HEARING DEVICE COMPRISING A FILTERBANK AND AN ONSET DETECTOR
20170347207 · 2017-11-30
Assignee
Inventors
Cpc classification
G10L19/025
PHYSICS
H04R2225/41
ELECTRICITY
H04R2430/03
ELECTRICITY
H04R25/43
ELECTRICITY
International classification
Abstract
A hearing device comprises A) a forward path, comprising a1) an input unit for providing a time-domain electric input signal as digital samples, a2) an analysis filter bank configured to provide a time-frequency representation of said electric input signal, a3) a signal processing unit for processing a signal of the forward path and providing a number of processed channel-signals, B) an onset detector configured to receive said time-domain electric input signal before entering said analysis filter bank, and to provide an onset control signal dependent on a current first order derivative of an envelope thereof, C) a level estimation unit for estimating a current level of said frequency sub-band signals, and comprising c1) a level adjustment unit configured to adjust the current levels of said frequency sub-band signals, and to control said level adjustment in dependence of said onset control signal. The invention may be used in audio devices, e.g. hearing aids.
Claims
1. A hearing device, e.g. a hearing aid, comprising A forward path, at least comprising the following operationally connected units An input unit for providing a time-domain electric input signal y(n) as digital samples at a first rate F.sub.s1, said electric input signal y(n) representing a sound signal in a full-band frequency range forming part of the human audible frequency range, n being a time-sample index, An analysis filter bank configured to provide a time-frequency representation Y(k,m) of said electric input signal y(n), where k=1, 2, . . . , K is a frequency sub-band index, K being the number of frequency sub-bands, and each frequency sub-band signal Y(k,m) representing a frequency sub-band FB.sub.k of the full-band frequency range, and m is a time frame index, A signal processing unit configured to execute one or more processing algorithms for processing a signal of the forward path in a number of processing channels, each processing channel comprising one or more of said frequency sub-bands, and providing a number of processed channel-signals, wherein the hearing device further comprises An onset detector configured to receive said time-domain electric input signal y(n) before entering said analysis filter bank, and to determine a current first order derivative of an envelope of said time-domain electric input signal y(n), or a signal derived therefrom, and to provide an onset control signal dependent thereon; A level estimation unit for estimating a current level of said frequency sub-band signals Y(k,m) or frequency sub-band signals derived therefrom, the level estimation unit comprising A level adjustment unit configured to receive said frequency sub-band signals from the analysis filter bank, or signals derived therefrom, and to adjust their current levels, and to control said level adjustment in dependence of said onset control signal.
2. A hearing device according to claim 1 wherein the onset detector is configured to provide the onset control signal at a second rate F.sub.s2.
3. A hearing device according to claim 1 wherein the onset detector comprises an envelope estimator unit comprising An ABS unit for providing a magnitude of the time-domain electric input signal y(n) or a signal derived therefrom at said first rate F.sub.s1, A buffer unit of a buffer size D for buffering D samples of the magnitude of the time-domain electric input signal, A MAX unit for determining a maximum magnitude value among the D samples of the magnitude of the time-domain electric input signal presently stored in said buffer unit, wherein a maximum value is provided at a second rate F.sub.s2 lower than said first rate F.sub.s1.
4. A hearing device according to claim 1 wherein said onset detector comprises a differentiator for determining said first order derivative of the envelope of said time-domain at electric input signal or a signal derived therefrom and to provide the onset control signal dependent thereon.
5. A hearing device according to claim 1 configured to modify said onset control signal according to a predefined criterion to be equal to a constant value, when the current value of said first order derivative is below an onset threshold value, and to be equal to the current value of said first order derivative, when it is above an onset threshold value.
6. A hearing device according to claim 1 wherein the level estimation unit comprises a pre-smoothing unit for reducing large variance in the said frequency sub-band signals, or signals derived therefrom, and to provide pre-smoothed levels of said frequency sub-band signals.
7. A hearing device according to claim 1 comprising a final smoothing unit for smoothing the adjusted levels from the adjustment unit.
8. A hearing device according to claim 7 wherein the final smoothing unit is configurable in that it provides dynamically determined attack and release time-constants, which are applied in the determination of final level estimates of said frequency sub-band signals, or signals derived therefrom.
9. A hearing device according to claim 6 wherein the level adjustment unit is configured to base the level adjustment on the level-change, which is given by the onset detector and the pre-smoothed level observed at the output of the pre-smoothing unit.
10. A hearing device according to claim 1 wherein the level adjustment unit is configured to maintain the adjusted level estimate at a certain level for a predefined time.
11. A hearing device according to claim 1 wherein the level adjustment unit comprises a counter and is configured to maintain the adjusted level estimate for a number of time frames smaller than a threshold number.
12. A hearing device according to claim 1 wherein the signal processing unit is configured to receive said current level of said frequency sub-band signals Y(k,m) or frequency sub-band signals derived therefrom from said level estimation unit and to control said one or more processing algorithms in dependence thereof.
13. A hearing device according to claim 6 configured to keep the level estimate after the pre-smoother at a fixed level for a first time period, when an onset detected by the onset detector exceeds a certain threshold, wherein the fixed level value is determined in dependence of the level-increase which is given by the onset detector and the actual level observed at the pre-smoother output.
14. A hearing device according to claim 13 wherein the first time period is dependent on a delay of the analysis filter bank.
15. A hearing device according to claim 13 configured to provide that the level estimate returns to the pre-smoother level when the first time period has lapsed or when the level at the pre-smoother output exceeds the adjusted level.
16. A hearing device according to claim 1 comprising a hearing instrument, a headset, an ear protection device or a combination thereof.
17. A method of operating a hearing device, e.g. a hearing aid, the method comprising providing a time-domain electric input signal y(n) representing a sound signal in a full-band frequency range forming part of the audible human frequency range, n being a time-sample index; converting said electric input signal y(n) to a time-frequency representation Y(k,m), where k=1, 2, . . . , K is a frequency sub-band index, K being the number of frequency sub-bands, and each frequency sub-band signal Y(k,m) representing a frequency sub-band FB.sub.k of the full-band frequency range, and m is a time frame index; executing one or more processing algorithms for processing a signal of the forward path in a number of processing channels, each comprising one or more of said frequency sub-bands, and providing a number of processed channel-signals; wherein the method further comprises determining a current first order derivative of said time-domain electric input signal y(n), or a signal derived therefrom before said conversion to a time-frequency representation Y(k,m), and providing an onset control signal; estimating a current level of said frequency sub-band signals Y(k,m) or frequency sub-band signals derived therefrom, adjusting the current levels of said frequency sub-band signals, or signals derived therefrom, and controlling said level adjustment in dependence of said onset control signal.
18. Use of a hearing device as claimed in claim 1.
19. A data processing system comprising a processor and program code means for causing the processor to perform the method of claim 17.
20. A computer program comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method of claim 17.
Description
BRIEF DESCRIPTION OF DRAWINGS
[0098] The aspects of the disclosure may be best understood from the following detailed description taken in conjunction with the accompanying figures. The figures are schematic and simplified for clarity, and they just show details to improve the understanding of the claims, while other details are left out. Throughout, the same reference numerals are used for identical or corresponding parts. The individual features of each aspect may each be combined with any or all features of the other aspects. These and other aspects, features and/or technical effect will be apparent from and elucidated with reference to the illustrations described hereinafter in which:
[0099]
[0100]
[0101]
[0102]
[0103]
[0104]
[0105]
[0106]
[0107]
[0108] The figures are schematic and simplified for clarity, and they just show details which are essential to the understanding of the disclosure, while other details are left out. Throughout, the same reference signs are used for identical or corresponding parts.
[0109] Further scope of applicability of the present disclosure will become apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the disclosure, are given by way of illustration only. Other embodiments may become apparent to those skilled in the art from the following detailed description.
DETAILED DESCRIPTION OF EMBODIMENTS
[0110] The detailed description set forth below in connection with the appended drawings is intended as a description of various configurations. The detailed description includes specific details for the purpose of providing a thorough understanding of various concepts. However, it will be apparent to those skilled in the art that these concepts may be practised without these specific details. Several aspects of the apparatus and methods are described by various blocks, functional units, modules, components, circuits, steps, processes, algorithms, etc. (collectively referred to as “elements”). Depending upon particular application, design constraints or other reasons, these elements may be implemented using electronic hardware, computer program, or any combination thereof.
[0111] The electronic hardware may include microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), gated logic, discrete hardware circuits, and other suitable hardware configured to perform the various functionality described throughout this disclosure. Computer program shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.
[0112] The present application relates to the field of hearing devices, e.g. hearing aids, and in particular to devices and methods for improving temporal performance of time-frequency signal processing.
[0113] Signal processing algorithms that operate in the time-frequency domain suffer from the fact that filtering into sub-bands as done with filter banks leads to temporal smearing of very-short-in-time input signals such as transients. Examples of such time-frequency processing is noise reduction, dynamic range compression and output power limiting in hearing aids. All these algorithms use level estimation in some form. Level estimation based on filter bank sub-bands suffers from time delay in the analysis stage, even when the fastest possible time constants are used in the level estimator. This means that input-dependent gain may not be on time and the processed signal may be corrupted with overshoot artefacts. The problem increases with higher frequency resolution and higher number of sub-bands,
[0114] A solution to this problem may be to adjust a level estimator, based on the input signal to the filter bank. The level estimator usually consists of a pre-smoother that reduces large variance at the input and a smoother that gives the correct time-constant behaviour of the final level estimate. This consists of two parts. 1. Onset Detection and 2. Level Adjustment.
[0115] 35
[0116] 1. Onset Detection
[0117] An onset-detector is used on the input. The onset detector does the following. If the first-order derivative of the input signal envelope exceeds a threshold, the level increase is passed on as the onset-detector output.
[0118]
[0119] Input Unit:
[0120] The onset detector comprises an input unit (denoted Input unit in
[0121] Envelope Estimator
[0122] The onset detector of
[0123] Slow Differentiator
[0124] The onset detector of
[0125] Time Constant Map and 1-st order IIR LP Smoothing
[0126] The onset detector of
[0127] Constant Map in FIG. IA) for determining appropriate time constants (e.g. attack and release time constants) of a smoothing filtering unit (1-st Order IIR LP Smoothing). The fast variations of the envelope (output of the Envelope Estimator unit) are then used to control a smoothing filter (1-st Order IIR LP Smoothing) in the envelope signal, such that the envelope is smoothed when it contains small variations and not smoothed when there are large variations, this means that small variations (noise variance) are removed from the envelope estimate and large variations (signal onsets and offsets) are maintained. The output of the 1-st Order IIR LP Smoothing unit is denoted (4) in
[0128] Differentiator
[0129] The onset detector of
[0130] Differentiator unit is denoted (5) in
[0131] Clipping
[0132] The onset detector of
[0133] An Example of an Onset Detector Implementation
[0134]
[0135] The Envelope Estimator unit of FIG. IA is e.g. embodied in units ABS, Buffer, MAX, and LOG. The purpose of these blocks is to take the envelope of the electric input signal (Input signal (1) in
[0136] The Slow Differentiator unit in
[0137] The Time Constant Map unit in
[0138] The 1-st Order IIR LP Smoothing unit in
[0139] The Differentiator unit is in FIG. IA is e.g. embodied in
[0140] The Input unit, the Clipping unit, and the Output unit in
[0141]
[0142] A hearing device, e.g. a hearing aid, may e.g. comprise a forward path comprising an input unit (cf. Input unit in
[0143] Level Adjustment
[0144] A Level Estimator (cf. dashed block in
[0145] When an onset is detected (i.e. the value from the onset detector ((cf. Onset Detector unit in
[0146] The following parameters can be used to control the behavior of this mechanism: [0147] Onset threshold; this parameter controls which level-increase to be regarded as onsets; [0148] Frame counter; this parameter controls for how many frames an adjustment should be hold (should at least correspond to the filter bank delay).
[0149] More parameters can be added to the system, in order to fine-tune the behavior.
[0150] In an embodiment, a single onset detector can be reused to supply the adjustment for multiple level estimators, possibly having different criteria for using the output of the onset detector (e.g. different thresholds for the clipping unit Clipping in
[0151]
[0152] The 6 graphs of
[0153]
[0154] The two graphs of
[0155] The top graph shows in solid line the adjusted level estimate provided by the scheme of the present disclosure, whereas the dotted graph illustrates a non-adjusted level estimate. It appears that the adjusted level provides a level adjustment of the onset of the signal (as even more clearly observed in the focused view of
[0156] The bottom graph shows the non adjusted and adjusted output signals. The dotted graph illustrates an output signal that is not subject to processing. The dashed graph illustrates an output signal that is subject to processing but not to level adjustment. The solid graph illustrates an output signal that has been subject to processing and level adjustment according to the present disclosure. It is clear that the onset detection and level adjustment according to the present disclosure removes the spike like overshoot of the non-adjusted signal (dashed graph). In other words, the algorithm or device according to the present disclosure is able to control the gain such that overshoot at the output can be avoided.
[0157] Examples of algorithms that can exploit level-adjustment are dynamic range compression, maximum power output limiters, fast noise reduction and transient noise reduction and other algorithms that process signals in the time-frequency domain.
[0158]
[0159] The 6 graphs of
[0160] The two graphs of
[0161]
[0162]
[0163]
[0164] The hearing aid (HD) exemplified in
[0165] The hearing aid (HD) may e.g. comprise a directional microphone system (beam former filtering unit (BFU)) adapted to enhance a target acoustic source among a multitude of acoustic sources in the local environment of the user wearing the hearing aid device. In an embodiment, the directional system is adapted to detect (such as adaptively detect) from which direction a particular part of the microphone signal (e.g. a target part and/or a noise part) originates. In an embodiment, the beam former filtering unit is adapted to receive inputs from a user interface (e.g. a remote control or a smartphone) regarding the present target direction. The memory unit (MEM) may e.g. comprise predefined (or adaptively determined) complex, frequency dependent constants (W.sub.ij) defining predefined or (or adaptively determined) ‘fixed’ beam patterns (e.g. omni-directional, target cancelling, etc.), together defining the beamformed signal Y.sub.BF.
[0166] The hearing aid of
[0167] The hearing aid (HD) according to the present disclosure may comprise a user interface UI, e.g. as shown in
[0168] The currently set values (here 0.8 and 0.2, respectively) are shown on the screen at the location of the slider on the (grey shaded) bar that span the configurable range of values. The arrows at the bottom of the screen allow changes to a preceding and a proceeding screen of the APP, and a tab on the circular dot between the two arrows brings up a menu that allows the selection of other APPs or features of the device.
[0169] The auxiliary device and the hearing aid are adapted to allow communication of data representative of the currently selected direction (if deviating from a predetermined direction (already stored in the hearing aid)) to the hearing aid via a, e.g. wireless, communication link (cf. dashed arrow WL2 in
[0170]
[0171] The method comprises
[0172] S1. providing a time-domain electric input signal y(n) representing a sound signal in a full-band frequency range forming part of the audible human frequency range, n being a time-sample index;
[0173] S2. converting said electric input signal y(n) to a time-frequency representation Y(k,m), where k=1, 2, . . . , K is a frequency sub-band index, K being the number of frequency sub-bands, and each frequency sub-band signal Y(k,m) representing a frequency sub-band FB.sub.k of the full-band frequency range, and m is a time frame index;
[0174] S3. executing one or more processing algorithms for processing a signal of the forward path in a number of processing channels, each comprising one or more of said frequency sub-bands, and providing a number of processed channel-signals;
[0175] S4. converting said processed channel-signals to a time-domain electric signal representing a sound signal,
[0176] S5. determining a current first order derivative of said time-domain electric input signal y(n), or a signal derived therefrom before said conversion to a time-frequency representation Y(k,m), and providing an onset control signal;
[0177] S6. estimating a current level of said frequency sub-band signals Y(k,m) or frequency sub-band signals derived therefrom,
[0178] S7. adjusting the current levels of said frequency sub-band signals, or signals derived therefrom, and
[0179] S8. controlling said level adjustment in dependence of said onset control signal.
[0180] It is intended that the structural features of the devices described above, either in the detailed description and/or in the claims, may be combined with steps of the method, when appropriately substituted by a corresponding process.
[0181] As used, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well (i.e. to have the meaning “at least one”), unless expressly stated otherwise. It will be further understood that the terms “includes,” “comprises,” “including,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will also be understood that when an element is referred to as being “connected” or “coupled” to another element, it can be directly connected or coupled to the other element but an intervening elements may also be present, unless expressly stated otherwise. Furthermore, “connected” or “coupled” as used herein may include wirelessly connected or coupled. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. The steps of any disclosed method is not limited to the exact order stated herein, unless expressly stated otherwise.
[0182] It should be appreciated that reference throughout this specification to “one embodiment” or “an embodiment” or “an aspect” or features included as “may” means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. Furthermore, the particular features, structures or characteristics may be combined as suitable in one or more embodiments of the disclosure. The previous description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects.
[0183] The claims are not intended to be limited to the aspects shown herein, but is to be accorded the full scope consistent with the language of the claims, wherein reference to an element in the singular is not intended to mean “one and only one” unless specifically so stated, but rather “one or more.” Unless specifically stated otherwise, the term “some” refers to one or more.
[0184] Accordingly, the scope should be judged in terms of the claims that follow.
REFERENCES
[0185] U.S. Pat. No. 8,929,574B2 (Widex) Mar. 11, 2011