Method of adaptive mixing of uncorrelated or correlated noisy signals, and a hearing device

Abstract

A hearing device, e.g. a hearing aid, adapted for being located at or in an ear, or to be fully or partially implanted in the head, of a user, the hearing device comprises a) an input unit providing at least two input audio data streams, each comprising a mixture of a target signal component from a target sound source and a noise component from one or more noise sources; b) a mixing processor for receiving said at least two input audio data streams, and for mixing said at least two input audio data streams, or processed versions thereof, and for providing a processed input signal based thereon; c) an output unit providing output stimuli perceivable to the user as sound based on said processed input signal or a processed version thereof. The processor is configured to process said noise component of said at least two input audio data streams, or processed versions thereof in order to reduce or avoid artefacts in said processed input signal due to said mixing. A method of operating a hearing device is further disclosed. The invention may e.g. be used in hearing aids, e.g. hearing aids configured to communicate with another device, e.g. binaural hearing aid systems.

Claims

1. A hearing device adapted for being located at or in an ear, or to be fully or partially implanted in the head, of a user, the hearing device comprising an input unit providing at least two input audio data streams, each comprising a mixture of a target signal component from a target sound source and a noise component from one or more noise sources; a processor for receiving said at least two input audio data streams, and for mixing said at least two input audio data streams, or processed versions thereof, and for providing a processed input signal based thereon; an output unit providing output stimuli perceivable to the user as sound based on said processed input signal or a processed version thereof; wherein, the processor is configured to process said noise component of said at least two input audio data streams, or processed versions thereof, in order to reduce or avoid artefacts in said processed input signal due to said mixing by balancing said noise components of the at least two input audio data streams in the processed input signal, and fade from a first input audio data stream to a second input audio stream, wherein said fading from a first input audio data stream to a second input audio data stream over a certain fading time period comprises determining respective fading parameters or a fading curve that gradually decreases a weight of said first input audio data stream, or a processed version thereof, while increasing a weight of said second input audio data stream, or a processed version thereof, and wherein the perceived noise level of the processed input signal is substantially unaltered during said fading.

2. A hearing device according to claim 1 wherein the processor is configured to estimate a noise variance of the at least two input audio data streams prior to mixing.

3. A hearing device according to claim 2 wherein the processor is configured to process said noise components in dependence of said noise variances of the at least two input audio data streams.

4. A hearing device according to claim 1 wherein the at least two input audio data streams originate from two different target sound sources.

5. A hearing device according to claim 1 wherein the at least two input audio data streams originate from the same target sound source.

6. A hearing device according to claim 1 wherein the processor is configured to estimate a level of said target components of said at least two input audio data streams.

7. A hearing device according claim 6 configured to fade between said at least two input audio data streams, or processed versions thereof, while ensuring that the level of the target signal components in the processed input signal is equalized.

8. A hearing device according to claim 1 wherein said fading from a first input audio data stream to a second input audio data stream over a certain fading 5 time period comprises that the mixing processor is configured to provide the first data stream as the processed signal at a first point in time t1 and to provide the second data stream as the processed signal at a second point in time t2, where the second time t2 is larger than the first time t1.

9. A hearing device according to claim 8 configured to provide that a fading time, Δtfad, is increased.

10. A hearing device according to claim 1, wherein said processor is configured to initiate fading based on a detected feedback of one of said input audio data streams.

11. A hearing device according to claim 1 comprising a voice activity detector configured to provide a VAD-control signal indicative of whether or not or with what probability a given input audio stream comprises a human voice.

12. A hearing device according to claim 1 wherein the input unit comprises at least two input transducers, each providing an electric input signal representing sound, and a beamformer filtering unit for spatially filtering said electric input signals and for providing at least one spatially filtered signal based thereon, the spatially filtered signal constituting or forming part of at least one of said at least two input audio data streams.

13. A hearing device according to claim 12 wherein the beamformer filtering unit comprises at least two beamformers, configured to provide at least two spatially filtered signals, which may constitute or form part of the multitude of input audio data streams.

14. A hearing device according to claim 13 wherein fading between respective input audio streams from said at least two beamformers is controlled in dependence on a detected or selected target direction.

15. A hearing device according claim 1 configured to fade between said at least two input audio data streams, or processed versions thereof, while ensuring that the noise components in the processed input signal are equalized to the level of the noise signal components in the input audio data stream exhibiting the largest noise level.

16. A hearing device according claim 1 configured to fade between said at least two input audio data streams, or processed versions thereof, the hearing device comprising a single channel post filter for attenuating noise in the processed input signal, wherein the postfilter is configured to increase attenuation of noise components of the processed input signal.

17. A hearing device according to claim 1 being constituted by or comprising a hearing aid, a headset, an earphone, an ear protection device or a combination thereof.

18. A method of operating a hearing device adapted for being located at or in an ear, or to be fully or partially implanted in the head, of a user, the method comprising providing at least two input audio data streams, each comprising a mixture of a target signal component from a target sound source and a noise component from one or more noise sources; receiving said at least two input audio data streams, and mixing said at least two input audio data streams, or processed versions thereof, and providing a processed input signal based thereon; providing output stimuli perceivable to the user as sound based on said processed input signal or a processed version thereof; processing said noise components of said at least two input audio data streams, or processed versions thereof in order to reduce or avoid artefacts due to said mixing in said processed input signal, by balancing said noise components of the at least two input audio data streams in the processed input signal; and fading from one input audio data stream to another input audio data stream, wherein said fading from a first input audio data stream to a second input audio data stream over a certain fading time period comprises determining respective fading parameters or a fading curve that gradually decreases a weight of said first input audio data stream, or a processed version thereof, while increasing a weight of said second input audio data stream, or a processed version thereof, and wherein the perceived noise level of the processed input signal is substantially unaltered during said fading.

Description

BRIEF DESCRIPTION OF DRAWINGS

(1) The aspects of the disclosure may be best understood from the following detailed description taken in conjunction with the accompanying figures. The figures are schematic and simplified for clarity, and they just show details to improve the understanding of the claims, while other details are left out. Throughout, the same reference numerals are used for identical or corresponding parts. The individual features of each aspect may each be combined with any or all features of the other aspects. These and other aspects, features and/or technical effect will be apparent from and elucidated with reference to the illustrations described hereinafter in which:

(2) FIGS. 1A and 1B shows a scenario for receiving acoustically and/or wirelessly propagated audio data streams (or a mixture thereof) in a hearing device, FIG. 1A illustrating a side view of a user wearing a hearing device comprising respective BTE and ITE-parts at the right ear, and

(3) FIG. 1B illustrating a front view of a user wearing a hearing device at a left as well as a right ear,

(4) FIG. 2A shows a block diagram of a first embodiment of a hearing device according to the present disclosure,

(5) FIG. 2B illustrates a processor for mixing primary and secondary source signals x.sub.1(n) and x.sub.2(n), modified by time varying gains α.sub.1 and α.sub.2, to a processed input signal y(n),

(6) FIG. 2C shows a block diagram of a second embodiment of a hearing device according to the present disclosure,

(7) FIG. 2D shows a block diagram of a third embodiment of a hearing device according to the present disclosure, and

(8) FIG. 2E shows a block diagram of a fourth embodiment of a hearing device according to the present disclosure,

(9) FIG. 3 illustrates an input stage of a hearing device comprising an input unit and an adaptive mixing unit according to the present disclosure providing fading between two microphone signals having different noise variances with a fading factor α, such that, an output y(n) with an unaltered noise (and target) level (before and after fading) is provided,

(10) FIG. 4 shows an input stage as the one illustrated FIG. 3, but where similar noise variance at each microphone is assumed,

(11) FIG. 5A shows a hearing device of the receiver in the ear type according to an embodiment of the present disclosure, and

(12) FIG. 5B shows a hearing device of the completely in the ear type according to an embodiment of the present disclosure,

(13) FIG. 6A shows an embodiment of a hearing system, e.g. a binaural hearing aid system, according to the present disclosure; and

(14) FIG. 6B illustrates an auxiliary device configured to execute an APP implementing a user interface of the hearing device or system from which a mode of operation and a currently appropriate sound input can be selected,

(15) FIG. 7 schematically illustrates a speakerphone comprising a multitude of microphones and number of beamformers configured to focus on a number of different target speakers in the environment around the speakerphone and to allow an adaptive fading between spatially filtered signals as described in the present disclosure,

(16) FIG. 8 shows an estimator for estimating a noise variance of the at least two input audio data streams prior to mixing of the audio streams, and

(17) FIG. 9 schematically illustrates an exemplary fading procedure between two input audio data streams having different target and noise levels.

(18) The figures are schematic and simplified for clarity, and they just show details which are essential to the understanding of the disclosure, while other details are left out. Throughout, the same reference signs are used for identical or corresponding parts.

(19) Further scope of applicability of the present disclosure will become apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the disclosure, are given by way of illustration only. Other embodiments may become apparent to those skilled in the art from the following detailed description.

DETAILED DESCRIPTION OF EMBODIMENTS

(20) The detailed description set forth below in connection with the appended drawings is intended as a description of various configurations. The detailed description includes specific details for the purpose of providing a thorough understanding of various concepts. However, it will be apparent to those skilled in the art that these concepts may be practiced without these specific details. Several aspects of the apparatus and methods are described by various blocks, functional units, modules, components, circuits, steps, processes, algorithms, etc. (collectively referred to as “elements” or “units”). Depending upon particular application, design constraints or other reasons, these elements (or units) may be implemented using electronic hardware, computer program, or any combination thereof.

(21) The electronic hardware may include microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), gated logic, discrete hardware circuits, and other suitable hardware configured to perform the various functionality described throughout this disclosure. Computer program shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

(22) The present application relates to the field of hearing devices, e.g. hearing aids.

(23) FIGS. 1A and 1B show a scenario for receiving acoustically and/or wirelessly propagated audio data streams (or a mixture thereof) in a hearing device, FIG. 1A illustrating a side view of a user wearing a hearing device comprising respective BTE and ITE-parts at the right ear, and FIG. 1B illustrating a front view of a user wearing a hearing device at a left as well as a right ear.

(24) In the case where a hearing aid user wants to listen to a mixture of audio data streams, the hearing aid should facilitate the natural perception of sound without any inflicted artefacts due to time-varying source balancing and/or fading. In the following we consider the mixing of two noisy speech sound streams.

(25) FIG. 1A shows a hearing device (HD) located at an ear (her a right ear) of a user (U). The hearing device comprises a BTE part adapted for being located at or behind an ear(pinna) of the user and an ITE part (ITE) adapted for being located at or in an ear canal of the user. The BTE-part comprises an input unit. The input unit comprises two microphones (BTE1, BTE2) for picking up sound from the environment of the user and two wireless audio receivers (here a telecoil (Telecoil) (or other receiver based on near-field communication) and an RF-receiver (Wireless) (e.g. based on Bluetooth or similar technology) for wirelessly receiving audio from respective audio transmitters. The hearing device of FIG. 1A may be a stand-alone hearing device or (as here) form part of a binaural hearing system, e.g. a binaural hearing aid system (as illustrated in FIG. 1B). FIG. 1B illustrates a binaural hearing system comprising first and second hearing devices (HD1, HD2) (e.g. hearing aids) adapted for being located at or in right and left ears of the user. FIG. 1B shows that the ITE-part of each hearing device (HD1, HD2) comprises a microphone (ITE) located at an environment-facing end of the ITE-part and a loudspeaker (Receiver) located at an eardrum-facing end of the ITE-part. The loudspeaker is thus configured to play into the residual volume between the ITE-part and the eardrum (Eardrum). The first and second hearing devices (HD1, HD2) are thus of the receiver in the ear type (RITE) comprising three microphones, including a microphone located at the ear canal opening (termed ITE-microphone), and two microphones at or behind pinna (termed BT-microphones), when the hearing device is operationally located on the user. Such hearing aid style may have the advantage of being able to utilize the advantage of the pinna (ITE-microphone, maintaining spatial cues) while also—when necessary in case of risk of howl at the ITE-microphone—providing sound to the user based on the BTE-microphone(s). The hearing device may e.g. comprise one or more microphones located elsewhere on the head or body of the user, e.g. in pinna, e.g. in concha, or in the ear canal, e.g. in the vicinity of the ear drum (e.g. to pick up sound from the residual volume near the ear drum).

(26) It is assumed that audio signals are provided as sub-band signals (time-frequency domain), e.g. time domain signals which have been transformed to the time-frequency domain using an analysis filter bank and transformed back to the time domain using a synthesis filter bank before being presented to the user (see e.g. units A and S, respectively, in FIG. 2C). The Input unit may e.g. comprise at least two audio inputs. The audio inputs may e.g. comprise two microphones and/or two direct (wireless or wired) audio receivers or a mixture of microphone(s) and direct audio receiver(s). The input unit (IU, see e.g. FIG. 2A, 2C, 2D, 2E) may further comprise a number of analogue-to-digital converters (e.g. one for each analogue audio input) for converting an analogue audio input to a sampled (digital) electric input signal. The input unit may further comprise a number of analysis filter banks (A in FIG. 2C) for providing an electric input signal in a time-frequency representation as a multitude of sub-band signals, each representing a sub-range of the frequency range representing audio frequencies in the audio signal in question (e.g. up to 20 kHz or less, e.g. between 0 and 10 kHz). The output unit (OU, see e.g. FIG. 2A, 2C, 2D, 2E) may e.g. comprise a synthesis filter bank (S, in FIG. 2C) for converting frequency sub-band signals to a time domain signal for presentation to a user via an output transducer of the output unit (e.g. a loudspeaker or a vibrator of a bone conduction hearing device). The output unit may further comprise a digital-to-analogue converter (or other driving circuitry), as appropriate. The output unit may further comprise antenna and transmitter circuitry for transmitting an audio output signal to another component or device (e.g. another hearing device, if appropriate for the application in question).

(27) In the present context, a noisy speech mixture signal y(n)=y.sub.s(n)+y.sub.v(n) is a mixture of noisy speech signals x.sub.1(n)=s.sub.1(n)+v.sub.1(n), and x.sub.2(n)=s.sub.2(n)+v.sub.2(n), where s(n) and v(n) denote the speech and noise components, respectively, and n represents time. The speech and noise components are assumed to be uncorrelated.

(28) The variance of the noise component y(n)=v.sub.1(n)+v.sub.2(n) is given by
σ.sub.y.sub.v.sup.2=σ.sub.v.sub.1.sup.2+σ.sub.v.sub.2.sup.2+2 Re{Cov(v.sub.1,v.sub.2)}.

(29) Where Re {X} denotes the real part of complex number X, and Cov(v.sub.1,v.sub.2) denotes the covariance between v.sub.1 and v.sub.2. The expression is valid for correlated as well as uncorrelated noise. The last part (2 Re{Cov(v.sub.1, v.sub.2)}) is zero, if the noise components (v.sub.1, v.sub.2) are un-correlated. In a hearing aid application, the signals are typically modified prior to mixing, e.g. for signal balancing/fading, noise reduction, etc. The mixture is given by:
y(n)=α.sub.1x.sub.1(n)+α.sub.2x.sub.2(n),
where α.sub.1 and α.sub.2 are gain factors. These gain factors may be time-varying.

(30) The noise variance of the mixture, including gains, is given by
σ.sub.y.sub.v.sup.2=α.sub.1.sup.2σ.sub.v.sub.1.sup.2+α.sub.2.sup.2σ.sub.v.sub.2.sup.2+2α.sub.1α.sub.2 Re{Cov(v.sub.1,v.sub.2)}.

(31) Since the noise and speech components are (assumed) uncorrelated, similar relationships can be found for the speech components. In a practical application, noise and speech variance are typically frequency dependent and time-varying estimators, found using level estimators which are controlled by Voice Activity Detectors (VAD). In particular, it can be detected whether or not noise between the microphones is un-correlated (e.g. based on the elements of the inter-microphone covariance matrix).

(32) The mixing or fading of source signals can cause annoying audible artefacts when the noise background of the signals is not equal. To overcome this problem, the noise component in the secondary source can be modified in order to avoid the artefacts.

(33) FIG. 2A shows a block diagram of a hearing device, e.g. a hearing aid, according to a first embodiment of the present disclosure. The hearing device is e.g. adapted for being located at or in an ear, or to be fully or partially implanted in the head, of a user. The hearing device comprises an input unit (IU) providing at least two input audio data streams (x.sub.1, x.sub.2), e.g. in a frequency sub-band representation. Each input audio data stream comprises a mixture of a target signal component and a noise component. The hearing device further comprises a mixing processor (PRO) for receiving the at least two of input audio data streams (x.sub.1, x.sub.2) from the input unit (IU), or processed versions thereof, and for mixing the at least two input audio data streams, or processed versions thereof, and for providing a processed input signal y based thereon. The hearing device further comprises an output unit (OU) configured to provide output stimuli perceivable to the user as sound based on the processed input signal or a (further) processed version thereof. The mixing processor (PRO is thus coupled to the input and output units (IU, OU). Thereby a forward (audio signal processing) path of the hearing device is implemented.

(34) FIG. 2B illustrates a processor (PRO) for mixing primary and secondary source signals (first and second input audio streams) x.sub.1(n) and x.sub.2(n), modified by time varying gains α.sub.1 and a, to a processed input signal y(n). The mixing may e.g. comprise fading from the primary signal (first input audio stream) to the secondary signal (second input audio stream). The functional unit handling the mixing is in the present application termed the adaptive mixing unit (ADM). In FIG. 2B the processor (PRO) consists of one function unit, the adaptive mixing unit (ADM). This need not generally be the case, though (as also indicated in FIG. 2D, 2E).

(35) In the embodiment of FIG. 2B, prior to mixing, the secondary source may be modified by a compensation gain β. The aim of this is to provide noise source balancing (by equalize the noise level) during (and after) mixing (e.g. fading).

(36) A compensation gain β(n) is applied to the secondary source x.sub.2(n), see FIG. 2B.
y(n)=α.sub.1x.sub.1(n)+βα.sub.2x.sub.2(n),
which means that the noise variance of the mixture, including gains, is given by
σ.sub.y.sub.v.sup.2=α.sub.1.sup.2σ.sub.v.sub.1.sup.2+α.sub.2.sup.2σ.sub.v.sub.2.sup.2+2α.sub.1α.sub.2β Re{Cov(v.sub.1,v.sub.2)}

(37) We now normalize with the primary input noise variance σ.sub.v.sub.1.sup.2.

(38) $\frac{{\sigma }_{y_v}^2}{{\sigma }_{v_1}^2}={\alpha }_1^2+{\alpha }_2^2{\beta }^2\frac{{\sigma }_{v_2}^2}{{\sigma }_{v_1}^2}+2{\alpha }_1{\alpha }_2\beta \frac{\mathrm{Re}\left\{\mathrm{Cov}\left(v_1,v_2\right)\right\}}{{\sigma }_{v_1}^2}$

(39) The modification gain β can now be found by choosing a desired output variance. For example: The desired output noise variance is chosen to be equal to the primary input noise variance, i.e. σ.sub.y.sub.v,target.sup.2=σ.sub.v.sub.1.sup.2. Substituting this into the previous equation, we get

(40) ${\alpha }_2^2{\beta }^2\frac{{\sigma }_{v_2}^2}{{\sigma }_{v_1}^2}+2{\alpha }_1{\alpha }_2\beta \frac{\mathrm{Re}\left\{\mathrm{Cov}\left(v_1,v_2\right)\right\}}{{\sigma }_{v_1}^2}-1+{\alpha }_1^2=0$

(41) This gives two solutions, of which one is negative. A negative β would imply mixing by subtraction, which we do not allow. So we only consider the solution where β is positive, i.e.

(42) $\beta =\frac{-B+\sqrt{B^2-4AC}}{2A},$

(43) Where

(44) $A=\frac{{\alpha }_1^2{\sigma }_{v_2}^2}{{\sigma }_{v_1}^2},B=\frac{2{\alpha }_1{\alpha }_2\mathrm{Re}\left\{\mathrm{Cov}\left({\nu }_1,{\nu }_2\right)\right\}}{{\sigma }_{v_1}^2},\mathrm{and}C={\alpha }_1^2-1$

(45) The modification gain β may be applied on time-frequency units of the secondary input which have been classified as noise-only, for example by using a Voice Activity Detector (VAD) (noise-only time-frequency units being units for which the VAD has indicated an absence of voice (e.g. speech)). The modification gain f may be found iteratively (e.g. a gradient-based minimization of the second degree polynomial). Hereby the square root can be avoided.

(46) The same principle can be applied on the speech component for target source balancing. However, it might not be desired to modify the spectral shape of the secondary input speech component to match the primary input speech component. In this case, constraints across frequency can be applied. An exemplary constraint may be to maintain a user's loudness perception during fading. The constraint may be used to determine f for given input audio streams.

(47) In a practical hearing aid application, it is desired to avoid operations such as square, square root, and division (due to their computational complexity (power constraints)). Most of the operations can be performed in the logarithmic domain, such that multiplication and divisions can be implemented using addition and subtraction operations respectively. Any other operations can be efficiently approximated by mapping functions or look-up tables.

(48) FIG. 2C shows a block diagram of a hearing device according to a second embodiment of the present disclosure. The hearing device of FIG. 2C illustrates a combination of FIGS. 2A and 2B, but wherein the input unit (IU), the adaptive mixing unit (ADM), and the output unit (OU) are described in further detail. The input unit (IU) comprises first and second input transducers (IT1, IT2) each providing a (preferably digitized) input audio stream as a (full-band) time-domain signal. The input unit (IU) further comprises respective analysis filter banks (A) for converting the two input audio streams to respective first and second frequency sub-band signals, thereby providing the first and second input audio streams (x.sub.1, x.sub.2) in a time-frequency representation. The adaptive mixing unit (ADM) receives the first and second input audio streams (x.sub.1, x.sub.2) and applies time varying gains (weights) α.sub.1, α.sub.2, β to the first (α.sub.1) and second (α.sub.2, β) input audio streams (x.sub.1, x.sub.2) to provide modified first and second input audio streams (x.sub.1α.sub.1 and x.sub.2α.sub.2β, respectively) and adds the modified audio streams to provide a processed input signal y (y=x.sub.1α.sub.1+x.sub.2α.sub.2β), as illustrated in FIG. 2B and described above. The adaptive mixing unit (ADM) further comprises a weighting unit (WGT) and a noise variance estimation unit (NVE). The weighting unit (WGT) is configured to determine the first and second time dependent weights (α.sub.1, α.sub.2) for being applied to the first and second input audio streams (x.sub.1, x.sub.2), respectively. The weights (α.sub.1, α.sub.2) may e.g. be determined from a (time-dependent) mixing function (e.g. a fading function, cf. e.g. FIG. 3, 4, e.g. stored in a memory of the hearing device) in dependence of a trigger input signal MT (e.g. from a user interface or determined based on outputs of one or more detectors (e.g. voice activity detectors)), e.g. based on properties of the first and second input audio streams (e.g. modulation, or noise, e.g. SNR). The trigger input signal (MT) may e.g. indicate an initiation of a fading procedure from one audio input stream (e.g. provided by a microphone or beamformer or direct audio input) to another, cf. e.g. FIG. 6B. The noise variance estimation unit (NVE) is configured to determine the compensation gain (β) for being applied to the second input audio stream (x.sub.2). The compensation gain (β) may be determined in dependence of properties of the first and second input audio streams (e.g. modulation, or noise, e.g. SNR) and current values of the time dependent weights (α.sub.1, α.sub.2), e.g. as described above, and optionally of the mixing trigger input signal (MT).

(49) FIG. 2D shows a block diagram of a hearing device according to a third embodiment of the present disclosure. The hearing device of FIG. 2D may comprise the units described in connection with FIGS. 2A, 2B and 2C. Additionally, the processor (PRO) comprises a hearing aid processor (HAG) for applying further processing algorithms to the signal y′ provided by the adaptive mixing unit (ADM). The hearing aid processor (HAG) may e.g. be adapted to compensate for a hearing impairment of a user, e.g. by applying a compressive amplification algorithm to a signal of the forward path, e.g. the processed input signal y′ (mixed or faded signal), or to a signal derived therefrom. The customized compressive amplification algorithm may be configured to apply a frequency and level dependent gain according to a user's particular needs. Other processing algorithms may additionally or alternatively be applied to the signal y′, e.g. a noise reduction signal (e.g. a post-filter). The hearing aid processor (HAG) thereby provides processed signal y, which is fed to the output unit (OU). In the embodiment of FIG. 2D, the processor (PRO) comprises the adaptive mixing unit (ADM) and the hearing aid processor (HAG). Further functional units may be included in the processor (PRO), e.g. feedback control, etc.

(50) FIG. 2E shows a block diagram of a fourth embodiment of a hearing device according to the present disclosure. The hearing device, e.g. a hearing aid, of FIG. 2E comprises the functional units described in connection with FIG. 2D. Additionally, the input unit comprises a beamformer filtering unit (BF). The beamformer filtering unit (BF) comprises two beamformers configured to provide respective (different) beamformed signals (x.sub.BF1, x.sub.BF2) based on the first and second input signals (x.sub.1, x.sub.2) from first and second input transducers (IT1, IT2), e.g. microphones, of the input unit (IU). The first and second beamformed signals (x.sub.BF1, x.sub.BF2) are e.g. provided as (different) linear combinations of the first and second input signals (x.sub.1, x.sub.2), e.g. x.sub.BF1=C.sub.11x.sub.1+C.sub.12x.sub.2, and x.sub.BF2=C.sub.21x.sub.1+C.sub.22x.sub.2, where the filter weights C.sub.11, C.sub.12 of the first beamformer and C.sub.21, C.sub.22 of the second beamformer are (generally) complex (fixed or adaptively determined, typically frequency dependent) parameters. The embodiment of FIG. 2E may e.g. be relevant for fading between two beamformed signals (from two different spatial locations), e.g. controlled by voice activity detection in the two signals (‘select the signal comprising voice’). Such scenario may e.g. comprise fixed beamformers, e.g. aimed at a car-situation with possible sound sources in fixed positions e.g. to the side or the back or the front of the user wearing the hearing device. Alternatively, the scenario may be aimed at a multi talker situation where directions to dominant speakers are adaptively determined and can be faded between, e.g. based on voice activity in the beamformed signal. The embodiment of FIG. 2E is shown to comprise two input transducers (IT1, IT2), but may comprise more than two, e.g. three or four or more. Adaptive mixing may e.g. be performed on two beamformed signals created from more than two electric input signals or based on different (or partially overlapping) electric input signals. In a three-input transducer example, one input transducer may e.g. be defined as a reference, whose electric input signal is used as input to both beamformers, and the two other electric input signals are used in each their respective beamformer.

(51) As an alternative, we may add uncorrelated noise to the mixture of uncorrelated noises such that the fading from one signal to another signal becomes inaudible. By adding uncorrelated noise, the same behavior of uncorrelated noise sources can be mimicked at both microphones. The cost of having a more similar behavior at both microphones is that more noise will be added to the least noisy microphone.

(52) The noise characteristics of the beamformed signals x.sub.BF1 and x.sub.BF2 referred to above may be equalized by generating respective signals
Y.sub.1=(1−α.sub.1)x.sub.ref+α.sub.1x.sub.BF1
Y.sub.2=(1−α.sub.2)x.sub.ref+α.sub.2x.sub.BF2
where x.sub.ref is the input data stream from a common reference microphone among the multitude of microphones. By adding a scaled reference microphone signal to each of the beamformed signals (where the beamformers point toward different target directions), similar noise characteristics at the two signals Y1 and Y2 may be obtained, hereby making a fading between the two signals less audible.

(53) When fading between the two ‘improved beamformed signals’ Y.sub.1, Y.sub.2, the processed input signal may be expressed as
Y=λY.sub.1+(1−λ)Y.sub.2
where X is a fading parameter for fading between the two “improved beamformed signals” Y.sub.1, Y.sub.2, and where α.sub.1, and α.sub.2 are determined such that the noise level in Y.sub.1 and Y.sub.2 are comparable. More than two beamformed signals, e.g. Y.sub.1, . . . , Y.sub.N, may be used. In that case α.sub.1, . . . α.sub.N are selected such that the background noise level in each beamformed signal approximately is the same. The different α-values may be adaptively determined over time and frequency.

(54) The proposed solution is shown in FIG. 3 illustrating fading between two microphone signals of a hearing device with a fading factor α, such that an output y(n) with an unaltered noise (and target) level is provided while fading from one microphone signal to the other. A possible fading function α(t) (when fading from microphone signal x.sub.1 from microphone M.sub.1 to microphone signal x.sub.2 from microphone M.sub.2) is shown in the middle part of FIG. 3 (in rectangular enclosure). The fading function is shown as a piecewise linear function changing (over time) from a maximum value (e.g. 1) to a minimum value (e.g. 0) over a time period Δt. Other monotonous courses of the function may be envisioned, such as a sigmoid (or sigmoid-like) function, or a linear fading in the logarithmic domain, etc. The time period Δt over which the transition occurs may vary depending on the specific application or listening situation. The time period Δt may e.g. be in the range between 0.5 and 5 s.

(55) We assume a system with at least two input signals. It could e.g. be two microphones signals (as shown in FIG. 3), two telecoil (or other wirelessly received) signals, a microphone signal and a telecoil (or other wirelessly received) signal, e.g. a streamed audio signal for a TV or the like, or other signals. Each signal consists of two parts: The desired target signal (s.sub.1, s.sub.2), which is assumed to be correlated (preferably identical), and some additive, uncorrelated noise (v.sub.1, v.sub.2). With reference to FIG. 3, each input x.sub.1 (i=1, 2) consists of a target component s.sub.1(n) and a noise component, v.sub.1(n), n being a time index. We assume that the target is similar at the two inputs, while the noise component is additive, and uncorrelated, with noise variances VAR[v.sub.1]=σ.sub.v.sub.1.sup.2 and VAR[v.sub.2]=σ.sub.v.sub.1.sup.2, respectively. This is graphically indicated by the two time segments schematically illustrating the two (time variant) microphone signals x.sub.1 and x.sub.2, respectively. The two time segments are inserted in FIG. 3 between the microphones (M.sub.1, M.sub.2) and the respective combination units (X). The noise variance at each microphone may be different, e.g. due to adjustments in order to make the target signal (level) at each microphone similar. The noise at each microphone may e.g. comprise (such as be dominated by) uncorrelated noise, e.g. microphone noise, and/or wind noise. Microphone noise (of each individual microphone) may be given in advance of operation of the system, e.g. measured, or estimated (e.g. based on a microphone specification), and e.g. stored in a memory.

(56) Sometimes, it is desirable to fade from one microphone signal to the other microphone signal, e.g. if one microphone has more feedback compared to the other microphone (e.g. in a microphone configuration as indicated in FIG. 5A or 5B, where one microphone is more prone to feedback from the output transducer than (the) other microphone(s)). As the uncorrelated part and the correlated part of the input signals do not mix in a similar way, when fading (from the first microphone M.sub.1 to the second microphone M.sub.2), it is proposed to add uncorrelated noise (v.sub.3) to the system in order to obtain an ‘unaltered signal’ (as regards noise and/or target signal or overall signal level) when fading from one microphone to the other.

(57) In other words, in an embodiment, we aim at fading between the two microphone signals x.sub.1 and x.sub.2 with a fading factor α, such that, we obtain an output y(n) with an unaltered target signal level, i.e.
y(n)=αx.sub.1+(1−α)x.sub.2.

(58) Similarly, we aim at maintaining a constant noise level equal to the maximum noise level of the two microphone levels by adding some additional noise, v.sub.3, i.e.
VAR[αv.sub.1]+VAR[(1−α)v.sub.2]+VAR(v.sub.3)=max(VAR[x.sub.1],VAR[x.sub.2])

(59) In order to estimate the noise variance of the additional random variable, we isolate the additional noise in the above equation, i.e.
σ.sub.v.sub.3.sup.2=max(σ.sub.x.sub.1.sup.2,σ.sub.x.sub.2.sup.2)−α.sup.2σ.sub.v.sub.1.sup.2−(1−α).sup.2σ.sub.v.sub.2.sup.2.

(60) Assuming that v.sub.1 is a Gaussian random variable with known variance σ.sub.v.sub.1.sup.2 and v.sub.2 is a Gaussian random variable with known variance σ.sub.v.sub.2.sup.2 (e.g. microphone noise or wind noise), we can generate and add a third Gaussian random variable v.sub.3 with an adaptive variance σ.sub.v.sub.3.sup.2 depending on σ.sub.v.sub.1.sup.2, σ.sub.v.sub.2.sup.2, and α.

(61) A consequence of the proposed method is that the noise level of the output corresponds to the microphone signal with the highest noise variance.

(62) In the setup of FIG. 3, an input stage of a hearing device comprises an input unit (IU) and an adaptive mixing unit (ADM) providing fading between two microphone signals having different noise variances. The adaptive mixing is performed with a fading factor α, such that, an output y(n) with an unaltered noise level (before and after fading) is provided. A proceeding hearing device processor for applying one or more processing algorithms (e.g. a noise reduction algorithm (e.g. comprising post-filtering (single channel noise reduction)) and/or or a compressive amplification algorithm, etc.) may be included down-stream of the input stage (cf. e.g. hearing aid processor HAG in FIG. 2D, 2E). Further, a voice activity detector may be used to qualify the microphone signals. The target signal components may or may not be equalized (equalization of the noise components is the more important of the two).

(63) FIG. 4 shows an input stage as the one illustrated FIG. 3, but where similar noise variance at each microphone is assumed. However, even if the noise variance is the same, we have to add noise during fading in order to maintain a steady noise level. The input stage of FIG. 4 is similar to the input stage of FIG. 3 apart from the fact that the two microphones M.sub.1, M.sub.2 exhibit the same noise variance σ.sup.2. The target signal level (|s.sub.1|, |s.sub.2|) may be different at the two microphones (M.sub.1, M.sub.2), though, e.g. if there are two target signals, e.g. one in the front or back of, and one to the side of the user wearing the hearing device (or if the two microphones are ‘far apart’). Such situation reflects a scenario where an intended listening direction of the user changes over time. It may be important to maintain the microphone level during fading. Instead of fading between two microphone signals, fading between two beamformed signals (e.g. from a front- (or rear-) directed and a side-directed beamformer, respectively) may be performed. This is e.g. illustrated in FIG. 2E. In case of a changing listening direction, the amount of noise to be attenuated may likewise change. In case of fading between two beamformed signals, more than two microphone signals may be used to generate the two beamformed signals.

(64) FIG. 5A shows a hearing device of the receiver in the ear type according to an embodiment of the present disclosure, and

(65) FIG. 5B shows a hearing device of the completely in the ear type according to an embodiment of the present disclosure.

(66) FIG. 5A shows a BTE/RITE style hearing device according to a first embodiment of the present disclosure (BTE=‘Behind-The-Ear’; RITE=Receiver-In-The-Ear’). The exemplary hearing device (HD), e.g. a hearing aid, is of a particular style (sometimes termed receiver-in-the ear, or RITE, style) comprising a BTE-part (BTE) adapted for being located at or behind an ear of a user, and an ITE-part (ITE) adapted for being located in or at an ear canal of the user's ear and comprising a receiver (loudspeaker, SPK). The BTE-part and the ITE-part are connected (e.g. electrically connected) by a connecting element (IC) and internal wiring in the ITE- and BTE-parts (cf. e.g. wiring Wx in the BTE-part). The connecting element may alternatively be fully or partially constituted by a wireless link between the BTE- and ITE-parts. Other styles, e.g. comprising a custom mould adapted to a user's ear and/or ear canal, may of course be used (cf. e.g. FIG. 5B).

(67) In the embodiment of a hearing device in FIG. 5A, the BTE part comprises an input unit comprising two input transducers (e.g. microphones) (M.sub.BTE1, M.sub.BTE2), each for providing an electric input audio signal representative of an input sound signal (S.sub.BTE) (originating from a sound field S around the hearing device). The input unit further comprises two wireless receivers (WLR.sub.1, WLR.sub.2) (or transceivers) for providing respective directly received auxiliary audio and/or control input signals (and/or allowing transmission of audio and/or control signals to other devices, e.g. a remote control or processing device, or a telephone, or another hearing device). The hearing device (HD) comprises a substrate (SUB) whereon a number of electronic components are mounted, including a memory (MEM), e.g. storing different hearing aid programs (e.g. user specific data, e.g. related to an audiogram, or parameter settings derived therefrom, e.g. defining such (user specific) programs, or other parameters of algorithms, e.g. beamformer filter weights, and/or fading parameters) and/or hearing aid configurations, e.g. input source combinations (M.sub.BTE1, M.sub.BTE2 (M.sub.ITE), WLR.sub.1, WLR.sub.2), e.g. optimized for a number of different listening situations. In a specific mode of operation, two or more of the electric input signals from the microphones are combined to provide a beamformed signal provided by applying appropriate (e.g. complex) weights to (at least some of) the respective signals.

(68) The substrate (SUB) further comprises a configurable signal processor (DSP, e.g. a digital signal processor), e.g. including a processor for applying a frequency and level dependent gain, e.g. providing beamforming, noise reduction, filter bank functionality, and other digital functionality of a hearing device, e.g. implementing features according to the present disclosure (as e.g. discussed in connection with FIG. 1A, 1B, 2A, 2B, 2C, 2D, 2E). The configurable signal processor (DSP) is adapted to access the memory (MEM) e.g. for selecting appropriate parameters for a current configuration or mode of operation and/or listening situation and/or for writing data to the memory (e.g. algorithm parameters, e.g. for logging user behavior). The configurable signal processor (DSP) is further configured to process one or more of the electric input audio signals and/or one or more of the directly received auxiliary audio input signals, based on a currently selected (activated) hearing aid program/parameter setting (e.g. either automatically selected, e.g. based on one or more sensors, or selected based on inputs from a user interface). The mentioned functional units (as well as other components) may be partitioned in circuits and components according to the application in question (e.g. with a view to size, power consumption, analogue vs. digital processing, acceptable latency, etc.), e.g. integrated in one or more integrated circuits, or as a combination of one or more integrated circuits and one or more separate electronic components (e.g. inductor, capacitor, etc.). The configurable signal processor (DSP) provides a processed audio signal, which is intended to be presented to a user. The substrate further comprises a front-end IC (FE) for interfacing the configurable signal processor (DSP) to the input and output transducers, etc., and typically comprising interfaces between analogue and digital signals (e.g. interfaces to microphones and/or loudspeaker(s), and possibly to sensors/detectors). The input and output transducers may be individual separate components, or integrated (e.g. MEMS-based) with other electronic circuitry.

(69) The hearing device (HD) further comprises an output unit (e.g. an output transducer) providing stimuli perceivable by the user as sound based on a processed audio signal from the processor or a signal derived therefrom. In the embodiment of a hearing device in FIG. 5A, the ITE part comprises (at least a part of) the output unit in the form of a loudspeaker (also termed a ‘receiver’) (SPK) for converting an electric signal to an acoustic (air borne) signal, which (when the hearing device is mounted at an ear of the user) is directed towards the ear drum (Ear drum), where sound signal (S.sub.ED) is provided. The ITE-part further comprises a guiding element, e.g. a dome, (DO) for guiding and positioning the ITE-part in the ear canal (Ear canal) of the user. In the embodiment of FIG. 5A, the ITE-part further comprises a further input transducer, e.g. a microphone (M.sub.ITE), for providing an electric input audio signal representative of an input sound signal (S.sub.ITE) at the ear canal. Propagation of sound (S.sub.ITE) from the environment to a residual volume at the ear drum via direct acoustic paths through the semi-open dome (DO) are indicated in FIG. 5A, 5B by dashed arrows (denoted Direct path). The directly propagated sound (indicated by sound fields S.sub.dir) is mixed with sound from the hearing device (HD) (indicated by sound field S.sub.HI) to a resulting sound field (S.sub.ED) at the ear drum. The ITE-part may comprise a (possibly custom made) mould for providing a relatively tight fitting to the user's ear canal. The mould may comprise a ventilation channel to provide a (controlled) leakage of sound from the residual volume between the mould and the ear drum (to manage the occlusion effect) cf. FIG. 5B.

(70) The electric input signals (from input transducers M.sub.BTE1, M.sub.BTE2, M.sub.ITE) may be processed in the time domain or in the (time-) frequency domain (or partly in the time domain and partly in the frequency domain as considered advantageous for the application in question).

(71) In the embodiment of FIG. 5A, the connecting element (IC) comprises electric conductors for connecting electric components of the BTE and ITE-parts. The connecting element (IC) may comprises an electric connector (CON) to attach the cable (IC) to a matching connector in the BTE-part. In another embodiment, the connecting element (IC) is an acoustic tube and the loudspeaker (SPK) is located in the BTE-part. In a still further embodiment, the hearing device comprises no BTE-part, but the whole hearing device is housed in the ear mould (ITE-part), cf. e.g. FIG. 5B.

(72) The embodiment of a hearing device (HD) exemplified in FIGS. 5A and 5B are portable devices comprising a battery (BAT), e.g. a rechargeable battery, e.g. based on Li-Ion battery technology, e.g. for energizing electronic components of the BTE- and possibly ITE-parts. In an embodiment, the hearing device, e.g. a hearing aid, is adapted to provide a frequency dependent gain and/or a level dependent compression and/or a transposition (with or without frequency compression of one or more frequency ranges to one or more other frequency ranges), e.g. to compensate for a hearing impairment of a user. The BTE-part may e.g. comprise a connector (e.g. a DAI or USB connector) for connecting a ‘shoe’ with added functionality (e.g. an FM-shoe or an extra battery, etc.), or a programming device, or a charger, etc., to the hearing device (HD). Alternatively or additionally, the hearing device may comprise a wireless interface for programming and/or charging the hearing device.

(73) FIG. 5B shows a further embodiment of a hearing aid (HD) according to the present disclosure. FIG. 5B schematically illustrates an ITE-style hearing aid according to an embodiment of the present disclosure. The hearing aid (HD) comprises or consists of an ITE-part comprising a housing (Housing), which may be a standard housing aimed at fitting a group of users, or it may be customized to a user's ear (e.g. as an ear mould, e.g. to provide an appropriate fitting to the outer ear and/or the ear canal). The housing schematically illustrated in FIG. 5B has a symmetric form, e.g. around a longitudinal axis from the environment towards the ear drum (Eardrum) of the user (when mounted), but this need not be the case. It may be customized to the form of a particular user's ear canal. The hearing aid may be configured to be located in the outer part of the ear canal, e.g. partially visible from the outside, or it may be configured to be located completely in the ear canal, possibly deep in the ear canal, e.g. fully or partially in the bony part of the ear canal.

(74) To minimize leakage of sound (played by the hearing aid towards the ear drum of the user) from the ear canal, a good mechanical contact between the housing of the hearing aid and the Skin/tissue of the ear canal is aimed at. In an attempt to minimize such leakage, the housing of the ITE-part may be customized to the ear of a particular user.

(75) The hearing aid (HD) comprises a number of microphones M.sub.q, i=1, . . . , Q, here two (Q=2). The two microphones (M.sub.1, M.sub.2) are located in the housing with a predefined distance d between them, e.g. 8-10 mm, e.g. on a part of the surface of the housing that faces the environment when the hearing aid is operationally mounted in or at the ear of the user. The microphones (M.sub.1, M.sub.2) are e.g. located on the housing to have their microphone axis (an axis through the centre of the two microphones) point in a forward direction relative to the user, e.g. a look direction of the user (as e.g. defined by the nose of the user, e.g. substantially in a horizontal plane), when the hearing aid is mounted in or at the ear of the user. Thereby the two microphones are well suited to create a directional signal towards the front (and/or back) of the user. The microphones are configured to convert sound (X.sub.1,ac, X.sub.2,ac) received from a sound field S around the user at their respective locations to respective (analogue) electric signals (x.sub.1, x.sub.2) representing the sound. The microphones are coupled to respective analogue to digital converters (AD) to provide the respective (analogue) electric signals (x.sub.1, x.sub.2) as digitized signals (x.sub.1, x.sub.2). The digitized signals may further be coupled to respective filter banks to provide each of the electric input signals (time domain signals) as frequency sub-band signals (frequency domain signals). The (digitized) electric input signals (x.sub.1, x.sub.2) are fed to a digital signal processor (DSP) for processing the audio signals (x.sub.1, x.sub.2), e.g. including one or more of spatial filtering (beamforming), adaptive mixing (e.g. fading), (e.g. single channel) noise reduction, compression (frequency and level dependent amplification/attenuation according to a user's needs, e.g. hearing impairment), spatial cue preservation/restoration, etc. The digital signal processor (DSP) may e.g. comprise the appropriate filter banks (e.g. analysis as well as synthesis filter banks) to allow processing in the frequency domain (individual processing of frequency sub-band signals). The digital signal processor (DSP) is configured to provide a processed signal y comprising a representation of the sound field S (e.g. including an estimate of a target signal therein). The processed signal y is fed to an output transducer (here a loudspeaker (SPK), e.g. via a synthesis filter bank and, optionally, a digital to analogue converter (DA), for conversion of a processed (digital electric) signal y (or analogue version y) to a sound signal S.sub.out.

(76) The hearing aid (HD) may e.g. comprise a venting channel (Vent) configured to minimize the effect of occlusion (when the user speaks). In addition to allowing an (un-intended) acoustic propagation path from a residual volume (cf. Res. Vol in FIG. 5B) between a hearing aid housing and the ear drum to be established, the venting channel also provides a direct acoustic propagation path of sound from the environment to the residual volume. The directly propagated sound S.sub.dir reaching the residual volume is mixed with the acoustic output of the hearing aid (HD) to create a resulting sound S.sub.ED at the ear drum. In a mode of operation, active noise suppression (ANS) is activated in an attempt to cancel out the directly propagated sound S.sub.dir.

(77) The ventilation channel (Vent) is asymmetrically located in the hearing aid housing (Housing). Such asymmetric location may be a result of a design constraint due to components of the hearing aid, e.g. a battery. Thereby the first and second microphones (M.sub.1, M.sub.2) have different feedback paths from the loudspeaker (SPK). The first microphone (M.sub.1) is located closer to the ventilation channel than the second microphone (M.sub.2). Other things being equal, the feedback measure (FBM1) of the first microphone is larger than the feedback measure (FBM2) of the second microphone. The scheme according to the present disclosure for controlling (e.g. to switch, such as fade, between) the use of either a beamformed signal or the signal from a single one of the input transducers in the forward path of the hearing aid may be applied to the ITE-hearing aid of FIG. 3B. Thereby more flexibility as regards the location of the input transducers and the ventilation channel relative to each other is provided without compromising (decreasing) the full-on gain value of the hearing aid. In a specific mode of operation, the signal from the (single) microphone having the lowest feedback is used for amplification and presentation to the user. Fading according to the present disclosure between the first and the second microphone signal is thus provided. Thereby the risk of feedback howl can be minimized.

(78) The hearing aid (HD) comprises an energy source, e.g. a battery (BAT), e.g. a rechargeable battery, for energizing the components of the device.

(79) FIG. 6A illustrates an embodiment of a hearing system, e.g. a binaural hearing aid system, according to the present disclosure. The hearing system comprises left and right hearing devices in communication with an auxiliary device, e.g. a remote control device, e.g. a communication device, such as a cellular telephone or similar device capable of establishing a communication link to one or both of the left and right hearing devices. FIG. 6B illustrates an auxiliary device configured to execute an application program (APP) implementing a user interface of the hearing device or system from which a mode of operation for selecting a particular sound input, e.g. an input from a particular microphone or a particular input from a wired or wireless direct reception of sound from another device (e.g. a telecoil- or RF-input), or a particular beamformed signal, can be selected.

(80) FIG. 6A, 6B together illustrate an application scenario comprising an embodiment of a binaural hearing aid system comprising first (left) and second (right) hearing devices (HD1, HD2) and an auxiliary device (AD) according to the present disclosure. The auxiliary device (AD) comprises a cellular telephone, e.g. a Smartphone. In the embodiment of FIG. 6A, the hearing devices and the auxiliary device are configured to establish wireless links (WL-RF) between them, e.g. in the form of digital transmission links according to the Bluetooth standard (e.g. Bluetooth Low Energy, or equivalent technology). The links may alternatively be implemented in any other convenient wireless and/or wired manner, and according to any appropriate modulation type or transmission standard, possibly different for different audio sources. The auxiliary device (e.g. a Smartphone) of FIG. 6A, 6B comprises a user interface (UI) providing the function of a remote control of the hearing aid device or system, e.g. for changing program or mode of operation or operating parameters (e.g. volume) in the hearing device(s), etc. The user interface (UI) of FIG. 6B illustrates an APP (denoted ‘Select audio input’ (‘Select an audio input among microphone, beamformer and direct audio inputs’) for selecting a mode of operation of the hearing system or device where a specific one of a number of audio inputs is currently preferred by the user (and selectable via the user interface). In the example of FIG. 6B, a currently preferred audio input can be selected among the following audio inputs: BTE-microphone 1 ITE-microphone Smartphone microphone Front-directed beamformer Side-directed beamformer Rear-directed beamformer Telecoil Telephone Music player

(81) In the screen of FIG. 6B, the ‘ITE-microphone’ has been selected as indicated by the left solid ‘tick-box’ and the bold face indication ‘ITE-microphone’. The screen further comprises the instruction ‘Click on preferred input. Press Activate, when ready’, referring to the activate button in the lower part of the screen.

(82) When the user changes a currently preferred audio input from one e.g. Front-directed beamformer to Side-directed beamformer (e.g. in a car-situation), fading between the two inputs as proposed in the present disclosure is automatically initiated.

(83) In embodiments of the APP, the user may be allowed to control details of a fading function between two audio input signals, e.g. the time period (Δt) of the transition and/or a possible residual weight of the audio input that was previously the preferred audio input (if relevant). In an embodiment, different configurations of fading parameters (functions, time periods, residual weight, etc.) may be defined for different pairs of audio inputs.

(84) The hearing devices (HD1, HD2) are shown in FIG. 6A as devices mounted at the ear (behind the ear) of a user (U), cf. e.g. FIG. 5A. Other styles may be used, e.g. located completely in the ear (e.g. in the ear canal, cf. e.g. FIG. 5B), fully or partly implanted in the head, etc. As indicated in FIG. 6A, each of the hearing instruments may comprise a wireless transceiver to establish an interaural wireless link (IA-WL) between the hearing devices, e.g. based on inductive communication or RF communication (e.g. Bluetooth technology). Each of the hearing devices further comprises a transceiver for establishing a wireless link (WL-RF, e.g. based on radiated fields (RF)) to the auxiliary device (AD), at least for receiving and/or transmitting signals, e.g. control signals, e.g. information signals, e.g. including audio signals. The transceivers are indicated by RF-IA-Rx/Tx-1 and RF-IA-Rx/Tx-2 in the right (HD2) and left (HD1) hearing devices, respectively.

(85) In an embodiment, the remote control APP is configured to interact with a single hearing device (instead of with a binaural hearing aid system).

(86) In the embodiment of FIG. 6A, 6B, the auxiliary device is described as a smartphone. The auxiliary device may, however, be embodied in other portable electronic devices, e.g. an FM-transmitter, a dedicated remote control device, a smartwatch, a tablet computer, etc.

(87) FIG. 7 schematically illustrates a speakerphone comprising an input unit comprising a multitude of microphones configured to pick up sound from an environment of the speakerphone and number of beamformers configured to focus on a number of different target speakers in the environment around the speakerphone and to allow an adaptive fading between spatially filtered signals as described in the present disclosure. The input unit of the speakerphone (SPKPHO) comprises a microphone array comprising a multitude (here 8) microphones (MIC) arranged in a predetermined pattern (here evenly distributed along the periphery of a circle). The speakerphone further comprises a loudspeaker (SPK) (here located at the centre of the speakerphone. The loudspeaker is configured to play sound received from a remote source for perception in the environment of the speakerphone. The speakerphone comprises a mixing processor as described in the present disclosure. The mixing processor is adapted to provide a processed input signal based on at least some of the signals from the multitude of microphones. The processed input signal (or a processed version thereof) is transmitted to another device or system for further processing and/or presentation to one or more remote users. The speakerphone is further configured to play sound received from a remote source for perception in the environment of the speakerphone.

(88) The input unit of the speakerphone may comprise a beamformer filtering unit receiving the electric input signals from the multitude of microphones (MIC). The beamformer filtering unit is configured to provide at least two spatially filtered (beamformed) signals (here four is shown BF1, BF2, BF3, BF4) directed towards at least two target sound sources (here four is shown, S1, S2, S3, S4) in the environment of the speakerphone. The multitude of microphones may be divided into sub-sets of microphones. Each beamformer may be based on a subset of the microphones or all of the microphones. The speakerphone may be configured to fade between the at least two spatially filtered signals and to transmit the (resulting) processed input signal (or a further processed version, e.g. a postfiltered version, thereof) to the (an)other device or system. A currently active beamformer (BF2) is indicated by a bold outline. Speaker S2 is currently active. When (dominant) speech activity is detected in another one of the beamformers, a fading procedure according to the present disclosure is initiated. The initiation of the fading procedure may be determined by respective voice-activity-detectors (e.g. one for each spatially filtered signal).

(89) FIG. 8 shows an estimator (NEST) for estimating a noise variance of the at least two input audio data streams prior to mixing of the audio streams. The input unit (IU) provides at least two input audio data streams (here x.sub.1, x.sub.2 from respective microphones M.sub.1, M.sub.2, the (digitized) microphone signals x.sub.1, x.sub.2 being converted to the frequency domain by respective analysis filter banks (A)). Each input audio data stream (x.sub.1, x.sub.2) comprises a mixture of a target signal component (s.sub.1, s.sub.2) from a target sound source and a noise component (v.sub.1, v.sub.2) from one or more noise sources, as exemplified in FIG. 3, 4. In FIG. 8, a procedure for estimating the respective noise variances VAR [v.sub.1]=σ.sub.v.sub.1.sup.2 and VAR [v.sub.2]=σ.sub.v.sub.2.sup.2 is exemplified.

(90) The two input audio data streams (x.sub.1, x.sub.2) are multiplied in combination unit ‘x’ and low-pass filtered by low-pass filter (LP) to provide an estimate of the correlation (COR) between the two data streams (x.sub.1, x.sub.2). The cross-correlation between x.sub.1 and x.sub.2 is determined as =<x.sub.1 x.sub.2*>, where * denotes complex conjugate (cf. * on the input to multiplication unit ‘x’ from x.sub.2), and <-> indicates smoothing over time, e.g. using a low-pass filter (LP), assuming that the processing is performed in the filter bank domain (i.e. the (time-)frequency domain), cf. analysis filter banks (FBA) in FIG. 8. The correlation (COR) is fed to controller CTR for controlling the estimation of the respective noise variances (using control signals U1, U2) and for determining the type of noise (signal NTP) present in the current input audio data streams (x.sub.1, x.sub.2).

(91) Each of the two input audio data streams (x.sub.1, x.sub.2) have separate (identical) noise variance estimation paths. Each noise estimation path comprises an ABS squared function for providing a magnitude squared representation (|x.sub.1|.sup.2, |x.sub.2|.sup.2) of the two input audio data streams (x.sub.1, x.sub.2). In each noise estimation path (m=1, 2, corresponding to M1, M2), the magnitude squared values (|x.sub.1|.sup.2, |x.sub.2|.sup.2) are low-pass filtered (LP, LPm, m=1, 2) in two different, parallel signal paths. Low-pass filter LP is configured to be continuously updated to provide an envelope (<|x.sub.1|.sup.2>, <|x.sub.2|.sup.2>) of the magnitude squared values. The level (L1, L2) of the envelope (<|x.sub.1|.sup.2>, <|x.sub.2|.sup.2>) of the magnitude squared values is estimated in respective level estimators LD, and the estimated levels (L1, L2) are fed to the controller (CTR). Low-pass filter LP1 in microphone path 1 (and correspondingly LP2 in microphone path M2) is updated in control of signal U1 (U2) from the controller (CTR). Control signal U1 (U2) is determined (at a given time) in dependence of the correlation (COR) between the two input audio data streams (x.sub.1, x.sub.2) and the estimated level (L1 (L2)) of the envelope (<|x.sub.1|.sup.2>(<|x.sub.2|.sup.2>)) of the magnitude squared values of the respective input audio data streams (x.sub.1 (x.sub.2)). When the correlation (COR) is low, the output of the low-pass filters LP1 and LP2 represent the noise variances σ.sub.1.sup.2 and σ.sub.2.sup.2 of the first and second input audio data streams x.sub.1 and x.sub.2, respectively.

(92) The controller (CTR) is configured to provide control signals U1, U2, NTP according to the following criteria: If L1 is low (e.g. below a first level threshold L.sub.th1), update LP1 (U1=1). If L2 is low (e.g. below a second level threshold L.sub.th2), update LP2 (U2=1). If COR is low (e.g. below a first correlation threshold COR.sub.th1), while Lm (m=1, 2) is low, signal type=microphone noise (=NTP). If COR is low (e.g. below a first correlation threshold COR.sub.th1), while Lm (m=1, 2) vary, signal type=wind noise (=NTP). If COR is high (e.g. above a second correlation threshold COR.sub.th2), while Lm (m=1, 2) vary, signal type=speech (=NTP).

(93) The control signal NTP can e.g. be used to discriminate between noise (including between wind noise and e.g. microphone noise) and no noise (e.g. speech) and thus implement a voice activity detector. This control signal may e.g. be used elsewhere in the hearing aid.

(94) The estimator (NEST) of FIG. 8 may e.g. form part of the processor (PRO), cf. e.g. FIG. 2A, 2B, 2C, 2D, 2E. The estimator (NEST) may e.g. form part of the adaptive mixing unit (ADM) cf. e.g. FIG. 2C, 2D, 2E. The estimator (NEST) may e.g. form part of the noise variance estimation unit (NVE) cf. e.g. FIG. 2C.

(95) FIG. 9 schematically illustrates an exemplary fading procedure between two input audio data streams having different target and noise levels. The two upper graphs schematically illustrate first and second input audio data streams x.sub.1 and x.sub.2, respectively (denoted Audio stream #1 and Audio stream #2, respectively). Sequences of alternating speech and no speech are illustrated (‘Level’ versus ‘Time’). The first and second data streams have different maximum and minimum input levels respectively (both assumed constant for simplicity). Audio stream #1 exhibits maximum level LS1 and minimum level LN1. Audio stream #2 correspondingly exhibits maximum level LS2 and minimum level LN2. The maximum level(s) (LS1, LS2) may be assumed to represent average speech levels (envelopes, top trackers). The minimum level(s) (LN1, LN2) may be assumed to represent average noise levels (envelopes, bottom trackers). All four levels (LS1, LS2, LN1, LN2) are indicated in the middle graph representing the waveform for the second input audio data stream (Audio stream #2). This is also the case in the bottom graph illustrating a fading from Audio stream #1 to Audio stream #2 over a fading time Δt.sub.fad. The fading time (Δt.sub.fad=T1+T2) may e.g. be larger than a minimum time and smaller than a maximum time, e.g. 1 s≤Δt.sub.fad.≤5 s. The bottom graph illustrates an example of the fading process where the noise levels (LN1, LN2) represent the noise variance estimates σ.sub.1.sup.2 and σ.sub.2.sup.2 of the respective audio streams. Instead of abruptly changing (from Audio stream #1 to Audio stream #2, the noise level of the mixed signal remain the level (LN1) of Audio stream #1 for a short period of time (T1) before it gradually (over time T2) changes to the level (L2) of Audio stream #2. Thereby significant artifacts in the mixing process is avoided.

(96) It is intended that the structural features of the devices described above, either in the detailed description and/or in the claims, may be combined with steps of the method, when appropriately substituted by a corresponding process.

(97) As used, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well (i.e. to have the meaning “at least one”), unless expressly stated otherwise. It will be further understood that the terms “includes,” “comprises,” “including,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will also be understood that when an element is referred to as being “connected” or “coupled” to another element, it can be directly connected or coupled to the other element but an intervening element may also be present, unless expressly stated otherwise. Furthermore, “connected” or “coupled” as used herein may include wirelessly connected or coupled. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. The steps of any disclosed method are not limited to the exact order stated herein, unless expressly stated otherwise.

(98) It should be appreciated that reference throughout this specification to “one embodiment” or “an embodiment” or “an aspect” or features included as “may” means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. Furthermore, the particular features, structures or characteristics may be combined as suitable in one or more embodiments of the disclosure. The previous description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects.

(99) The claims are not intended to be limited to the aspects shown herein but are to be accorded the full scope consistent with the language of the claims, wherein reference to an element in the singular is not intended to mean “one and only one” unless specifically so stated, but rather “one or more.” Unless specifically stated otherwise, the term “some” refers to one or more.

(100) Accordingly, the scope should be judged in terms of the claims that follow.