Abstract
A sound capture device configured to be worn by a person and/or to be located on a surface is configured to pick up target sound from a target sound source s. The sound capture device comprises a) an input unit providing a multitude of electric input signals, each comprising a target signal component and a noise signal component; b) a directional noise reduction system comprising a beamformer unit coupled to said multitude of input signals and configured to provide an estimate of the target sound s. The beamformer unit comprises b1) target maintaining, reference beamformer providing a current reference signal; and b2) a target cancelling beamformer providing a current target cancelling sign. The directional noise reduction system is configured to operate in at least two modes in dependence of a mode control signal, 1) in a directional mode and 2) in a non-directional, omni-directional mode. The sound capture device further comprises c) antenna and transceiver circuitry for establishing an audio link to another device, and to transmit said estimate of the target sound s to said another device, and d) a mode controller for determining said mode control signal in dependence of said current reference signal and said current target cancelling signal. A method of operating a sound capture device is further disclosed.
Claims
1. A sound capture device configured to be worn by a person and/or to be located on a surface, the sound capture device being configured to pick up target sound from a target sound source s, the sound capture device comprising an input unit comprising a multitude of input transducers IT.sub.m, m=1, 2, . . . , M, M being larger than or equal to two, each input transducer being configured to pick up a sound from the environment of the sound capture device and to provide corresponding electric input signals, each electric input signal IN.sub.m, m=1, . . . , M, comprising a target signal component and a noise signal component; a housing wherein said multitude of input transducers are located; a directional noise reduction system for providing an estimate of the target sound s, the directional noise reduction system comprising a beamformer unit operationally coupled to said multitude of input transducers IT.sub.m, m=1, . . . , M, the beamformer unit comprising target maintaining, reference beamformer configured to leave signal components from a fixed target direction un-attenuated or less attenuated relative to signal components from other directions, and providing a current reference signal; and a target cancelling beamformer configured to attenuate signal components from said target direction, whereas signal components from other directions are attenuated less relative to signal components from said target direction, and providing a current target cancelling signal; the directional noise reduction system being configured to operate in at least two modes in dependence of a mode control signal, a directional mode wherein said estimate of the target sound s is based on target signal components from said fixed target direction, and a non-directional, omni-directional mode, wherein said estimate of the target sound s is based on target signal components from all directions; antenna and transceiver circuitry for establishing an audio link to another device, and wherein the sound capture device is configured to transmit said estimate of the target sound s to said another device; and a mode controller for determining said mode control signal in dependence of said current reference signal and said current target cancelling signal.
2. A sound capture device according to claim 1, wherein at least one of said input transducers is a microphone.
3. A sound capture device according to claim 1 comprising a filter bank.
4. A sound capture device according to claim 3, wherein the magnitude, or otherwise processed versions, of the respective current reference signal and the current target cancelling signal are averaged across time to provide respective smoothed reference and target-cancelling measures.
5. A sound capture device according to claim 4 comprising a voice activity detector and wherein the sound capture device is configured to provide that the averaging only takes place, in time frames when the user's voice is detected by the voice activity detector.
6. A sound capture device according to claim 3 comprising a combination processor configured to compare said current reference signal and said current target cancelling signal, or processed versions thereof, in different frequency sub-bands, and to provide respective frequency sub-band comparison signals.
7. A sound capture device according to claim 3 comprising a decision controller configured to provide a resulting mode control signal indicative of an appropriate mode of operation of the directional noise reduction system in dependence of said frequency sub-band comparison signals.
8. A sound capture device according to claim 7 wherein said decision controller is configured to provide said resulting mode control signal in dependence of a weighted sum of individual sub-band comparison signals.
9. A sound capture device according to claim 7 wherein said directional noise reduction system is adapted to be in a directional mode when said mode control signal indicates a relatively large difference over frequency between said current reference signal and said current target cancelling signal, or processed versions thereof, and to be in an omni-directional mode when said mode control signal indicates a relatively small difference over frequency between said current reference signal and said current target cancelling signal, or processed versions thereof.
10. A sound capture device according to claim 1 being constituted by or comprising a microphone device.
11. A hearing system comprising a sound capture device according to claim 1 and the another device, wherein said sound capture device and said another device are configured to establish a communication link between them allowing the exchange of data, including audio data between them or from the sound capture device to the another device.
12. A hearing system according to claim 11 wherein the another device is a hearing device.
13. A hearing system according to claim 12 wherein said hearing device is constituted by or comprises an air-conduction type hearing aid, a bone-conduction type hearing aid, a cochlear implant type hearing aid, or a combination thereof.
14. A hearing system according to claim 11 adapted to provide that said sound capture device transmits said estimate of the target sound s to the another device.
15. Use of a sound capture device as claimed in claim 1.
16. A sound capture device according to claim 1 wherein the housing comprises a preferred direction coinciding with said fixed target direction.
17. A method of operating a sound capture device configured to be worn by a person and/or to be located on a surface, the sound capture device being configured to pick up target sound from a target sound source s, the method comprising providing a multitude M of electric input signals, each electric input signal IN.sub.m, m=1, . . . , M, comprising a target signal component and a noise signal component; providing an estimate of the target sound s, providing a target maintaining, reference beamformer configured to attenuate signal components from other directions than a fixed target direction, whereas signal components from the fixed target direction are left un-attenuated or are attenuated less relative to signal components from said other directions, and providing a reference signal in dependence of said multitude M of electric input signals; and providing a target cancelling beamformer configured to attenuate signal components from said target direction, whereas signal components from other directions are attenuated less relative to signal components from said target direction, and providing a target cancelling signal in dependence of said multitude M of electric input signals; providing at least two modes in dependence of a mode control signal, a directional mode wherein said estimate of the target sound s is based on target signal components from said fixed target direction, and a non-directional, omni-directional mode, wherein said estimate of the target sound s is based on target signal components from all directions; establishing an audio link to another device, and transmitting said estimate of the target sound s to said another device, determining said mode control signal in dependence of said reference signal and said target cancelling signal.
18. A data processing system comprising a processor and program code means for causing the processor to perform the steps of the method of claim 17.
19. A non-transitory computer readable medium on which is stored a computer program comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method of claim 17.
20. A hearing aid configured to be worn by a user, the hearing aid comprising an input unit comprising a multitude of input transducers IT.sub.m, m=1, 2, . . . , M, M being larger than or equal to two, each input transducer being configured to pick up a sound from the environment of the sound capture device and configured to provide corresponding electric input signals, each electric input signal IN.sub.m, m=1, . . . , M, comprising a target signal from a target signal source and a noise signal from one or more noise signal sources; an own voice detector configured to provide an own voice control signal indicative of whether or not, or with what probability, a given electric input signal, or a processed version thereof, originates from the voice of said user; the own voice detector comprising a beamformer unit operationally coupled to said multitude of input transducers IT.sub.m, m=1, . . . , M, the beamformer unit comprising target maintaining, reference beamformer configured to leave signal components from a fixed target direction un-attenuated or less attenuated relative to signal components from other directions, and providing a current reference signal; and a target cancelling beamformer configured to attenuate signal components from said target direction, whereas signal components from other directions are attenuated less relative to signal components from said target direction, and providing a current target cancelling signal; wherein said fixed target direction is a direction from the hearing aid towards the user's mouth and said target signal is the user's own voice; and a controller for determining said own voice control signal in dependence of said current reference signal and said current target cancelling signal.
21. A hearing aid according to claim 20 wherein said controller is configured to determine said own voice control signal in dependence of a comparison of said current reference signal and said current target cancelling signal.
22. A hearing aid according to claim 20 wherein said controller is configured to determine said own voice control signal in dependence of the magnitude of the reference and target cancelling beamformers.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1) The aspects of the disclosure may be best understood from the following detailed description taken in conjunction with the accompanying figures. The figures are schematic and simplified for clarity, and they just show details to improve the understanding of the claims, while other details are left out. Throughout, the same reference numerals are used for identical or corresponding parts. The individual features of each aspect may each be combined with any or all features of the other aspects. These and other aspects, features and/or technical effect will be apparent from and elucidated with reference to the illustrations described hereinafter in which:
(2) FIG. 1A shows a sound capture unit located in an ideal position attached to a shirt of a person and configured to pick up the voice of the wearer;
(3) FIG. 1B shows a sound capture device positioned in a sub-optimal way, where the microphone axis points away from the wearer's mouth; and
(4) FIG. 1C shows the sound capture device used as a table microphone,
(5) FIG. 2A illustrates a perfect target cancelling beamformer;
(6) FIG. 2B illustrates a situation where the sound capture device is tilted, so that the null direction of the target cancelling beamformer does not point directly towards the user's mouth.
(7) FIG. 2C illustrates a situation where the sound capture device is placed at a table; and
(8) FIG. 2D illustrates a situation where the reference beampattern is cardioid-shaped with its null direction pointing away from the user's voice,
(9) FIG. 3 shows a first embodiment of an input stage of a sound capture device, e.g. a microphone unit, or a hearing device, according to the present disclosure,
(10) FIG. 4 shows a second embodiment of an input stage of a sound capture device, e.g. a microphone unit, according to the present disclosure,
(11) FIG. 5A shows an embodiment of a sound capture device according to the present disclosure comprising a light indicator (LED) for indicating a correct (optimal) location/orientation of the unit; and
(12) FIG. 5B shows an embodiment of a sound capture device according to the present disclosure comprising a light indicator (LED) for indicating an incorrect (non-optimal) location/orientation of the unit,
(13) FIG. 6 shows an adaptive beamformer configuration, wherein the adaptive beamformer in the k'th frequency sub-band Y(k) is created by subtracting a (e.g. fixed) target cancelling beamformer C.sub.2(k) scaled by the adaptation factor β(k) from an (e.g. fixed) omni-directional beamformer C.sub.1(k),
(14) FIG. 7 shows an adaptive beamformer configuration similar to the one shown in FIG. 6, where the adaptive beampattern Y(k) is created by subtracting a target cancelling beamformer C.sub.2(k) scaled by the adaptation factor β(k) from another fixed beampattern C.sub.1(k),
(15) FIG. 8 shows an embodiment of a hearing device according to the present disclosure comprising a BTE-part as well as an ITE-part,
(16) FIG. 9 shows an embodiment of an own voice detector according to the present disclosure,
(17) FIG. 10 shows a voice control interface connected to an own voice detector according to the present disclosure,
(18) FIG. 11 shows a block diagram of a hearing device comprising an own voice detector according to the present disclosure, and
(19) FIG. 12 shows a block diagram of a sound capture device comprising a mode detector according to the present disclosure.
(20) The figures are schematic and simplified for clarity, and they just show details which are essential to the understanding of the disclosure, while other details are left out. Throughout, the same reference signs are used for identical or corresponding parts.
(21) Further scope of applicability of the present disclosure will become apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the disclosure, are given by way of illustration only. Other embodiments may become apparent to those skilled in the art from the following detailed description.
DETAILED DESCRIPTION OF EMBODIMENTS
(22) The detailed description set forth below in connection with the appended drawings is intended as a description of various configurations. The detailed description includes specific details for the purpose of providing a thorough understanding of various concepts. However, it will be apparent to those skilled in the art that these concepts may be practiced without these specific details. Several aspects of the apparatus and methods are described by various blocks, functional units, modules, components, circuits, steps, processes, algorithms, etc. (collectively referred to as “elements”). Depending upon particular application, design constraints or other reasons, these elements may be implemented using electronic hardware, computer program, or any combination thereof.
(23) The electronic hardware may include micro-electronic-mechanical systems (MEMS), integrated circuits (e.g. application specific), microprocessors, microcontrollers, digital signal processors (DSPs), field programmable gate arrays (FPGAs), programmable logic devices (PLDs), gated logic, discrete hardware circuits, printed circuit boards (PCB) (e.g. flexible PCBs), and other suitable hardware configured to perform the various functionality described throughout this disclosure, e.g. sensors, e.g. for sensing and/or registering physical properties of the environment, the device, the user, etc. Computer program shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.
(24) The present application relates to the field of audio communication, in particular to a sound capture device, e.g. to hearing aid(s). In an aspect, it relates to interaction of a hearing aid (hearing instrument) with an external (auxiliary) device. The auxiliary device may take the form of a (e.g. wireless) sound capture device, e.g. comprising a microphone array, configured to communicate with the hearing aid. The wireless sound capture device may e.g. be adapted for being worn by a person, e.g. the user of a hearing aid or another person, and/or be adapted for being positioned at a location where sound of interest to the hearing aid user can be picked up, e.g. at a support structure, such as a table or a shelf. The wireless sound capture device may comprise at least two microphones and be configured to apply directional processing in order to enhance a desired sound signal picked up by microphones of the sound capture device. Directional processing is desirable, when the sound of interest always is impinging from the same desired direction. When a sound capture device is attached to a person, the person's voice is (assumed to be) of interest. Given that the sound capture device is correctly mounted, the microphone array (e.g. a linear array) always points towards the person's mouth. Hereby directional processing can be applied in order to enhance the person's own voice while background noise is attenuated.
(25) The sound capture device may thus be able to catch the sound of interest and to transmit the captured sound directly e.g. to a hearing instrument user. Hereby typically a better signal to noise ratio is obtained compared to the sound picked up directly by the hearing instrument microphones.
(26) The sound capture device may however not always be used to pick up the voice of a single talker. Sometimes the sound capture device may be placed at a table in order to pick up the sound of any person located around the table. In this situation, an omni-directional response of the microphone may be more desirable than a directional response. Different sound capture device use cases are illustrated in FIG. 1A, 1B, 1C. The sound capture device, e.g. a microphone unit (MICU), comprises a housing wherein two microphones (M1, M2) are located. The two microphones define a microphone direction (M-DIR). The microphone direction is (in the embodiment of FIG. 1A-1C) parallel to a longitudinal (‘preferred’) direction defined by the housing. The microphone direction may define a target direction. The target direction of a target maintaining beamformer may be defined relative to the microphone direction or to the preferred direction of the housing of the sound capture device.
(27) FIG. 1A shows a sound capture device (MICU) located in an ideal position attached to a shirt (SHIRT) of a person (MICU-W) and configured to pick up the voice of the wearer. FIG. 1A shows the intended use of a ‘clip microphone unit’ for own voice pickup. The microphone array (M1, M2) is pointing (M-DIR) towards the user's mouth (MOUTH) (signal of interest), hereby enabling an efficient directional attenuation of background sounds. The background noise can be attenuated by use of directional processing, where the background noise is attenuated while the direction of the user's mouth (OV-DIR) is unaltered (cf. dashed beampattern ‘DIR’). If the sound capture device (MICU) is not correctly mounted, e.g. as illustrated in FIG. 1B, the user's voice may be attenuated by the directional system. FIG. 1B shows a sound capture device positioned in a sub-optimal way, where the microphone axis (M-DIR) points away from the wearer's mouth (MOUTH). In that case, in order to ensure that the target talker (MICU-W) is not attenuated by the directional noise reduction system should be turned off so that the microphone array sensitivity becomes omni-directional (switch to an omni-directional mode, cf. dashed circular beampattern ‘OMNI’). FIG. 1C shows the sound capture device (MICU) used as a table microphone. In FIG. 1C, the sound capture device is placed on a support structure (SURF), e.g. at a table, in order to pick up voices from persons sitting around the table. In that situation, a directional microphone mode may attenuate some voices of interest. Hence, an omni-directional microphone sensitivity is preferred (cf. semi-spherical beampattern ‘OMNI’).
(28) Different use cases of a sound capture device according to the present disclosure, e.g. a microphone unit (MICU) as illustrated in FIG. 1A-1C, are illustrated in FIG. 2A-2D with a focus on exemplary beampatterns for controlling a mode of operations of the directional system.
(29) The present disclosure proposes to switch between directional and omni-directional mode in a sound capture device (MICU) based on a quality estimate of the possible directional benefit. The quality of a directional beamformer can be assessed based on an estimate of how well the null is steered towards the target talker compared to a reference beampattern such as an omni-directional beampattern. A useful building block in many adaptive noise reduction algorithms is a target cancelling beamformer. A target cancelling beamformer is a directional beampattern pointing its null towards the signal of interest, ideally fully removing the target signal and hereby obtaining an estimate of the background noise in absence of the target signal. A target cancelling beamformer may be pre-calibrated to a specific target position/direction, e.g. (ideally) the direction of the user's own voice (OV-DIR). A target cancelling beamformer is illustrated in FIG. 2A (cf. solid cardioid, denoted ‘DIR’). In this situation, we would expect full benefit form a directional noise reduction system as we see a big difference between the target cancelling beamformer (DIR) and the reference beampattern (dashed circular pattern, denoted ‘OMNI-REF’). The null-direction of cardioid-shaped pattern points directly towards the user's mouth (OV-DIR), hereby cancelling the voice of the user (MICU-W). The dashed beampattern shows an omni-directional reference beampattern (OMNI-REF). Considering the difference between the reference beampattern and the beampattern of the target cancelling beamformer, we see that the highest difference is obtained, when the null direction of the target beamformer is pointing directly towards the user's mouth (OV-DIR). In the case, when the sound capture device (‘clip array’, MICU) is tilted (FIG. 2B), the difference between the target cancelling beamformer (solid line, DIR) and the reference beampattern (dashed line, OMNI-REF) becomes smaller, and the user's voice is not fully cancelled by the target cancelling beamformer. In that case, less difference between the target cancelling beamformer and the reference omni-directional beampattern (dashed line) is seen. Similarly, when the sound capture device (‘microphone array’, MICU) is placed at a table (cf. ‘SURF’ in FIG. 2C), it is unlikely that the sounds of interest solely arrives from the pre-defined target direction (M-DIR). Voices of interest may (depending on the practical situation) arrive from any direction around the table. It is thus unlikely to observe a high average difference between the target cancelling beamformer (solid line, DIR) and the reference beampattern (dashed line, OMNI-REF). The reference beampattern does not necessarily have to be omni-directional, e.g. a cardioid pointing the opposite way of the target cancelling beamformer (solid line cardioid denoted ‘DIR’) may be used as reference beampattern. This is illustrated in FIG. 2D (cf. dashed line cardioid denoted ‘REF’). The scenarios of FIG. 2A-2D are similar to the configurations of FIG. 1A-1C and uses the same reference names for the same elements.
(30) The term ‘beampattern’ (as used throughout the present disclosure) may also be termed ‘sensitivity pattern’ indicating a spatial sensitivity (e.g. angle dependence) of a (directional) microphone system.
(31) In FIGS. 3 and 4 discussed below, embodiments of a sound capture device (MICU) comprising a mode detector (cf. rectangular enclosure denoted MODE-DET in FIG. 3, 4) according to the present disclosure using the principles indicated in FIG. 2A-2D are outlined. FIGS. 3 and 4 illustrate a wearer (MICU-W) of the sound capture device (MICU) and an ideal microphone direction (equal to a direction (OV-DIR) towards the wearer's mouth) of microphones (M1, M2) of an input unit (IU) of the sound capture device. The first and second microphones (M1, M2) provide (time domain, e.g. digitized) electric input signals x.sub.1, x.sub.2, respectively. The sound capture device comprises respective analysis filter banks for providing the first and second electric input signals (x.sub.1, x.sub.2, respectively) in a time-frequency representation (X.sub.1, X.sub.2, respectively). The (time-frequency domain) first and second electric input signals (X.sub.1, X.sub.2) are fed to the mode detector (MODE-DET), specifically to the beamformer unit (F-BF). The beamformer unit is configured to provide a number of fixed beamformers, including a reference beamformer (ref) and a target cancelling beamformer (TC), each being a linear combination of the first and second electric input signals (X.sub.1, X.sub.2), wherein the weights (w.sub.ij) of the respective beamformers are complex and frequency dependent. The difference between the (reference) (e.g. omni-directional) beamformer (OMNI-BF, signal ‘ref’) and the target voice cancelling beamformer (TC-BF, signal ‘TC’) is combined into a decision across frequency bands. A high difference indicates optimal conditions for the directional noise reduction system, and directional enhancement of the user's voice is enabled. A smaller difference between the two beamformers indicates a sub-optimal condition for the directional noise reduction system. A fading between omni-directional and directional mode may be implemented for values of the difference between a first and second threshold values. The first threshold value may be lower than the second threshold value. The threshold values may be frequency dependent, e.g. different in different frequency sub-bands. Preferably, the difference between the two directional signals is only updated in presence of the user's voice. The user's voice may be detected by use of a voice activity detector. The sound capture device may e.g. be embodied in a microphone unit, e.g. adapted to communicate with another device, e.g. a hearing aid. The sound capture device may e.g. be embodied in a hearing device, e.g. a hearing aid.
(32) FIG. 3 shows a first embodiment of an input stage of a sound capture device, e.g. a microphone unit, or a hearing device, according to the present disclosure. The magnitude, signals |ref| and |TC|, (cf. units ‘abs’, or squared-magnitude) of the reference beamformer (cf. ‘OMNI-BF’, signal ref) and the target voice cancelling beamformer (cf. TC-BF), signal TC, respectively, are averaged (e.g. by smoothing across time frames using a first order low-pass filter (cf. respective units ‘LP’)) in order to obtain stable estimates, cf. signals <|ref|> and <|TC|>, respectively, and hereby avoiding a fluctuating decision. Preferably, the smoothing only takes place, when the user's voice is detected. The voice may be detected by use of a voice activity detector (cf. ‘VAD’), e.g. a modulation-based voice activity detector. The smoothed magnitudes of the reference beamformer (cf. ‘OMNI-BF’) and the target voice cancelling beamformer (cf. TC-BF) are converted to the logarithmic domain (cf. units ‘log’), cf. signals log(<|ref|>) and log(<|TC|>), respectively. The difference found in separate frequency channels (cf SUM-unit ‘+’ in FIG. 3) are combined onto a joint decision across frequency (cf block ‘COMB-F’). The combination unit (COMB-F) may e.g. be implemented by a weighted sum or by logistic regression or by a neural network. The weights may be estimated based on supervised learning. Alternatively, the combination function may be tuned manually. When the estimated difference between the reference directional signal and the target voice cancelling signal is high, it indicates that the benefit of directional noise reduction is high, and the microphone unit (MICU) should switch to directional noise reduction. Otherwise, if the difference is small (e.g. smaller than 3 dB or smaller than 6 dB or smaller than 9 dB) the potential benefit of directional noise reduction is limited, and the microphone unit should switch into an omni-directional mode. The directional mode may be adaptive or fixed. The decision (cf. block ‘Decision’) may be a smooth transition between the different directional modes (cf. insert in FIG. 3, illustrating a smooth transition from ‘omni’ to ‘directional’ mode (represented by signal M-CTR) with increasing difference between the omni- and target-cancelling beamformers (represented by signal COMP)). Alternatively, the decision may be a binary transition between directional and omni-directional. Hysteresis may be built into the decision. In addition to solely switching between the directional and the omni-directional mode, also the frequency shaping of the audio signal may be altered based on the detected mode. The output of the mode detector (MODE-DET), here the decision block (Decision), is mode control signal M-CTR.
(33) Another embodiment of an input stage of sound capture device according to the present disclosure is illustrated in FIG. 4. The input unit (IU) providing electric input signals (X.sub.1, X.sub.2) and beamformer unit (F-BF) providing fixed beamformers in the form of reference beamformer (ref) and a target cancelling beamformer (TC) of the embodiment of FIG. 4 is equivalent to the embodiment of FIG. 3. However, contrary to considering the difference between the reference beampattern (ref) and the target voice beampattern (TC) as shown in the embodiment of FIG. 3, the embodiment of FIG. 4 provides a normalized correlation coefficient β between the two directional signals
(34)
(35) (cf. blocks ‘TC*ref’ and ‘|TC|.sup.2’ providing the same signals, and low pass filters LP (controlled by the voice activity detector VAD) providing smoothed versions (<TC*ref> and <|TC|.sup.2>) of these signals, and finally combination unit (division unit ÷) providing β. This coefficient may as well be applied as adaptive coefficient in an adaptive beamformer, see e.g. [Elko and Pong; 1995] or EP3588981A1, or EP3253075A1. In situations, where the target voice is dominant (and the target cancelling beamformer is able to cancel the target signal), the value of β will increase. We may thus detect the situation of user's own voice if β frequently has a high value (own voice detection). We may thus apply directional processing, if a high value of β occurs frequently. Preferably, β is only updated if voice activity is detected, cf. VAD-unit in FIG. 4 (For other applications, such as noise reduction, β may instead be averaged based on absence of voice). As β may be calculated across frequency channels, the values should be combined into a single decision across frequency (cf. units ‘COMB-F’ and ‘Decision’). The decision (cf. block ‘Decision’) may be a smooth transition between the different directional modes (cf. insert in FIG. 4, illustrating a smooth transition from ‘omni’ to ‘directional’ mode (represented by mode control signal M-CTR) with increasing absolute value of the parameter β (cf. |β| on the horizontal axis of the graph)). As in the embodiment of FIG. 3, the decision may be a binary transition between directional and omni-directional. Hysteresis may be built into the decision. In addition to solely switching between the directional and the omni-directional mode, also the frequency shaping of the audio signal may be altered based on the detected mode. The output of the mode detector (MODE-DET), here the decision block (Decision), is the mode control signal M-CTR. As in the embodiment of FIG. 3, the combination unit (COMB-F) (and/or the decision unit (‘Decision’)) may e.g. be implemented by a weighted sum or by logistic regression or by a neural network. The weights may be estimated based on supervised learning or by manual tuning.
(36) Different own voice-cancelling beamformer candidates (e.g. based on predetermined beamformer weights, e.g. stored in a memory) may be provided in the embodiments described in relation to FIG. 3 and FIG. 4. The advantage of having a multitude (e.g. a few) of own voice beamformer candidates in parallel is that it becomes possible to cover a range of mouth-to-sound device distances, as the optimal own voice cancelling beamformer is distance dependent. Possible own voice candidate beamformers could e.g. cover a range of 10-30 cm from the mouth. The beamformer having the deepest null may be selected at a given point in time.
(37) A joint decision across different frequency bands may be obtained by combining the differences (or parameter f) across frequency. The decision may be based on a trained neural network. The block ‘COMB-F’ or the block ‘Decision’ may be implemented by a trained neural network. The result of the decision in the ‘Decision’ block is the mode control signal (M-CTR), which may be provided as an output ‘vector’ of a trained neural network, where the input vector is the combined (frequency dependent) signals of the respective comparison units (‘+’ in FIG. 3 and ‘÷’ in FIG. 4). In FIG. 3, the output of the comparison unit (+) and inputs to the ‘Combination across frequency’ unit (COMB-F) is log<|ref(k,l)|>−log<|TC(k,l)|>. In FIG. 4 outputs of the comparison unit (+) and inputs to the ‘Combination across frequency’ unit (COMB-F) is β(k,l), k and l being frequency and time-frame indices, respectively.
(38) As the user (MICU-W) is only wearing but not listening to the sound capture device, when e.g. implemented as a microphone unit (MICU), an indication of the directional quality and/or how well the sound capture device is mounted may be desirable. An indication could e.g. be provided via a visual indicator, e.g. an LED or a display with information, or a haptic indicator, e.g. a vibrator, or an acoustic indicator. This is shown in FIG. 5A, 5B (which illustrate the same scenarios as FIGS. 1A and 1B, respectively). The indication could be based on the directional mode estimated by the pre-mentioned detectors. Alternatively, the indication could be based on an orientation sensor such as an accelerometer or a magnetometer. FIGS. 5A and 5B shows an embodiment of a sound capture device (MICU) according to the present disclosure comprising a light indicator (LED) for indicating a correct (optimal) (FIG. 5A) and an incorrect (non-optimal) (FIG. 5B) location/orientation of the unit on the wearer (MICU-W). The detected directional quality or an orientation of the sound capture device may e.g. be conveyed to the user via a change in colour e.g. from green to red (e.g. via yellow as an intermediate level) or via a constant to blinking pattern, etc.
(39) FIGS. 6 and 7 illustrate respective embodiments of adaptive beamformer configurations that may be used to implement an own voice beamformer for use in a sound capture device according to the present disclosure. FIGS. 6 and 7 both show a two-microphone configuration, which is frequently used in state of the art hearing devices, e.g. hearing aids (or other sound capture devices). The beamformers may however be based on more than two microphones, e.g. on three or more (e.g. as a linear array or possibly arranged in a non-linear configuration). An adaptive beampattern (Y(k)), for a given frequency band k, is obtained by linearly combining two beamformers C.sub.1(k) and C.sub.2(k). C.sub.1(k) and C.sub.2(k) (time indices have been skipped for simplicity), each representing different (possibly fixed) linear combinations of first and second electric input signals X.sub.1 and X.sub.2, from first and second microphones M1 and M2, respectively. The first and second electric input signals X.sub.1 and X.sub.2 are provided by respective analysis filter banks (‘Filterbank’). The frequency domain signals (downstream of the respective analysis filter banks (‘Filterbank’) are indicated with bold arrows, whereas the time domain nature of the outputs of the first and second microphones (M1, M2) are indicated as thin line arrows. The block ‘F-BF’ in FIGS. 3 and 4 providing fixed beamformers ‘ref’ and ‘TC’ is equivalent to the block ‘F-BF’ indicated by solid rectangular enclosure in FIGS. 6 and 7. Signals ref and TC of FIGS. 3 and 4 are equal to signals C.sub.1(k) and C.sub.2(k), respectively, of FIG. 6. In another embodiment, signals ‘ref’ and ‘TC’ of FIGS. 3 and 4 may be equal to signals C.sub.1(k) and C.sub.2(k), respectively, of FIG. 7.
(40) FIG. 6 shows an adaptive beamformer configuration, wherein the adaptive beamformer in the k'th frequency sub-band Y(k) is created by subtracting a (e.g. fixed) target cancelling beamformer C2(k) scaled by the adaptation factor β(k) from an (e.g. fixed) omni-directional beamformer C1(k). The adaptation factor β may e.g. be determined as
(41)
(42) The two beamformers C.sub.1 and C.sub.2 of FIG. 6 are e.g. orthogonal. This is actually not necessarily the case, though. The beamformers of FIG. 7 are not orthogonal. When the beamformers C.sub.1 and C.sub.2 are orthogonal, uncorrelated noise will be attenuated when β=0.
(43) Whereas the (reference) beampattern C.sub.1(k) in FIG. 6 is an omni-directional beampattern (cf. e.g. FIG. 2A), the (reference) beampattern C.sub.1(k) in FIG. 7 is a beamformer with a null towards the opposite direction of that of C.sub.2(k) (cf. e.g. FIG. 2D). Other sets of fixed beampatterns C.sub.1(k) and C.sub.2(k) may as well be used.
(44) FIG. 7 shows an adaptive beamformer configuration similar to the one shown in FIG. 6, where the adaptive beampattern Y(k) is created by subtracting a target cancelling beamformer C.sub.2(k) scaled by the adaptation factor β(k) from another fixed beampattern C.sub.1(k). This set of beamformers are not orthogonal. In case that C.sub.2 in FIGS. 6 and 7 represents an own voice-cancelling beamformer, β will increase, when own voice is present.
(45) The beampatterns could e.g. be the combination of an omni-directional delay-and-sum-beamformer C.sub.1(k) and a delay-and-subtract-beamformer C.sub.2(k) with its null direction pointing towards the target direction (e.g. the mouth of the person wearing the device, i.e. a target-cancelling beamformer) as shown in FIG. 6 or it could be two delay-and-subtract-beamformers as shown in FIG. 7, where one, C.sub.1(k), has maximum gain towards the target direction, and the other beamformer, C.sub.2(k), is a target-cancelling beamformer. Other combinations of beamformers may as well be applied. Preferably, the beamformers should be orthogonal, i.e. [w.sub.11 w.sub.12][w.sub.21w.sub.22].sup.H=0. The adaptive beampattern arises by scaling the target cancelling beamformer C.sub.2(k) by a complex-valued, frequency-dependent, e.g. adaptively updated scaling factor β(k) and subtracting it from the C.sub.1(k), i.e.
Y(k)=C.sub.1(k)−β(k)C.sub.2(k)=w.sub.1.sup.H(k)x(k)−β(k)w.sub.2.sup.H(k)x(k).
(46) Where w.sub.1.sup.H=[w.sub.11, w.sub.12], w.sub.2.sup.H=[w.sub.21, w.sub.22] are complex beamformer weights according to FIG. 6 or FIG. 7 and x=[x.sub.1, x.sub.2].sup.T is the input signals at the two microphones (after filter bank processing).
(47) In the context of FIGS. 6 and 7, the fixed reference beamformer, ref, of FIGS. 3 and 4 is thus equal to C.sub.1=w.sub.1.sup.H(k)x(k), and the fixed target-cancelling beamformer, TC, is equal to C.sub.2=w.sub.2.sup.H(k)x(k), where w.sub.1.sup.H=[w.sub.11, w.sub.12], and w.sub.2.sup.H=[w.sub.21, w.sub.22] are complex beamformer weights, e.g. predetermined and stored in a memory (or occasionally updated during use), and x=[x.sub.1, x.sub.2].sup.T represent the (current) electric input signals at the two microphones (after filter bank processing).
(48) FIG. 8 shows an embodiment of a hearing device according to the present disclosure comprising a BTE-part as well as an ITE-part. FIG. 8 shows an embodiment of a hearing device according to the present disclosure comprising at least two input transducers, e.g. microphones, located in a BTE-part and/or in an ITE-part. The hearing device (HD) of FIG. 8, e.g. a hearing aid, comprises a BTE-part (BTE) adapted for being located at or behind an ear of a user and an ITE-part (ITE) adapted for being located in or at an ear canal of a user's ear. The BTE-part and the ITE-part are connected (e.g. electrically connected) by a connecting element (IC) and internal wiring in the ITE- and BTE-parts (cf. e.g. schematically illustrated as wiring Wx in the BTE-part). The BTE- and ITE-parts may each comprise an input transducer, e.g. a microphone (M.sub.BTE and M.sub.ITE), respectively, which are used to pick up sounds from the environment of a user wearing the hearing device, and—in certain modes of operation—to pick up the voice of the user. The ITE-part may comprise a mould intended to allow a relatively large sound pressure level to be delivered to the ear drum of the user (e.g. a user having a severe-to-profound hearing loss). An output transducer, e.g. a loudspeaker, may be located in the BTE-part and the connecting element (IC) may comprise a tube for acoustically propagating sound to an ear mould and through the ear mould to the eardrum of the user.
(49) The hearing device (HD) comprises an input unit comprising two or more input transducers (e.g. microphones) (each for providing an electric input audio signal representative of an input sound signal). The input unit further comprises two (e.g. individually selectable) wireless receivers (WLR.sub.1, WLR.sub.2) for providing respective directly received auxiliary audio input and/or control or information signals. The BTE-part comprises a substrate SUB whereon a number of electronic components (MEM, FE, DSP) are mounted. The BTE-part comprises a configurable signal processor (DSP) and memory (MEM) accessible therefrom. In an embodiment, the signal processor (DSP) form part of an integrated circuit, e.g. a (mainly) digital integrated circuit, whereas the front-end chip (FE) comprises mainly analogue circuitry and/or mixed analogue digital circuitry (including interfaces to microphones and loudspeaker).
(50) The hearing device (HD) comprises an output transducer (SPK) providing an enhanced output signal as stimuli perceivable by the user as sound based on an enhanced audio signal from the signal processor (DSP) or a signal derived therefrom. Alternatively or additionally, the enhanced audio signal from the signal processor (DSP) may be further processed and/or transmitted to another device depending on the specific application scenario.
(51) In the embodiment of a hearing device in FIG. 8, the ITE part comprises the output unit in the form of a loudspeaker (sometimes termed ‘receiver’) (SPK) for converting an electric signal to an acoustic signal. The ITE-part of the embodiments of FIG. 8 also comprises input transducer (M.sub.ITE, e.g. a microphone) for picking up a sound from the environment. The input transducer (M.sub.ITE) may—depending on the acoustic environment—pick up more or less sound from the output transducer (SPK) (unintentional acoustic feedback). The ITE-part further comprises a guiding element, e.g. a dome or mould or micro-mould (DO) for guiding and positioning the ITE-part in the ear canal (Ear canal) of the user.
(52) In the scenario of FIG. 8, a (far-field) (target) sound source S is propagated (and mixed with other sounds of the environment) to respective sound fields at the BTE microphone (M.sub.BTE) of the BTE-part S.sub.ITE at the ITE microphone (M.sub.ITE) of the ITE-part, and S.sub.ED at the ear drum (Ear drum)
(53) The hearing devices (HD) exemplified in FIG. 8 represent a portable device and further comprises a battery (BAT), e.g. a rechargeable battery, for energizing electronic components of the BTE- and ITE-parts. The hearing device of FIG. 8 may in various embodiments implement an own voice detector (OVD) according to the present disclosure (cf. e.g. FIG. 9). The own voice detector may e.g. be used in connection with a telephone mode, and/or in connection with a voice control interface, cf. e.g. FIG. 10, 11.
(54) In an embodiment, the hearing device (HD), e.g. a hearing aid (e.g. the processor (DSP)), is adapted to provide a frequency dependent gain and/or a level dependent compression and/or a transposition (with or without frequency compression) of one or frequency ranges to one or more other frequency ranges, e.g. to compensate for a hearing impairment of a user.
(55) The hearing device of FIG. 8 contains two input transducers (M.sub.BTE and M.sub.ITE), e.g. microphones, one (M.sub.ITE, in the ITE-part) is located in or at the ear canal of a user and the other (M.sub.BTE, in the BTE-part) is located elsewhere at the ear of the user (e.g. behind the ear (pinna) of the user), when the hearing device is operationally mounted on the head of the user. In the embodiment of FIG. 8, the hearing device may be configured to provide that the two input transducers (M.sub.BTE and M.sub.ITE) are located along a substantially horizontal line (OL) when the hearing device is mounted at the ear of the user in a normal, operational state (cf. e.g. input transducers M.sub.BTE, M.sub.ITE and double arrowed, dashed line OL in FIG. 8). This has the advantage of facilitating beamforming of the electric input signals from the input transducers in an appropriate (horizontal) direction, e.g. in the ‘look direction’ of the user (e.g. towards a target sound source). The microphones may alternatively be located so that their axis points towards the user's mouth. Or, a further microphone may be included to provide such microphone axis together with one of the other microphones, to thereby improve the pick-up of the wearer's voice.
(56) FIG. 9 shows an embodiment of an input stage of a sound capture device, e.g. a hearing device comprising an own voice detector (OVD) according to the present disclosure. The own voice detector (OVD) is configured to provide an own voice control signal (OV) indicative of whether or not, or with what probability, a given electric input signal (X.sub.1, X.sub.2), or a processed version thereof, originates from the voice of a user wearing the device (e.g. a sound capture device or a hearing device, e.g. a hearing aid) comprising the own voice detector. The own voice detector is configured to receive a multitude M of electric input signals (X.sub.m, m=1, . . . , M, here M=2, X.sub.1, X.sub.2) provided in a time-frequency representation (k,l), where k and l are frequency and time frame indices, respectively. The own voice detector (OVD) comprises a beamformer unit operationally coupled to a multitude of input transducers IT.sub.m, m=1, . . . , M, here microphones (M1, M2) providing the multitude of electric input signals (X.sub.1, X.sub.2). The beamformer unit (F-BF) comprises at least two fixed beamformers including a target maintaining beamformer (‘OMNI-REF’, termed the ‘reference beamformer’) configured to leave signal components from a fixed target direction un-attenuated or less attenuated relative to signal components from other directions, and providing a current reference signal (ref). The beamformer unit (F-BF) further comprises a target cancelling beamformer (TC-BF) configured to attenuate signal components from the target direction, whereas signal components from other directions are attenuated less relative to signal components from the target direction, and providing a current target cancelling signal (TC). The fixed target direction is e.g. a direction from the hearing aid (e.g. the hearing aid microphones) towards the user's mouth and the target signal is the user's own voice. The fixed beamformers (ref, TC) are e.g. the fixed beamformers discussed in connection with FIGS. 6 and 7 based on respective sets of frequency dependent beamformer weights (w.sub.11, w.sub.12, w.sub.21, w.sub.22), e.g. stored in a memory. The own voice detector (OVD) further comprises a controller (OVD-PRO) for determining the own voice control signal (OV) in dependence of the current reference signal (ref) and the current target cancelling signal (TC). The controller (OVD-PRO) comprises respective signal paths of the reference beamformer signal (ref) and the target voice cancelling beamformer signal (TC), each signal path comprising blocks ‘abs, ‘LP, and ‘log’ to provide signals log(<|ref|>) and log(<|TC|>), respectively, and summation unit (‘+’) for providing a resulting difference (in a frequency sub-band representation) between the two signals (log(<|ref|>)−log(<|TC|>)), as described for the embodiment of a mode detector (MODE-DET) in connection with FIG. 3. As in FIG. 3, the smoothing provided by the low pass filters (LP) are preferably only performed when the user's voice is detected (the optional feature is indicated by the dashed outline of the VAD and the VAD control signals t the LP-unit. The difference found in separate frequency channels (cf. SUM-unit ‘+’ in FIG. 9) are (as also described in connection with FIG. 3) combined onto a joint decision across frequency (cf. blocks ‘COMB-F’ and ‘Decision’) in substantially the same way (large difference=>high probability of own-voice presence, small difference=>small probability of own-voice presence). Again, the blocks ‘COMB-F’ and/or ‘Decision’ may be implemented as logic blocks or as a trained neural network.
(57) FIG. 10 shows a voice control interface (VCI), e.g. for a sound capture device, e.g. a microphone unit, or a hearing device, such as a hearing aid. The voice control interface (VCI) is connected to an own voice detector (OVD) according to the present disclosure (as e.g. shown in FIG. 9). The voice control interface (VCI) of FIG. 10 comprises a keyword spotting system configured to detect whether or not, or with what probability, a particular keyword KWx (x=1, . . . , Q) is present in a current audio stream (here signal Y, e.g. from own voice beamformer Y of FIG. 6 or 7) presented to the keyword spotting system. In the embodiment of FIG. 10, the keyword spotting system comprises a keyword detector (KWD) that is split into first and second parts (KWDa, KWDb). The first part of the keyword detector (KWDa) comprises a wake-word detector (WWD), denoted KWDa (WWD) for detecting a specific wake-word (KW1) of the voice control interface (VCI) of the device in question, e.g. a hearing device (to thereby save power). The second part of the keyword detector (KWDb) is configured to detect the rest of the limited number of keywords (KWx, x=2, . . . , Q). The voice interface of the hearing device is configured to be activated by the specific wake-word spoken by the user wearing the hearing device. The activation of the second part of the keyword detector (KWDb) is in the embodiment of FIG. 10 made dependent of the own voice indicator (OV) from the own voice detector (OVD), in dependence of electric input signals X.sub.1, X.sub.2, as well as the detection of the wake-word (KW1) by the first part of the keyword detector (KWDa) (the wake-word detector). The voice control interface (VCI) comprises a memory (MEM) for storing a current time segment of the input audio stream (Y) thereby allowing to detect a period of own voice absence in the own voice indicator (OV), before a wake word (or other keyword) is detected by the keyword detector. The first and/or the second parts of the keyword detector may be implemented as respective (trained) neural networks, whose weights are determined in advance of use (or during a training session, while using the device in question, e.g. a hearing device) and applied to respective networks. The voice control interface may be configured to control functionality of the device it forms part of, e.g. a hearing device. The keywords detectable by the keyword detector may comprise command words configured to control functionality of the device, e.g. mode shift, volume control, program shift, telephone call control, directionality, etc. The voice control interface (VCI) comprises a voice control interface controller (VC-PRO) for converting identified keywords (KWx) by the keyword detector (KWDb) to corresponding control signal(s) HA.sub.ctr for controlling functionality of the device it forms part of, here e.g. a hearing aid as described in FIG. 11.
(58) FIG. 11 shows a block diagram of a hearing device (HD), e.g. a hearing aid, configured to be worn by a user, and optionally to compensate for a hearing impairment of the user. The hearing aid (HD) comprises an own voice detector (OVD) according to the present disclosure, as e.g. described in connection with FIG. 9. The own voice detector (OVD) provides an own voice control signal (OV) indicative of whether or not, or with what probability, a given electric input signal (X.sub.1, X.sub.2), or a processed version thereof, originates from the voice of the user. The hearing aid comprises an input unit (IU) comprising first and second microphones (M1, M2) adapted to provide (time domain, e.g. digitized) electric input signals (x.sub.1, x.sub.2), respectively. The hearing device comprises respective analysis filter banks (FB-A) for providing the first and second electric input signals (x.sub.1, x.sub.2) in a time-frequency representation (X.sub.1, X.sub.2). The (time-frequency domain) first and second electric input signals (X.sub.1, X.sub.2) are fed to an own voice beamformer (OV-BF) providing an estimate of the user's own voice (Y), e.g. as described in connection with FIG. 6, 7. In the embodiment of FIG. 11, the own voice detector (OVD) is partitioned to share the provision of beamformer signals (ref and TC) with the own voice beamformer (OV-BF). The reference (target maintaining) and target-cancelling beamformer signals (ref and TC, respectively) are fed to (own voice detection) controller (OVD-PRO) for determining the own voice control signal (OV) in dependence of the current reference signal (ref) and the current target cancelling signal (TC) as described in connection with FIG. 9. The estimate of the user's own voice (Y) from the own-voice beamformer (OV-BF) and the corresponding own-voice indicator from the own voice detector (here OVD-PRO) are fed to the voice interface (VCI), as e.g. described in FIG. 10, for providing a control signal HA.sub.ctr for controlling functionality of the hearing aid. The hearing aid comprises a forward (signal) path from input unit (IU) to output unit (OU). The forward path comprises respective analysis filter banks (FB-A) providing respective electric input signals (X.sub.1, X.sub.2) in a time-frequency representation as described above. The electric input signals (X.sub.1, X.sub.2) are fed to a (far-field) beamformer unit (FF-BF) for providing a beamformed signal Y.sub.BF representing (spatially filtered) sound from the environment (e.g. sound from a communication partner). The forward path further comprises a signal processor (HA-PRO) for applying one or more processing algorithms to the beamformed signal Y.sub.BF. The one or more processing algorithms may e.g. comprise a compressive amplification algorithm for compensating for a hearing impairment of the user (by applying a frequency and level dependent gain to a signal of the forward path, e.g. the beamformed signal Y.sub.BF). The signal processor (HA-PRO), e.g. the one or more processing algorithms, may e.g. be controlled via control signal HA.sub.ctr from the voice control interface (VCI). The signal processor (HA-PRO) provides a processed signal OUT to a synthesis filter bank (FB-S) that converts the time-frequency domain signal OUT to a time domain signal out that is fed to the output unit (OU). The output unit may comprise appropriate digital to analogue converter functionality and an output transducer, e.g. in the form of a loudspeaker of an air conduction type hearing aid and/or a vibrator of a bone-conduction type hearing aid. The output unit may also or alternatively comprise an electrode array of a cochlear implant type hearing aid for electrically stimulating the cochlear nerve, in which case the synthesis filter bank may be dispensed with.
(59) FIG. 12 shows a sound capture device (SCD), e.g. a microphone unit, adapted to—in a first use case—be worn by a person and to pick up a voice of the person (‘the wearer’), and optionally—in a second use case—to be located on a surface, e.g. a table, and in that mode to pick up sound from the environment (e.g. from persons speaking). The sound capture device (SCD) comprises a mode detector (MODE-DET) according to the present disclosure, as described in connection with FIG. 3, 4. The mode detector (MODE-DET) provides mode control signal (MCTR) in dependence of respective reference (ref) and target cancelling (TC) beamformer signals at a given point in time (cf. FIG. 3, 4). The input stage of the sound capture device (SCD) comprises input unit (IU) comprising first and second microphones (M1, M2) adapted to provide (time domain, e.g. digitized) electric input signals (x.sub.1, x.sub.2), respectively, and respective analysis filter banks (FB-A) for providing the first and second electric input signals (x.sub.1, x.sub.2) in a time-frequency representation (X.sub.1, X.sub.2). The (time-frequency domain) first and second electric input signals (X.sub.1, X.sub.2) are fed to a configurable noise reduction system (CONF-BF) for providing a configurable output signal (Y.sub.x) in dependence of the mode control signal (M-CTR). In the first use case, where the sound capture device (SCD) is worn by a person, the noise reduction system (CONF-BF) is configured to provide an estimate (Y.sub.x) of the user's own voice, e.g. as described in connection with FIG. 6, 7, when the mode control signal (M-CTR) indicates a good match between the microphone direction of the microphones of the input unit with the direction to the wearer's mouth (M-DIR and OV-DIR, respectively, in FIG. 1A, 2A, 2D). In the first use case, when the mode control signal (M-CTR) indicates a poor match between the microphone direction (M-DIR) of the microphones of the input unit with the direction to the wearer's mouth (OV-DIR) (cf. FIG. 1B, 2B), the noise reduction system (CONF-BF) is configured to provide an omni-directional signal (e.g. from one of the microphones, e.g. from M1 (or from the target maintaining beamformer (signal ‘ref’)). In the second use case, where the sound capture device (SCD) is located on a carrier, e.g. a table, the same functionality of the directional noise reduction system (CONF-BF) is provided in dependence of the mode control signal (M-CTR). In the second use case, however, the ‘directional mode’ is only fulfilled for a person located along the microphone axis (M-DIR) of the sound capture device (SCD). In case that only one person is intended to be listened to, the sound capture device (SCD) may preferably be located so that the microphone axis points towards that person. Otherwise, the directional noise reduction system (CONF-BF) will be in an omni-directional mode providing signal Y.sub.x as an omni-directional signal. The sound capture device (SCD) further comprises a synthesis filter bank (FB-S) for converting time-frequency signal Y.sub.x(k,l) to a time-domain signal Y.sub.x(n), where k, l and n are frequency (k) and time (l, n) indices, respectively. The sound capture device (SCD) further comprises a transmitter (Tx) for (e.g. wirelessly) transmitting signal Y.sub.x(n) representing sound picked up by the sound capture device (SCD) to another device, e.g. a telephone, a PC, hearing aid, or other communication device (cf. indication ‘To other device’).
(60) Free Fall Detection:
(61) As the sound capture device (MICU) may comprise a movement sensor, such as an accelerometer, it is possible to detect the onset of a free fall, which could be caused by the user losing his or her grip on the device. As there is a risk that the sound capture device (MICU) will fall on a hard surface, there is the additional risk that the impact noise produced in the impact with the hard surface, such as the floor, and possible subsequent bouncing of the sound capture device (MICU) on the surface, there is a need to mitigate this risk of loud noise as it may cause a disturbing sound to be produced by the hearing aid output transducer. When the sound capture device (MICU) detects that a free fall has occurred, there are some options to mitigate the possible impact noise. A first option is to mute the input signal, i.e. stop recording the input signal from the microphones and then either transmit signals without any sound information to the hearing aid, or to interrupt transmission of signals to the hearing aid. Another option is to transmit a signal from the sound capture device (MICU) to the hearing aid indicating that a free fall of the sound capture device (MICU) has been detected, and that the sound from the processor to the output transducer is to be muted, or at least dampened, or, even that a special noise cancellation process is to be initiated.
(62) As to the normal operation of the sound from the sound capture device (MICU) being resumed, a timer function may be implemented. The timer may be triggered in either the sound capture device (MICU) and/or in the hearing aid, where after sound may be resumed to the previous level as prior to the onset of the free fall. The resumption may include a gradual increase, such as a ramping-up or fade-in period, where the sound volume is increased from none to operational level, or a predefined level, over a predefined period of time or with a fixed step size. This may allow the user of the sound capture device (MICU) to locate the device again using the sound signal, and to allow the user to regain an understanding of sounds in the surrounding environment. The resumption of the sound transmission may also be offset by a signal from the accelerometer that the sound capture device (MICU) has hit the ground a first time, in which case some sound caused by bouncing of the sound capture device (MICU) could be transmitted to the hearing aid, but with a lower sound level than usual and thereby with less inconvenience to the user.
(63) As not all impact sounds may be annoying to the user, the onset of a free fall could for a first period of time trigger a lowering of the output level, and if the fall continues beyond this first period, the output volume could then be lowered to no output, i.e. a complete mute. This could prevent that all sounds are muted if the device only falls a short distance and the sounds transmitted from the sound capture device are back to normal level faster.
(64) Besides free fall, one could imagine that the sound capture device bounces into something (without a free fall prior to the impact). As there is a small transmission delay, we may as well have a few milliseconds after a high acceleration has been detected (due to the impact) to mute the hearing aid or to stop the transmission of sound from the sound device.
(65) It is intended that the structural features of the devices described above, either in the detailed description and/or in the claims, may be combined with steps of the method, when appropriately substituted by a corresponding process.
(66) As used, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well (i.e. to have the meaning “at least one”), unless expressly stated otherwise. It will be further understood that the terms “includes,” “comprises,” “including,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will also be understood that when an element is referred to as being “connected” or “coupled” to another element, it can be directly connected or coupled to the other element but an intervening element may also be present, unless expressly stated otherwise. Furthermore, “connected” or “coupled” as used herein may include wirelessly connected or coupled. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. The steps of any disclosed method is not limited to the exact order stated herein, unless expressly stated otherwise.
(67) It should be appreciated that reference throughout this specification to “one embodiment” or “an embodiment” or “an aspect” or features included as “may” means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. Furthermore, the particular features, structures or characteristics may be combined as suitable in one or more embodiments of the disclosure. The previous description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects.
(68) The claims are not intended to be limited to the aspects shown herein but are to be accorded the full scope consistent with the language of the claims, wherein reference to an element in the singular is not intended to mean “one and only one” unless specifically so stated, but rather “one or more.” Unless specifically stated otherwise, the term “some” refers to one or more.
(69) Accordingly, the scope should be judged in terms of the claims that follow.
REFERENCES
(70) [Elko & Pong; 1995] Gary W Elko, Anh-Tho Nguyen Pong, “A Simple Adaptive First-Order Differential Microphone”. Published in: Proceedings of 1995 Workshop on Applications of Signal Processing to Audio and Acoustics, IEEE, Print ISBN: 0-7803-3064-1. EP3588981A1 (Oticon) Jan. 1, 2020. EP3253075A1 (Oticon) Jun. 12, 2017.
