MOTION DATA BASED SIGNAL PROCESSING

Abstract

A hearing aid includes an input unit, an output unit, a signal processing unit connected to said input unit and output unit, where the input unit, the signal processing unit and the output unit are forming part of a forward path of the hearing aid, where the signal processing unit is configured to apply a forward gain to the at least one electric input signal or a signal originating therefrom. The hearing aid further includes a feedback control unit configured to reduce a risk of howl due to acoustic, electrical, and/or mechanical feedback of an external feedback path from the output unit to the input unit of said hearing aid, where the hearing aid is configured to receive motion data characterising movement and/or acceleration and/or orientation and/or position of the hearing aid to control processing.

Claims

1. Hearing aid (HA) configured to be worn by a hearing aid user at or in an ear of the hearing aid user or to be fully or partially implanted in the head at an ear of a hearing aid user, the hearing aid comprising: an input unit configured to receive an input sound signal from an environment of a hearing aid user and to provide at least one electric input signal (IN) representing said input sound signal, an output unit configured to provide at least one set of stimuli perceivable as sound to the hearing aid user based on a processed version of said at least one electric input signal (IN), a signal processing unit (SPU) connected to said input unit and output unit, where the input unit, the signal processing unit (SPU) and the output unit are forming part of a forward path of the hearing aid, where the signal processing unit (SPU) being configured to apply a forward gain to the at least one electric input signal or a signal originating therefrom, where the hearing aid (HA) further comprising a feedback control unit configured to reduce a risk of howl due to acoustic, electrical, and/or mechanical feedback of an external feedback path (FBP) from the output unit to the input unit of said hearing aid (HA), where the hearing aid being configured to receive motion data characterising movement and/or acceleration and/or orientation and/or position of the hearing aid, and where the hearing aid being configured to control processing of the feedback control unit based on the received motion data.

2. Hearing aid (HA) according to claim 1, wherein hearing aid further being configured to control processing of the signal processing unit based on the received motion data.

3. Hearing aid (HA) according to claim 1, wherein the hearing aid further comprising a control unit, and where the control unit being configured to control said processing of the feedback control unit and/or of said signal processing unit based on the received motion data.

4. Hearing aid (HA) according to claim 3, wherein the hearing aid and/or the control unit being configured to determine the hearing aid as being in one of a plurality of different modes based on the received motion data.

5. Hearing aid (HA) according to claim 4, wherein the hearing aid being configured to control said processing of the feedback control unit based on said determined mode of the hearing aid.

6. Hearing aid (HA) according to claim 4, wherein the control unit being configured to control said processing of the feedback control unit based on said determined mode of the hearing aid.

7. Hearing aid (HA) according to claim 4, wherein said determination of the hearing aid as being in one of a plurality of different modes is based on a neural network.

8. Hearing aid (HA) according to claim 4, wherein said determination of the hearing aid as being in one of a plurality of different modes comprises determination of the hearing aid as being in one of one or more of the following pluralities of different modes: Head movement mode, Conversation mode, Active mode, Jaw movement mode, and Playing instruments mode.

9. Hearing aid (HA) according to claim 1, wherein the hearing aid further comprising at least one motion detector configured to provide said motion data.

10. Hearing aid (HA) according to claim 1, wherein the feedback control unit comprising a feedback reduction unit (FBRU) configured to modulate said forward gain in time.

11. Hearing aid (HA) according to claim 4, wherein the feedback control unit comprising a feedback cancellation unit comprising an adaptive filter, and where the feedback control unit being configured to increase and/or decrease the adaptation speed of the adaptive filter based on said determined mode.

12. A hearing system comprising left and right hearing aids according to claim 1, where the left and right hearing aids are configured to be worn in or at left and right ears, respectively, of said hearing aid user, and/or to be fully or partially implanted in the head at left and right ears, respectively, of the hearing aid user, and being configured to establish a wired or wireless connection between them allowing data to be exchanged between them.

13. A hearing system according to claim 12, wherein the hearing system further comprising an auxiliary device, and where the hearing system being configured to establish a communication link between the hearing aids and the auxiliary device to provide that information can be exchanged or forwarded from one to the other.

14. A hearing system according to claim 13, wherein the auxiliary device comprises at least one motion detector configured to provide said motion data and/or comprises a control unit configured to control said processing of the feedback control unit and/or of said signal processing unit based on the received motion data.

15. Method of processing an electric signal representing sound, the method comprising: receiving an input sound signal from an environment of a hearing aid user and providing at least one electric input signal (IN) representing said input sound signal, by an input unit, providing at least one set of stimuli perceivable as sound to the hearing aid user based on a processed version of said at least one electric input signal, by an output unit, where a signal processing unit (SPU) is connected to said input unit and output unit, where the input unit, the signal processing unit (SPU) and the output unit are forming part of a forward path of the hearing aid, applying a forward gain to the at least one electric input signal or a signal originating therefrom, by the signal processing unit (SPU) where the hearing aid (HA) further comprising a feedback control unit for reducing a risk of howl due to acoustic, electrical, or mechanical feedback of an external feedback path (FBP) from the output unit to the input unit of said hearing aid, receiving motion data characterising movement and/or acceleration and/or orientation and/or position of the hearing aid, and controlling processing of the feedback control unit based on the received motion data.

16. Hearing aid (HA) according to claim 2, wherein the hearing aid further comprising a control unit, and where the control unit being configured to control said processing of the feedback control unit and/or of said signal processing unit based on the received motion data.

17. Hearing aid (HA) according to claim 5, wherein said determination of the hearing aid as being in one of a plurality of different modes is based on a neural network.

18. Hearing aid (HA) according to claim 6, wherein said determination of the hearing aid as being in one of a plurality of different modes is based on a neural network.

19. Hearing aid (HA) according to claim 5, wherein said determination of the hearing aid as being in one of a plurality of different modes comprises determination of the hearing aid as being in one of one or more of the following pluralities of different modes: Head movement mode, Conversation mode, Active mode, Jaw movement mode, and Playing instruments mode.

20. Hearing aid (HA) according to claim 6, wherein said determination of the hearing aid as being in one of a plurality of different modes comprises determination of the hearing aid as being in one of one or more of the following pluralities of different modes: Head movement mode, Conversation mode, Active mode, Jaw movement mode, and Playing instruments mode.

Description

BRIEF DESCRIPTION OF DRAWINGS

[0244] The aspects of the disclosure may be best understood from the following detailed description taken in conjunction with the accompanying figures. The figures are schematic and simplified for clarity, and they just show details to improve the understanding of the claims, while other details are left out. Throughout, the same reference numerals are used for identical or corresponding parts. The individual features of each aspect may each be combined with any or all features of the other aspects. These and other aspects, features and/or technical effect will be apparent from and elucidated with reference to the illustrations described hereinafter in which:

[0245] FIG. 1 shows an exemplary determination of a hearing aid as being in one of a plurality of different modes.

[0246] FIG. 2 shows an exemplary round-trip loop delay in a hearing aid.

[0247] FIG. 3 shows an exemplary hearing aid comprising a feedback control unit and a motion detector.

[0248] FIG. 4 shows an exemplary hearing aid comprising a feedback control unit and a motion detector.

[0249] FIG. 5 shows an exemplary hearing system comprising a hearing aid and an exemplary auxiliary device comprising a motion detector.

[0250] FIG. 6 shows an exemplary hearing aid comprising a feedback cancellation unit, a feedback reduction unit, a filler signal unit, a control unit, and a motion detector.

[0251] The figures are schematic and simplified for clarity, and they just show details which are essential to the understanding of the disclosure, while other details are left out. Throughout, the same reference signs are used for identical or corresponding parts.

[0252] Further scope of applicability of the present disclosure will become apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the disclosure, are given by way of illustration only. Other embodiments may become apparent to those skilled in the art from the following detailed description.

DETAILED DESCRIPTION OF EMBODIMENTS

[0253] The detailed description set forth below in connection with the appended drawings is intended as a description of various configurations. The detailed description includes specific details for the purpose of providing a thorough understanding of various concepts. However, it will be apparent to those skilled in the all that these concepts may be practiced without these specific details. Several aspects of the apparatus and methods are described by various blocks, functional units, modules, components, circuits, steps, processes, algorithms, etc. (collectively referred to as “elements”). Depending upon particular application, design constraints or other reasons, these elements may be implemented using electronic hardware, computer program, or any combination thereof.

[0254] FIG. 1 shows an exemplary determination of a hearing aid as being in one of a plurality of different modes.

[0255] In FIG. 1, it is illustrated that the determination may be based on motion data (‘motion data’) as input data. The motion data may be detected/measured by a motion detector, which may e.g. be an accelerometer and/or a gyroscope. The motion detector may be arranged/installed in a hearing aid. Alternatively, or additionally, the motion detector may be arranged/installed in an auxiliary device, which may be communicate with the hearing aid (via a wired or wireless connection).

[0256] Additionally, the determination may be based on an input sound signal (‘Sound signal’) from an environment of the hearing aid, and/or e.g. in the form of at least one electric input signal representing said input sound signal.

[0257] Based on the (raw) motion data and possibly the sound signal, a feedback control unit of the hearing aid may detect and/or determine (‘Movement detections’) the type of movements present in the motion data.

[0258] In FIG. 1, it is shown that the movement detection and/or determination may end up with a determination of jaw movements (‘Jaw movements’, e.g. when a hearing aid user is chewing or yawning), body movements (‘Body movements’, e.g. when a hearing aid user is being active by e.g. playing sports), playing instruments (‘playing instruments’, e.g. when a hearing aid user is playing an instrument), head movements (‘Head movements’, e.g. when a hearing aid user is stretching his/her neck by moving the head towards the shoulder(s) or chest), and/or conversation movements (‘Conversation movements’, e.g. when a hearing aid user is having a conversation).

[0259] The movement detection and/or determination from motion data may be based on a trained neural network 1 (e.g. a deep neural network), where the neural network may have been trained prior to initial use of the hearing aid, based on a library of motion data and movements (jaw, body, etc) so that movements of the hearing aid user may be identified in motion data received during use of the hearing aid. The neural network 1 may also be continuously trained e.g. during use or service of the hearing aid.

[0260] Alternatively, a control unit may carry out the movement detection and/or determination from the motion data.

[0261] Based on the detected and/or determined movement, the feedback control unit or the control unit may determine corresponding modes of the feedback control unit and, possibly, of the signal processing unit of the hearing aid. In other words, when jaw movements (‘Jaw movements’) are detected and/or determined, then the feedback control unit and, possibly, of the signal processing unit may be set to a jaw movement mode (‘Jaw movement mode’). Similarly, body movements may result in an active mode (‘Active mode’), playing instruments may result in a playing instruments mode (‘Playing instruments mode’), head movements may result in a head movements mode (‘Head movements mode’), and conversation movements may result in a conversation mode (‘Conversation mode’).

[0262] As shown in FIG. 1, each of the movements may be combined with additional detector signals before a mode is determined. In the case of conversation movements, the determination of mode may also be based on a voice activity detector (‘VAD’) detecting a speech sound signal in the input sound signal. Additionally, the determination may also be based on an OVD detecting a speech signal of the hearing aid user, which would indicate that the hearing aid user is taking part in a conversation.

[0263] Based on the determined mode, the feedback control unit and, possibly, of the signal processing unit may be set according to predetermined settings of the determined mode. For example, in the conversation mode (‘Conversation mode’), the priority could be speech understanding, and the gain/amplification (in the compression unit) in the hearing aid may be high (on target gain), and the beamformer and the noise reduction system may be “aggressive” as they might modify the gain quickly especially if it is a speech in noise situation. Further, the feedback control system may be set to handle feedback challenging situations in terms of high gain and rapid gain changes.

[0264] Also, in FIG. 1, it is shown that additional movements may also be detected and/or determined, and possibly combined with additional detector signals, e.g. from a physiological sensor, to determine an additional mode.

[0265] In case no movement is recognised, or an unknown movement is detected, the feedback control unit and, possibly, of the signal processing unit may be set to predetermined settings defining a standard/normal sound and activity environment.

[0266] FIG. 2 shows an exemplary round-trip loop delay in a hearing aid.

[0267] FIG. 2 shows that the hearing aid (‘HA’) may receive an acoustic input (‘Acoustic input’), which is processed in the forward path (‘Forward Path’) of the hearing aid (‘HA’) and provided as an acoustic output (‘Acoustic output’) to the hearing aid user. A feedback signal may arise via a feedback path (‘Feedback Path’) from the output unit to the input unit. The feedback path (‘Feedback Path’) may define a round-trip loop delay (‘Loop Delay’). A feedback path (‘Feedback Path’) may be present from the output unit (output transducer) to each input unit (input transducer).

[0268] FIG. 3 shows an exemplary hearing aid comprising a feedback control unit and a motion detector.

[0269] In FIG. 3, the hearing aid (‘HA’) is shown to comprise an input unit comprising a first 2 and a second input transducer 3 and an output unit comprising an output transducer 4.

[0270] A feedback path (‘Feedback Path 1’) may be present from the output transducer 4 to the first input transducer 2, and feedback path (‘Feedback Path 2’) may be present from the output transducer 4 to the second input transducer 3.

[0271] In the exemplary hearing aid (‘HA’) of FIG. 3, the hearing aid (‘HA’) is shown to comprise a motion detector (‘Motion detector’). The hearing aid (‘HA’) may further comprise a feedback control unit (‘Feedback control unit’) in an analysis path, and a beamformer (‘Beamformer’), a noise reduction system (‘Noise reduction’), and a compression unit (‘Compression’) in the forward path. The signal processing unit of the hearing aid (‘HA’) may comprise some or all of the beamformer (‘Beamformer’), the noise reduction system (‘Noise reduction’), and the compression unit (‘Compression’) of the forward path.

[0272] As indicated by the dotted arrows, the feedback control unit (‘Feedback control unit’) may receive motion data from the motion detector (‘Motion detector’) and data from the beamformer (‘Beamformer’), the noise reduction system (‘Noise reduction’), and the compression unit (‘Compression’). Based on the received data, the feedback control unit (‘Feedback control unit’) may detect and/or determine the mode of the hearing aid user, and provide a feedback control signal to the electric input signals from the first 2 and second input transducer 3 via first 5 and second combination units 6 (here a summation (subtraction) unit, ‘+’) according to the determined mode.

[0273] FIG. 4 shows an exemplary hearing aid comprising a feedback control unit and a motion detector.

[0274] Compared to the exemplary hearing aid shown in FIG. 3, the exemplary hearing aid (‘HA’) of FIG. 4 further comprises a control unit (‘Control Unit’).

[0275] The control unit (‘Control Unit’) may instead of the feedback control unit (‘Feedback control unit’) receive the motion data from the motion detector (‘Motion detector’) and data from the beamformer (‘Beamformer’), the noise reduction system (‘Noise reduction’), and the compression unit (‘Compression’). The control unit (‘Control Unit’) may also receive data from the feedback control unit (‘Feedback control unit’) e.g. regarding an estimate of the current feedback in the hearing aid.

[0276] Based on the received data, the control unit (‘Control Unit’) may detect and/or determine the mode of the hearing aid user and control the processing of the feedback control unit based on the received motion data (indicated by the two-way dotted arrow) and, possibly, based on the received data from the beamformer (‘Beamformer’), the noise reduction system (‘Noise reduction’), feedback control unit (‘Feedback control unit’), and the compression unit (‘Compression’).

[0277] Based on the determined mode of the hearing aid user, the control unit (‘Control Unit’) may also, possibly, control the processing of the signal processing unit, as indicated by the two-way dotted arrows between the control unit (‘Control Unit’) and each of the beamformer (‘Beamformer’), the noise reduction system (‘Noise reduction’), and the compression unit (‘Compression’).

[0278] FIG. 5 shows an exemplary hearing system comprising a hearing aid and an exemplary auxiliary device comprising a motion detector.

[0279] Compared to the exemplary hearing aid shown in FIG. 4, the exemplary hearing aid (‘HA’) of FIG. 5 does not comprise a motion detector.

[0280] Instead in FIG. 5, the auxiliary device (‘Aux’) comprises a motion detector (‘Motion detector’) configured to provide motion data.

[0281] It is, however, contemplated that the hearing aid (‘HA’) of FIG. 5 also comprises a motion detector.

[0282] The auxiliary device may comprise a remote control, a smartphone, or other portable or wearable electronic device, such as a smartwatch or the like.

[0283] The hearing system may be adapted to establish a communication link 7 (wired or wireless) between the hearing aid (‘HA’) and the auxiliary device (‘Aux’) to provide that information (e.g. control and status signals, possibly audio signals) can be exchanged or forwarded from one to the other. Further, the auxiliary device (‘Aux’) may send the motion data of the motion detector (‘Motion detector’) to the control unit (‘Control unit’) via the communication link 7.

[0284] FIG. 6 shows an exemplary hearing aid comprising a feedback cancellation unit, a feedback reduction unit, a filler signal unit, a control unit, and a motion detector.

[0285] FIG. 6 shows an exemplary hearing aid (HA) comprising a feedback reduction unit (FBRU) in the forward path of the hearing aid as well as a feedback cancellation unit (FEC) comprising a feedback estimation unit (FEE) for estimating the acoustic feedback path (FBP) from the output transducer (OT) to the input transducer (IT). The feedback estimation unit (FBE) may comprise an adaptive filter comprising algorithm (‘Algorithm’) and filter (‘Filter’) units. The forward path may further comprise a combination unit (‘+’).

[0286] Accordingly, in FIG. 6, the feedback control unit of FIGS. 3 to 5 is shown to comprise the feedback reduction unit (FBRU) and the feedback cancellation unit (FBC).

[0287] The input transducer (IT) (of the input unit) may further comprise a microphone (MIC) for converting an input sound (Acoustic input) to an analogue electric input signal and an analogue-to-digital (AD) converter to digitize the analogue electric input signal from the microphone (MIC) with a predefined sampling rate, e.g. 20 kHz, and provide a digitized electric input signal (IN) to the forward path.

[0288] The output transducer (OT) (of the output unit) may comprise a digital-to-analogue (DA) converter to convert a digital signal (OUT) (e.g. of the combination unit (‘+’)) to an analogue electric output signal. Further, the output transducer (OT) may comprise a loudspeaker (SP) configured to present the analogue electric output signal to a hearing aid user as an output sound (Acoustic output).

[0289] The hearing aid (HA) may comprise a filler signal unit (FU) configured to generate a filler signal (FS) and provide it to the modulated resulting signal (RES) of the feedback reduction unit (FBRU) by the combination unit (‘+’). The filler signal (FS) may be provided in one or more second time periods T.sub.L, corresponding to one or more reduced forward gains A.sub.L.

[0290] As also shown in FIG. 4, the hearing aid (‘HA’) may comprise a motion detector (‘Motion detector’) and a control unit (‘Control unit’).

[0291] The control unit (‘Control Unit’) may receive motion data from the motion detector (‘Motion detector’), data from the signal processing unit (‘SPU’), data from the feedback reduction unit (FBRU), and data from the feedback cancellation unit (FBC).

[0292] Based on the received data, the control unit (‘Control Unit’) may detect and/or determine the mode of the hearing aid user and control the processing of the feedback reduction unit (FBRU) and of the feedback cancellation unit (FBC), and control the processing of the signal processing unit (SPU) (indicated by the two-way dotted arrows).

[0293] It is intended that the structural features of the devices described above, either in the detailed description and/or in the claims, may be combined with steps of the method, when appropriately substituted by a corresponding process.

[0294] As used, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well (i.e. to have the meaning “at least one”), unless expressly stated otherwise. It will be further understood that the terms “includes,” “comprises,” “including,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will also be understood that when an element is referred to as being “connected” or “coupled” to another element, it can be directly connected or coupled to the other element but an intervening element may also be present, unless expressly stated otherwise. Furthermore, “connected” or “coupled” as used herein may include wirelessly connected or coupled. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items. The steps of any disclosed method are not limited to the exact order stated herein, unless expressly stated otherwise.

[0295] It should be appreciated that reference throughout this specification to “one embodiment” or “an embodiment” or “an aspect” or features included as “may” means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. Furthermore, the particular features, structures or characteristics may be combined as suitable in one or more embodiments of the disclosure. The previous description is provided to enable any person skilled in the all to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects.

[0296] The claims are not intended to be limited to the aspects shown herein but are to be accorded the full scope consistent with the language of the claims, wherein reference to an element in the singular is not intended to mean “one and only one” unless specifically so stated, but rather “one or more.” Unless specifically stated otherwise, the term “some” refers to one or more.