AUTOMATED SCANNING FOR HEARING AID PARAMETERS
20180007477 · 2018-01-04
Inventors
Cpc classification
H04R2460/07
ELECTRICITY
H04R2225/55
ELECTRICITY
H04R25/30
ELECTRICITY
H04R25/70
ELECTRICITY
H04R25/50
ELECTRICITY
H04R25/554
ELECTRICITY
International classification
Abstract
A hearing aid system is provided that facilitates adjustment of signal processing parameters θ of the hearing aid system with minimum user intervention, wherein the hearing aid system is capable of calculating signal processing parameters θ for evaluation of the user when the user has entered an input, e.g. using a smartwatch, to this effect. The evaluation takes place for a certain time period and in the event that the user has entered a consent input indicating that he or she is pleased with the set θ of signal processing parameters under evaluation, the hearing aid system continues processing with those signal processing parameters; and if the user is not pleased with the signal processing parameters θ under evaluation, the hearing aid system calculates another set {circumflex over (θ)} of signal processing parameters for evaluation of the user.
Claims
1. A hearing aid system comprising: a first hearing aid with a first microphone for provision of a first audio signal in response to sound signals received at the first microphone from a sound environment, a first hearing loss signal processor that is configured to process the first audio signal in accordance with a signal processing algorithm to generate a first hearing loss compensated audio signal for compensation of a hearing loss of a user of the hearing aid system, wherein the signal processing algorithm F is configured to apply a first set of signal processing parameters, a first output transducer for providing a first output signal to a user of the hearing aid system based on the first hearing loss compensated audio signal, and a first interface configured for data communication with one or more other device(s); a user interface; and an adjustment processor that is configured for calculating a second set of signal processing parameters comprising alternate value(s) for one or more of the signal processing parameters in the first set, and controlling the first hearing loss signal processor to process the first audio signal with the signal processing algorithm applying the second set of signal processing parameters for evaluation of the first hearing loss compensated audio signal.
2. The hearing aid system according to claim 1, wherein the adjustment processor is configured to repeat the functions of calculating the second set of the signal processing parameters, and controlling the first hearing loss signal processor to process the first audio signal with the signal processing algorithm applying the second set of the signal processing parameters.
3. The hearing aid system according to claim 2, wherein the adjustment processor is configured to repeat the functions of calculating the second set of the signal processing parameters, and controlling the first hearing loss signal processor, when a predetermined time period has elapsed until a predetermined number of repetitions have been performed.
4. The hearing aid system according to claim 1, wherein the adjustment processor is configured to update a utility model U defined as:
U=ω.sup.Tb wherein b is a K-dimensional set of basis functions, and wherein ω is a K-dimensional vector comprising utility parameters for the utility model.
5. The hearing aid system according to claim 4, wherein the adjustment processor is configured to calculate the second set of the signal processing parameters by Thompson sampling of the second set of signal processing parameters from a preference probability distribution p given by
6. The hearing aid system according to claim 1, wherein the adjustment processor is configured to use Bayes rule to include the most recent response d in a preference probability distribution.
7. The hearing aid system according to claim 6, wherein the preference probability distribution is p(θ|D), and wherein the adjustment processor is configured to use Bayes rule to include the most recent response din the preference probability distribution p(θ|D) by calculation of a posterior distribution ({tilde over (μ)},{tilde over (Σ)}) of utility parameters ω with mean {tilde over (μ)} and covariance matrix {tilde over (Σ)} based on the following:
p(ω|D,d)∝p(d|ω).Math.p(ω|D), wherein D relates to observed data, d indicates user consent or user dissent,
8. The hearing aid system according to claim 7, wherein the adjustment processor is configured to perform a Laplace approximation to obtain a distribution of the utility parameters co by updating (μ,Σ) to ({tilde over (μ)},{tilde over (Σ)}): (μ,Σ) with mean μ and covariance matrix Σ.
9. The hearing aid system according to claim 1, further comprising a wearable device with a data interface that is configured for data communication with the first hearing aid; wherein the user interface that is configured for entry of a dissent input or a consent input by the user.
10. The hearing aid system according to claim 9, wherein the adjustment processor is configured to transmit control signals to the first hearing aid using the data interface for controlling the first hearing loss signal processor to process the first audio signal with the signal processing algorithm applying the second set of the signal processing parameters.
11. The hearing aid system according to claim 1, further comprising a sound environment detector configured for: determining a category of the sound environment surrounding the hearing aid system; wherein the adjustment processor is configured for calculating the second set of the signal processing parameters of the first hearing aid of the hearing aid system based on the category of the sound environment determined by the sound environment detector.
12. The hearing aid system according to claim 1, further comprising a location detector configured for determining a geographical position of the hearing aid system; wherein the adjustment processor is configured for calculating the second set of the signal processing parameters of the first hearing aid of the hearing aid system based the geographical position of the hearing aid system.
13. The hearing aid system according to claim 1, wherein the user interface is configured for allowing the user of the hearing aid system to adjust at least one of the signal processing parameters in the first set; wherein the adjustment processor is configured for recording of the adjustment of the at least one of the signal processing parameters made by the user of the hearing aid system, and incorporating the adjustment made by the user in a preference probability distribution.
14. The hearing aid system according to claim 1, wherein the first hearing loss signal processor comprises the adjustment processor.
15. A method of in-situ fitting of a hearing aid, the hearing aid having a microphone for provision of an audio signal in response to sound signals received at the microphone from a sound environment, a hearing loss signal processor that is configured to process the audio signal in accordance with a signal processing algorithm to generate a first hearing loss compensated audio signal for compensation of a hearing loss of a user of the hearing aid system, the signal processing algorithm configured to apply a first set of signal processing parameters, and a first output transducer for providing a first output signal based on the first hearing loss compensated audio signal, the method comprising: calculating a second set of signal processing parameters having alternate value(s) for one or more of the signal processing parameters in the first set; and controlling the hearing loss signal processor to process the audio signal with the signal processing algorithm applying the second set of the signal processing parameters for evaluation of the first hearing loss compensated audio signal.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0155] The drawings illustrate the design and utility of embodiments, in which similar elements are referred to by common reference numerals. These drawings are not necessarily drawn to scale. In order to better appreciate how the above-recited and other advantages and objects are obtained, a more particular description of the embodiments will be rendered, which are illustrated in the accompanying drawings. These drawings depict only typical embodiments and are not therefore to be considered limiting of its scope.
[0156]
[0157]
[0158]
[0159]
[0160]
DETAILED DESCRIPTION
[0161] Various exemplary embodiments are described hereinafter with reference to the figures. It should be noted that the figures are not drawn to scale and that elements of similar structures or functions are represented by like reference numerals throughout the figures. It should also be noted that the figures are only intended to facilitate the description of the embodiments. They are not intended as an exhaustive description of the claimed invention or as a limitation on the scope of the claimed invention. In addition, an illustrated embodiment needs not have all the aspects or advantages shown. An aspect or an advantage described in conjunction with a particular embodiment is not necessarily limited to that embodiment and can be practiced in any other embodiments even if not so illustrated, or not so explicitly described.
[0162] The hearing aid system will now be described more fully hereinafter with reference to the accompanying drawings, in which various types of the hearing aid system are shown. The hearing aid system may be embodied in different forms not shown in the accompanying drawings and should not be construed as limited to the embodiments and examples set forth herein.
[0163]
[0164]
[0165] The hearing loss compensated output signal is transmitted through electrical wires contained in a sound signal transmission member 20 to a receiver 22 for conversion of the hearing loss compensated output signal to an acoustic output signal for transmission towards the eardrum of a user and contained in an earpiece 24 that is shaped (not shown) to be comfortably positioned in the ear canal of a user for fastening and retaining the sound signal transmission member in its intended position in the ear canal of the user as is well-known in the art of BTE hearing aids.
[0166] The earpiece 24 also holds one microphone 26 that is positioned for abutment of a wall of the ear canal when the earpiece is positioned in its intended position in the ear canal of the user for reception of the user's own voice utilizing bone conduction of the voice to the microphone 26. The microphone 26 is connected to an A/D converter (not shown) and optional to a pre-filter (not shown) in the BTE housing 12, with interconnecting electrical wires (not visible) contained in the sound transmission member 20.
[0167] The BTE hearing aid 12 is powered by battery 28.
[0168] The hearing loss signal processor 18 is adapted for execution of a number of different signal processing algorithms of a library of signal processing algorithms F(θ) stored in a non-volatile memory (not shown) connected to the hearing loss signal processor 18. Each signal processing algorithm F(θ), or a combination of them, is tailored to particular user preferences and particular categories of sound environment. θ is the set of signal processing parameters of the signal processing algorithm F.
[0169] Initial settings of signal processing parameters of the various signal processing algorithms are typically determined during an initial fitting session in a dispenser's office and programmed into the hearing aid by activating desired algorithms and setting algorithm parameters in a non-volatile memory area of the hearing aid and/or transmitting desired algorithms and algorithm parameter settings to the non-volatile memory area. Subsequently, the hearing aid system comprising the hearing aid 12 shown in
[0170] Various functions of the hearing loss signal processor 18 are disclosed above and in more detail below.
[0171]
[0172]
[0173]
[0174] The operation of the illustrated hearing aid system 10 includes the following steps:
[0175] DETECT 100: Whenever the user 30 perceives that the sound 34 output by the hearing aid 12 could or should be improved, the user 30 can initiate a trial by entering a dissent input, e.g. by touching a specific icon on a touch screen of a smartwatch 36 or a smartphone 38, etc.
[0176] TRY 110: After reception of the dissent input, a computational process called the TRY step is executed on the smartwatch 36, wherein the adjustment processor, in this example residing in the smartwatch 36, calculates a set {circumflex over (θ)} of signal processing parameters. Next, the smartwatch 36 sends the set {circumflex over (θ)} of signal processing parameters to the hearing aid device 12.
[0177] EXECUTE 120. The hearing aid device 12 receives the set {circumflex over (θ)} of signal processing parameters and the hearing loss signal processor 18 executes the digital signal processing (DSP) algorithm F(θ) with the set {circumflex over (θ)} of signal processing parameters for provision of the hearing loss compensated output signal 34 based on the audio input signal 32.
[0178] RATE 130. The user 30 now listens to the sound 34 that is generated by the digital signal processing (DSP) algorithm F(θ) with the set {circumflex over (θ)} of signal processing parameters and evaluates the perceived quality of the sound resulting from the change to the set {circumflex over (θ)} of signal processing parameters. In the event that the user 30 decides to continue the scanning process, the user 30 does nothing, i.e. the user 30 does not enter a consent input using the touchscreen of the smartwatch 36 or the smartphone 38. When the user 30 has not entered a consent input for a predetermined time period, which in this example is 5 seconds, this is considered to constitute entry of a dissent input by the hearing aid system 10, and another trial will be performed. In the event that the user 30 perceives the evaluated sound to be of such a quality that the user desires that the hearing loss signal processor 18 continues processing sound with the set {circumflex over (θ)} of signal processing parameters, the user touches a “consent” icon on the touchscreen of the smartwatch 36 or the smartphone 38 thereby entering a consent input.
[0179] Upon receipt of the consent input, no further trials will be performed, until a new dissent input is entered, and the hearing loss signal processor continues operation with the latest set {circumflex over (θ)} of signal processing parameters.
[0180] ADAPT 140. Further, the adjustment processor is adapted to learn from the user preferences input in the form of consent and dissent inputs, i.e. the adjustment processor may base subsequent calculations of sets {circumflex over (θ)} of signal processing parameters on the set of signal processing parameters used by the hearing loss signal processor 18 when a consent input is entered. In this way, a set {circumflex over (θ)} of signal processing parameters accepted for use by the user is reached with a minimum number of trials.
[0181] As explained previously, Bayes rule may be used to include the most recent response d in the preference probability distribution by calculation of:
p(ω|D,d)∝p(d|ω).Math.p(ω|D)
[0182] The posterior Gaussian distribution of the utility parameters, i.e. the Gaussian distribution of the utility parameters after inclusion of the most recent response d, may be parameterized by mean {tilde over (μ)} and covariance matrix {tilde over (Σ)}:
p(ω|D)=(μ,Σ),
[0183] Bayes rule as applied above involves multiplication of a Gaussian distribution with a logistic function, which does not lead analytically to a Gaussian distribution for the resulting posterior distribution p(ω|D,d).
[0184] However, the procedure denoted “Laplace approximation” may be used to create a Gaussian posterior distribution for the utility parameters.
[0185] The Laplace approximation leads to the following update rule for updating (μ,Σ) to ({tilde over (μ)},{tilde over (Σ)}):
wherein
{tilde over (b)}=b(θ.sub.a)−b(θ.sub.r) and
{circumflex over (d)}=g(λω.sup.T{tilde over (b)}).
The update rule may be carried out each time a user response d has been received.
[0186] In the event the user 30 has not entered a consent input after 10 trials, the trials will terminate and the signal processing parameters θ will be reset to the reference values, i.e. their values immediately before entry of the dissent input.
[0187] The hearing aid system 10 also comprises a hand-held device 38, in this example a smartphone, that provides the hearing aid system 10 with a network interface for interconnection of the hearing aid 12 and the smartwatch 36 of the hearing aid system 10 with a network, such as the Internet, e.g. with one or more servers on the Internet, e.g. interconnected as is well-known in the art of computer networks, such as in the art of cloud computing, grid computing, etc., whereby computing resources and database resources may be made available to the hearing aid system.
[0188] For example, the adjustment processor may be adapted to use computing resources and information stored in the cloud for its calculation of sets {circumflex over (θ)} of signal processing parameters.
[0189] For example, in the illustrated hearing aid system 10, a remote server (not shown) connected to the Internet may have access to a preference probability distribution (not shown) based on determined preference probability distributions of a plurality of users of a plurality of the hearing aid systems 10, and the adjustment processor may be adapted for calculating set {circumflex over (θ)} of signal processing parameters of the first hearing aid 12 based on the determined preference probability distribution of the user of the hearing aid system 10 and the preference probability distributions of the plurality of users.
[0190] The preference probability distribution may include at least one user parameter selected from the group consisting of the user audiogram, age, sex, race, height, and native language.
[0191] The preference probability distribution may include a hearing loss model, e.g. one of the hearing loss models mentioned in EP 2 871 858 A1.
[0192] The preference probability distribution may include various sound environment categories so that signal processing parameters determined based on the preference probability distribution may vary for different sound environment categories.
[0193] The illustrated hearing aid system 10 may have a sound environment detector 52 adapted for determination of the sound environment surrounding the hearing aid system 10 based on sound signals received by the hearing aid system 10, e.g. from one hearing aid 12A, 12B of the respective hearing aid system 10; or, from two hearing aids 12A, 12B of the respective hearing aid system 10. For example, the sound environment detector 52 may determine a category of the sound environment surrounding the respective hearing aid, such as speech, babble speech, restaurant clatter, music, traffic noise, etc.
[0194] The illustrated hearing aid system 10 may have a wearable device, in the illustrated example the smartwatch 36, and/or a hand-held device, in the illustrated example the smartphone 38, that is interconnected with the hearing aid 12 of the hearing aid system 10 and that comprises the sound environment detector 52 that is adapted for determination of the sound environment surrounding the hearing aid 12 in question. The sound environment detector 52 residing in the wearable device 36 and/or the hand-held device 38 benefits from the larger computing resources and power supply typically available in the wearable device 36 and/or hand-held device 38 as compared with the limited computing resources and power available in the hearing aid 12.
[0195]
[0196]
[0197] The hearing aids 12A, 12B may be any type of hearing aid, such as a BTE, a RIE, an ITE, an ITC, a CIC, etc., hearing aid.
[0198] Each of the illustrated hearing aids 12A, 12B comprises a front microphone 14 and a rear microphone 16 connected to respective A/D converters (not shown) for provision of respective digital input signals in response to sound signals received at the microphones 14, 16 in a sound environment surrounding the user of the hearing aid system 10. The digital input signals are input to a hearing loss signal processor 18A, 18B that is adapted to process the digital input signals in accordance with a signal processing algorithm selected from a library of signal processing algorithms F(θ) to generate a hearing loss compensated output signal. The hearing loss compensated output signal is routed to a D/A converter (not shown) and a receiver 22A, 22B for conversion of the hearing loss compensated output signal to an acoustic output signal emitted towards an eardrum of the user.
[0199] The hearing aid system 10 further comprises a wearable or hand-held device, such as a smartwatch 36, a smartphone 38, etc., facilitating data transmission between the hearing aids 12A, 12B and the wearable 36 or hand-held device 38 and possibly remote devices connected to the wearable or hand-held device through the Internet. The illustrated hearing aids 12A, 12B and the wearable 36 or hand-held device 38 are interconnected with, e.g., a Bluetooth Low Energy interface for exchange of sensor data and control signals between the hearing aids 12A, 12B and the wearable 36 or hand-held device 38. The illustrated wearable or hand-held device 36, 38 has a mobile telephone interface 50, such as a GSM-interface, for interconnection with a mobile telephone network and a WiFi interface 50 as is well-known in the art of smartphones. The wearable or hand-held device 36, 38 interconnects with the network 80 and possible remote servers (not shown) through the Internet with the WiFi interface 50 and/or the mobile telephone interface 50 as is well-known in the art of WANs.
[0200] The orientation sensors 44, such as gyroscopes, e.g. MEMS gyros, tilt sensors, roll ball switches, etc., are adapted for outputting signals for determination of orientation of the head of a user wearing the hearing aid 12A, e.g. one or more of head yaw, head pitch, head roll, or combinations hereof, e.g. tilt, i.e. the angular deviation from the heads normal vertical position, when the user is standing up or sitting down. E.g. in a resting position, the tilt of the head of a person standing up or sitting down is 0°, and in a resting position, the tilt of the head of a person lying down is 90°.
[0201] The wearable 36 or hand-held device 38 comprises a sound environment detector 52 for determining the category of the sound environment surrounding the user of the hearing aid system 10. The determining of the sound environment category is based on a sound signal picked up by a microphone 54 in the hand-held device. Based on the determination of the category, the sound environment detector 52 provides an output 56 to the adjustment processor 48 for calculation of sets and
of signal processing parameters appropriate for the sound environment category in question and to be used by the respective first and second hearing loss signal processors 18A, 18B.
[0202] The sound environment detector 52 benefits from the computing resources and power supply typically available in the wearable 36 or hand-held device 38 that are larger than the resources and power supply available in the hearing aid 12A, 12B.
[0203] The sound environment detector 52 may categorize the current sound environment into one of a set of environmental categories, such as speech, babble speech, restaurant clatter, music, traffic noise, etc.
[0204] The adjustment processor 48 transmits a signal processor parameter control signal 58A, 58B to each of the hearing aids 12A, 12B, respectively, with information on the calculated sets and
of signal processing parameters to be used by the respective first and second hearing loss signal processors 18A, 18B when executing their signal processing algorithms F(θ) in response to the signal processor parameter control signal 58A, 58B. Examples of signal processing parameters include: Amount of noise reduction, amount of gain and amount of HF gain, algorithm control parameters controlling whether corresponding signal algorithms are selected for execution or not, corner-frequencies and slopes of filters, compression thresholds and ratios of compressor algorithms, filter coefficients, including adaptive filter coefficients, adaptation rates and probe signal characteristics of adaptive feedback cancellation algorithms, etc.
[0205] The wearable 36 or hand-held device 38 includes a location detector 42 with a GPS receiver adapted for determining the geographical position of the hearing aid system 10. In absence of useful GPS signals, the position of the illustrated hearing aid system 10 may be determined as the address of the WIFI network access point or by triangulation based on signals received from various GSM-transmitters as is well-known in the art of smartphones.
[0206] The wearable 36 or hand-held device 38 may be adapted for transmission of determined sound environment categories and/or geographical positions to the adjustment processor 48 for determination of a signal processing parameter θ.sub.i.sup.n values and/or a signal processing algorithm F appropriate for the determined sound environment category and/or determined geographical position.
[0207] The wearable 36 or hand-held device 38 may be adapted for transmission of determined sound environment categories and/or geographical positions to possible remote server(s) through the WiFi interface 50 and/or the mobile telephone interface 50. The adjustment processor 48 is adapted for recording the determined geographical positions together with the determined categories of the sound environment at the respective geographical positions. Recording may be performed at regular time intervals, and/or with a certain geographical distance between recordings, and/or triggered by certain events, e.g. a shift in category of the sound environment, a change in signal processing, such as a change in signal processing programme, a change in signal processing parameters, a user input entered with the user interface, etc., etc. The recorded data may be included in the preference probability distribution.
[0208] When the hearing aid system 10 is located within an area of geographical positions with recordings of a specific category of the sound environment, the adjustment processor 48 may be adapted for increasing the probability that the current sound environment is of the respective previously recorded category of the sound environment.
[0209] The wearable device 36 or the hand-held device 38 may also be adapted for accessing a calendar system of the user, e.g. through the WiFi interface 50 and/or the mobile telephone interface 50, to obtain information on the whereabouts of the user, e.g. meeting room, office, canteen, restaurant, home, etc., and to include this information in the determining of the category of the sound environment. Information from the calendar system of the user may substitute or supplement information on the geographical position determined by the GPS receiver and transmitted to the at least one server.
[0210] Also, when the user is inside a building, e.g. a high rise building, GPS signals may be absent or so weak that the geographical position cannot be determined by the GPS receiver. Information from the calendar system on the whereabouts of the user may then be used to provide information on the geographical position, or information from the calendar system may supplement information on the geographical position, e.g. indication of a specific meeting room may provide information on the floor in a high rise building. Information on height is typically not available from a GPS receiver.
[0211] Information on the orientation of the head of the user is also transmitted to the adjustment processor 48 to be included in the preference probability distribution and form basis for determination of signal processing parameters and/or algorithms of the hearing aid 12.
[0212] Although particular embodiments have been shown and described, it will be understood that they are not intended to limit the claimed inventions, and it will be obvious to those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the claimed inventions. The specification and drawings are, accordingly, to be regarded in an illustrative rather than restrictive sense. The claimed inventions are intended to cover alternatives, modifications, and equivalents.