ELECTRONIC HEARING DEVICE AND METHOD

Abstract

A method performed by an electronic hearing device with an earpiece configured to be worn in an ear, includes: engaging a hearing mode wherein a compensated output signal is based on current hearing compensation data. Performing a first fitting procedure including: obtaining first hearing compensation data via audiometric measurements; emitting an otoacoustic stimulation signal and capturing an acoustic signal including otoacoustic emissions. In response to receiving a first input signal, performing a first monitoring procedure including: emitting an otoacoustic stimulation signal and capturing an acoustic signal including otoacoustic emissions, if any. Determining a deviation value based on the second acoustic signal and the third acoustic signal; and determining whether the deviation value satisfies a first criterion. In accordance with a determination that the deviation value satisfies the first criterion, communicating a first notification signal indicative of the deviation from the hearing device.

Claims

1. A method performed by a hearing system having a hearing device, the hearing device comprising an acoustic output transducer, a first acoustic input transducer, a second acoustic input transducer, a first wireless communications unit, and a processing unit, the method comprising: obtaining a first acoustic signal by the first acoustic input transducer, and generating a compensated output signal based on the first acoustic signal, wherein the compensated output signal is based on current hearing compensation data; performing a first fitting procedure by: obtaining first hearing compensation data, emitting an otoacoustic stimulation signal via the acoustic output transducer, and obtaining a second acoustic signal by the second acoustic input transducer; and performing a first monitoring procedure by: emitting another otoacoustic stimulation signal via the acoustic output transducer, and obtaining a third acoustic signal by the second acoustic input transducer; determining a deviation value based on the second acoustic signal and the third acoustic signal; and in accordance with the deviation value satisfying a first criterion, outputting a first notification signal.

2. The method according to claim 1, wherein the hearing system also includes an electronic device having a display, an input component, a second wireless communications unit, and a processor.

3. The method according to claim 1, wherein the first monitoring procedure is performed automatically without requiring a user's input.

4. The method according to claim 1, wherein the first monitoring procedure is performed after a determination that the second acoustic signal satisfies a second criterion.

5. The method according to claim 1, further comprising storing data values associated with the first monitoring procedure; wherein the data values include or are stored with a date-time value representing a time of obtaining the third acoustic signal.

6. The method according to claim 1, further comprising performing a second fitting procedure by emitting a further otoacoustic stimulation signal via the acoustic output transducer, and obtaining a fourth acoustic signal by the second acoustic input transducer.

7. The method according to claim 6, wherein the first monitoring procedure is performed after a determination that the fourth acoustic signal exceeds a threshold.

8. The method according to claim 1, after the first fitting procedure is performed, providing a first notification prompting a user to engage the first monitoring procedure, or providing a second notification prompting the user to engage a second monitoring procedure.

9. The method according to claim 1, wherein the first fitting procedure further comprises enabling the first monitoring procedure.

10. The method according to claim 9, wherein the first monitoring procedure is enabled in accordance with a determination that the second acoustic signal exceeds a threshold.

11. The method according to claim 1, wherein the first monitoring procedure is performed after receiving, by the hearing device, an input signal from an electronic device.

12. The method according to claim 1, further comprising: providing the current hearing compensation data for storage as a first selectable item; and providing the first hearing compensation data or second hearing compensation data for storage as a second selectable item; wherein each of the first selectable item and the second selectable item is selectable.

13. The method according to claim 1, further comprising updating the current hearing compensation data based on the third acoustic signal.

14. The method according to claim 1, further comprising performing a second fitting procedure to obtain second hearing compensation data, and updating the current hearing compensation data based on the second hearing compensation data.

15. The method according to claim 1, wherein the third acoustic signal is associated with the other otoacoustic stimulation signal.

16. The method according to claim 1, wherein the first hearing compensation data is based on audiometric measurements.

17. The method according to claim 1, wherein the monitoring procedure is performed in response to an input signal.

18. The method according to claim 1, wherein the hearing system comprises only the hearing device, and the method is performed by the hearing device.

19. A non-transitory processor-readable storage medium comprising one or more programs, the one or more programs including instructions for performing the method of claim 1.

20. A hearing device comprising: an earpiece; an acoustic output transducer; a first acoustic input transducer; a second acoustic input transducer; a wireless communications unit; a processing unit; and a memory storing one or more programs, the one or more programs including instructions which, when executed by the processing unit, cause the method of claim 1 to be performed.

21. A hearing device comprising: an earpiece; an acoustic output transducer; a first acoustic input transducer; a second acoustic input transducer; a wireless communications unit; and a processing unit; wherein the first acoustic input transducer is configured to obtain a first acoustic signal, wherein the hearing device is configured to generate a compensated output signal based on the first acoustic signal, wherein the compensated output signal is based on current hearing compensation data; wherein the hearing device is configured to perform a fitting procedure by: obtaining first hearing compensation data, emitting an otoacoustic stimulation signal via the acoustic output transducer, and obtaining a second acoustic signal by the second acoustic input transducer; and wherein the hearing device is configured to perform a monitoring procedure by: emitting another otoacoustic stimulation signal via the acoustic output transducer, and obtaining a third acoustic signal by the second acoustic input transducer; determining a deviation value based on the second acoustic signal and the third acoustic signal; and in accordance with the deviation value satisfying a criterion, outputting a notification signal.

Description

BRIEF DESCRIPTION OF THE FIGURES

[0099] A more detailed description follows below with reference to the drawing, in which:

[0100] FIG. 1a shows a block diagram of an electronic hearing device, a mobile electronic device, and a server computer; FIG. 1b shows a mobile electronic device with a display; and FIG. 1c shows a block diagram of a mobile electronic device;

[0101] FIG. 2 shows a first flowchart including a fitting procedure and a first monitoring procedure;

[0102] FIG. 3 shows a second flowchart including a second monitoring procedure;

[0103] FIGS. 4a and 4b show examples of user interfaces; and

[0104] FIG. 5 shows an illustration of an ear with an electronic hearing device for capturing first acoustic signals from surroundings and second acoustic signals including otoacoustic emissions in response to a stimulation signal.

DETAILED DESCRIPTION

[0105] Various embodiments are described hereinafter with reference to the figures. Like reference numerals refer to like elements throughout. Like elements will, thus, not be described in detail with respect to the description of each figure. It should also be noted that the figures are only intended to facilitate the description of the embodiments. They are not intended as an exhaustive description of the claimed invention or as a limitation on the scope of the claimed invention. In addition, an illustrated embodiment needs not have all the aspects or advantages shown. An aspect or an advantage described in conjunction with a particular embodiment is not necessarily limited to that embodiment and can be practiced in any other embodiments even if not so illustrated, or if not so explicitly described.

[0106] FIG. 1a shows a block diagram of an electronic hearing device 101, a first electronic device 120, a second electronic device 140 and a server computer 130. The electronic hearing device 101 includes wireless communication means such as an antenna 108 and a transceiver 109 for wireless communication with the first electronic device 120 e.g. using a Bluetooth or Wi-Fi protocol or another communications protocol. The first electronic device 120 is configured to communicate with the server computer 130, such as a cloud server, at least occasionally, using a wireless connection e.g. based on a public telecommunications network, such as 3G, 4G or 5G network, and/or a private communications network e.g. based on a Wi-Fi protocol. The first electronic device 120 may be an electronic device, such as a smartphone, possessed by the wearer of the electronic hearing device 101. The first electronic device 120 may be configured with a so-called app (software application) to enhance or add a user interface to the electronic hearing device 101. A second electronic device 140 may be possessed by a human audiologist to perform e.g. fitting procedures and/or supervision of the wearer's hearing e.g. based on recurrently obtained otoacoustic data.

[0107] The electronic hearing device 101 comprises an earpiece configured to be worn in the wearer's ear and includes an acoustic output transducer 105, a first acoustic input transducer 102, a second acoustic input transducer 110, a first wireless communications unit 108, such as an antenna; and a processor 150 coupled to the acoustic transducers. The acoustic output transducer 105 may include one or more miniature loudspeaker(s). The acoustic input transducers may each include one or more microphones. The first acoustic input transducer 102 is arranged in the earpiece to capture acoustic waves propagating towards the wearer. The second acoustic input transducer 110 and the acoustic output transducer 105 are arranged in the earpiece to emit and capture acoustic waves in a space established between the earpiece and the wearer's ear canal and the middle ear.

[0108] In the hearing mode, the processor 150 captures the first acoustic signal, from the environment surrounding the wearer, by means of the first input transducer 102. A hearing compensation unit 103 of the processor 150 performs hearing compensation using a current hearing compensation profile and outputs a compensated signal to an output unit 104, which outputs the compensated signal to the acoustic output transducer 105 in the hearing mode. Thus, in the hearing mode, a signal path is established from the first acoustic input transducer 102 to the acoustic output transducer 105. The acoustic output transducer is arranged e.g. in the earpiece to emit acoustic signals towards the wearer's eardrum. In some examples the first acoustic input transducer 102 includes a directional microphone, or an array of microphones coupled to one or more beamformers. A hearing profile may be deployed via a hearing mode controller 106.

[0109] During an otoacoustic monitoring procedure, the acoustic output transducer 105 emits an otoacoustic stimulation signal and the second acoustic input transducer 110 captures a second acoustic signal including otoacoustic emissions, if any, emitted from the wearer's ear. Thus, the second acoustic signal propagates in the wearer's ear canal. An otoacoustic control unit 107 generates or forwards the otoacoustic stimulation signal via the output unit 104 and processes the otoacoustic signals received via the second acoustic input transducer 110. During the otoacoustic monitoring procedure the hearing mode may be suspended. The acoustic output transducer 105 may include one or more miniature loudspeakers.

[0110] During a fitting procedure, the electronic hearing device 101 may be engaged to perform audiometric measurements and generate stimulation signals e.g. in interaction with the first electronic device 120 and/or the second electronic device 140 and/or the cloud server 130.

[0111] In some examples, the otoacoustic stimulation signals are generated in the first or second electronic device. In some examples, the otoacoustic stimulation signals are generated in the electronic hearing device.

[0112] FIG. 1b shows a first electronic device 120 with a display 121. The first electronic device 120 may have similar elements as the second electronic device 140. The electronic devices 120, 140 are, in some examples, mobile electronic devices as depicted or wearable electronic devices e.g. including a smart watch, a tablet computer or another type of computer. The electronic device 120 includes a touch-sensitive display 121, physical input buttons 122, 123 and 124, a camera lens 126 for a built-in camera (not shown) and a loudspeaker opening 125. The electronic device 120 displays a set of icons and/or affordances designated ‘M’, ‘12’, ‘C’, ‘H’, ‘C’ and ‘P’. An affordance, as known in the art of graphical user interfaces, has a graphical icon and properties that help a user understand that they can interact with it, and the type of interaction that may be involved. For instance, the affordance ‘C’ may be tapped to activate an application, e.g. an app, that is engaged to perform portions of the method described herein.

[0113] FIG. 1c shows hardware elements of the electronic device 120; The hardware elements comprise a processor 150 that may include a combination of one or more hardware elements. In this respect, the processor 150 may be configured to run one or more a software programs or software components thereof including the application that can be activated via the affordance ‘C’. The processor 150 is coupled to an audio circuit 151, a radio frequency circuit 152, including one or more antennas 153, a display 154, which may be display 121, a touch input circuit 155 and a memory 156.

[0114] FIG. 2 shows a first flowchart 200 for a method including a fitting procedure and a first monitoring procedure. Following completion of the fitting procedure and the first monitoring procedure, the hearing mode is engaged in step 230 based on the result of at least the fitting procedure. In some examples, the hearing mode is engaged a first time, before completion of the fitting procedure and the first monitoring procedure, e.g. based on a default hearing profile such as a flat hearing profile.

[0115] The method is performed by an electronic hearing device e.g. as described in connection with FIGS. 1a-1c and including an earpiece configured to be worn in an ear and including: an acoustic output transducer, a first acoustic input transducer, a second acoustic input transducer, a first wireless communications unit; and a processor coupled to the acoustic transducers.

[0116] For the sake of completeness, the hearing mode, includes capturing a first acoustic signal by means of the first acoustic input transducer, generating a compensated output signal based on the acoustic signal and emitting the compensated output signal by means of the first acoustic output transducer. The compensated output signal is based on current hearing compensation data.

[0117] The first fitting procedure is started in step 201. The first fitting procedure includes both of audiometric fitting performed in step 202 as it is known in the art of hearing aids and otoacoustic monitoring performed in step 210. The first fitting procedure thus includes obtaining first hearing compensation data via audiometric measurements requiring the wearer's input to confirm a hearing threshold. As exemplified by steps 203 and 204 this includes playing a fitting signal f(n) such as a tone at a predefined amplitude and frequency and in response thereto receiving the wearer's gesture input to confirm or not whether the fitting signal was perceived heard by the wearer. The steps 203 and 204 are repeated at various frequencies and at various amplitudes, e.g. several times at each frequency and amplitude such as three times. The frequencies may include 125 Hz, 250 Hz, 500 Hz, 1 KHz, 2 KHz, 4 KHz and 8 KHz or fewer or more frequencies. The amplitudes may be varied in steps of 3 dB or more or less.

[0118] Further, the first fitting procedure includes performing otoacoustic monitoring in step 210. Generally, compared to a conventional audiometric procedure, the otoacoustic test is faster and does not require the wearer to respond orally or by gestures. The otoacoustic test can therefore be performed, e.g. automatically. This is useful e.g. when the wearer is a patient under serious medical treatment and is weakened in physically e.g. mentally affected.

[0119] As exemplified by steps 211 and 212 this includes emitting an otoacoustic stimulation signal via the acoustic output transducer and capturing a second acoustic signal including otoacoustic emissions, if any, by means of the second acoustic input transducer. The otoacoustic stimulation signal may include one or more tones e.g. two tones at the same time at frequencies f1(m) and f2(m) to stimulate otoacoustic distortion products as it is known. In response thereto, at the same time or immediately after, an otoacoustic response, if any, is measured. The stimulation is repeated at different frequency pairs f1, f2, wherein f2 is e.g. a function of f1, e.g. f2 is 2 times f1. In some examples the amplitudes of the stimulation signals are each fixed or set at a pre-set value. In some examples, e.g. in about 25% of a population, the wearer's ear does not produce an otoacoustic response. This is however mainly due to wax in the ear canal and/or problems with the inner ear.

[0120] Following completion of the otoacoustic monitoring in step 210, or following stimulation at one or more frequency pairs or one or more amplitude pairs, the captured signals or data based thereon are stored as data OTO1 in step 212.

[0121] Further, in step 213 it is determined whether the captured signals or data based thereon, stored as data OTO1, exceeds a first threshold. This enables testing whether an otoacoustic response was generated, or at least detectable, in the wearer's ear. In the affirmative (y) event thereof, a monitoring procedure is enabled in step 215. It is then possible, at a later time, to verify whether an otoacoustic response was generated and to enable an otoacoustic monitoring procedure at a later time. In the non-affirmative (n) event, the method forgoes enabling the monitoring procedure or disables the monitoring procedure in step 214. A notification, e.g. a fourth notification is displayed in step 217 to indicate the absence of an otoacoustic response. Step 217 may be omitted.

[0122] Subsequently, the fitting procedure including the otoacoustic monitoring procedure is completed in step 216 and current hearing compensation data are deployed at the electronic hearing device to enable hearing compensation in accordance with the result of the fitting procedure.

[0123] The hearing mode can then be engaged or re-engaged in step 230.

[0124] FIG. 3 shows a second flowchart 300 including a second monitoring procedure 310. Whereas the first monitoring procedure is performed in connection with a fitting procedure, the second monitoring procedure is performed in response to receiving a first input signal. In an example the first input signal is a signal received in response to a user's or wearer's input e.g. at an affordance displayed on the first electronic device 120.

[0125] The second monitoring procedure includes performing otoacoustic monitoring in step 210 as described above. Also, as exemplified by steps 211 and 212, this includes emitting an otoacoustic stimulation signal via the acoustic output transducer 105 and capturing, this time, a third acoustic signal including otoacoustic emissions, if any, by means of the second acoustic input transducer 110. The captured signals or a data value based thereon are designated OTO(2). Also, in step 213 it is determined whether the captured signals, or a data value based thereon, OTO(2), exceeds the first threshold, TH1. In the non-affirmative event (n) of step 213, a 4th notification may be transmitted in step 217, e.g. to the first electronic device 120 or the second electronic device 140. The 4th notification may inform the wearer and/or an audiologist that an otoacoustic response is not detectable and/or sufficiently strong.

[0126] In the affirmative event (y) of step 213, it is tested in step 302 whether the monitoring procedure was enabled based on a previous test, e.g. in connection with the first fitting procedure. In the non-affirmative event (n) of step 302, in step 303 a 5th notification may be generated and/or the monitoring procedure may be enabled for subsequent monitoring procedures. In the affirmative event (y) of step 302 the method tests in step 304 whether the most recent otoacoustic response e.g. OTO(2) deviates, e.g. significantly, from a previous or preceding otoacoustic response e.g. OTO(1). In the non-affirmative event (n) of step 304, i.e. that there is no deviation or no significant deviation, a 3.sup.rd notification is transmitted, e.g. to the first electronic device, in step 305. In the affirmative event (y) of step 304, a 1st notification is transmitted in step 306 e.g. to the first electronic device and/or to the second electronic device e.g. via a server computer. The most recent otoacoustic response e.g. OTO(2) or a set of otoacoustic responses may be transmitted or uploaded to the server computer in step 307. Thus, in accordance with a determination that the deviation value is significant, the method communicates a first notification signal indicative of the deviation from the hearing device. In some examples determining whether the deviation is significant is based on the so-called Kullback-Leibler divergence. determining whether the deviation is significant is based on a sum of differences e.g. a weighted sum of differences.

[0127] In some embodiments, the test regarding whether monitoring is enabled is omitted. Then steps 302 and 303 in box 310 are omitted.

[0128] In some examples, the captured otoacoustic signals or data based thereon are stored with a date-time value, e.g. a time-stamp, each time a monitoring procedure is performed e.g. as data items OTO(1), OTO(2), OTO(k), . . . . The data items are communicated to the first electronic device and/or the second electronic device e.g. via a server computer. Thereby, the data items including the date-time values can be made available to an audiologist for analysis of temporal changes in the data values. In step 306 the data items OTO(1), OTO(2), OTO(k) may be uploaded individually in response to being obtained or at times when an upload connection becomes available.

[0129] When the second monitoring mode is completed or interrupted e.g. following transmission of a notification in steps 217, 303 or 305, the method may proceed to engage the hearing mode in step 230.

[0130] FIGS. 4a and 4b show examples of user interfaces.

[0131] In FIG. 4a a notification 410 to engage in a monitoring procedure is displayed in a notification centre 411. The notification centre 411 may be a part of the operating system of the electronic device.

[0132] In FIG. 4b a report 421 with results of an otoacoustic monitoring procedure is shown e.g. including a graphical audiogram in response to activation of an affordance 420.

[0133] FIG. 5 shows an illustration of an ear 601 with an electronic hearing device 101 for capturing first acoustic signals 502 from surroundings and capturing second acoustic signals 503 including otoacoustic emissions in response to a stimulation signal.

[0134] In some examples, audiometric data may be provided by an external source; for example, the results of an audiogram testing process may be provided by an audiologist. The audiometric data can be input via a wireless connection into the electronic hearing device.

[0135] There is also provided an item as set out below:

1. a method performed by a hearing system at least including an electronic hearing device with an earpiece configured to be worn in an ear and including: an acoustic output transducer, a first acoustic input transducer, a second acoustic input transducer, a first wireless communications unit; and a processor coupled to the acoustic transducers; the method comprising;

[0136] at a first time, performing a first monitoring procedure (240) including: [0137] emitting an otoacoustic stimulation signal via the acoustic output transducer (105) and capturing a second acoustic signal including otoacoustic emissions, if any, by means of the second acoustic input transducer (110);

[0138] at least at a second time, performing the first monitoring procedure (310) including: [0139] emitting an otoacoustic stimulation signal via the acoustic output transducer and capturing a third acoustic signal including otoacoustic emissions, by means of the second acoustic input transducer; [0140] determining (303) a deviation value based on the second acoustic signal and the third acoustic signal; and determining whether the deviation value satisfies a first criterion;

[0141] in accordance with a determination that the deviation value satisfies (y) the first criterion, communicating a first notification signal (305) indicative of the deviation from the hearing device.

[0142] Embodiments of the method defined in item 1 above, are set out in the present disclosure and in particular in dependent claims 2-12 and in claims 13-14.

[0143] Although particular features have been shown and described, it will be understood that they are not intended to limit the claimed invention, and it will be made obvious to those skilled in the art that various changes and modifications may be made without departing from the scope of the claimed invention. The specification and drawings are, accordingly to be regarded in an illustrative rather than restrictive sense. The claimed invention is intended to cover all alternatives, modifications, and equivalents.