Abstract
A binaural aid assistance system comprises first and second hearing assistance devices adapted for being located at or in left and right ears of a user. Each of the first and second hearing assistance devices comprises a) a first wireless interface comprising first antenna and transceiver circuitry adapted for establishing a first communication link to the respective other hearing assistance device based on near-field communication; b) a second wireless interface comprising second antenna and transceiver circuitry adapted for establishing a second communication link to an auxiliary device based on far-field communication. The binaural hearing aid system further comprises c) a user interface from which a user can select a suitable routing of an audio signal from the auxiliary device to each of the first and second hearing assistance devices.
Claims
1. A binaural hearing aid system comprising first and second hearing assistance devices adapted for being located at or in, or fully or partially implanted in, the head at left and right ears of a user, wherein each of the first and second hearing assistance devices comprises a) a first wireless interface comprising first antenna and transceiver circuitry adapted for establishing a first communication link to the respective other hearing assistance device based on near-field communication; b) a second wireless interface comprising second antenna and transceiver circuitry adapted for establishing a second communication link to an auxiliary device based on far-field communication; and wherein the binaural hearing assistance system further comprises c) a user interface from which a user can select a suitable routing of an audio signal from the auxiliary device to each of the first and second hearing assistance devices.
2. A binaural hearing aid system according to claim 1 configured such that a suitable routing of an audio signal from the auxiliary device to each of the first and second hearing assistance devices can be selected via the user interface by activating or deactivating a link between devices.
3. A binaural hearing aid system according to claim 1 wherein said user interface is implemented as an APP of a SmartPhone or a remote control.
4. A binaural hearing aid system according to claim 1 wherein said suitable routing is selectable via a graphical user interface, said graphical user interface forming part of the auxiliary device supplying the audio signal or part of a different auxiliary device.
5. A binaural hearing aid system according to claim 4 wherein the auxiliary device comprising the graphical user interface is configured to allow the user to select a currently active audio source to be transmitted to the left and right hearing assistance devices.
6. A binaural hearing aid system according to claim 4 wherein the auxiliary device comprising the graphical user interface is or forms part of a SmartPhone.
7. A binaural hearing aid system according to claim 1 wherein said second communication link is based on Bluetooth technology.
8. A binaural hearing aid system according to claim 1 wherein said first and second hearing assistance devices each comprise a user interface allowing a user to influence operation of the binaural hearing aid system by selecting between: listening to a particular one of currently received audio sources, and listening to multiple ones of the currently received audio sources.
9. A binaural hearing aid system according to claim 1 wherein said first and second hearing assistance devices each comprise a link control unit operatively coupled to the second antenna and transceiver circuitry and configured to repeatedly estimate a second link quality measure indicative of a link quality of the second communication link; wherein the first and second hearing assistance devices are configured to exchange said respective second link quality measures between one another via said first communication link and/or said second communication link.
10. A binaural hearing aid system according to claim 9 wherein the user interface comprises a graphical user interface illustrating current audio links and their link quality.
11. A binaural hearing aid system according to claim 9 comprising the auxiliary device and the user interface and wherein the user interface is configured to display the second link quality measures estimated by the system.
12. A binaural hearing aid system according to claim 1 configured to switch between the first and second hearing assistance device as the sole recipient of an audio signal via the second communication link with a switch frequency controlled by the user via the user interface.
13. A binaural hearing assistance system according to claim 1 wherein the auxiliary device comprises a touch sensitive display allowing the user to control the first and second communication links by activating or deactivating a link between devices by clicking on different parts of respective lines representing the first and second communication links in the display.
14. A binaural hearing aid system according to claim 1 configured to allow an automatic routing strategy implemented in the binaural hearing assistance system to be manually overrided via the user interface.
15. A binaural hearing aid system according to claim 9 configured to display estimated current audio link qualities in both directions of the first communication link between the first and second hearing assistance devices via the user interface.
16. A binaural hearing aid system according to claim 2 wherein an activation or deactivation of the first communication link only concerns the audio signal part of the transmitted signal.
17. A binaural hearing aid system according to claim 2 wherein a given audio link can be activated or deactivated by clicking on a central part of a line representing the given audio link.
18. A binaural hearing aid system according to claim 2 wherein a direction of transmission can be selected or deselected by clicking on an end of a line representing a link between devices.
19. A binaural hearing aid system according to claim 1 wherein the user interface forms part of the auxiliary device that also provides the audio signal.
20. A binaural hearing aid system according to claim 1 wherein the user interface is implemented in a different device than the auxiliary device supplying the audio signal.
21. A binaural hearing aid system according to claim 1 wherein said first communication link is an inductive link.
22. A binaural hearing aid system according to claim 1 wherein the first and second hearing assistance devices are adapted to establish the second communication link to the auxiliary device according to different wireless communication technologies.
23. A binaural hearing aid system according to claim 1 wherein the first and second hearing assistance devices are or comprise respective first and second hearing aids.
24. A method of operating a binaural hearing aid system comprising first and second hearing assistance devices adapted for being located at or in, or fully or partially implanted in, left and right ear regions of a user, the method comprising a) providing, in each of the first and second hearing assistance devices, a first wireless interface adapted for establishing a first communication link to the other of the first and second hearing assistance devices based on near-field communication; b) providing, in each of the first and second hearing assistance devices, a second wireless interface adapted for establishing a second communication link to an auxiliary device based on far-field communication; and c) providing, in the binaural hearing aid system, a user interface from which the user can select a suitable routing of an audio signal from the auxiliary device to each of the first and second hearing assistance devices.
25. A data processing system comprising a processor and a memory storing a program which, when executed, causes the processor to perform the method of claim 24.
Description
BRIEF DESCRIPTION OF DRAWINGS
(1) The disclosure will be explained more fully below in connection with a preferred embodiment and with reference to the drawings in which:
(2) FIGS. 1A-1B show two application scenarios of a binaural hearing assistance system, FIG. 1A illustrating the two hearing assistance devices receiving an audio signal from an auxiliary (audio delivery) device via a wireless link, FIG. 1B illustrating a situation where audio signals from two different audio sources (a TV and a microphone, respectively) are wirelessly transmitted to and available for reception in the two hearing assistance devices,
(3) FIG. 2 shows an embodiment of a binaural hearing assistance system according to the present disclosure comprising first and second hearing assistance devices and an auxiliary device, the system being adapted for establishing wireless communication links between the devices,
(4) FIGS. 3A-3B show an embodiment of a binaural hearing aid system comprising first and second hearing assistance devices, the system being configured to determine whether or not the first and second hearing assistance devices are operationally mounted on the head of the user,
(5) FIG. 4 shows an embodiment of a binaural hearing aid system comprising first and second hearing assistance devices in communication with an auxiliary device functioning as a user interface for the binaural hearing aid system,
(6) FIGS. 5A-5H show various configurations of the different wireless communications links of a binaural hearing assistance system according to the present disclosure,
(7) FIGS. 6A-6B show embodiments of a binaural hearing assistance system comprising first and second hearing assistance devices in communication with an auxiliary device, where the transmission of audio signals from the auxiliary device to the first and second hearing assistance devices alternatingly uses the 2.sup.nd communication link to the first and second hearing assistance devices (one at a time) and the 1.sup.st communication link to relay the audio signal to the other hearing assistance device, and
(8) FIGS. 7A-7C show embodiments of an auxiliary device functioning as a user interface for a binaural hearing aid system according the present disclosure, FIGS. 7A, 7B and 7C illustrating three different audio routing scenarios between the auxiliary device and the hearing assistance devices, such routing being selectable via the graphical user interface of the auxiliary device (e.g. based on link quality measures illustrated in the display).
(9) The figures are schematic and simplified for clarity, and they just show details which are essential to the understanding of the disclosure, while other details are left out. Throughout, the same reference signs are used for identical or corresponding parts.
(10) Further scope of applicability of the present disclosure will become apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the disclosure, are given by way of illustration only. Other embodiments may become apparent to those skilled in the art from the following detailed description.
DETAILED DESCRIPTION OF EMBODIMENTS
(11) FIGS. 1A-1B show two application scenarios of a binaural hearing assistance system. In FIGS. 1A-1B, each of the left and right hearing assistance devices are adapted for being located at and/or in left and right ears of a user U and comprises a first wireless interface comprising first antenna (NF-ANT) and transceiver circuitry adapted for establishing a first communication link (1.sup.st-WL) to the respective other hearing assistance device based on near-field communication (e.g. magnetic/inductive), and a second wireless interface comprising second antenna (RF-Ant) and transceiver circuitry adapted for establishing a second communication link (2.sup.nd-WL) to an auxiliary device (AD) based on far-field communication (radiated fields, RF). Each of the left and right hearing assistance devices (HAD.sub.1, HAD.sub.r) further comprises a link control unit operatively coupled to the second antenna (RF-Ant) and transceiver circuitry and configured to repeatedly provide a second link quality measure indicative of a link quality of the second communication link (2.sup.nd-WL). The left and right hearing assistance devices (HAD.sub.1, HAD.sub.r) are each configured to exchange the respective second link quality measures between them via said first and/or second communication links (1.sup.st-WL, 2.sup.nd-WL(l), 2.sup.nd-WL(r)), preferably via said first communication link (1.sup.st-WL).
(12) If, e.g., during streaming from the audio delivery device (AD), e.g. embodied in a SmartPhone, over the RF-link (2.sup.nd-WL(l), 2.sup.nd-WL(r)) to both hearing assistance devices (HAD.sub.1, HAD.sub.r), one of them, e.g. the left HAD.sub.1, experiences a poor signal quality on the RF link (2.sup.nd-WL(l) in FIG. 1A), e.g. due to attenuation of the RF-signal by a diffractive medium (e.g. the head of the user, as indicated by the dashed line part of the propagation path of the link (2.sup.nd-WL(l)), it will be possible to use the magnetic link (1.sup.st-WL) to receive a relayed audio stream from the right hearing assistance device HAD.sub.r (assumed to have a better signal quality). This situation is e.g. illustrated in FIG. 1A (AD=SmartPhone) and in FIG. 1B (AD=TV). If, on the other hand, the left hearing assistance device HAD.sub.1 has a signal of better quality than HAD.sub.r (as e.g. illustrated by transmission of source S.sub.2 from WL-Mic in FIG. 1B), the fading challenge can be solved by converting the RF stream of the left hearing assistance device HAD.sub.1 to the magnetic link (1.sup.st-WL) and relaying it to the right hearing assistance device HAD.sub.r.
(13) Preferably, both hearing assistance devices are configured to continuously monitor the quality of the RF signal received by the respective device, and to exchange information on this over the magnetic link (1.sup.st-WL) in order to ensure that the magnetic link relay is set up when needed and is always transmitted to the hearing assistance device with the poorest quality RF link. Preferably, to save power and minimize complexity, the relay of audio signals will only be established in case the RF link quality of one of the RF-links drops below a certain threshold.
(14) In a further embodiment, the binaural hearing assistance system is configured to monitor RF link quality over time (e.g. by regularly storing historic values of the link quality measure, and/or determining a running average) in order to enable a prediction of when the quality of the RF link to one of the hearing assistance devices will drop below an acceptable level.
(15) FIG. 1A specifically illustrates the two hearing assistance devices (HAD.sub.1, HAD.sub.r) of the binaural hearing assistance system receiving the same audio signal from one auxiliary (audio delivery) device (AD) via respective (second) wireless RF-links (2.sup.nd-WL(l), 2.sup.nd-WL(r)). In the scenario of FIG. 1A, the auxiliary device AD is shown to comprise a display showing a user currently available audio sources, and highlighting a selected one (here audio, e.g. music, from a Library of audio files, e.g. stored in a storage unit of the auxiliary device). The auxiliary device may thus comprise a user interface of the binaural hearing assistance system allowing a user to select a currently active audio source to be transmitted to the left and right hearing assistance devices. In an embodiment, auxiliary device AD is or forms part of a SmartPhone. In an embodiment, the RF link is based on Bluetooth, e.g. including Bluetooth Low energy. In an embodiment, the user interface may be configured to illustrateand possibly allow a user to select (route)which of the available links (1.sup.st-WL, 2.sup.nd-WL(l), 2.sup.nd-WL(r)) to use for a given audio source at a given point in time. This feature (possibly implemented as an APP on a SmartPhone) is further discussed in connection with FIGS. 7A-7C.
(16) FIG. 1B specifically illustrates a situation where audio signals from two different audio sources (a TV (S.sub.1) and a wireless microphone (S.sub.2), respectively) are wirelessly transmitted to and available for reception in the two hearing assistance devices (HAD.sub.1, HAD.sub.r) of the binaural hearing assistance system. In the scenario of FIG. 1B, two hearing assistance devices are shown each comprise a user interface UI allowing a user to influence the function of the hearing assistance system, e.g. to choose to listen to one particular of the currently received audio sources, or, alternatively, to select to listen to both of the currently received audio sources. In the embodiment of FIG. 1B, each hearing assistance device comprises a single (second) wireless RF-interface allowing each hearing assistance device to receive one audio signal at a time from a single of the currently available wireless RF-communication links. In an embodiment, each hearing assistance device comprises several (e.g. two, second, e.g. equal or different) wireless RF-interfaces allowing each hearing assistance device to receive two audio signals at a time from two of the currently available wireless RF-communication links. In the example of FIG. 1B, the RF-links from the wireless microphone (WL-Mic) is a standard Bluetooth link comprising separate links (2.sup.nd-WL(l), 2.sup.nd-WL(r)) to the left and right hearing assistance devices (HAD.sub.1, HAD.sub.r), respectively, whereas the RF-links from the television set (TV) is a proprietary link (e.g. based on Bluetooth) comprising separate links (2.sup.nd-WL(l), 2.sup.nd-WL(r)) to the left and right hearing assistance devices, respectively. In an embodiment, the left and/or right hearing assistance devices comprise an input transducer (e.g. a microphone system) for converting acoustic sounds from the environment to electric input signals. In an embodiment, the hearing assistance devices comprise a selector and mixing unit connected to an output transducer allowing a specific or a (e.g. weighted) mixture of (some or all of) the available audio signals to be presented to the user as a perceivable sound.
(17) In an alternative embodiment (not shown in FIG. 1B, but further discussed in connection with FIG. 5C), each hearing assistance device comprises a single wireless RF-interfaces allowing each hearing assistance device to receive one audio signal at a time from the currently available wireless RF-communication links, but each hearing assistance device comprises a wireless RF-interface that is different from the other (e.g. one is an interface according to the Bluetooth SIG-specification, and the other is a proprietary interface).
(18) FIG. 2 shows an embodiment of a binaural hearing assistance system BHAS according to the present disclosure comprising first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) and an auxiliary device (AD), the system being adapted for establishing wireless communication links between the devices: A bi-directional (first, inductive) link (1st-WL(12), 1st-WL(12)) between the first and second hearing assistance devices (HAD1, HAD2). A bi-directional (second, RF) link (2nd-WL(1)) between the auxiliary device (AD) and the first hearing assistance device (HAD1). A bi-directional (second, RF) link (2nd-WL(2)) between the auxiliary device (AD) and the first hearing assistance device (HAD.sub.2).
(19) The bi-directional (first, inductive) link (1.sup.st-WL(12), 1.sup.st-(12)) is implemented by a first wireless interface comprising first antenna and transceiver circuitry (Rx1, Tx1) in the first hearing assistance device (HAD.sub.1) as well as in the second hearing assistance device (HAD.sub.2). The bi-directional (first, inductive) link may establish a uni-directional connection (1.sup.st-WL(12) for transmission of audio (Tx1Aud) signals and/or control (Tx1Ctr) signals (e.g. including link quality measures) from the first (HAD.sub.1) hearing assistance device and received as corresponding audio (Rx1Aud) signals and control (Rx1Ctr) signals, respectively, in the second hearing assistance device (HAD.sub.2). Likewise, The bi-directional (first, inductive) link may establish a uni-directional connection (1.sup.st-WL(21) for transmission of audio (Tx1Aud) signals and/or control (Tx1Ctr) signals (e.g. including link quality measures) from the second (HAD.sub.2) hearing assistance device and received as corresponding audio (Rx1Aud) signals and control (Rx1Ctr) signals, respectively, in the first hearing assistance device (HAD.sub.1).
(20) The two bi-directional (second, RF) links (2.sup.nd-WL(1), 2.sup.nd-WL(2)) are implemented by second wireless interfaces comprising second antenna and transceiver circuitry (Rx2, Tx2) in the first hearing assistance device (HAD.sub.1) as well as in the second hearing assistance device (HAD.sub.2) and antenna and transceiver circuitry (Rx2/Tx2) in the auxiliary device. The bi-directional (second, RF) link (2.sup.nd-WL(1)) between the first hearing assistance device (HAD.sub.1) and the auxiliary device (AD) may be configured to transmit control (Tx2Ctr) signals (e.g. including link quality measures) and optionally audio (Tx2Aud, indicated in dashed line) signals from the first (HAD.sub.1) hearing assistance device and received as corresponding audio and control signals, respectively, in the auxiliary device (AD) and correspondingly to receive in the first (HAD.sub.1) hearing assistance device audio (Rx2Aud) signals and/or control (Rx2Ctr) signals from the auxiliary device (AD). The bi-directional (second, RF) link (2.sup.nd-WL(2)) between the second hearing assistance device (HAD.sub.2) and the auxiliary device (AD) may be correspondingly configured.
(21) In each of the embodiments of first and second hearing assistance devices shown in FIG. 2, a link control unit LCU is operatively connected to (transceiver circuitry of) the first and second wireless interfaces via the transmitted and received audio and control signals (Tx1Aud, Tx1Ctr, Rx1Aud, Rx1Ctr) and (Tx2Aud (optional), Tx2Ctr, Rx2Aud, Rx2Ctr) from the first (1.sup.st-WL) and second (2.sup.nd-WL) communication links, respectively. The link control unit LCU is configured to repeatedly provide a second link quality measure LQ2 indicative of a link quality of the second communication link (2.sup.nd-WL). The first and second hearing assistance devices are configured to exchange the respective second link quality measures (LQ2) between them via control signals Tx1Ctr/Rx1Ctr over the first communication link (1.sup.st-WL). The first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) each comprises a link quality unit (LQ) for extracting the second link quality measures (LQ2) indicative of a quality of the respective second communication links (2.sup.nd-WL), the second link quality measures e.g. comprising a signal strength and/or a bit error rate of a signal received via the receiver (Rx2) from the auxiliary device (AD).
(22) The link quality measures LQ2 are used to control the routing of audio signals transmitted by the auxiliary device (represented in FIG. 2 by transceiver unit Rx2/Tx2) as discussed in connection with FIG. 1A-B above and FIGS. 5A-5H below. In an embodiment, a measure of link quality (LQ2) is based on the signal strength of the received signal (e.g. based on the RSSI (received signal strength indication) and/or its bit error rate and/or the gain-settings of the receiver (e.g. of an automatic gain control (AGC) unit) of the receiving (or transmitting) device (forming part of the second wireless interface). In an embodiment, the binaural hearing assistance device is configured to forward information about a poor link quality measure (e.g. a received signal strength or a transceiver status) of a 2.sup.nd communication link (e.g. 2.sup.nd-WL(2)) between the auxiliary device and one of the first or second hearing assistance devices (e.g. HAD.sub.2) to the auxiliary device via (a back-link comprising) the first communication link (e.g. 1.sup.st-WL(21) and signals Tx1Ctr->Rx1Ctr), the opposite hearing assistance device (e.g. HAW and the second communication link (e.g. 2.sup.nd-WL(2) and signal Tx2Ctr) back to the auxiliary device (AD (Rx2/Tx2)).
(23) Each of the hearing assistance devices (HAD.sub.1, HAD.sub.2) comprise an energy source status monitoring circuit (ESI) configured to monitor the current status of the local energy source (ES), e.g. a battery, via signal BatV, and to provide a corresponding energy status indication signal ESInd to the link control unit LCU. The energy status indication signals ESInd are exchanged between hearing assistance devices of the binaural hearing assistance system via the first communication link 1.sup.st-WL (signals Tx1Ctr->Rx1Ctr). In each hearing assistance device, the energy status indication signal ESInd generated in and received from the opposite hearing assistance device is likewise fed to the link control unit LCU for evaluation (e.g. comparison with the locally generated energy status indication signal ESInd).
(24) In an embodiment, at least one of the hearing assistance devices is configured to control the first (1.sup.st-WL) and/or second (2.sup.nd-WL) communication links dependent of the energy status indication signal(s) ESInd. In an embodiment, the binaural hearing assistance system BHAS is configuredin a specific power saving mode of operation where the energy status indication signal ESInd in the first hearing assistance device HAD.sub.1 fulfils a predefined low status criterionto relay an audio signal received from the auxiliary device AD by the second hearing assistance device HAD.sub.2 to the first hearing assistance device HAD.sub.1 via the first communication link 1st-WL(21) (signal Tx1Aud(HAD.sub.2)->Rx1Aud(HAD.sub.1)).
(25) Preferably, a predetermined priority (or priority algorithm) for weighting the influence of the link quality measure LQ2 and the energy status indication signal ESInd in the control of the first and/or second communication links.
(26) The first and second hearing assistance devices (HAD.sub.1,HAD.sub.2) each comprise an input transducer IT and an output transducer OT, a forward path being defined therebetween and comprising a signal processing unit SPU for processing an input signal In comprising an audio signal and for providing an enhanced audio signal AIn. The enhanced audio signal AIn is fed to the link control unit LCU. In addition to determining an appropriate routing of the signals to and from the first and second communication links, the link control unit LCU is configured to provide a resulting audio signal AOut for being presented to the user via the output transducer OT. The resulting audio signal AOut may be one of an audio signal picked up by the input transducer (originating from signal In, AIn, e.g. comprising sounds from the environment), an audio signal received from the auxiliary device via the second communication link 2.sup.nd-WL (such signal originating from signal Rx2Aud), or a signal received from the other hearing assistance device via the first communication link 1.sup.st-WL (such signal originating from signal Rx1Aud), or a (e.g. weighted) mixture of two or more of these signals.
(27) In an embodiment, the binaural hearing aid system BAHS further comprises second antenna and transceiver circuitry, allowing a second (RF) communication link between the first and second hearing assistance devices to be established. In an embodiment, such second communication link may be established by the antenna and transceiver units (Rx2/Tx2) for establishing second communication links (2.sup.nd-WL) between the respective first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) and the auxiliary device (AD). Alternatively, the first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) each comprises separate antenna and transceiver units for establishing an interaural second (RF) communication link.
(28) Preferably, the first and/or second communication links are configured to allow bi-directional transmission of control signals. Preferably, the first and/or second communication links are configured to allow bi-directional audio transmission (duplex). In an embodiment, the first and/or second communication links are configured to allow bi-directional audio transmission, but in one direction at a given time (half duplex).
(29) Various aspects of inductive (first) communication links are e.g. discussed in EP 1 107 472 A2, EP 1 777 644 Al, US 2005/0110700 A1, and US2011222621A1. WO 2005/055654 and WO 2005/053179 describe various aspects of a hearing aid comprising an induction coil for inductive communication with other units. A protocol for use in an inductive communication link is e.g. described in US 2005/0255843 A1.
(30) In an embodiment, the (second) RF-communication link is based on classic Bluetooth as specified by the Bluetooth Special Interest Group (SIG) (cf. e.g. https://www.bluetooth.org). In an embodiment, the (second) RF-communication link is based other standard or proprietary protocols (e.g. a modified version of Bluetooth, e.g. Bluetooth Low Energy modified to comprise an audio layer).
(31) FIGS. 3A-3B show an embodiment of a binaural hearing aid system comprising first and second hearing assistance devices (HAD.sub.1, HAD.sub.2), the system being configured to determine whether or not the first and second hearing assistance devices are operationally mounted on the head of the user (U). FIG. 3A shows a situation, where the hearing assistance devices (HAD.sub.1, HAD.sub.2) are located close together, e.g. on a table or in a box. The first and second wireless interfaces comprise first (NF-ANT.sub.1, NF-ANT.sub.2) and second (RF-ANT.sub.1, RF-ANT.sub.2) sets of antennas, respectively, coupled to first and second transceiver circuitry (symbolically commonly denoted RxTx in each hearing assistance device). FIG. 3A illustrate the definition of the (current) transfer functions H1 and H2 for transmission between the first (NF-ANT.sub.1, NF-ANT.sub.2) and second (RF-ANT.sub.1, RF-ANT.sub.2) sets of antennas of the first (1.sup.st-WL) and second (2.sup.nd-WL) communication links, respectively, in this particular situation. FIG. 3B shows a (normal) operating situation of the system, where the hearing assistance devices (HAD.sub.1, HAD.sub.2) are mounted on the head of a user (here behind the ear). The left and right drawings of FIG. 3B illustrate the definition of the (reference) transfer functions H1 and H2 for transmission between the first (NF-ANT.sub.1, NF-ANT.sub.2) and second (RF-ANT.sub.1, RF-ANT.sub.2) sets of antennas of the first (1.sup.st-WL) and second (2.sup.nd-WL) communication links, respectively, in this normal mode of operation.
(32) Hearing assistance devices (HAD.sub.1, HAD.sub.2) may be equipped with several wireless systems, such as e.g. magnetic inductance antennas (NF-Ant) and Bluetooth antennas (RF-Ant). Depending on the wireless technology used, the transfer function H between the antennas will be different. The transfer functions of the magnetic inductance antennas will mainly depend on the distance between the antennas, while the transfer function of the Bluetooth antennas will be affected by the energy loss inside the head of the user when the hearing assistance devices are mounted on the head of the user.
(33) By transmitting a measure of the transmission power used by the transmitters of the first and second communication links (1.sup.st-WL, 2.sup.nd-WL) of a given hearing assistance devices as a control signal to the opposite hearing assistance device, the transfer function between the two antennas of each link can be estimated in the receiving hearing assistance device. Knowledge about the transfer functions between the two of antennas of each set of antennas of the hearing assistance devices when mounted at each ear of a user, as shown in FIG. 3B (and their current values, where the devices may be arbitrarily located, e.g. operatively mounted or located close together on a table or in storage box (as shown in FIG. 3A), etc.) may be used to detect whether or not the hearing assistance devices are operationally mounted at each ear of the user. By combining (e.g. comparing) the estimated transfer functions (H1, H2) for the two different types of wireless interfaces (inductive (1.sup.st-WL) and Bluetooth (2.sup.nd-WL)) with respective reference values, an indication of the current location and environment of the hearing assistance devices, e.g. whether or not an RF-attenuating medium is located between the two devices. In an embodiment, the binaural hearing assistance system is configured to enter a power down mode, when the current values of the first and second transfer functions H1, H2 fulfill a predefined criterion e.g. H1>H1, H2>H2, where Hi (i=1, 2) are the respective reference transfer functions, when operatively mounted on the user's head (as illustrated in FIG. 3B).
(34) Alternatively or additionally, the predefined criterion may comprise that H2>>H2, e.g. H2>5*H2, such as H2>10*H2, or H2>100*H2).
(35) FIG. 4 shows an embodiment of a binaural hearing aid system comprising left (second) and right (first) hearing assistance devices (HAD.sub.1, HAD.sub.r) in communication with a portable (handheld) auxiliary device (AD) functioning as a user interface (UI) for the binaural hearing aid system. In an embodiment, the binaural hearing aid system comprises the auxiliary device (and the user interface) and is configured to display the link quality measures estimated by the system. The user interface displaying the link qualities of the available wireless (1.sup.st and 2.sup.nd communication) links of the binaural hearing aid system may be implemented as an APP of the auxiliary device (e.g. a SmartPhone). In the embodiment of FIG. 4, the available wireless links are denoted 1.sup.st-WL (inductive link between the hearing assistance devices) and 2.sup.nd-WL(1) and 2.sup.nd-WL(r) (RF-links between the auxiliary device and the left and between the auxiliary device and the right hearing assistance device, respectively). The 1.sup.st and 2.sup.nd wireless interfaces are implemented in the left and right hearing assistance devices (HAD.sub.1, HAD.sub.r) by antenna and transceiver circuitry Rx1/Tx1 and Rx2/Tx2, respectively. The auxiliary device comprising the user interface is adapted for being held in a hand (Hand) of a user (U), and hence convenient for displaying a current arrangement of available links and their estimated link qualities.
(36) In an embodiment, threshold values of the first and second link quality measure LQ1 and LQ2 are defined (and e.g. stored in the respective link control units of the first and second hearing assistance devices), the respective threshold values LQ1.sub.th,i and LQ2.sub.th,i (i=1, 2, . . . , Q) being determined to separate different grades of link quality (e.g. a GOOD, BAD, Q=1, or GOOD, MEDIUM, BAD, Q=2) of the first and second communication links. In the example illustrated in FIG. 4, the (second) RF-link between the auxiliary device and the left hearing assistance device (HAD.sub.1) has a low link quality (L, denoted L: LQ=low), whereas the (second) RF-link between the auxiliary device and the right hearing assistance device (HAD.sub.r) has a high link quality (H, denoted H: LQ=high). The (first) inductive link between the left and right hearing assistance devices (HAD.sub.1, HAD.sub.r) is likewise indicated to have a high link quality (H). The first and second communication links are indicated to be bi-directional (by the double arrow). Typically, the first communication link is uni-directional audio (from one hearing assistance device to the other) and bi-directional control. Typically, the second communication links are uni-directional audio (from auxiliary device to hearing assistance device) and bi-directional control. In the example of FIG. 4, the medium link quality (M, denoted M: LQ=medium) is not used.
(37) FIGS. 5A-5H show various configurations of the different wireless communications links of a binaural hearing assistance system according to the present disclosure. The binaural hearing assistance system comprises first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) adapted to exchange audio and control signals (including link quality measures) between them via a first wireless interface enabling the establishment of a first communication link (denoted 1 in FIGS. 5A-5H) based on Near-Field (NF), e.g. inductive, communication. Each of the first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) further comprises a second wireless interface enabling the establishment of a second communication link (denoted 2 in FIGS. 5A-5H) based on Far-Field communication (radiated fields (RF)) to an auxiliary device (AD). In FIGS. 5A-5H, the individual first and second communication link are illustrated as separate audio (bold line) and control (thin line) channels (typically one-way audio and two-way control channels). An inactive link (or a link with low or inferior transmission quality) is indicated in dashed line. Uni- and bi-directionality are indicated by arrows. Each of the first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) and the auxiliary device (AD) comprise appropriate antenna and transceiver circuitry as necessary to implement the first and second communication links (and may e.g. be embodied as described in connection with FIG. 2). In FIGS. 5A-5H the antenna and transceiver circuitry is only indicated in the auxiliary device (denoted Rx/Tx), but implicit in the hearing assistance devices. In some embodiments, the first (1) and/or second (2, 2) communication links are configured to allow bi-directional audio transmission, transmission in both directions are enabled at a given time (sometimes termed duplex). In some embodiments, the first (1) and/or second (2, 2) communication links are configured to allow bi-directional audio transmission, but in one direction at a given time (sometimes termed half duplex).
(38) FIG. 5A illustrates a normal situation where both of the second RF-links (2) from the auxiliary device (AD) to the first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) are active, whereas the inductive link (1) between the first and second hearing assistance devices is deactivated (except for a control channel for bi-directional exchange of control signals). It may e.g. illustrate a situation where the same audio signal is streamed (broadcast) from the transceiver (Rx/Tx) of the auxiliary device (AD) (e.g. an entertainment device, e.g. a telephone) to the first and second hearing assistance devices (HAD.sub.1, HAD.sub.2). Second link quality measures (LQ2) representing estimates of the link qualities of the second RF-communication links to the respective first and second hearing assistance devices are exchanged between the hearing assistance devices on the 2-way control channel of the first inductive communication link.
(39) FIG. 5B illustrates a situation like the one described in FIG. 5A but where instead different audio signals are transmitted from the auxiliary device to the respective first and second hearing assistance devices (HAD.sub.1, HAD.sub.2). The scenario may e.g. represent a stereo signal being transmitted from the auxiliary device to the binaural hearing aid system. Alternatively, it may represent a situation where two independent audio signals are transmitted to the respective hearing assistance devices.
(40) FIG. 5C illustrates a situation, where each of the first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) is configured to establish a separate second RF-link (2, 2) to respective first and second auxiliary devices (AD.sub.1, AD.sub.2). In this setup, each of the first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) may receive independent audio signals. The first hearing assistance device may e.g. receive a live transmission (e.g. from a telephone or a radio) from the first auxiliary device, and the second hearing assistance device may e.g. receive a recorded transmission (e.g. of music, or an audio book, etc.) from the second auxiliary device. The two separate second RF-links (2, 2) may implement wireless RF-interfaces according to the same specification (e.g. classic Bluetooth) or to different specifications (e.g. one according to classic Bluetooth, and one according to another standardized (e.g. DECT or Bluetooth Low Energy) or proprietary specification). The two, possibly independent, sources may be active at complementary points in time or be overlapping in time. The different audio signals received in the first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) may be exchanged between the hearing assistance devices via the first inductive communication link (1). Thereby both devices have access to both audio signals, and hence, a combined (possibly a weighted combination) can be presented to the user at both ears (possibly differently weighted at the two ears).
(41) In an alternative embodiment, the (single) auxiliary device AD contains two RF, e.g. Bluetooth (BT), transmitters (Rx/Tx). One transmitter sends the signal to the first hearing assistance device (e.g. HAD.sub.1) using a first BT-channel (2); the second transmitter sends the same signal by a different BT-channel (2) to the other hearing assistance device (e.g. HAD.sub.2). In this embodiment, the hearing assistance devices are configured to interchange the two received signals (and/or link quality measures of the respective BT-links/channels (2, 2)) via the first (inductive) communication link (1). Hence, the signal with the best quality can be presented at both ears (either a) as determined in each hearing assistance device separately, based on the received versions of the signal transmitted from the auxiliary device, or b) by comparison of link quality measures for the two BT-channels at the given point in time; and subsequently transfer of the signal with the best quality to the respective other device). The advantage would be that the two transmission channels (2, 2) are not necessarily jammed by the same amount of noise (at a given time), whereby the probability of receiving a signal of sufficient quality at both hearing assistance devices is increased.
(42) In an embodiment, the binaural hearing assistance system is arranged to provide that both hearing assistance devices (HAD.sub.1, HAD.sub.2)at the same timemay transmit different signals to an auxiliary device (AD) via respective RF and/or inductive communication links. This requires e.g. that the auxiliary device (AD) comprises two different RF (e.g. BT) receivers or one RF and one inductive receiver (or two inductive receivers).
(43) In another embodiment of a system comprising two auxiliary devices, each of the auxiliary devices comprise a microphone. In this scenario such microphones could be used to pick up sound from two independent audio sources (e.g. two different speakers, e.g. to aid a hearing impaired person in a conversation with two different persons in a noisy environment, e.g. a restaurant). In an embodiment, at least one of the two (such as both) auxiliary devices each comprise a SmartPhone configured to be used as an external microphone for the hearing assistance devices.
(44) FIG. 5D illustrates a scenario as described in connection with FIG. 5A, but where additionally or alternatively, an RF-link between the first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) can be established. The interaural RF-link may be used to exchange control signals orif convenient in a given situation audio signals between the first and second hearing assistance devices. In the embodiment shown in FIG. 5D the audio channels of the interaural links between the first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) are deactivated, whereas the (bi-directional) control channels are active. In an embodiment, the same (duplicate) data can be exchanged on the two links to increase reliability. Alternatively, different data can be exchanged on the two links, e.g. link quality data on one link and other data on the other. In an embodiment, data are transmitted and distributed on the two links depending on the current bandwidth requirements. In an embodiment, control data are exchanged between the first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) on the inductive link (1), whereas audio data are exchanged between first and second hearing assistance devices on the RF-link (2).
(45) FIG. 5E illustrates a situation where the link quality of the RF-link (2) from the auxiliary device (AD) to the second hearing assistance device (HAD.sub.2) is inferior, here due to attenuation of the RF-signal due to the presence of a diffractive medium (here the user's head, as indicated in FIG. 5E by the shaded area denoted diffraction) in the transmission path between the auxiliary device and the second hearing assistance device). The binaural hearing assistance system is configured to (e.g. automatically, based on the link quality measures LQ2 of the RF-links) reconfigure the communication links, so that the audio signal received at the first hearing assistance devices (HAD.sub.1) via RF-link (2) from the auxiliary device (AD) is relayed to the second hearing assistance device (HAD.sub.2) via the interaural inductive link (1). Thereby the audio signals can be presented to the user at both ears even though one of the RF-links from the auxiliary device is inferior.
(46) FIG. 5F illustrates a situation similar to the one in FIG. 5E, but where the inferior link quality of the RF-link (2) from the auxiliary device (AD) to the second hearing assistance device (HAD.sub.2) is due to jamming of the RF-signal to the second hearing assistance device (HAD.sub.2), e.g. from a portable communication device, e.g. a cellular telephone. The reaction of the binaural hearing assistance system is the same as in the scenario of FIG. 5E.
(47) FIG. 5G illustrates a situation similar to the one in FIG. 5F, but where the auxiliary device itself (AD), here a cellular telephone, jams the second transceiver circuitry in the second hearing assistance device (HAD.sub.2) (too close to the transmitter of the cellular telephone), thereby prohibiting the device from receiving the audio signal from the cellular telephone. In the scenario of FIG. 5G, the RF-link (2) from the cellular telephone (AD) to the first hearing assistance device (HAD.sub.1) is functional and the binaural hearing assistance system is configured to relay the audio signal received in the first hearing assistance device to the second first hearing assistance device via the interaural inductive link (1).
(48) FIG. 5H illustrates a situation, where audio signals from the hearing assistance devices(s) (HAD.sub.1, HAD.sub.2) (e.g. picked up by a microphone of the hearing assistance devices(s)) are transmitted to the auxiliary device(s) (AD), here illustrated as a cell phone. This scenario may reflect a telephone conversation, where the user's voice is picked up by microphones of the hearing assistance devices and transmitted back to the cell phone via the second communication link(s) (2). In this scenario, the second (RF) communication links are configured to be bi-directional (duplex) links. In the illustrated example, a situation as also described in connection with FIG. 5E, prevails. Here, the 2.sup.nd RF-link (2) from the cell phone to the second hearing assistance device (HAD.sub.2) is inferior (e.g. due to shadowing effect of the user's head, diffraction in FIG. 5H). Consequently, the binaural hearing assistance system is configured to transmit (relay) audio signals received by the first hearing assistance device (HADD from the cell phone (AD) to the second hearing assistance device (HAD.sub.2) on the first (inductive) communication link (1). Further, the system is configured to transmit the microphone signal picked up by the second hearing assistance device (HAD.sub.2) to the first hearing assistance device (HAD.sub.1) via the 1.sup.st inductive link (1), where it e.g. is mixed with a microphone signal picked up by a microphone of the first hearing assistance device (HAW. A resulting, mixed microphone signal is transmitted (back) to the cell phone (AD) via the 2.sup.nd RF-link from the first hearing assistance device (HAD.sub.1).
(49) FIGS. 6A-6B schematically show embodiments of a binaural hearing assistance system comprising first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) in communication with an auxiliary device (AD) implementing a specific power saving mode of operation. In this power saving mode of operation, the binaural hearing assistance system is adapted to transmit audio signals from the auxiliary device (AD) to the first and second hearing assistance devices (HAD.sub.1, HAD.sub.2) by alternatingly using the 2.sup.nd communication link (2) to the first and second hearing assistance devices (one at a time), respectively, and continuously using the 1.sup.st communication link (1) to relay the audio signal to the other hearing assistance device. In the specific power saving mode of operation, only one of the second communications links (2) between an auxiliary device (AD) and a hearing assistance device (HAD.sub.1 or HAD.sub.2) is actively receiving audio (or is active at all) at a given time. FIGS. 6A and 6B illustrates the two possible configurations of the system in the specific power saving mode. FIG. 6A corresponds to a first point in time t.sub.1 (denoted @time=t.sub.1 in FIG. 6A), where the second communication link to the first hearing assistance device (HAD.sub.1) is active. FIG. 6B corresponds to a second point in time t.sub.2 (denoted @time=t.sub.2 in FIG. 6B), where the second communication link to the second hearing assistance device (HAD.sub.2) is active. The binaural hearing assistance system may e.g. be configured to switch between the first and second hearing assistance device as the sole recipient of an audio signal via the second communication link with a predefined switch frequency, e.g. every hour, and/or controlled by a user via a user interface and/or in connection with a power-up after a power-down.
(50) FIGS. 7A-7C show embodiments of an auxiliary device functioning as a user interface for a binaural hearing aid system according the present disclosure, FIGS. 7A, 7B and 7C illustrating three different audio routing scenarios between the auxiliary device and the hearing assistance devices, such routing being selectable via the graphical user interface of the auxiliary device (e.g. based on link quality measures illustrated in the display).
(51) The user interface is implemented in the auxiliary device, e.g. as a remote control device, e.g. implemented as an APP, e.g. as an APP of a SmartPhone, from which a user can select a suitable routing of an audio signal from the auxiliary device to each of the first and second hearing assistance devices. The auxiliary device comprises a graphical interface (e.g. a touch sensitive display) allowing a user to control the 1.sup.st and 2.sup.nd communication links by activating or deactivating a link in the current arrangement of devices (e.g. by clicking on different parts of the arrowed lines representing the 1.sup.st and 2.sup.nd communication links in the display). Preferably, the estimated current audio link quality (LQ) of the audio links are illustrated via the graphical user interface, cf. indications H, M, L, indicating a high, a medium, and a low link quality, respectively (as also described in connection with FIG. 4). This indication may be utilized to manually override an automatic routing strategy implemented in the hearing assistance system. In an embodiment, the estimated current audio link quality of at least the 2.sup.nd communication links from the auxiliary device to the hearing assistance devices are indicated. Preferably, the estimated current audio link qualities in both directions of the 1.sup.st communication link between the hearing assistance devices are included as well. It is to be understood that the activation or deactivation of the 1.sup.st communication link is intended to only concern the audio signal part of the transmitted signal. In general, the control signal part of the 1.sup.st communication link, including the link quality measures (LQ2 and optionally LQ1(HAD.sub.1->HAD.sub.r) and LQ1(HAD.sub.r->HAD.sub.1) exchanged between the two hearing assistance devices (HAD.sub.1, HAD.sub.r) is intended to be always on (at least in an audio reception mode where audio signals are to be received from the auxiliary device).
(52) A given audio link can be activated (or deactivated) by clicking on a central part of the bold line representing the link in question. A direction of transmission can be selected (or deselected) by clicking on an end of the line representing the link in question. FIGS. 7A-7C show examples of possible routing scenarios. FIG. 7A shows a situation where the audio link to the left hearing assistance device (HAD.sub.1) is deactivated (having a low estimated link quality L), so the audio signal to the left hearing assistance device (HAD.sub.1) is provided by the RF-link to the right hearing assistance device (HAD.sub.r) (having a high estimated link quality H), and relayed further by the inductive link to the left hearing assistance device (HAD.sub.1). FIG. 7B shows a situation (e.g. a test scenario) where the audio link to the right hearing assistance device (HAD.sub.r) is deactivated (having a high estimated link quality H), so the audio signal to the right hearing assistance device (HAD.sub.r) is provided by the RF-link to the left hearing assistance device (HAD.sub.r) (having a low estimated link quality L) and further by the inductive link to right hearing assistance device (HAD.sub.r). FIG. 7C shows a situation (e.g. a normal scenario) where both of the RF-links to the left and right hearing assistance devices (HAD.sub.1, HAD.sub.r) (both having a high estimated link quality H) are active, whereas the inductive link between the left and right hearing assistance devices is deactivated (except for control signals). Thereby routing of audio signals between an auxiliary device and a pair of hearing assistance devices can be controlled according to a user's wishes via the user interface.
(53) In the embodiment of FIGS. 7A-7C, the user interface is assumed to form part of the auxiliary device that also provides the audio signal (e.g. integrated in a SmartPhone or tablet computer or a music delivery device). Alternatively, the user interface and the audio signal delivery device may be implemented in two different devices, e.g. a remote control (user interface) and a TV-set (audio source), respectively.
(54) The invention is defined by the features of the independent claim(s). Preferred embodiments are defined in the dependent claims. Any reference numerals in the claims are intended to be non-limiting for their scope.
(55) Some preferred embodiments have been shown in the foregoing, but it should be stressed that the invention is not limited to these, but may be embodied in other ways within the subject-matter defined in the following claims and equivalents thereof.
REFERENCES
(56) US2008159548A1 (STARKEY) 3 Mar. 2008
(57) US2007291970A1 (SAT) 20 Dec. 2007
(58) EP1107472A2 (SONY) 13 Jun. 2001
(59) EP1777644A1 (OTICON) 24 May 2007
(60) US20050110700A1 (STARKEY/OTICON) 26 May 2005
(61) US2011222621A1 (OTICON) 15 Sep. 2011
(62) WO2005055654 (STARKEY/OTICON) 16 Jun. 2005
(63) WO2005053179 (STARKEY/OTICON) 9 Jun. 2005
(64) US20050255843A1 (STARKEY/OTICON) 17 Nov. 2005.
