Ear interface detection
10586521 ยท 2020-03-10
Assignee
Inventors
Cpc classification
G10K11/17881
PHYSICS
G10K11/178
PHYSICS
H04R2499/11
ELECTRICITY
G10K11/1783
PHYSICS
G10K11/17817
PHYSICS
G10K2210/30351
PHYSICS
International classification
G10K11/178
PHYSICS
Abstract
An ear interface mode of headphones may be determined by measuring an acoustic response of the headphones. For example, the headphones may be determined to be in a leaky or sealed configuration. An adaptive noise cancellation (ANC) system may be controlled based on the determined ear interface mode of the headphones. For example, a set of configuration parameters may be loaded for the ANC system corresponding to the known ear interface mode. An anti-noise signal may be generated according to the selected configuration parameters, and that anti-noise signal added during playback of media, such as voice recordings, music, videos, or telephone call speech.
Claims
1. A method, comprising: setting a temporary set of configuration parameters for an adaptive noise cancellation (ANC) system including the headphone device; determining if the headphone device is inserted into or on a user's ear; and when the headphone device is determined to be inserted into or on the user's ear: determining an acoustic response of the headphone device by estimating a secondary path of the adaptive noise cancellation (ANC) system; determining an ear interface mode among two or more ear interface modes of the headphone device based, at least in part, on the acoustic response of the headphone device including the secondary path; selecting a set of configuration parameters for the adaptive noise cancellation (ANC) system based, at least in part, on the determined ear interface mode; and outputting an audio signal to the headphone device, wherein the audio signal includes an anti-noise signal generated by the adaptive noise cancellation (ANC) system based, at least in part, on the selected set of configuration parameters, wherein the step of determining the ear interface mode comprises determining whether the headphone device is configured with an ear tip or is configured without an ear tip.
2. The method of claim 1, wherein the step of determining the ear interface mode comprises determining whether the headphone device is in a leaky ear interface mode or is in a sealing ear interface mode.
3. The method of claim 1, wherein the step of selecting the set of configuration parameters comprises selecting a set of adaptive noise cancellation (ANC) parameters for playback of media through the headphone device, and wherein the audio signal includes playback of the media adjusted according to the set of adaptive noise cancellation (ANC) parameters.
4. The method of claim 1, wherein the step of determining the acoustic response of the headphone device comprises outputting an inaudible signal to the headphone device to calculate an acoustic volume of the secondary path.
5. The method of claim 1, further comprising: determining the headphone device is inserted in a user's ear, wherein the step of determining the acoustic response of the headphone device is performed after the step of determining the headphone device is inserted in the user's ear.
6. The method of claim 1, wherein the step of determining the ear interface mode among two or more ear interface modes comprises comparing the acoustic response with a look-up table of known acoustic responses and corresponding ear interface modes.
7. An apparatus, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to perform steps comprising: setting a temporary set of configuration parameters for an adaptive noise cancellation (ANC) system including the headphone device; determining if the headphone device is inserted into or on a user's ear; and when the headphone device is determined to be inserted into or on the user's ear: determining an acoustic response of a headphone device by estimating a secondary path of an adaptive noise cancellation (ANC) system including the headphone device; determining an ear interface mode among two or more ear interface modes of the headphone device based, at least in part, on the acoustic response of the headphone of device including the secondary path; selecting a set of configuration parameters for the adaptive noise cancellation (ANC) system based, at least in part, on the determined ear interface mode; and outputting an audio signal to the headphone device, wherein the audio signal includes an anti-noise signal generated by the adaptive noise cancellation (ANC) system based, at least in part, on the selected set of configuration parameters, wherein the step of determining the ear interface mode comprises determining whether the headphone device is configured with an eartip or is configured without an ear tip.
8. The apparatus of claim 7, wherein the step of determining the ear interface mode comprises determining whether the headphone device is in a leaky ear interface mode or is in a sealing ear interface mode.
9. The apparatus of claim 7, wherein the step of selecting the set of configuration parameters comprises selecting a set of adaptive noise cancellation (ANC) parameters for playback of media through the headphone device, and wherein the audio signal includes playback of the media adjusted according to the set of adaptive noise cancellation (ANC) parameters.
10. The apparatus of claim 7, wherein the step of determining the acoustic response of the headphone device comprises outputting an inaudible signal to the headphone device to calculate an acoustic volume of the secondary path.
11. The apparatus of claim 7, wherein the processor is further configured to perform steps comprising: determining the headphone device is inserted in a user's ear, wherein the step of determining the acoustic response of the headphone device is performed after the step of determining the headphone device is inserted in the user's ear.
12. The apparatus of claim 7, wherein the step of determining the ear interface mode among two or more ear interface modes comprises comparing the acoustic response with a look-up table of known acoustic responses and corresponding ear interface modes.
13. A computer program product, comprising: a non-transitory computer readable medium comprising code to perform steps comprising: setting a temporary set of configuration parameters for an adaptive noise cancellation (ANC) system including the headphone device; determining if the headphone device is inserted into or on a user's ear; when the headphone device is determined to be inserted into or on the user's ear: determining an acoustic response of a headphone device by estimating a secondary path of an adaptive noise cancellation (ANC) system including the headphone device; determining an ear interface mode among two or more ear interface modes of the headphone device based, at least in part, on the acoustic response of the headphone of device including the secondary path; selecting a set of configuration parameters for the adaptive noise cancellation (ANC) system based, at least in part, on the determined ear interface mode; and outputting an audio signal to the headphone device, wherein the audio signal includes an anti-noise signal generated by the adaptive noise cancellation (ANC) system based, at least in part, on the selected set of configuration parameters, wherein the step of determining the ear interface mode comprises determining whether the headphone device is configured with an ear tip or is configured without an ear tip.
14. The computer program product of claim 13, wherein the step of determining the ear interface mode comprises determining whether the headphone device is in a leaky ear interface mode or is in a sealing ear interface mode.
15. The computer program product of claim 13, wherein the medium further comprises code to perform the steps comprising: determining the headphone device is inserted in a user's ear, wherein the step of determining the acoustic response of the headphone device is performed after the step of determining the headphone device is inserted in the user's ear.
16. The computer program product of claim 13, wherein the step of determining the ear interface mode among two or more ear interface modes comprises comparing the acoustic response with a look-up table of known acoustic responses and corresponding ear interface modes.
17. The computer program product of claim 13, wherein the step of selecting the set of configuration parameters comprises selecting a set of adaptive noise cancellation (ANC) parameters for playback of media through the headphone device, and wherein the audio signal includes playback of the media adjusted according to the set of adaptive noise cancellation (ANC) parameters.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) For a more complete understanding of the disclosed system and methods, reference is now made to the following descriptions taken in conjunction with the accompanying drawings.
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
DETAILED DESCRIPTION
(11)
(12) The mobile device 102 may also include a near-speech microphone 136, an error microphone 134, and a reference microphone 132, each of which may be an analog or digital microphone. Each of the microphones 132, 134, and 136 receive audible sounds fields and translate the acoustic sound fields into electrical signals for processing by the circuit 120. For example, the near-speech microphone 136 may receive speech during a conversation occurring during a phone call. In another example, the error microphone 134 may receive the acoustic sound field 150 generated by the speaker 104. In a further example, the reference microphone 132 may be positioned away from a typical position of a user's mouth and may measure an ambient acoustic environment.
(13) In some embodiments, aspects of the ANC system described above may be implemented through headphone earbuds. For example, the speaker 104 may be located inside a headphone earbud that is configured to rest on a user's ear 160 or fit within an ear canal of the user's ear 160. Furthermore, any one or more of the microphones 132, 134, and 136 may be integrated with the headphone device, either into the earbud or as a microphone attached to a line leading to the earbuds. The circuit 120 may perform steps to determine a configuration of a headphone device containing the speaker 104 and implement configuration parameters in an ANC system based on the determined configuration. For example, the processor 124 may determine a transfer function for a secondary path of the ANC system between the speaker 104 and one of the microphones 132, 134, and 136. The determined transfer function may be identified as corresponding to headphones with no overmolds (e.g., ear tips), overmolds with a leaky seal, or overmolds with a tight seal. The processor 124 may set configuration parameters for the ANC system implemented by the circuit 120 based on the determined headphone ear interface mode. When the mobile device 102 plays audio through the headphones, the ANC system may generate an anti-noise signal for adjusting the audio output to the speaker 104. The anti-noise signal may be based on input from one or more of the microphones 132, 134, and 136 and also based on the set configuration parameters.
(14) One method that may be implemented by the processor 124 of the mobile device 102, or any logic circuitry in any electronic device, for identifying an ear interface mode for a headphone and configuring the device for the ear interface mode is described with reference to
(15) A determination of ear interface mode may be made by analyzing an acoustic response of the transducer in the headphones. A measurement of the acoustic response may be made by outputting an audio signal to the transducer and measuring audio with a microphone near the transducer. The transducer and microphone may be coupled through acoustic volume in the ear canal, and characteristics of the acoustic volume may change based on the ear interface mode of the headphones. A measurement of a secondary path acoustic volume may provide the characteristics of the acoustic volume that may be used to determine the ear interface mode. The output audio signal for the measurement may be audible or inaudible. In some embodiments, the output audio signal may be piggybacked onto a start-up signal output to the transducer when the mobile phone initializes or begins playback of audio. The measurement may be compared to a known acoustic volume signature to determine an ear interface mode that the headphone is most likely to be configured in. For example, the measurement may be compared to several known acoustic volume signatures and an integral of the difference between the signature and each measurement computed, wherein the signature with the lowest integral is determined to be the ear interface mode. Some known acoustic volume signatures are shown in
(16) A method for controlling an audio system based on ear interface mode by estimating a secondary path is described with reference to
(17) The determination of the ear interface mode may be hindered when the headphone device is not inserted in or on the user's ear. That is, the acoustic volume of the user's ear canal may not be measured until the headphone device is in or on the user's ear. Thus, the determination of ear interface mode and configuration of the audio system thereof may be not performed until after insertion in the user's ear is detected. A method for operating the audio system to wait for insertion into the user's ear is described with reference to
(18) The determination of whether the headphone device is in an on ear state, such as when the headphone device is in or on the user's ear, or in an off ear state may affect the measured acoustic response of the headphone device. A comparison of the acoustic response in an on ear and off ear condition is shown in
(19) A determined ear interface mode may be provided to an adaptive noise cancellation (ANC) system for adapting the noise control system.
(20) The ANC circuit 730 may generate an anti-noise signal, which is provided to a combiner 726. The anti-noise signal may be generated based on a selected set of configuration parameters. The configuration parameters may be selected based on a determination of an ear interface mode for the headphone device containing the transducer 104. In some embodiments, the configuration parameters may be written into memory, such as registers, within the ANC circuit 730, after determination of the ear interface. The writing of the configuration parameters to the memory may be performed under control of an application processor coupled to the circuit 720, such as a central processing unit (CPU) located within the mobile device containing the circuit 720. Such an application processor may be executing a mobile application that performs testing of the acoustic response of the headphone device or that receives user input regarding the ear interface mode. The combiner 726 combines the anti-noise signal from the ANC circuit 730 with sound from the near speech microphone 136, internal audio 726, and audio signals. The audio signals may be received wirelessly through an antenna 728 and processed by a radio frequency (RF) circuit 722, such as when the audio signals are a wireless telephone call or audio streamed from over a network connection. The audio signals may also or alternatively be received from a local memory 740, such as when the audio signals are locally-stored music or ringtones. A multiplexer 742 may be present to select an audio signal for input to the combiner 726. The internal audio 736 may be, for example, ringtones, audio files, and/or audio portions of video files. Audio signals received through the antenna 728 may be, for example, streamed analog or digital audio signals and/or telephone conversations. The combiner 726 provides a single signal to a digital-to-analog converter (DAC) 723. The DAC 723 converts the digital signal of the combiner 723 to an analog audio signal for amplification by the amplifier 122 and output at the speaker 104.
(21) During some operation of the ANC systems described above, the ANC system may operate using a temporary parameter set. The temporary parameter set may be a parameter set known to safely control the ANC output regardless of the ear interface mode of an attached headset. For example, referring back to block 502 of
(22)
(23) Example embodiments described above illustrate the determination of the presence of ear molding on headphones and modifying operation of an adaptive noise cancellation (ANC) system to match the headphones. The ear molding of the headphones may correspond to different ear interface modes. However, the presence of or configuration of ear molding is only one example physical characteristic that may produce different ear interface modes. Furthermore, embodiments of the invention may perform other functionality on different devices. For example, different characteristics of headphones may result in different ear interface configurations resulting in different acoustic responses for different headphones or different acoustic responses for a single headphone. That is, the molding on, or otherwise the shape of, the headphones is only one possible characteristic affecting ear interface mode. Other factors, such as ear tip size, configuration of the string attaching the two earbuds of the headphones, and/or presence of a clip for holding the earbud in the ear, may affect the acoustic response and used to determine an ear interface mode of the headphones. Furthermore, the transducer being used to output sounds from the ANC system may be located in any type of housing, in which headphones are only one example. For example, the transducer may be located in speakers.
(24) The schematic flow chart diagrams of
(25) The operations described above as performed by a controller, DSP, or ANC system may be performed by any circuit configured to perform the described operations. Such a circuit may be an integrated circuit (IC) constructed on a semiconductor substrate and include logic circuitry, such as transistors configured as logic gates, and memory circuitry, such as transistors and capacitors configured as dynamic random access memory (DRAM), electronically programmable read-only memory (EPROM), or other memory devices. The logic circuitry may be configured through hard-wire connections or through programming by instructions contained in firmware. Further, the logic circuitry may be configured as a general purpose processor capable of executing instructions contained in software. If implemented in firmware and/or software, functions described above may be stored as one or more instructions or code on a computer-readable medium. Examples include non-transitory computer-readable media encoded with a data structure and computer-readable media encoded with a computer program. Computer-readable media includes physical computer storage media. A storage medium may be any available medium that can be accessed by a computer. By way of example, and not limitation, such computer-readable media can comprise random access memory (RAM), read-only memory (ROM), electrically-erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store desired program code in the form of instructions or data structures and that can be accessed by a computer. Disk and disc includes compact discs (CD), laser discs, optical discs, digital versatile discs (DVD), floppy disks and Blu-ray discs. Generally, disks reproduce data magnetically, and discs reproduce data optically. Combinations of the above should also be included within the scope of computer-readable media.
(26) In addition to storage on computer readable medium, instructions and/or data may be provided as signals on transmission media included in a communication apparatus. For example, a communication apparatus may include a transceiver having signals indicative of instructions and data. The instructions and data are configured to cause one or more processors to implement the functions outlined in the claims.
(27) Although the present disclosure and certain representative advantages have been described in detail, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the disclosure as defined by the appended claims. Moreover, the scope of the present application is not intended to be limited to the particular embodiments of the process, machine, manufacture, composition of matter, means, methods and steps described in the specification. For example, although digital signal processors (DSPs) are described throughout the detailed description, aspects of the invention may be applied to the design of other processors, such as graphics processing units (GPUs) and central processing units (CPUs). As one of ordinary skill in the art will readily appreciate from the present disclosure, processes, machines, manufacture, compositions of matter, means, methods, or steps, presently existing or later to be developed that perform substantially the same function or achieve substantially the same result as the corresponding embodiments described herein may be utilized. Accordingly, the appended claims are intended to include within their scope such processes, machines, manufacture, compositions of matter, means, methods, or steps.