Oversight control of an adaptive noise canceler in a personal audio device
09633646 ยท 2017-04-25
Assignee
Inventors
- Jon D. Hendrix (Wimberly, TX)
- Ali Abdollahzadeh Milani (Austin, TX)
- Nitin Kwatra (Austin, TX, US)
- Dayong Zhou (Austin, TX)
- Yang Lu (Cedar Park, TX, US)
- Jeffrey Alderson (Austin, TX)
Cpc classification
G10K2210/108
PHYSICS
G10K11/17881
PHYSICS
G10K2210/3226
PHYSICS
G10K11/17833
PHYSICS
H04R2499/11
ELECTRICITY
G10K11/17885
PHYSICS
G10K2210/3216
PHYSICS
G10K2210/3017
PHYSICS
G10K2210/1081
PHYSICS
International classification
G10K11/16
PHYSICS
H04R1/10
ELECTRICITY
Abstract
A personal audio device, such as a wireless telephone, includes an adaptive noise canceling (ANC) circuit that adaptively generates an anti-noise signal from a reference microphone signal and injects the anti-noise signal into the speaker or other transducer output to cause cancellation of ambient audio sounds. An error microphone is also provided proximate the speaker to measure the ambient sounds and transducer output near the transducer, thus providing an indication of the effectiveness of the noise canceling. A processing circuit uses the reference and/or error microphone, optionally along with a microphone provided for capturing near-end speech, to determine whether the ANC circuit is incorrectly adapting or may incorrectly adapt to the instant acoustic environment and/or whether the anti-noise signal may be incorrect and/or disruptive and then take action in the processing circuit to prevent or remedy such conditions.
Claims
1. A personal audio device, comprising: a personal audio device housing; a transducer mounted on the housing for reproducing an audio signal including both source audio for playback to a listener and an anti-noise signal for countering the effects of ambient audio sounds in an acoustic output of the transducer; a reference microphone mounted on the housing for providing a reference microphone signal indicative of the ambient audio sounds; an error microphone mounted on the housing in proximity to the transducer for providing an error microphone signal indicative of the acoustic output of the transducer and the ambient audio sounds at the transducer; and a processing circuit that implements at least one adaptive filter having a response that generates the anti-noise signal from the reference signal to reduce the presence of the ambient audio sounds heard by the listener, wherein the processing circuit implements a coefficient control block that shapes the response of the at least one adaptive filter in conformity with the error microphone signal and the reference microphone signal by computing coefficients that determine the response of the adaptive filter to minimize the ambient audio sounds at the error microphone, and wherein the processing circuit detects that an ambient audio event is occurring that could cause the adaptive filter to generate an undesirable component in the anti-noise signal and changes the adapting of the at least one adaptive filter independent of the computing of the coefficients by the coefficient control block, wherein the ambient audio event is wind noise, scratching on the housing of the personal audio device, a substantially tonal ambient sound, or a signal level of the reference microphone signal falling outside of a predetermined range.
2. The personal audio device of claim 1, wherein the processing circuit changes the adaptation of the adaptive filter by halting the adaptation of the at least one of the adaptive filter.
3. The personal audio device of claim 1, wherein the processing circuit mutes the anti-noise signal during the ambient audio event.
4. The personal audio device of claim 1, wherein the processing circuit sets one or more coefficients of the at least one adaptive filter to a predetermined value to remedy disruption of the adapting of the response of the at least one adaptive filter by the ambient audio event.
5. The personal audio device of claim 1, wherein the ambient audio event is a level of the reference microphone signal falling outside of a predetermined range.
6. The personal audio device of claim 1, wherein the ambient audio event is substantially tonal.
7. The personal audio device of claim 1, wherein the ambient audio event is near-end speech.
8. A method of canceling ambient audio sounds in the proximity of a transducer of a personal audio device, the method comprising: first measuring ambient audio sounds with a reference microphone to produce a reference microphone signal; second measuring an output of the transducer and the ambient audio sounds at the transducer with an error microphone; adaptively generating an anti-noise signal by computing coefficients that control a response of an adaptive filter from a result of the first measuring and the second measuring for countering the effects of ambient audio sounds at an acoustic output of the transducer by adapting the response of the adaptive filter, wherein the adaptive filter filters an output of the reference microphone to generate the anti-noise signal; combining the anti-noise signal with a source audio signal to generate an audio signal provided to the transducer; detecting that an ambient audio event is occurring that could cause the adaptive filter to generate an undesirable component in the anti-noise signal, wherein the ambient audio event is wind noise, scratching on a housing of the personal audio device, a substantially tonal ambient sound, or a signal level of the reference microphone signal falling outside of a predetermined range; and responsive to the detecting, changing the adapting of the at least one adaptive filter independent of the computing of the coefficients.
9. The method of claim 8, wherein the changing changes the adaptation of the adaptive filter by halting the adaptation of the at least one of the adaptive filter.
10. The method of claim 8, further comprising muting the anti-noise signal during the ambient audio event.
11. The method of claim 8, wherein the changing sets one or more coefficients of the at least one adaptive filter to a predetermined value to remedy disruption of the adapting of the response of the at least one adaptive filter by the ambient audio event.
12. The method of claim 8, wherein the ambient audio event is a level of the reference microphone signal falling outside of a predetermined range.
13. The method of claim 8, wherein the ambient audio event is substantially tonal.
14. The method of claim 8, wherein the ambient audio event is near-end speech.
15. An integrated circuit for implementing at least a portion of a personal audio device, comprising: an output for providing a signal to a transducer including both source audio for playback to a listener and an anti-noise signal for countering the effects of ambient audio sounds in an acoustic output of the transducer; a reference microphone input for receiving a reference microphone signal indicative of the ambient audio sounds; an error microphone input for receiving an error microphone signal indicative of the output of the transducer and the ambient audio sounds at the transducer; and a processing circuit that implements at least one adaptive filter having a response that generates the anti-noise signal from the reference signal to reduce the presence of the ambient audio sounds heard by the listener, wherein the processing circuit implements a coefficient control block that shapes the response of the at least one adaptive filter in conformity with the error microphone signal and the reference microphone signal by computing coefficients that determine the response of the adaptive filter to minimize the ambient audio sounds at the error microphone, and wherein the processing circuit detects that an ambient audio event is occurring that could cause the adaptive filter to generate an undesirable component in the anti-noise signal and changes the adapting of the at least one adaptive filter independent of the computing of the coefficients by the coefficient control block, wherein the ambient audio event is wind noise, scratching on a housing of the personal audio device, a substantially tonal ambient sound, or a signal level of the reference microphone signal falling outside of a predetermined range.
16. The integrated circuit of claim 15, wherein the processing circuit changes the adaptation of the adaptive filter by halting the adaptation of the at least one of the adaptive filter.
17. The integrated circuit of claim 15, wherein the processing circuit mutes the anti-noise signal during the ambient audio event.
18. The integrated circuit of claim 15, wherein the processing circuit sets one or more coefficients of the at least one adaptive filter to a predetermined value to remedy disruption of the adapting of the response of the at least one adaptive filter by the ambient audio event.
19. The integrated circuit of claim 15, wherein the ambient audio event is a level of the reference microphone signal falling outside of a predetermined range.
20. The integrated circuit of claim 15, wherein the ambient audio event is substantially tonal.
21. The integrated circuit of claim 15, wherein the ambient audio event is near-end speech.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
DESCRIPTION OF ILLUSTRATIVE EMBODIMENT
(7) The present invention encompasses noise canceling techniques and circuits that can be implemented in a personal audio device, such as a wireless telephone. The personal audio device includes an adaptive noise canceling (ANC) circuit that measures the ambient acoustic environment and generates a signal that is injected in the speaker (or other transducer) output to cancel ambient acoustic events. A reference microphone is provided to measure the ambient acoustic environment and an error microphone is included for controlling the adaptation of the anti-noise signal to cancel the ambient audio sounds and for correcting for the electro-acoustic path from the output of the processing circuit through the transducer. However, under certain acoustic conditions, e.g., when a particular acoustic condition or event occurs, the ANC circuit may operate improperly or in an unstable/chaotic manner. The present invention provides mechanisms for preventing and/or minimizing the impact of such conditions.
(8) Referring now to
(9) Wireless telephone 10 includes adaptive noise canceling (ANC) circuits and features that inject an anti-noise signal into speaker SPKR to improve intelligibility of the distant speech and other audio reproduced by speaker SPKR. A reference microphone R is provided for measuring the ambient acoustic environment, and is positioned away from the typical position of a user's mouth, so that the near-end speech is minimized in the signal produced by reference microphone R. A third microphone, error microphone E, is provided in order to further improve the ANC operation by providing a measure of the ambient audio combined with the audio reproduced by speaker SPKR close to ear 5, when wireless telephone 10 is in close proximity to ear 5. Exemplary circuit 14 within wireless telephone 10 includes an audio CODEC integrated circuit 20 that receives the signals from reference microphone R, near speech microphone NS and error microphone E and interfaces with other integrated circuits such as an RF integrated circuit 12 containing the wireless telephone transceiver. In other embodiments of the invention, the circuits and techniques disclosed herein may be incorporated in a single integrated circuit that contains control circuits and other functionality for implementing the entirety of the personal audio device, such as an MP3 player-on-a-chip integrated circuit.
(10) In general, the ANC techniques of the present invention measure ambient acoustic events (as opposed to the output of speaker SPKR and/or the near-end speech) impinging on reference microphone R, and by also measuring the same ambient acoustic events impinging on error microphone E, the ANC processing circuits of illustrated wireless telephone 10 adapt an anti-noise signal generated from the output of reference microphone R to have a characteristic that minimizes the amplitude of the ambient acoustic events at error microphone E. Since acoustic path P(z) extends from reference microphone R to error microphone E, the ANC circuits are essentially estimating acoustic path P(z) combined with removing effects of an electro-acoustic path S(z) that represents the response of the audio output circuits of CODEC IC 20 and the acoustic/electric transfer function of speaker SPKR including the coupling between speaker SPKR and error microphone E in the particular acoustic environment, which is affected by the proximity and structure of ear 5 and other physical objects and human head structures that may be in proximity to wireless telephone 10, when wireless telephone is not firmly pressed to ear 5. While the illustrated wireless telephone 10 includes a two microphone ANC system with a third near speech microphone NS, some aspects of the present invention may be practiced in a system that does not include separate error and reference microphones, or a wireless telephone uses near speech microphone NS to perform the function of the reference microphone R. Also, in personal audio devices designed only for audio playback, near speech microphone NS will generally not be included, and the near-speech signal paths in the circuits described in further detail below can be omitted, without changing the scope of the invention, other than to limit the options provided for input to the microphone covering detection schemes.
(11) Referring now to
(12) Referring now to
(13) To implement the above, adaptive filter 34A has coefficients controlled by SE coefficient control block 33, which compares downlink audio signal ds and error microphone signal err after removal of the above-described filtered downlink audio signal ds, that has been filtered by adaptive filter 34A to represent the expected downlink audio delivered to error microphone E, and which is removed from the output of adaptive filter 34A by a combiner 36A. SE coefficient control block 33 correlates the actual downlink speech signal ds with the components of downlink audio signal ds that are present in error microphone signal err. Adaptive filter 34A is thereby adapted to generate a signal from downlink audio signal ds (and optionally, the anti-noise signal combined by combiner 36B during muting conditions as described above), that when subtracted from error microphone signal err, contains the content of error microphone signal err that is not due to downlink audio signal ds. Event detection 39 and oversight control logic 38 perform various actions in response to various events in conformity with various embodiments of the invention, as will be disclosed in further detail below.
(14) Table 1 below depicts a list of ambient audio events or conditions that may occur in the environment of wireless telephone 10 of
(15) TABLE-US-00001 TABLE I Type of Ambient Audio Condition or Event Cause Issue Response Mechanical Noise at Wind, Scratching, etc. Unstable anti-noise, Mute anti-noise Microphone or ineffective cancelation Stop adapt W(z) instability of the Reset W(z) coefficients of W(z) in Optional 1: general Stop adapt SE(z) Reset/Backtrack SE(z) Alternative: Mute anti-noise Redirect anti-noise into SE(z) Howling Positive feedback Anti-noise generates Mute anti-noise caused by undesirable tone Stop adapt W(z) increased Stop adapt SE(z) acoustic coupling Reset W(z) between transducer Optional: and reference Reset/Backtrack SE(z) microphone Overloading noise SPL too high Clipping of signals in Stop adapt W(z) ANC circuit or Optionally mute transducer can't anti-noise produce enough output Optional: to cancel stop adapting SE(s) reset/backtrack SE(z) Silence Quiet Environment No reason to ANC, Stop adapt W(z) nothing to adapt to. Optionally mute anti-noise Tone Multiple Disrupts response of Stop adapt W(z) W(z) Near-end speech User talking Don't want to train to Stop adapt W(z) cancel near end speech or increase leakage Source audio too low Downlink audio silent, Insufficient level to Stop adapt SE(z) or playback of media train SE(z) stops
As illustrated in
(16) Referring now to
(17) Referring now to
(18) Referring now to
W.sub.k+1=(1).Math.W.sub.k+.Math.e.sub.k.Math.X.sub.k
where =2.sup.normalzed.sup._.sup.stepsize and normalized_stepsize is a control value to control the step between each increment of k, =2.sup.normalized.sup._.sup.leakage, where normalized_leakage is a control value that determines the amount of leakage, e.sub.k is the magnitude of the error signal, X.sub.k is the magnitude of the reference microphone signal ref, W.sub.k is the starting magnitude of the amplitude response of filter 44A and W.sub.k+1 is the updated value of the magnitude of the amplitude response of filter 44A. As mentioned above, increasing the leakage of LMS coefficient controller 54A can be performed when near-end speech is detected, so that the anti-noise signal is eventually generated from the fixed response, until the near-end speech has ended and the adaptive filter can again adapt to cancel the ambient environment at the listener's ear.
(19) In the system depicted in
(20) The above arrangement of baseband and oversampled signaling provides for simplified control and reduced power consumed in the adaptive control blocks, such as leaky LMS controllers 54A and 54B, while providing the tap flexibility afforded by implementing adaptive filter stages 44A-44B, 55A-55B and filter 51 at the oversampled rates. The remainder of the system of
(21) In accordance with an embodiment of the invention, the output of combiner 46D is also combined with the output of adaptive filter stages 44A-44B that have been processed by a control chain that includes a corresponding hard mute block 45A, 45B for each of the filter stages, a combiner 46A that combines the outputs of hard mute blocks 45A, 45B, a soft mute 47 and then a soft limiter 48 to produce the anti-noise signal that is subtracted by a combiner 46B with the source audio output of combiner 46D. The output of combiner 46B is interpolated up by a factor of two by an interpolator 49 and then reproduced by a sigma-delta DAC 50 operated at the 64 oversampling rate. The output of DAC 50 is provided to amplifier A1, which generates the signal delivered to speaker SPKR.
(22) Each or some of the elements in the system of
(23) While the invention has been particularly shown and described with reference to the preferred embodiments thereof, it will be understood by those skilled in the art that the foregoing and other changes in form, and details may be made therein without departing from the spirit and scope of the invention.