Power management of adaptive noise cancellation (ANC) in a personal audio device

Abstract

A personal audio device, such as a wireless telephone, includes an adaptive noise canceling (ANC) circuit that adaptively generates an anti-noise signal from an output of a microphone that measures ambient audio. The anti-noise signal is combined with source audio to provide an output for a speaker. The anti-noise signal causes cancellation of ambient audio sounds that appear at the microphone. A processing circuit estimates a level of background noise from the microphone output and sets a power conservation mode of the personal audio device in response to detecting that the background noise level is lower than a predetermined threshold.

Claims

1. A personal audio device, comprising: a personal audio device housing; a transducer mounted on the housing for reproducing an audio signal including both source audio for playback to a listener and an anti-noise signal for countering the effects of ambient audio sounds; at least one microphone mounted on the housing for providing at least one microphone signal indicative of the ambient audio sounds; and a processing circuit that generates the anti-noise signal using an adaptive filter to reduce the presence of the ambient audio sounds heard by the listener in conformity with the at least one microphone signal, and wherein the processing circuit comprises a first processing portion that implements the adaptive filter and a second processing portion that controls the adaptive filter in conformity with the at least one microphone signal, wherein a first power conservation mode of the first processing portion and a second power conservation mode of the second processing portion are independently selected by the processing circuit from a plurality of operating modes including a full power operating mode and at least one lower-power mode.

2. The personal audio device of claim 1, wherein the processing circuit sets the first power conservation mode of the first processing portion in conformity with a measurement of the at least one microphone signal.

3. The personal audio device of claim 2, wherein the processing circuit estimates a background noise level from the at least one microphone signal and sets the first power conservation mode of the first processing portion in conformity with a magnitude of the estimated background noise level.

4. The personal audio device of claim 3, wherein the processing circuit implements a noise power measurement algorithm that estimates the background noise level from a minimum value of noise sources within a time interval having a predetermined duration, wherein the noise power measurement algorithm measures the at least one microphone signal using a minima-tracking algorithm over the time interval to filter non-stationary noise sources and non-noise sources from the at least one microphone signal.

5. The personal audio device of claim 4, wherein the predetermined duration is adjustable to vary a property of the non-stationary noise sources filtered from the at least one microphone signal.

6. The personal audio device of claim 3, wherein the processing circuit compares the background noise level to multiple thresholds and sets one of multiple power conservation modes of the personal audio device in response to a result of the comparisons.

7. The personal audio device of claim 1, wherein the at least one microphone includes an error microphone that provides an error microphone signal indicative of the ambient audio sounds at an output of the transducer, wherein the second processing portion includes a secondary path adaptive filter that filters a copy of the source audio to generate shaped source audio, wherein the processing circuit subtracts the shaped source audio from the error microphone signal to control the adaptive filter that generates the anti-noise signal, wherein if the second power conservation mode is set to the full-power operating mode, the secondary path adaptive filter is active, and wherein if the second power conservation mode is set to the at least one lower-power mode, the secondary path adaptive filter is deactivated.

8. The personal audio device of claim 7, wherein if the first power conservation mode is set to the full-power operating mode, the adaptive filter that generates the anti-noise signal is active, and wherein if the first power conservation mode is set to the at least one lower-power mode, the adaptive filter that generates the anti-noise signal is deactivated, so that if the first power conservation mode is set to the at least one lower-power operating mode and the second power conservation mode is set to the full-power operating mode, the adaptive filter is deactivated while the secondary path adaptive filter continues to operate.

9. A method of countering effects of ambient audio sounds by a personal audio device, the method comprising: measuring the ambient audio sounds with at least one microphone to generate at least one microphone signal; adaptively generating an anti-noise signal using an adaptive filter to reduce the presence of the ambient audio sounds heard by the listener in conformity with the at least one microphone signal, wherein the adaptive filter has a first processing portion that implements the adaptive filter and a second processing portion that controls the adaptive filter in conformity with the at least one microphone signal; combining the anti-noise signal with source audio; providing a result of the combining to a transducer; and independently selecting a first power conservation mode of the first processing portion and selecting a second power conservation mode of the second processing portion from a plurality of operating modes including a full power operating mode and at least one lower-power mode.

10. The method of claim 9, further comprising setting the first power conservation mode of the first processing portion in conformity with a measurement of the at least one microphone signal.

11. The method of claim 10, further comprising estimating a background noise level from the at least one microphone signal and sets the first power conservation mode of the first processing portion in conformity with a magnitude of the estimated background noise level.

12. The method of claim 11, wherein the estimating comprises estimating the background noise level from a minimum value of noise sources within a time interval having a predetermined duration by measuring the at least one microphone signal using a minima-tracking algorithm over the time interval to filter non-stationary noise sources and non-noise sources from the at least one microphone signal.

13. The method of claim 12, wherein the estimating further comprises adjusting the predetermined duration to vary a property of the non-stationary noise sources filtered from the at least one microphone signal.

14. The method of claim 11, further comprising comparing the background noise level to multiple thresholds, and wherein the setting sets one of multiple power conservation modes of the personal audio device in response to a result of the comparing.

15. The method of claim 9, wherein the at least one microphone includes an error microphone that provides an error microphone signal indicative of the ambient audio sounds at an output of the transducer, wherein the second processing portion includes a secondary path adaptive filter that filters a copy of the source audio to generate shaped source audio and a combiner that subtracts the shaped source audio from the error microphone signal to control the adaptive filter that generates the anti-noise signal, wherein if the independently setting sets the second power conservation mode to the full-power operating mode, the secondary path adaptive filter is active and sets the second power conservation mode to the at least one lower-power mode, the secondary path adaptive filter is deactivated.

16. The method of claim 15, wherein if the first power conservation mode is set to the full-power operating mode, the adaptive filter that generates the anti-noise signal is active, and wherein if the first power conservation mode is set to the at least one lower-power mode, the adaptive filter that generates the anti-noise signal is deactivated, so that if the independently setting sets the first power conservation mode to the at least one lower-power operating mode and sets the second power conservation mode to the full-power operating mode, the adaptive filter is deactivated while the secondary path adaptive filter continues to operate.

17. An integrated circuit for implementing at least a portion of a personal audio device, comprising: an output for providing an output signal to an output transducer including both source audio for playback to a listener and an anti-noise signal for countering the effects of ambient audio sounds; at least one microphone input for receiving at least one microphone signal indicative of the ambient audio sounds; and a processing circuit that adaptively generates the anti-noise signal using an adaptive filter to reduce the presence of the ambient audio sounds heard by the listener in conformity with the at least one microphone signal, and wherein the processing circuit comprises a first processing portion that implements the adaptive filter and a second processing portion that controls the adaptive filter in conformity with the at least one microphone signal, wherein a first power conservation mode of the first processing portion and a second power conservation mode of the second processing portion are independently set to either of a full power operating mode and at least one lower-power mode by the processing circuit.

18. The integrated circuit of claim 17, wherein the processing circuit sets the first power conservation mode of the first processing portion in conformity with a measurement of the at least one microphone signal.

19. The integrated circuit of claim 18, wherein the processing circuit estimates a background noise level from the at least one microphone signal and sets the first power conservation mode of the first processing portion in conformity with a magnitude of the estimated background noise level.

20. The integrated circuit of claim 19, wherein the processing circuit implements a noise power measurement algorithm that estimates the background noise level from a minimum value of noise sources within a time interval having a predetermined duration, wherein the noise power measurement algorithm measures the at least one microphone signal using a minima-tracking algorithm over the time interval to filter non-stationary noise sources and non-noise sources from the at least one microphone signal.

21. The integrated circuit of claim 20, wherein the predetermined duration is adjustable to vary a property of the non-stationary noise sources filtered from the at least one microphone signal.

22. The integrated circuit of claim 19, wherein the processing circuit compares the background noise level to multiple threshold and sets one of multiple power conservation modes of the personal audio device in response to a result of the comparisons.

23. The integrated circuit of claim 17, wherein the at least one microphone includes an error microphone that provides an error microphone signal indicative of the ambient audio sounds at an output of the transducer, wherein the second processing portion includes a secondary path adaptive filter that filters a copy of the source audio to generate shaped source audio, wherein the processing circuit subtracts the shaped source audio from the error microphone signal to control the adaptive filter that generates the anti-noise signal, wherein if the second power conservation mode is set to the full-power operating mode, the secondary path adaptive filter is active, and wherein if the second power conservation mode is set to the at least one lower-power mode, the secondary path adaptive filter is deactivated.

24. The integrated circuit of claim 23, wherein if the first power conservation mode is set to the full-power operating mode, the adaptive filter that generates the anti-noise signal is active, and wherein if the first power conservation mode is set to the at least one lower-power mode, the adaptive filter that generates the anti-noise signal is deactivated, so that if the first power conservation mode is set to the at least one lower-power operating mode and the second power conservation mode is set to the full-power operating mode, the adaptive filter is deactivated while the secondary path adaptive filter continues to operate.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

(1) FIG. 1 is an illustration of an exemplary wireless telephone 10.

(2) FIG. 2 is a block diagram of circuits within wireless telephone 10.

(3) FIG. 3 is a block diagram depicting signal processing circuits and functional blocks of an exemplary circuit that can be used to implement ANC circuit 30 of CODEC integrated circuit 20 of FIG. 2.

(4) FIG. 4 is a block diagram depicting an example of details of exemplary background noise estimator 35 and power manager 39 within ANC circuit 30 of FIG. 3.

(5) FIG. 5 is a signal waveform diagram illustrating operation of background noise estimator 35 of FIG. 4.

(6) FIG. 6 is a block diagram depicting signal processing circuits and functional blocks within CODEC integrated circuit 20.

DESCRIPTION OF ILLUSTRATIVE EMBODIMENT

(7) Noise-canceling techniques and circuits that can be implemented in a personal audio device, such as a wireless telephone, are disclosed. The personal audio device includes an adaptive noise canceling (ANC) circuit that measures the ambient acoustic environment and generates a signal that is injected into the speaker (or other transducer) output to cancel ambient acoustic events. The ANC circuit also estimates the background noise level, and when the background noise level is below a threshold, the ANC circuit sets a power conservation mode of the personal audio device, conserving energy when ANC operation is not required.

(8) FIG. 1 shows an exemplary wireless telephone 10 in proximity to a human ear 5. Illustrated wireless telephone 10 is an example of a device in which techniques illustrated herein may be employed, but it is understood that not all of the elements or configurations embodied in illustrated wireless telephone 10, or in the circuits depicted in subsequent illustrations, are required. Wireless telephone 10 includes a transducer, such as speaker SPKR, that reproduces distant speech received by wireless telephone 10, along with other local audio events such as ringtones, stored audio program material, near-end speech, sources from web-pages or other network communications received by wireless telephone 10 and audio indications such as battery low and other system event notifications. A near-speech microphone NS is provided to capture near-end speech, which is transmitted from wireless telephone 10 to the other conversation participant(s).

(9) Wireless telephone 10 includes adaptive noise canceling (ANC) circuits and features that inject an anti-noise signal into speaker SPKR to improve intelligibility of the distant speech and other audio reproduced by speaker SPKR. A reference microphone R is provided for measuring the ambient acoustic environment and is positioned away from the typical position of a user/talker's mouth, so that the near-end speech is minimized in the signal produced by reference microphone R. A third microphone, error microphone E, is provided in order to further improve the ANC operation by providing a measure of the ambient audio combined with the audio signal reproduced by speaker SPKR close to ear 5, when wireless telephone 10 is in close proximity to ear 5. Exemplary circuit 14 within wireless telephone 10 includes an audio CODEC integrated circuit 20 that receives the signals from reference microphone R, near speech microphone NS, and error microphone E and interfaces with other integrated circuits such as an RF integrated circuit 12 containing the wireless telephone transceiver. In other implementations, the circuits and techniques disclosed herein may be incorporated in a single integrated circuit that contains control circuits and other functionality for implementing the entirety of the personal audio device, such as an MP3 player-on-a-chip integrated circuit.

(10) In general, the ANC techniques disclosed herein measure ambient acoustic events (as opposed to the output of speaker SPKR and/or the near-end speech) impinging on reference microphone R, and by also measuring the same ambient acoustic events impinging on error microphone E, the ANC processing circuits of illustrated wireless telephone 10 adapt an anti-noise signal generated from the output of reference microphone R to have a characteristic that minimizes the amplitude of the ambient acoustic events present at error microphone E. Since acoustic path P(z) extends from reference microphone R to error microphone E, the ANC circuits are essentially estimating acoustic path P(z) combined with removing effects of an electro-acoustic path S(z). Electro-acoustic path S(z) represents the response of the audio output circuits of CODEC IC 20 and the acoustic/electric transfer function of speaker SPKR including the coupling between speaker SPKR and error microphone E in the particular acoustic environment. Electro-acoustic path S(z) is affected by the proximity and structure of ear 5 and other physical objects and human head structures that may be in proximity to wireless telephone 10, when wireless telephone 10 is not firmly pressed to ear 5. While the illustrated wireless telephone 10 includes a two microphone ANC system with a third near speech microphone NS, other systems that do not include separate error and reference microphones can implement the above-described techniques. Alternatively, near speech microphone NS can be used to perform the function of the reference microphone R in the above-described system. Finally, in personal audio devices designed only for audio playback, near speech microphone NS will generally not be included, and the near-speech signal paths in the circuits described in further detail below can be omitted.

(11) Referring now to FIG. 2, circuits within wireless telephone 10 are shown in a block diagram. CODEC integrated circuit 20 includes an analog-to-digital converter (ADC) 21A for receiving the reference microphone signal and generating a digital representation ref of the reference microphone signal, an ADC 21B for receiving the error microphone signal and generating a digital representation err of the error microphone signal, and an ADC 21C for receiving the near speech microphone signal and generating a digital representation of near speech microphone signal ns. CODEC IC 20 generates an output for driving speaker SPKR or headphones from an amplifier A1, which amplifies the output of a digital-to-analog converter (DAC) 23 that receives the output of a combiner 26. Combiner 26 combines audio signals is from internal audio sources 24, the anti-noise signal anti-noise generated by an ANC circuit 30, which by convention has the same polarity as the noise in reference microphone signal ref and is therefore subtracted by combiner 26. Additionally, combiner 26 also combines a portion of near speech signal ns so that the user of wireless telephone 10 hears their own voice in proper relation to downlink speech ds, which is received from a radio frequency (RF) integrated circuit 22. In the exemplary circuit, downlink speech ds is provided to ANC circuit 30. The downlink speech ds and internal audio is are provided to combiner 26 to provide source audio (ds+ia), so that source audio (ds+ia) may be presented to estimate acoustic path S(z) with a secondary path adaptive filter within ANC circuit 30. Near speech signal ns is also provided to RF integrated circuit 22 and is transmitted as uplink speech to the service provider via antenna ANT. ANC circuit 30 includes features to measure the ambient background noise, and determine when a low-power or power-down mode may be set for at least a portion of ANC circuit 30. Further, ANC circuit 30 provides a control signal power down that may be used to signal to other circuits within personal audio device 10 that ANC circuit 30 has determined that ANC operation is not needed. For example, control signal power down might be used to control an operational state of ADC 21B that provides error microphone signal err, during times that reference microphone signal ref indicates that the background noise level is low and ANC operation is halted.

(12) Referring now to FIG. 3, details of ANC circuit 30 are shown. An adaptive filter 32 receives reference microphone signal ref and under ideal circumstances, adapts its transfer function W(z) to be P(z)/S(z) to generate anti-noise signal anti-noise, which is provided to an output combiner that combines the anti-noise signal with the audio to be reproduced by speaker SPKR, as exemplified by combiner 26 of FIG. 2. The coefficients of adaptive filter 32 are controlled by a W coefficient control block 31 that uses a correlation of two signals to determine the response of adaptive filter 32, which generally minimizes the error, in a least-mean squares sense, between those components of reference microphone signal ref present in error microphone signal err. The signals processed by W coefficient control block 31 are reference microphone signal ref shaped by a copy of an estimate of the response of path S(z) (i.e., response SE.sub.COPY(z)) provided by a filter 34B and another signal that includes error microphone signal err. By transforming reference microphone signal ref with a copy of the estimate of the response of path S(z), response SE.sub.COPY(z), and minimizing error microphone signal err after removing components of error microphone signal err due to playback of source audio, adaptive filter 32 adapts to the desired response of P(z)/S(z).

(13) In addition to error microphone signal err, the other signal processed along with the output of filter 34B by W coefficient control block 31 includes an inverted amount of the source audio (ds+ia), which is processed by a filter 34A having response SE(z), of which response SE.sub.COPY(z) is a copy. Filter 34B is not an adaptive filter, per se, but has an adjustable response that is tuned to match the response of adaptive filter 34A, so that the response of filter 34B tracks the adapting of adaptive filter 34A. To implement the above, adaptive filter 34A has coefficients controlled by an SE coefficient control block 33. Adaptive filter 34A processes source audio (ds+ia), to provide a signal representing the expected source audio delivered to error microphone E. Adaptive filter 34A is thereby adapted to generate a signal from source audio (ds+ia), that when subtracted from error microphone signal err, forms an error signal e containing the content of error microphone signal err that is not due to source audio (ds+ia). A combiner 36 removes the filtered source audio (ds+ia) from error microphone signal err to generate error signal e. By removing an amount of source audio that has been filtered by response SE(z), adaptive filter 32 is prevented from adapting to the relatively large amount of source audio present in error microphone signal err.

(14) Within ANC circuit 30, a background noise estimator 35 determines a value corresponding to a background noise level present in reference microphone signal ref. Alternatively other microphone signals could be used as input to background noise estimator 35, such as the outputs of near speech microphone ns or error microphone err. However, reference microphone ref will generally not be occluded by a listener's ear as will error microphone err, and will have less near speech content than near speech microphone ns, and as will be seen below, the background noise level estimate should not include near speech components. A near speech detector 37, which may be the voice activity detector (VAD) used for other purposes within wireless telephone 10, indicates to background noise estimator 35 when near speech is present. Similarly, a wind/scratch detector 38 indicates to background noise estimator 35 when wind or other mechanical noise is present at wireless telephone 10. Wind/scratch detector 38 computes the time derivative of the sum Σ|W.sub.n(z)| of the magnitudes of the coefficients W.sub.n(z) that shape the response of adaptive filter 32, which is an indication of the variation overall gain of the response of adaptive filter 32. Large variations in sum Σ|W.sub.n(z)| indicate that mechanical noise such as that produced by wind incident on reference microphone R or varying mechanical contact (e.g., scratching) on the housing of wireless telephone 10, or other conditions such as an adaptation step size that is too large and causes unstable operation has been used in the system. Wind/scratch detector 38 then compares the time derivative of sum Σ|W.sub.n(z)| to a threshold to determine when mechanical noise is present, and provides an indication of the presence of mechanical noise to background noise estimator 35 while the mechanical noise condition exists. While wind/scratch detector 38 provides one example of wind/scratch measurement, other alternative techniques for detecting wind and/or mechanical noise could be used to provide such an indication to background noise estimator 35. Background noise estimator 35 provides an indication to a power manager 39 of the amount of background noise present in reference microphone signal and power manager generates one or more control signals to control the power-management state of circuits within wireless telephone 10, for example control signal power down as described above. Another power-saving state can be supported, for example, by an optional control signal SE enable that causes a portion of the circuits power-managed by control signal power down to remain enabled.

(15) Referring now to FIG. 4, details of an exemplary background noise level estimator 35 and power manager 39 are shown, which detail an algorithm that is implemented within wireless telephone 10 to estimate background noise. Background noise level estimator 35 includes a noise power computation (Σx.sup.2) block 51 that computes a measure of the ongoing (instantaneous) noise power of reference microphone signal ref. The output of noise power computation block 51 provides an input to a smoothing function block 52, which in the example circuit applies an exponential smoothing to the noise power. The rate of the smoothing is controlled by control signal(s) rate provided by a control logic 54 that selects from different exponential smoothing coefficients applied by smoothing function block 52 according to indications wind/scratch and near speech, provided from wind/scratch detector 38 and near speech detector 37 of FIG. 3, respectively. A minima detection block 56 detects the minimum value of the smoothed instantaneous power of reference microphone signal ref over a predetermined time interval, which is programmable in order to control the criteria for eliminating non-stationary noise sources in reference microphone signal ref. The output of minima detection block 56 is biased by combiner 57 with a bias value selected by control logic 54 in accordance with the predetermined time interval and smoothing factors/rate being applied to the output of power computation block 51. The output of combiner 57 is used as an estimate of the background noise present in reference microphone signal ref, which is then provided to power manager 39. Power manager 39 compares the background noise estimate to turn-on threshold and a turn-off threshold, operations which are symbolized by comparators k2 and k1, respectively. A control logic 50 determines whether to de-assert indication power down if indication power down is asserted, according to whether the background noise exceeds the turn-on threshold, and whether to assert indication power down if indication power down is de-asserted, according to whether the background noise exceeds the turn-off threshold. The turn-on threshold is generally set to a value between 3 dB and 10 dB greater than the turn-off threshold, in order to provide a suitable amount of hysteresis for the power management of circuits within personal audio device that are power managed by indication power down. Another comparator k3 can be optionally provided to implement an intermediate level of power management of the ANC circuits. In the depicted example, a threshold value between the power up and power down threshold is used to inform control logic 50 that the background noise estimate is between the turn-on threshold and the turn-off threshold and above a “turn-on SE threshold” that causes control logic 50 to assert control signal SE enable, while maintaining control signal power down in the power down state. Table I below illustrates an exemplary set of power conservation modes.

(16) TABLE-US-00001 TABLE I power down SE enable SE Circuits W Circuits 0 1 Power-up/Enabled Power-up/Enabled 1 1 Power-up/Enabled Power-down/Disabled 1 0 Power-down/Disabled Power-down/Disabled

(17) Referring now to FIG. 5, a waveform diagram illustrating the operation of background noise level estimator 35 is shown. A smoothed reference microphone power 60 is shown as a value that is rapidly changing over time with respect to the actual background noise power estimate, which is yielded by the value of a minimum power on each interval 62. The predetermined interval used to filter non-stationary sources of noise can be seen as the width of the smallest steps in waveform minimum power on interval 62, and as mentioned above, can be adjusted in order to control the criteria used to filter non-stationary noise source contributions from the background noise estimate.

(18) Referring now to FIG. 6, a block diagram of an ANC system is shown for implementing ANC techniques as depicted in FIG. 3, and having a processing circuit 40 as may be implemented within CODEC integrated circuit 20 of FIG. 2. Processing circuit 40 includes a processor core 42 coupled to a memory 44 in which are stored program instructions comprising a computer-program product that may implement some or all of the above-described ANC techniques, as well as other signal processing. Optionally, a dedicated digital signal processing (DSP) logic 46 may be provided to implement a portion of, or alternatively all of, the ANC signal processing provided by processing circuit 40. In the illustrated example processor core 42 provides control signal power down to DSP logic 46, so that the logic implementing filters or other DSP circuits can be shut down when ANC operation is not needed. Further, the state of control signal power down can alternatively, or in combination, be used to control the operation of processor core 42 so that power is conserved. For example, processor core 42 could be halted if the background noise level estimate and comparison is performed entirely in discrete circuits, or the program code executed by processor core 42 may periodically enter a sleep mode, intermittently resuming operation to measure the background noise level in order to update the state of control signal power down. Processing circuit 40 also includes ADCs 21A-21C, for receiving inputs from reference microphone R, error microphone E and near speech microphone NS, respectively. In alternative embodiments in which one or more of reference microphone R, error microphone E and near speech microphone NS have digital outputs, the corresponding ones of ADCs 21A-21C are omitted and the digital microphone signal(s) are interfaced directly to processing circuit 40. DAC 23 and amplifier A1 are also provided by processing circuit 40 for providing the speaker output signal, including anti-noise as described above. The speaker output signal may be a digital output signal for provision to a module that reproduces the digital output signal acoustically.

(19) While the invention has been particularly shown and described with reference to the preferred embodiments thereof, it will be understood by those skilled in the art that the foregoing and other changes in form, and details may be made therein without departing from the spirit and scope of the invention.