Providing ambient naturalness in ANR headphones
11477557 · 2022-10-18
Assignee
Inventors
Cpc classification
G10K11/17881
PHYSICS
H04R3/002
ELECTRICITY
G10K11/17885
PHYSICS
G10K2210/3028
PHYSICS
G10K11/17821
PHYSICS
G10K11/17837
PHYSICS
G10K2210/1081
PHYSICS
International classification
H04R1/10
ELECTRICITY
Abstract
In an active noise reducing headphone, a signal processor applies filters and control gains of both the feed-forward and feedback active noise cancellation signal paths. The signal processor is configured to apply first feed-forward filters to the feed-forward signal path and apply first feedback filters to the feedback signal path during a first operating mode providing effective cancellation of ambient sound, and to apply second feed-forward filters to the feed-forward signal path during a second operating mode providing active hear-through of ambient sounds with ambient naturalness.
Claims
1. A computer-implemented method comprising: receiving a first external audio signal from a microphone of a noise-reducing device; generating a noise-cancellation signal for cancelling the first external audio signal; causing a speaker of the noise-reducing device to generate audio corresponding to the noise-cancellation signal in an active noise reduction (ANR) mode; receiving a second external audio signal from the microphone of the noise-reducing device; determining that at least a first portion of the second external audio signal indicates that the noise-reducing device should change from the ANR mode to a hear-through mode; and changing to the hear-through mode, the changing comprises facilitating presentation of at least a second portion of the second external audio signal at the noise-reducing device by modifying one or more filter coefficients for a feed-forward path of the noise-reducing device, wherein the modified filter coefficients result in less attenuation of sounds within a first frequency range than of sounds outside of the first frequency range for at least the second portion of the second external audio signal, and the modified filter coefficients result in an insertion gain that is substantially 0 dB for frequencies throughout the first frequency range, the first frequency range extends to cover the range of about 300 Hz to about 3 kHz.
2. The method of claim 1, wherein the second external audio signal comprises a voice or an alarm.
3. The method of claim 1, wherein the second external audio signal comprises a voice of a user of the noise-reducing device.
4. The method of claim 3, wherein the noise-reducing device remains in the hear-through mode at least as long as the voice of the user of the noise-reducing device is detected and for a predetermined time period after the voice of the user of the noise-reducing device is last detected.
5. The method of claim 1, further comprising modifying one or more filter coefficients for a feedback path of the noise-reducing device.
6. The method of claim 1, wherein the modified filter coefficients cause a corresponding filter to have at least one right-half-plane zero in a change between sounds within 300 Hz to 3 kHz and sounds outside of the same range.
7. The method of claim 1, further comprising: selecting the hear-through mode from a plurality of hear-through modes.
8. The method of claim 7, wherein selecting the hear-through mode from a plurality of hear-through modes comprises: detecting a level of ambient noise; and selecting the hear-through mode from the plurality of hear-through modes based on the level of ambient noise.
9. The method of claim 1, wherein the insertion gain for frequencies outside of the first frequency range is substantially an insertion gain achieved in the ANR mode for the frequencies outside of the first frequency range.
10. A noise-reducing device comprising: an ear piece configured to couple to a wearer's ear, the ear piece providing passive attenuation of ambient sound into the wearer's ear; a first microphone acoustically coupled to an external environment and electrically coupled to a first active noise cancellation signal path having a first filter with configurable coefficients; an output transducer acoustically coupled to the wearer's ear canal when the ear piece is coupled to the wearer's ear and electrically coupled to the first active noise cancellation signal path; and a signal processor configured to apply the coefficients of the first filter, wherein: in an active noise reduction (ANR) mode, the first microphone is configured to receive a first external audio signal, the first active noise cancellation signal path is configured to generate a noise cancellation signal for cancelling the first external audio signal, and the output transducer is configured to generate audio corresponding to the noise cancellation signal; the first microphone is configured to receive a second external audio signal; and the signal processor is configured to: determine that at least a first portion of the second external audio signal indicates that the noise-reducing device should change from the ANR mode to a hear-through mode; and change the noise-reducing device to the hear-through mode, the change comprises facilitating presentation of at least a second portion of the second external audio signal at the noise-reducing device by modifying one or more of the coefficients for the first filter, wherein the modified coefficients result in less attenuation of sounds within a first frequency range than of sounds outside of the first frequency range for at least the second portion of the second external audio signal, and the modified coefficients result in an insertion gain that is substantially 0 dB for frequencies throughout the first frequency range, the first frequency range extends to cover the range of about 300 Hz to about 3 kHz.
11. The noise-reducing device of claim 10, wherein the second external audio signal comprises a voice or an alarm.
12. The noise-reducing device of claim 10, wherein the second external audio signal comprises a voice of the wearer of the noise-reducing device.
13. The noise-reducing device of claim 12, wherein the signal processor causes the noise-reducing device to remain in the hear-through mode at least as long as the voice of the wearer of the noise-reducing device is detected and for a predetermined time period after the voice of the user of the noise-reducing device is last detected.
14. The noise-reducing device of claim 10, wherein the modified coefficients cause the first filter to have at least one right-half-plane zero in a change between sounds within a human speech band and sounds outside of the human speech band.
15. The noise-reducing device of claim 10, wherein the hear-through mode is selected from a plurality of hear-through modes.
16. The noise-reducing device of claim 15, wherein the hear-through mode is selected from the plurality of hear-through modes based on a level of ambient noise.
17. The noise-reducing device of claim 10, further comprising: a second microphone acoustically coupled to the wearer's ear canal when the ear piece is coupled to the wearer's ear and electrically coupled to a second active noise cancellation signal path having a second filter with configurable coefficients, wherein the output transducer is also electrically coupled to the second active noise cancellation signal path, the signal processor is further configured to apply the coefficients of the second filter.
18. The noise-reducing device of claim 10, further comprising a wireless connection to an audio source.
19. The noise-reducing device of claim 10, further comprising a visual indicator, the visual indicator configured to be in a first state that indicates the noise-reducing device is in the ANR mode, and a second state that indicates the noise-reducing device is in the hear-through mode.
20. The noise-reducing device of claim 10, wherein the insertion gain for frequencies outside of the first frequency range is substantially an insertion gain achieved in the ANR mode for frequencies outside of the first frequency range.
21. The noise-reducing device of claim 10, wherein the first frequency range extends to cover the range of about 140 Hz to about 5 kHz.
22. An active noise reducing headphone comprising: an audio input unit configured to receive an external audio signal; a noise cancellation unit configured to perform noise cancellation using a first portion of the external audio signal in an active noise reducing (ANR) mode; and a processor configured to: determine that a second portion of the external audio signal indicates that the active noise reducing headphone should change from the ANR mode to an active hear-through mode; change the active noise reducing headphone to the active hear-through mode, the change comprising facilitating presentation of at least a third portion of the external audio signal at the active noise reducing headphone by modifying one or more filter coefficients for a feed-forward path of the active noise reducing headphone, wherein the modified filter coefficients result in less attenuation of sounds within a first frequency range than of sounds outside of the first frequency range for at least the third portion of the external audio signal, and the modified filter coefficients result in an insertion gain that is substantially 0 dB for frequencies throughout the first frequency range, the first frequency range extends to cover the range of about 300 Hz to about 3 kHz.
23. The active noise reducing headphone of claim 22, wherein the processor determines that the second portion of the external audio signal indicates that the active noise reducing headphone should change from the ANR mode to the active hear-through mode based on a user input.
24. The active noise reducing headphone of claim 23, wherein the processor causes the active noise reducing headphone to remain in the active hear-through mode at least until an additional user input is received.
25. The active noise reducing headphone of claim 22, wherein the processor determines that the second portion of the external audio signal indicates that the active noise reducing headphone should change from the ANR mode to the active hear-through mode based on detecting a voice of the wearer of the active noise reducing headphone.
26. The active noise reducing headphone of claim 25, wherein the processor causes the active noise reducing headphone to remain in the active hear-through mode at least as long as the voice of the wearer of the active noise reducing headphone is detected and for a predetermined time period after the voice of the wearer of the noise-reducing device is last detected.
27. The active noise reducing headphone of claim 22, wherein the processor determines that the second portion of the external audio signal indicates that the active noise reducing headphone should change from the ANR mode to the active hear-through mode based on detecting a voice of someone other than the wearer of the active noise reducing headphone.
28. The active noise reducing headphone of claim 22, wherein the modified filter coefficients cause the filter to have at least one right-half-plane zero in a change between sounds within a human speech band and sounds outside of the human speech band.
29. The active noise reducing headphone of claim 22, wherein the insertion gain for frequencies outside of the first frequency range is approximately equal to an insertion gain achieved in the ANR mode for the frequencies outside of the first frequency range.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
DESCRIPTION
(8) A typical active noise reduction (ANR) headphone system 10 is shown in
(9) The microphones and speaker are all coupled to an ANR circuit 118. The ANR circuit may receive additional input from a communications microphone 120 or an audio source 122. In the case of a digital ANR circuit, for example that described in U.S. Pat. No. 8,073,150, incorporated here by reference, software or configuration parameters for the ANR circuit may be obtained from a storage 124. The ANR system is powered by a power supply 126, which may be a battery, part of the audio source 122, or a communications system, for example. In some examples, one or more of the ANR circuit 118, storage 124, power source 126, external microphone 120, and audio source 122 are located inside or attached to the ear cup 102, or divided between the two ear cups when two earphones 100 are provided. In some examples, some components, such as the ANR circuit, are duplicated between the earphones, while others, such as the power supply, are located in only one earphone, as described in U.S. Pat. No. 7,412,070, incorporated here by reference. The external noise to be cancelled by the ANR headphone system is represented as acoustic noise source 128.
(10) When both a feedback ANR circuit and a feed-forward ANR circuit are provided in the same headphone, they are generally tuned to operate over different, but complementary, frequency ranges. When describing the frequency range in which a feedback or feed-forward noise cancelation path is operative, we refer to the range in which the ambient noise is reduced; outside this range, the noise is not altered or may be slightly amplified. Where their operating ranges overlap, the circuits' attenuation may be intentionally reduced to avoid creating a range where the cancellation is greater than everywhere else. That is, the attenuation of an ANR headset may be modified in different frequency ranges to provide a more uniform response than would be achieved by simply maximizing the attenuation within stability or fundamental acoustical limits at all frequencies. Ideally, between the feedback path, the feed-forward path, and the passive attenuation of the headphones, a uniform amount of noise reduction is provided throughout the audible range. We refer to such a system as providing effective cancellation of the ambient sound. To provide the active hear-through features described below, it is preferable that the feedback path have a high-frequency cross-over frequency (where the attenuation drops below 0 dB) above at least 500 Hz. The feed-forward loop will generally operate extending to a higher frequency range than the feedback path.
(11) This application concerns improvements to hear-through achieved through sophisticated manipulation of the active noise reduction system. Different hear-through topologies are illustrated in
(12) We define active hear-through to describe a feature that varies the active noise cancellation parameters of a headset so that the user can hear some or all of the ambient sounds in the environment. The goal of active hear-through is to let the user hear the environment as if they were not wearing the headset at all. That is, while direct talk-through as in
(13) Active hear-through (HT) is provided, as shown in
(14) Natural Hear-Through of Ambient Sounds
(15) Providing natural hear-through of ambient sounds, which we refer to as “ambient naturalness,” is accomplished through modifications to the active noise cancellation filters. As explained in U.S. Pat. No. 8,073,150, the filters may be modified by changing their coefficients, gain settings, or interconnections, among other things. In a system having both feedback and feed-forward noise cancellation circuits, either or both cancellation circuits can be modified. As explained in U.S. Pat. No. 8,155,334, incorporated herein, a feed-forward filter implemented in a digital signal processor can be modified to provide talk-through by not completely cancelling all or a subset of the ambient noise. In the example of that application, the feed-forward filters are modified to attenuate sounds within the human speech band less than they attenuate sounds outside that band. That application also suggests providing parallel analog filters, one for full attenuation and one with reduced attenuation in the speech band, as an alternative to digital filters.
(16) To make the sounds that are allowed to pass sound more natural, compensating for the changes in the sound resulting from the passive attenuation, and providing natural hear-through over the full range of audio frequencies, the feed-forward filters can be modified in more sophisticated ways.
(17) The various electronic signal pathways of the ANR circuit apply the following filters, which we may refer to as gains of the pathways: a) K.sub.fb: Gain of the feedback compensation filter b) K.sub.ff: Gain of the feed-forward compensation filter c) K.sub.ht: Gain of the active hear-through filter (in
We define the target hear-through insertion gain, i.e., how the total system should filter the ambient sound, as T.sub.htig. If T.sub.htig=1 (0 dB), then the user should hear the world around them the same as they would if not wearing headphones. In practice, a target value other than 0 dB is often desired. For example, cancellation at low frequencies, such as below 100 Hz, is still useful during an active hear-through mode, as such sounds tend to be unpleasant and to not contain useful information. However, a T.sub.htig pass-band that extends to cover at least the range of 300 Hz to 3 kHz is necessary for the voices of those around the user to be clearly understandable. Preferably the pass-band extends from 140 Hz to 5 kHz to approach a sense of naturalness. The pass-band may be shaped to improve perception of the naturalness in an active hear-through mode. For example, a gentle high-frequency roll-off may compensate for the distortion of spatial hearing caused by the presence of the headphones. Ultimately, the filter should be designed to provide a total system response that is smooth and piecewise-linear. By “smooth and piecewise-linear,” we are referring to the general shape of a plot of the system response on a dB/log-frequency scale.
(18) Combining these factors, the total response at the ear to ambient noise when wearing the headphones is G.sub.pfb+G.sub.nx*K.sub.ht*G.sub.ffe. The desired response is G.sub.oea*T.sub.htig. That is, the combination of the passive and feedback response G.sub.pfb with the actual hear-through response G.sub.nx*K.sub.ht*G.sub.ffe should sound like the target hear-through insertion gain T.sub.htig applied to the open-ear response G.sub.oea. The system is tuned to deliver the desired response by measuring the various actual responses (the G.sub.xx terms) and defining the filter K.sub.ht, within the limits of realizability, to bring the actual system response as close as possible to the target, based on the equation:
(19)
Solving equation (1) for K.sub.ht leads to:
(20)
(21) To best achieve the desired T.sub.htig, the filter K.sub.ht implemented in the feed-forward signal path may be non-minimum phase, i.e., it may have zeros in the right half plane. This can, for example, allow active hear-through to pass human speech while canceling the ambient rumble present in many buildings due to heating and cooling systems. Such a combination is provided by designing K.sub.ht so that T.sub.htig approaches 0 dB only in the active hear-through passband. Outside the active hear-through passband, K.sub.ht is designed such that T.sub.htig approaches, and ideally equals, the insertion gain (which is actually an insertion loss) achieved by a feed-forward filter that results in significant attenuation (i.e., the usual K.sub.ff). The sign of the feed-forward filter required for effective attenuation (K.sub.ff) and active hear-through (K.sub.ht) are, in general, opposite in the hear-through passband. Designing a K.sub.ht that rolls off at the low-frequency edge of the passband and transitions to an effective K.sub.ff response can be achieved by including at least one right-half-plane zero in the vicinity of that transition.
(22) In total, replacing the feed-forward filter K.sub.ff with the active hear-through filter K.sub.ht, while maintaining the feedback loop K.sub.fb, enables the ANR system to combine with the passive acoustic path through the headphone to create a natural experience at the ear that sounds the same as if the headphone were not present. To allow K.sub.ht to deliver the intended sound of the outside world, the feedback loop in combination with the passive acoustic path through the headphone should provide at least 8 dB of attenuation at all frequencies of interest. That is, the noise level heard at the ear when the feedback loop is active, but the feed-forward path is not, should be less than the noise level at the ear when the headphones aren't worn at all by at least 8 dB (note that “less than by 8 dB” refers to the ratio of levels, not a number of decibels on some external scale). When G.sub.pfb is less than or equal to −8 dB, the effect it has on the actual hear-through insertion gain is less than 3 dB error when the desired T.sub.htig=0 dB. The attenuation may be much higher, if the feedback loop is capable of more gain, or the passive attenuation is greater. To achieve this naturalness in some cases, it may also be desirable to reduce the gain K.sub.ht of the feedback loop from its maximum capability, as discussed below.
(23) The difference in overall noise reduction at the ear between the normal ANR mode and the active hear-through model should be at least 12 dBA. This provides enough of a change in ambient noise level that switching from active hear-through mode with quiet background music to noise reduction results in a dramatic change. This is because of the rapid decrease in the perceived loudness of the ambient noise in the presence of the music masker when switching modes. The music, which is quietly in the background in hear-through mode, can make the noise virtually inaudible in noise reduction mode as long as there is at least 12 dBA of noise reduction change between the hear-through and noise reduction modes.
(24) In some examples, a digital signal processor like that described in U.S. Pat. No. 8,184,822, incorporated here by reference, advantageously sums the output of the feedback loop with the path through the fed-forward microphone, avoiding the combing (deep nulls in the combined signal) that might result if K.sub.ht has a latency typical of an audio-quality ADC/DAC combination, typically several hundred microseconds. Preferably, the system is implemented using a DSP having a latency of less than 250 μs so that the first potential null from combing (which will be at 2 kHz with 250 μs latency) is at least one octave above the typical minimum insertion loss frequency in G.sub.pfb, which is typically around 1 khz. The configurable processor described in the cited patent also allows easy substitution of the active hear-through filter K.sub.ht for the feed-forward filter K.sub.ff.
(25) Once ambient naturalness is achieved, additional features may be provided by selecting between more than one feed-forward filter K.sub.ht, providing different total response characteristics. For example, one filter may be preferable for providing hear-through in an aircraft, where loud, low-frequency sounds tend to mask conversation, so some cancellation in that frequency should be maintained, while voice-band signals should be passed as naturally as possible. Another filter may be preferable in generally quieter environments, where the user wants or needs to hear the environmental sounds accurately, such as to provide situational awareness when walking down the street. Selecting between active hear-through modes may be done using a user interface, such as buttons, switches, or an application on a smart phone paired to the headset. In some examples, the user interface for selecting a hear-through mode is a volume control, with different hear-through filters being selected based on the volume setting chosen by the user.
(26) The hear-through filter selection may also be automatic, in response to ambient noise spectrum or level. For example, if the ambient noise is generally quiet or generally broad-spectrum, a broad-spectrum hear-through filter may be selected, but if the ambient noise has a high signal content at a particular frequency range, such as that of aircraft engines or the roar of a subway, that range may be cancelled more than providing ambient naturalness would call for. The filter may also be selected to provide broad-spectrum hear-through but at reduced volume levels. For example, setting T.sub.htig=0.5 will provide 6 dB of insertion loss over a broad frequency range. The measurement of ambient sounds used to automatically select the hear-through filters may be a time-average measurement of the spectrum or level, which may be updated periodically or continuously. Alternatively, the measurement may be made instantaneously at the time the user activates the hear-through mode, or a time average of a sample time immediately prior to or immediately after the user makes the selection may be used.
(27) One example use for an automatically-selected set of active hear-through filters is industrial hearing protection. A headphone having feedback and feed-forward active noise reduction, plus passive attenuation, that delivers 20 dB attenuation could be used to protect hearing, to accepted standards, in noise levels as high as 105 dBA (i.e., it reduces the noise 20 dB from 105 dBA to 85 dBA), which covers the vast majority of industrial noise environments. However, in an industrial environment where the noise level changes over time or with location, one doesn't want the full 20 dB of attenuation when it is comparatively quiet (e.g., less than 70 dBA) since it hinders communication between workers. A multi-mode active hear-through headphone can function as a dynamic noise reduction hearing protector.
(28) Such a device would monitor the ambient level at the feed-forward microphones and, if the level is below 70 dBA, apply a filter K.sub.ht to the feed-forward path that creates a T.sub.htig=0 dB. As the noise levels increases above 70 dBA, the headphone detects this and steps through several sets of K.sub.ht filter parameters (such as from a lookup table) to gradually reduce the insertion gain. Preferably, the headphone will have many possible sets of filters to apply and the detection of ambient level be done with a long time constant. The audible effect would be to compress a slow increase from 70 to 105 dBA in actual noise level around the user to a perceived increase from 70 to only 85 dBA, while continuing to pass the short-term dynamics of speech and the noise.
(29) The figures and description above consider a single ear cup. In general, active noise reducing headphones have two ear cups. In some examples, the same hear-through filters are applied for both ear cups, but in other examples, different filters may be applied, or the hear-through filter K.sub.ht may be applied to only one ear cup while the feed-forward cancellation filter K.sub.ff is maintained in the other ear cup. This may be advantageous in several examples. If the headphone is a pilot's headset used for communication with other vehicles or a control center, turning on hear-through in only one ear cup may allow the pilot to speak with a crew member not wearing a headset while maintaining awareness of communication signals or warnings by keeping noise cancellation active in the other ear cup.
(30) The active hear-through performance may be enhanced if the feed-forward microphone signals of each ear cup are shared with the other ear cup, and inserted into each opposite ear cup's signal path using another set of filters K.sub.xo. This can provide directionality to the hear-through signal, so the wearer is better able to determine the source of sounds in their environment. Such improvements may also increase the perceived relative level of the voice of a person on-axis in front of the wearer, relative to diffuse ambient noise. A system capable of providing the cross-over feed-forward signals is described in U.S. Patent Application publication 2010/0272280, incorporated here by reference.
(31) In addition to using active noise cancellation techniques to provide both ANR and hear-through, an active hear-through system may also include a single-channel noise reduction filter in the feed-forward signal path during the hear-through mode. Such a filter may clean up the hear-through signal, for example improving the intelligibility of speech. Such in-channel noise reduction filters are well-known for use in communications headsets. For best performance, such a filter should be implemented within the latency constraints described above
(32) When the feed-forward microphone is used to provide active hear-through of ambient sounds, it may be beneficial to protect the microphone against wind noise, that is, noise caused by air moving quickly past the microphone. Headsets used indoors, such as on aircraft, generally do not need wind noise protection, but headsets that may be used outdoors may be susceptible. As shown abstractly in
(33) Natural Hear-Through of the User's Voice
(34) When a person hears their own voice as sounding natural, we refer to this as “self naturalness.” As just described, ambient naturalness is accomplished through modifications of the feed-forward filter. Self naturalness is provided by modifying the feed-forward filters and the feedback system, but the changes are not necessarily the same as those used when ambient naturalness alone is desired. In general, simultaneously achieving ambient naturalness and self naturalness in active hear-through requires altering both the feed-forward and feedback filters.
(35) As shown in
(36) When wearing headphones, the first path 402 is blocked to some degree, so the user can't hear that portion of his own voice, changing the mix of the signals reaching the inner ear. In addition to the contribution from the second path providing a greater share of the total sound energy reaching the inner ear due to the loss of the first path, the second path itself becomes more efficient when the ear is blocked. When the ear is open, the sound entering the ear canal through the second path can exit the ear canal through the opening of the ear canal. Blocking the ear canal opening improves the efficiency of coupling of ear canal wall vibration into the air of the ear canal, which increases the amplitude of pressure variations in the ear canal, and in turn increases the pressure on the ear drum. This is commonly called the occlusion effect, and it can amplify sounds at the fundamental frequencies of a male voice by as much as 20-25 dB. As a result of these changes, the user perceives their voice to have over-emphasized lower frequencies and under-emphasized higher frequencies. In addition to making the voice sound lower, the removal of the higher frequency sounds from human voice will also make the voice less intelligible.
(37) This change in the user's perception of their own voice can be addressed by modifying the feed-forward filters to admit the air-conducted portion of the user's voice, and modifying the feedback filters to counteract the occlusion effect. The changes to the feed-forward filters for ambient naturalness, discussed above, are generally sufficient to provide self naturalness as well, if the occlusion effect can be reduced. Reducing the occlusion effect may have benefits beyond self-naturalness, and is discussed in more detail below.
(38) Reduction of the Occlusion Effect
(39) The occlusion effect is particularly strong when the headphone is just capped, i.e., by headphones that block the entrance to the ear canal directly, but do not protrude far into the ear canal. Larger volume ear cups provide more room for sounds to escape the ear canal and dissipate, and deep-canal earphones block some of the sound from passing from the soft tissues into the ear canal in the first place. If the headphones or earplugs extend far enough into the ear canal, past the muscle and cartilage to where the skin is very thin over the bone of the skull, the occlusion effect goes away, as little sound pressure enters the enclosed volume through the bone, but extending a headphone that far into the ear canal is difficult, dangerous, and can be painful. For any type of headphone, reducing whatever amount of occlusion effect is produced can be beneficial for providing self naturalness in an active hear-through feature and for removing non-voice elements of the occlusion effect.
(40) The experience of wearing headphones is improved by eliminating the occlusion effect, so that the user hears their own voice naturally when active hear-through is provided.
(41) Reducing or even eliminating the negative consequences of the occlusion effect may be accomplished without perfect cancellation of the sound pressure. Some feedback-based noise cancelling headphones are capable of providing more cancellation than is needed to mitigate the occlusion effect. When the goal is only to remove the occlusion effect, the feedback filters or gain are adjusted to provide just enough cancellation to do that, without further cancelling ambient sounds. We represent this as applying filter K.sub.on in place of the full feedback filter K.sub.ht.
(42) As shown in
(43) As with the feed-forward system, filter parameters for the feedback system to achieve self naturalness by eliminating the occlusion effect as much as possible can be found from the responses of the various signal paths in the head-headphone system shown in
The body-conducted responses G.sub.bcc and G.sub.bcm are significant at different frequency ranges, generally below and above 1.5 kHz, respectively. These three paths combine to form the net open-ear response of the user's voice at the ear canal, without the headphones, G.sub.oev=G.sub.ac+G.sub.bcc+G.sub.bcm. In contrast, the net closed-ear voice response when the headphones are present is defined as G.sub.cev.
(44) The net responses G.sub.oev or G.sub.cev can't be measured directly with any repeatability or precision, but their ratio G.sub.cev/G.sub.oev can be measured by suspending a miniature microphone in the ear canal (without blocking the ear canal) and finding the ratio of the spectrum measured when the subject speaks while wearing the headphone to the spectrum measured when the subject speaks without wearing the headphone. Performing the measurement on both ears, with one obstructed by the headphone and the other open, guards against errors resulting from the variability of human speech between measurements. Such measurements are the source of the occlusion effect curves in
(45) To find the value of K.sub.on to use to just cancel the occlusion effect, we consider the effect of the headphones and ANR system on the responses as they combine to form G.sub.cev. A reasonable approximation is that G.sub.ac is affected the same way as air-conducted ambient noise, so its contribution to G.sub.cev is G.sub.ac*(G.sub.pfb+G.sub.nx*K.sub.ht*G.sub.ffe). The headphones have a negligible effect on the third path 420 directly to the middle and inner ear, so G.sub.bcm remains unchanged. As for the second path 412, the body-conducted sound entering the ear canal is indistinguishable from ambient noise that gets past the ear cup, so the feedback ANR system cancels it with the feedback loop occlusion filter K.sub.on, providing a response of G.sub.bcc/(1−L.sub.fb), where loop gain L.sub.fb is the product of the feedback filter K.sub.on and the driver-to-system-microphone response G.sub.ds. In total, then,
(46)
(47) For self-naturalness, one wants Gcev/Goev=1 (0 dB). Combined with the earlier equation (1) for self-naturalness, this allows balancing these two aspects of the hear-thru experience. Human perception of ambient sound is largely insensitive to phase (assuming the phase does not change very rapidly) so the phase response resulting from the value of K.sub.ht chosen to approximate T.sub.htig is not significant. What matters in solving equation (1) for K.sub.ht is matching the magnitude |T.sub.htig|. The phase of G.sub.pfb+G.sub.nx*K.sub.ht*G.sub.ffe will, however, affect how the covered-ear G.sub.ac path (affected by K.sub.ht) sums with the covered-ear G.sub.bcc path (affected by K.sub.on). The design process breaks into the following steps: a) Measure the occlusion effect (the low frequency boost in G.sub.cev/G.sub.oev) by measuring G.sub.cev with all ANR turned off. b) Design the ANR feedback loop to counter-balance the measured occlusion effect. If the measurements show 10 dB of occlusion effect boost at 400 Hz then one would, to first approximation, want 10 dB of feedback loop desensitivity (1−Lfb) at that frequency. For headphones that don't have enough feedback ANR gain to fully cancel the occlusion effect, K.sub.on will simply be equal to the K.sub.fb of the optimized feedback loop. For headphones that do have sufficient headroom in the feedback loop, K.sub.on will be some value less than K.sub.ht. c) Design K.sub.ht for ambient naturalness as discussed above. d) Apply the K.sub.ht filter to the feed-forward loop and K.sub.on to the feedback loop and measure G.sub.cev/G.sub.oev again. e) Adjust the phase of K.sub.ht without altering the magnitude by adding all-pass filter stages or moving zeros into the right half plane (or outside the unit circle in digital systems) to minimize any deviation in G.sub.cev/G.sub.oev from 1 (transparency). f) It may also be beneficial to adjust K.sub.on in this process. Updated values of K.sub.on and K.sub.ht are iterated to find the best balance of desired ambient response and own-voice response.
(48) Reducing the occlusion effect and allowing the wearer to hear his own voice naturally has a further benefit of encouraging the user to speak at a normal level when talking to someone else. When people are listening to music or other sounds on headphones, they tend to speak too loudly, as they speak loudly enough to hear themselves over the other sound they hear, even though no-one else can hear that sound. Conversely, when people are wearing noise-cancelling headphones but not listening to music, they tend to speak too softly to be understood by others in a noisy environment, apparently because in this case they easily hear their own voice over the quiet residual ambient noise they hear. The way people adjust their own speaking level in response to how they hear their own voice in relation to other environmental sounds is called the Lombard Reflex. Allowing the user to accurately hear the level of his own voice via active hear-through allows him to correctly control that level. In the case of music playing in the headphones causing the user to speak too loudly, muting the music when switching into the hear-through mode could also help the user to correctly hear his own voice and control its level.
(49) Retaining Entertainment Audio During Active Hear-Through
(50) Headphones that provide direct talk-through or passive monitoring by muting the ANR circuit and either reproducing the external sounds or allowing them to passively move through the headphones also mute any input audio, such as music, that they may be reproducing. In the system described above, active noise reduction and active hear-through can be provided independently of reproduction of entertainment audio.
(51) Providing a separate path for the input audio allows headphones to be configured to adjust the active ANR to provide active hear-through, but at the same time keep playing the entertainment audio. The input audio may be played at some reduced volume, or kept at full volume. This allows a user to interact with others, such as a flight attendant, without missing whatever they are listening to, such as the dialog of a movie. Additionally, it allows users to listen to music without being isolated from their environment, if that is their desire. This allows the user to wear the headphones for background listening while maintaining situational awareness and remaining connected with their environment. Situational awareness is valuable, for example, in urban settings where someone walking down the street wants to be aware of people and traffic around them but may want to listen to music to enhance their mood or to podcasts or radio for information, for example. They may even wear the headphone to send a “do not disturb” social signal while actually wanting to be aware of what's going on around them. Even if situational awareness is not of value, for example, a user listening to music at home without other disturbances, some users may prefer to be aware of the environment, and to not have the isolation that even passive headphones typically provide. Keeping active hear-through enabled while listening to music provides this experience.
(52) The specifics of the feed-forward and input audio signal path filters will affect how active hear-through interacts with reproduction of input audio signals to produce a total system response. In some examples, the system is tuned so that the total audio response is the same in both noise-canceling mode and active hear-through mode. That is, the sound reproduced from the input audio signal sounds the same in both modes. If K.sub.on≠K.sub.fb, then K.sub.eq must differ in the two modes by the change in desensitivity from 1−G.sub.dsK.sub.fb to 1−G.sub.dsK.sub.on. In some examples, the frequency response is kept the same, but the gains applied to the input audio and feed-forward paths are modified. In one example, the gain in K.sub.eq is reduced during active hear-through mode so that the output level of the input audio is reduced. This can have the effect of keeping the total output level constant between active noise cancelation mode, where the input audio is the only thing heard, and the hear-through mode, where the input audio is combined with the ambient noise.
(53) In another example, the gain in K.sub.eq is increased during the active hear-through mode, so that the output level of the input audio is increased. Raising the volume of the input audio signal decreases the extent to which the ambient noise that is inserted during active hear-through masks the input audio signal. This can have the effect of preserving the intelligibility of the input audio signal, by keeping it louder than the background noise, which of course increases during the active hear-through mode. Of course, if it is desired to mute the input audio during the active hear-through mode, this can be accomplished by simply setting the gain of K.sub.eq to zero, or by turning off the input audio signal path (which, in some implementations, may be the same thing).
(54) Providing the ANR and audio playback through separate signal paths also allows the audio playback to be maintained even when the ANR circuitry is not powered at all, either because the user has turned it off or because the power supply is not available or depleted. In some examples, a secondary audio path with a different equalizing filter K.sub.np implemented in passive circuitry is used to deliver the input audio signal to the output transducer, bypassing the signal processor. The passive filter K.sub.np may be designed to reproduce, as closely as possible, the system response experienced when the system is powered, without unduly compromising sensitivity. When such a circuit is available, the signal processor or other active electronics will disconnect the passive path when the active system is powered on and replace it with the active input signal path. In some examples, the system may be configured to delay the reconnection of the input signal path as a signal to the user that the active system is now operating. The active system may also fade-in the input audio signal upon power-on, both as a signal to the user that it is operating and to provide a more gradual transition. Alternatively, the active system may be configured to make the transition from passive to active audio as smoothly as possible without dropping the audio signal. This can be accomplished by retaining the passive signal path until the active system is ready to take over, applying a set of filters to match the active signal path to the passive path, switching from the passive path to the active path, and then fading into the preferred active K.sub.eq filter.
(55) When active hear-through and audio reproduction are available simultaneously, the user interface becomes more complicated than in typical ANR headphones. In one example, audio is kept on by default during active hear-through, and a momentary button which is pushed to toggle between noise reduction and hear-through modes is held in to additionally mute audio when activating hear-through. In another example, the choice of whether to mute audio on entering hear-through is a setting into which the headphone is configured according to the user's preference. In another example, a headphone configured to control a playback device, such as a smartphone, can signal the device to pause audio playback in place of muting the audio within the headphones when active hear-through is enabled. In the same example, such a headphone may be configured to activate the active hear-through mode whenever the music is paused.
(56) Other User Interface Considerations
(57) In general, headphones having an active hear-through feature will include some user control for activating the feature, such as a button or switch. In some examples, this user interface may take the form of more sophisticated interfaces, such as a capacitive sensor or accelerometer in the ear cup, that detects when the user touches the ear cup in a particular manner that is interpreted as calling for the active hear-through mode. In some cases, additional controls are provided. For situations where someone other than the user may need to activate a hear-through mode, such as a flight attendant needing the attention of a passenger or a teacher needing the attention of a student, an external remote control may be desirable. This could be implemented with any conventional remote control technology, but there are a few considerations due to the likely use cases of such devices.
(58) In an aircraft, it would be assumed that multiple passengers are wearing compatible headphones, but have not coordinated their selection of these products with each other or the airline, such that the flight attendant will not have information, such as unique device IDs, needed to specify which headset is to activate its hear-through mode. In this situation, it may be desired to provide a line-of-sight remote control, such as an infrared control with a narrow beam, that must be aimed directly at a given set of headphones to activate their hear-through mode. In another situation, however, such as during pre-flight announcements or in an emergency, the flight crew may need to activate hear-through on all compatible headphones. For this situation, a number of wide-beam infrared emitters could be located throughout the aircraft, positioned to assure that each seat is covered. Another source of remote control suitable to the aircraft use case is to overlay control signals on the audio input line. In that way, any set of headphones plugged into the aircraft's entertainment audio can be signaled, and this may provide both a broadcast and seat-specific means of signaling. In the classroom, military, or business context, on the other hand, it might be the case that all the headphones were purchased or at least coordinated by a single entity, so unique device identifiers may be available, and an broadcast type of remote control, such as radio, may be used to turn active hear-through on and off at individually specified headphones.
(59) Headphones having active circuitry generally include visible indications of their state, usually a simple on/off light. When active hear-through is provided, additional indicators are advantageous. At the simplest level, a second light may indicate to the user that the active hear-through mode is active. For situations where the user might use the active hear-through mode to communicate with others, such as a flight crew or co-workers in an office environment, additional indicators may be of value. In some examples, a light visible to others is illuminated red when ANR is active but active hear-through is not active, and the light changes to green when active hear-through is active, indicating to others that they can now talk to the user of the headphones. In some examples, the indicator light is structured so that it is only visible from a narrow range of angles, such as directly ahead of the user, so that only someone who is actually facing the user will know what state their headphones are in. This allow the wearer to still use the headphones so socially signal “do not disturb” to others they are not facing.
(60) Automatic Hear-Through When Talking
(61) In some examples, the feedback system is also used to automatically turn on active hear-through. When the user starts speaking, the amplitude of low-frequency pressure variations inside his ear canal is increased, as explained above, by sound pressure moving through soft tissues from the larynx to the ear canal. The feedback microphone will detect this increase. In addition to cancelling the increased pressure as part of ongoing occlusion effect compensation, the system can also use this increase in pressure amplitude to identify that the user is speaking, and therefore turn on the full active hear-through mode to provide self-naturalness of the user's voice. Band-pass filters on the feedback microphone signal, or correlation between the feedback and feed-forward microphone signals, can be used to make sure that active hear-through is switched on only in response to voice, and not to other internal pressure sources such as blood flow or body movement. When the user is speaking, the feed-forward and feedback microphones will both detect the user's voice. The feed-forward microphone will detect the air-conducted portion of the user's voice, which may cover the entire frequency range of human speech, while the feedback microphone will detect that part of the speech that is transmitted through the head, which happens to be amplified by the occlusion effect. The envelope of these signals will, therefore, be correlated within the band amplified by the occlusion effect when the user is speaking. If another person is speaking near the user, the feed-forward microphone may detect similar signals to those when the user is speaking, while any residual sound the feedback microphone detects of that speech will be significantly lower in level. By checking the correlation and the level of the signals for values consistent with the user speaking, the headphones can determine when the user is speaking, and activate the active hear-through system accordingly.
(62) In addition to allowing the user to hear his own voice naturally, automatic activation of the active hear-through feature also allows the user to hear the response of whomever he is talking to. In such an example, the hear-through mode may be kept on for some amount of time after the user stops speaking.
(63) An automatic active hear-through mode is also advantageous when the headphones are connected to a communications device, such as a wireless telephone, that does not provide a side tone, that is, a reproduction of the user's own voice over the near-end output. By turning on hear-through when the user is speaking or when the headset detects electronically that a call is in progress, the user hears his own voice naturally and will speak at an appropriate level into the phone. If the communications microphone is part of the same headset, a correlation between that microphone's signal and the feedback microphone's signal can be used to further confirm that the user is speaking.
(64) Stability Protection
(65) The active hear-through feature has the potential to introduce a new failure mode in ANR headsets. If the output transducer is acoustically coupled to the feed-forward microphone, to a greater extent than should exist under normal operation, a positive feedback loop may be created, resulting in high-frequency ringing, which may be unpleasant or off-putting to the user. This may happen, for example, if the user cups a hand over an ear when using headphones with a back cavity that is ported or open to the environment, or if the headphones are removed from the head while the active hear-through system is activated, allowing free-space coupling from the front of the output transducer to the feed-forward microphone.
(66) This risk can be mitigated by detecting high-frequency signals in the feed-forward signal path, and activating a compressing limiter if those signals exceed a level or amplitude threshold that is indicative of such a positive feedback loop being present. Once the feedback is eliminated, the limiter may be deactivated. In some examples, the limiter is deactivated gradually, and if feedback is again detected, it is raised back to the lowest level at which feedback was not detected. In some examples, a phase locked loop monitoring the output of the feed-forward compensator K.sub.ff is configured to lock onto a relatively pure tone over a predefined frequency span. When the phase locked loop achieves a locking condition, this would indicate an instability which would then trigger the compressor along the feed-forward signal path. The gain at the compressor is reduced at a prescribed rate until the gain is low enough for the oscillation condition to stop. When the oscillation stops, the phase-locked loop loses the lock condition and releases the compressor, which allows the gain to recover to the normal operating value. Since the oscillation must first occur before it can be suppressed by the compressor, the user will hear a repeated chirp if the physical condition (e.g., hand position) is maintained. However, short repeated quiet chirps are much less off-putting than a sustained loud squeal.
(67) Binaural Telepresence
(68) Another feature made possible by the availability of active hear-through is a shared binaural telepresence. For this feature, the feed-forward microphone signals from the right and left ear cups of a first set of headphones are transmitted to a second set of headphones, which reproduces them using its own equalization filters based on the acoustics of the second set of headphones. The transmitted signals may be filtered to compensate for the specific frequency response of the feed-forward microphones, providing a more normalized signal to the remote headphones. Playing back the first set of headphones' feed-forward microphone signals in the second set of headphones allows the user of the second set of headphones to hear the environment of the first set of headphones. Such an arrangement may be reciprocal, with both sets of headphones transmitting their feed-forward microphone signals to the other. The users could either choose to each hear the other's environment, or select one environment for both of them to hear. In the latter mode, both users “share” the source user's ears, and the remote user may choose to be in full noise-cancelling mode to be immersed in the sound environment of the source user.
(69) Such a feature can make simple communications between two people more immersive, and it may also have industrial applications, such as allowing a remote technician to hear the environment of a facility where a local co-worker or client is attempting to design or diagnose an audio system or problem. For example, an audio system engineer installing an audio system at a new auditorium may wish to consult with another system engineer located back at their home office on the sound being produced by the audio system. By both wearing such headphones, the remote engineer can here what the installer hears with sufficient clarity, due to the active hear-through filters, to give quality advice on how to tune the system.
(70) Such a binaural telepresence system requires some system for communication, and a way to provide the microphone signals to the communication system. In one example, smart phones or tablet computers may be used. At least one set of headphones, the one providing the remote audio signals, is modified from the conventional design to provide both ears' feed-forward microphone signals as outputs to the communication device. Headset audio connections for smartphones and computers generally include only three signal paths—stereo audio to the headset, and mono microphone audio from the headset to the phone or computer. Binaural output from the headphone, in addition to any communication microphone output, may be accomplished through a non-standard application of an existing protocol, such as by making the headphones operate as a Bluetooth stereo audio source and the phone a receiver (opposite the conventional arrangement). Alternatively, additional audio signals may be provided through a wired connection with more conductors than the usual headset jack, or a proprietary wireless or wired digital protocol may be used.
(71) However the signals are delivered to the communication device, it then transmits the pair of audio signals to the remote communication device, which provides them to the second headset. In the simplest configuration, the two audio signals may be delivered to the receiving headset as a standard stereo audio signal, but it may be more effective to deliver them separately from the normal stereo audio input to the headphones.
(72) If the communication devices used for this system also provide video conferencing, such that the users can see each other, it may also be desirable to flip the left and right feed-forward microphone signals. This way, if one user reacts to a sound to their left, the other user hears this in their right ear, matching the direction in which the see the remote user looking in the video conference display. This reversing of signals can be done at any point in the system, but is probably most effective if it is done by the receiving communication device, as that device knows whether the user at that end is receiving the video conference signal.
(73) Another feature made possible by providing the feed-forward microphone signals as outputs from the headphones is binaural recording with ambient naturalness on playback. That is, a binaural recording made using the raw or microphone-filtered signal from the feed-forward microphones can be played back using the K.sub.eq of the playback headset so that the person listening to the recording feels fully immersed in the original environment.
(74) Other implementations are within the scope of the following claims and other claims to which the applicant may be entitled.