Feedback acoustic noise cancellation tuning
11445290 · 2022-09-13
Assignee
Inventors
- Scott C. Grinker (Belmont, CA, US)
- Vladan Bajic (San Francisco, CA, US)
- Brian D. Clark (San Jose, CA, US)
- Tom-Davy W. Saux (Los Altos, CA, US)
- Hanchi Chen (San Jose, CA, US)
Cpc classification
G10K11/17875
PHYSICS
G10K11/17881
PHYSICS
G10K2210/3214
PHYSICS
G10K2210/3028
PHYSICS
G10K11/178
PHYSICS
International classification
Abstract
A method performed by an in-ear headphone that includes a speaker and an internal microphone. The method receives a microphone signal from the internal microphone that indicates a current sound pressure level (SPL) in an ear canal of a user. The current SPL is a result of a control leak from the in-ear headphone into an ambient environment that reduces a SPL in the ear canal between 2 dB and 25 dB at a frequency within a frequency range than if otherwise not present. The method determines an active noise cancellation (ANC) filter based on the microphone signal and generates an anti-noise signal using the ANC filter. The method drives the speaker using the anti-noise signal to reduce the current SPL in the ear canal of the user as much as 25 dB at a frequency within the frequency range.
Claims
1. A method performed by an in-ear headphone that includes a speaker and an internal microphone, the method comprising: receiving a microphone signal from the internal microphone that indicates a current sound pressure level (SPL) in an ear canal of a user, wherein the current SPL is a result of an opening that extends through an enclosure of the in-ear headphone such that an inside portion of the enclosure directly connects to an ambient environment outside the enclosure, thereby reducing a SPL in the ear canal; determining an active noise cancellation (ANC) filter based on the microphone signal; and generating an anti-noise signal using the ANC filter; and driving the speaker using the anti-noise signal to reduce the current SPL in the ear canal of the user by as much as 25 dB at a frequency within a frequency range.
2. The method of claim 1, wherein the frequency range is 20 Hz-1200 Hz.
3. The method of claim 1, wherein the opening reduces the SPL in the ear canal to zero below 20 Hz.
4. The method of claim 1, wherein the enclosure includes a front volume and a back volume, wherein the opening is a port that allows a path between the front volume and the ambient environment.
5. The method of claim 4, wherein the port is a first port and the path is a first path, wherein the in-ear headphone further comprises a second port that allows a second path between the back volume, the front volume, and the ambient environment.
6. The method of claim 1, wherein the enclosure also includes a main port that is configured to direct sound output by the speaker into the ear canal of the user, wherein the main port has a cross-sectional area that is at least twice a cross-sectional area of the opening.
7. The method of claim 1, wherein the microphone signal is a first microphone signal, wherein the in-ear headphone further comprises an external microphone, wherein the method further comprises receiving a second microphone signal from the external microphone that includes sound of the ambient environment; and generating a filtered audio signal that includes at least a portion of the sound of the ambient environment by filtering the second microphone signal with an acoustic transparency filter; and driving the speaker with the filtered audio signal and the anti-noise signal.
8. The method of claim 1, wherein the opening is positioned on an ear tip of the in-ear headphone.
9. An in-ear headphone comprising: a speaker; an internal microphone; an enclosure that comprises the speaker and the internal microphone; an opening that extends through the enclosure to directly connect an inside portion of the in-ear headphone to an ambient environment outside the enclosure; a processor; and memory having instructions which when executed by the processor causes the in-ear headphone to receive a microphone signal from the internal microphone that indicates a current sound pressure level (SPL); determine an active noise cancellation (ANC) filter based on the microphone signal; and generate an anti-noise signal using the ANC filter; and driving the speaker using the anti-noise signal to reduce the SPL in an ear canal of the user as much as 25 dB at a frequency within a frequency range.
10. The in-ear headphone of claim 9, wherein the frequency range is 20 Hz-1200 Hz.
11. The in-ear headphone of claim 9, wherein the opening reduces the SPL in the ear canal to zero below 20 Hz.
12. The in-ear headphone of claim 9, wherein the enclosure includes a front volume and a back volume, wherein the opening is a port that allows a path between the front volume and the ambient environment.
13. The in-ear headphone of claim 12, wherein the port is a first port and the path is a first path, wherein the in-ear headphone further comprises a second port that allows a second path between the back volume, the front volume, and the ambient environment.
14. The in-ear headphone of claim 9, wherein the enclosure further comprises a main port that is configured to direct sound output by the speaker into the ear canal of the user, wherein the main port has a cross-sectional area that is at least twice a cross-sectional area of the opening.
15. The in-ear headphone of claim 9, wherein the microphone signal is a first microphone signal, wherein the in-ear headphone further comprises an external microphone, wherein the memory has further instructions to receive a second microphone signal from the external microphone that includes sound of an ambient environment; generating a filtered audio signal that includes at least a portion of the sound of the ambient environment by filtering the second microphone signal with an acoustic transparency filter; and driving the speaker with the filtered audio signal and the anti-noise signal.
16. An article of manufacture comprising a non-transitory machine-readable medium having instructions stored therein that when executed by a processor of an in-ear headphone cause the headphone to receive, from an internal microphone of the in-ear headphone, a microphone signal that indicates a current sound pressure level (SPL) in an ear canal of a user, wherein the in-ear headphone comprises an opening that extends through an enclosure of the in-ear headphone such that an inside portion of the enclosure directly connects to an ambient environment that is outside the enclosure, thereby reducing a SPL in the ear canal; determine an active noise cancellation (ANC) filter based on the microphone signal; and generate an anti-noise signal using the ANC filter; driving a speaker of the in-ear headphone using the anti-noise signal to reduce the current SPL in the ear canal of the user as much as 25 dB at a frequency within a frequency range.
17. The article of manufacture of claim 16, wherein the frequency range is 20 Hz-1200 Hz.
18. The article of manufacture of claim 16, wherein the enclosure includes a front volume and a back volume, wherein the opening is a port that allows a path between the front volume and the ambient environment.
19. The article of manufacture of claim 18, wherein the port is a first port and the path is a first path, wherein the in-ear headphone further comprises a second port that allows a second path between the back volume, the front volume, and the ambient environment.
20. The article of manufacture of claim 16, wherein the enclosure also includes a main port that is configured to direct sound output by the speaker into the ear canal of the user, wherein the main port has a cross-sectional area that is at least twice a cross-sectional area of the opening.
21. The article of manufacture of claim 16, wherein the microphone signal is a first microphone signal, wherein the in-ear headphone further comprises an external microphone, wherein the non-transitory machine readable medium has further instructions to receive a second microphone signal from the external microphone that includes sound of the ambient environment; generate a filtered audio signal that includes at least a portion of the sound of the ambient environment by filtering the second microphone signal with an acoustic transparency filter; and drive the speaker with the filtered audio signal and the anti-noise signal.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The aspects are illustrated by way of example and not by way of limitation in the figures of the accompanying drawings in which like references indicate similar elements. It should be noted that references to “an” or “one” aspect of this disclosure are not necessarily to the same aspect, and they mean at least one. Also, in the interest of conciseness and reducing the total number of figures, a given figure may be used to illustrate the features of more than one aspect, and not all elements in the figure may be required for a given aspect.
(2)
(3)
(4)
(5)
(6)
DETAILED DESCRIPTION
(7) Several aspects of the disclosure with reference to the appended drawings are now explained. Whenever the shapes, relative positions and other aspects of the parts described in a given aspect are not explicitly defined, the scope of the disclosure here is not limited only to the parts shown, which are meant merely for the purpose of illustration. Also, while numerous details are set forth, it is understood that some aspects may be practiced without these details. In other instances, well-known circuits, structures, and techniques have not been shown in detail so as not to obscure the understanding of this description. Furthermore, unless the meaning is clearly to the contrary, all ranges set forth herein are deemed to be inclusive of each range's endpoints.
(8) Users of in-ear audio devices which when worn acoustically seal the ear canal of the user, such as in-ear headphones and hearing aids, may experience an occlusion effect that causes the user to perceive “hollow” or “booming” echo-like sounds of their own voice. Compared to a completely open ear canal, the occlusion effect may increase low-frequency spectral content (e.g., below 2000 Hz) of sound pressure within the ear canal by about 30 dB. One way to effectively reduce the occlusion effect is to not completely seal the ear canal. To do this, manufacturers of in-ear headphones and hearing aids reduce the occlusion effect by including a “pressure” vent in the in-ear audio device that allows air within the ear canal to escape into the ambient environment in order to alleviate the sound pressure within the ear canal. Pressure vents, however, may reduce the benefit of passive attenuation due to the sealing nature of the in-ear audio devices. In addition, the effectiveness of pressure vents may vary between users. For example, the occlusion effect may be different between users, due to differences (e.g., shape and size) in ear canals between the users. As a result, pressure vents, which are static holes (which are not adjustable), may aid in reducing the effect of occlusion in some people but not others.
(9) To overcome these deficiencies, the present disclosure describes an in-ear headphone that uses a combination of a control leak and a feedback acoustic noise cancellation (ANC) function to efficiently reduce the occlusion effect. The in-ear headphone includes a speaker, an internal microphone, and a control leak from the in-ear headphone into an ambient environment. The internal microphone produces a microphone signal that indicates a current sound pressure level (SPL or in-ear SPL) in an ear canal of a user due to the occlusion effect that is caused by the in-ear headphone being inserted into the ear canal. The current SPL is a result of the control leak that reduces a SPL in the ear canal within a first SPL range at a frequency within a frequency range than if otherwise not present. In other words, if the in-ear headphone fully acoustically sealed the ear canal, in which the in-ear headphone does not include the control leak (or the control leak is blocked) the SPL would be higher than the current SPL. Using the microphone signal, an ANC filter is determined and used to produce an anti-noise signal, which when used to drive the speaker reduces the current SPL in the ear canal of the user within a second SPL range at the frequency within the frequency range. As a result, the combination of the control leak and the ANC filter (which may be adapted to the user's ear canal) minimizes the sound pressure in the ear canal, thereby reducing the occlusion effect.
(10)
(11) The in-ear headphone 4 has an against-the-ear acoustic transducer or speaker 6 arranged and configured to reproduce sound that is represented in an audio signal directly into the ear canal 3 of the user 1. The headphone 4 also includes a control leak 8 that may have one or more ports that are configured to allow an air path from the in-ear headphone into the ambient environment. More about the control leak is described in
(12) In one aspect, an output audio signal or playback signal that may contain program audio such as music, podcast, or the voice of a far-end user during a voice communication session (e.g., phone call) can be provided along with other signals (such as an anti-noise signal produced by an ANC function) to drive the speaker, either separately or at least partially contemporaneously. The playback signal may be provided, via a network interface (such as the interface 32 of
(13)
(14) The in-ear headphone has an enclosure 26 that includes a back volume 28 and a front volume 27. The front volume includes the internal microphone 7, and speaker 6 is positioned such that a portion of the speaker is positioned inside the back volume and another portion is positioned in the front volume. In one aspect, a partition (or wall) that separates the back volume from the front volume may be formed around the speaker 6. In another aspect, the speaker 6 may be fully inside either volume. The front volume includes a main port 23 that is configured to direct outputted sound by the speaker into the ear canal 3 of the user.
(15) The enclosure also includes a first port 21 and a second port 22, where at least one of which make up the control leak. In one aspect, the ports may be openings of any shape, such as, for example, circular, square, or rectangular shaped. The first port allows a (first) path between the front volume and the ambient environment, while the second port allows a (second) path between the back volume, the front volume, and the ambient environment. In one aspect, the enclosure may not include the second port 22, thereby sealing off the back volume 28. In another aspect, the first port 21 may be positioned on the ear tip 60. In another aspect, there may be additional ports (e.g., a port that allows a path from the back volume into the ambient environment, without having to traverse through the front volume).
(16) In one aspect, the ports reduce the occlusion effect by alleviating at least some of the air pressure within the ear canal 3 by not allowing the in-ear headphone to make a complete seal (thereby containing a trapped pocket of air) when the headphone is inside the user's ear canal. In particular, the ports (either separate or a combination thereof) may reduce the in-ear SPL of the ear canal within a first range at a frequency within a frequency range. In another aspect, the ports may be sized such that they are smaller than the main port. For example, the main port may be circular shaped and have a diameter at least twice the size of either port. Specifically, the main port may have a diameter 2-7 mm, whereas the ports may have a diameter of 1-3 mm. As another example, the ports may have different shapes with respect to the main port, such as being rectangular shaped. In that case, the main port may have a cross-sectional area that is at least twice a cross-sectional area of either port.
(17)
(18) In one aspect each of these elements (or components) of the in-ear headphone may be integrated into the (e.g., enclosure of the) headphone 4. In another aspect, the headphone may include more (or less) elements as described herein. For instance, the in-ear headphone may include two or more speakers, two or more (external and/or internal) microphones, and/or a display screen that is configured to display image data.
(19) The controller 31 may be a special-purpose processor such as an application-specific integrated circuit (ASIC), a general purpose microprocessor, a field-programmable gate array (FPGA), a digital signal controller, or a set of hardware logic structures (e.g., filters, arithmetic logic units, and dedicated state machines). The controller is configured to perform feedback ANC operations in order to reduce the occlusion effect in the user's ear canal. In addition, the controller is configured to perform networking operations and/or perform a transparency function. Also, the controller may optionally be configured to perform beamforming processes. In one aspect, although illustrated as being separate, (at least a portion of) the network interface 32 may be a part of the controller 31. More about how the controller performs these operations is described herein.
(20) As described herein, the headphone 4 may be a wireless electronic device that is configured to establish a wireless communication data link via the network interface 32 with another electronic device over a wireless computer network (e.g., a wireless personal area network (WPAN)) using e.g., BLUETOOTH protocol or a WLAN in order to exchange data. In one aspect, the network interface 32 is configured to establish a wireless communication data link with a wireless access point in order to exchange data with a remote electronic server (e.g., over the internet). For example, the headphone may retrieve program audio for playback through the speaker 6 from a server. In another aspect, the network interface 32 may be configured to establish a communication data link via a mobile voice/data network that employs any type of wireless telecom protocol (e.g., a 4G Long Term Evolution (LTE) network).
(21) In one aspect, the headphone 4 may be a part of an audio system that is configured to perform ANC operations or functions as described herein. In another aspect, the audio system may include a separate (e.g., companion) device, such as a smart phone, with which the headphone establishes a (e.g., wired and/or wireless) connection in order to pair both devices together. In one aspect, the (e.g., programmed processor of the) companion device may perform one or more of the operations described herein. For instance, the companion device may obtain program audio from a remote source and transmit the audio to the headphone for playback. In another aspect, at least some of the elements of the headphone may be a part of the companion device (or another electronic device) within the system, such as one or more external microphones.
(22) The controller 31 may have one or more operational blocks, which may include a feedback ANC function 33, a transparency 34, and a beamformer 35. The feedback ANC function is configured to cause the speaker 6 of the headphone to produce anti-noise in order to minimize the occlusion effect. Specifically, the feedback ANC 33 receives a microphone signal from the internal microphone 7 and determines (or selects) an ANC filter based on the microphone signal. The ANC 33 may determine the filter such that an anti-noise signal produced using the filter reduces (when outputted by the speaker 6) the in-ear SPL in order to further minimize the occlusion effect. Specifically, the ANC 33 determines the filter such that when a corresponding anti-noise signal is used to drive the speaker, the current in-ear SPL is reduced. For instance, the microphone signal may indicate the (current) in-ear SPL. From the signal, the ANC 33 may select a filter such that the in-ear SPL is reduced within a second SPL range at a frequency within a frequency range when the anti-noise signal is outputted by the speaker. In one aspect, the frequency and/or frequency range may be the same (or different) to the frequency and/or frequency range within which the control leak reduces the in-ear SPL within the first SPL range as described herein.
(23) In one aspect, the feedback ANC may determine the ANC filter based on multiple microphone signals. In particular, the feedback ANC may determine which ANC filter should be used based on differences between an in-ear SPL and an ambient SPL of the ambient environment. For instance, the feedback ANC may receive the microphone signal form the internal microphone 7 and a microphone signal from the external microphone 30. The ANC may determine the in-ear SPL based on the differences between both microphone signals.
(24) The beamformer 35 is configured to process two or more microphone signals that are produced and received from two or more external microphones to form at least one directional beam pattern in a particular direction, so as to be more sensitive to a sound source that is located within the ambient environment, such as the user's mouth. As a result, the beamformer may produce at least one sound pickup beamformer output signal that includes one or more directional beam patterns that are aimed towards the sound source.
(25) The transparency function 34 is configured to receive a microphone signal produced by the external microphone 30 (or a beamformer output signal produced by the beamformer 35) that includes ambient sounds of the ambient environment and configured to render the signal to cause the speaker 6 to reproduce the ambient sounds. Specifically, this function enables the user of the headphone to hear the ambient sounds within the environment more clearly, and preferably in a manner that is “transparent” as possible, e.g., as if the headphone was not being worn by the user. To do this, the controller 31 obtains the microphone signal, which includes one or more ambient sounds, and processes (or filters) the signal through a transparency filter to produce one or more filtered signals that includes at least a portion of the ambient sound. In one aspect, the transparency filter may reduce acoustic occlusion due to the headphones being in, on or over the user's ear, while also preserving spatial filtering effect of the user's anatomical features (e.g., head, pinna, shoulder, etc.). The filter may also help preserve the timbre and spatial cues associate with the actual ambient sound. Thus, in one aspect the transparency filter may be user specific, according to specific measurements of the user's head. For instance, the controller may determine the transparency filter according to a HRTF or equivalently, head related impulse response (HRIR) that is based on the user's anthropometrics. In one aspect, when the headphone has several microphones, a specific (or general) transparency filter may be applied to microphones signals produced by each of the microphones, and resulting filtered signals may be combined or summed together.
(26) In one aspect, the controller 31 is configured to combine the anti-noise signal produced by the feedback ANC 33 and the filtered signal produced by the transparency 34 in order to drive the speaker 6 with both signals. In another aspect, the controller 31 may be configured to perform operations of any of the operational blocks described herein separately. For instance, the controller may only output the anti-noise signal, without the filtered signal, and vice a versa. In some aspects, this configuration may be based on user input (e.g., received by a companion device that transmits control signals to the controller via the network interface). For example, the user may indicate (via a user-interface of the companion device) that only feedback ANC is to be activated. As a result, the companion device is configured to instruct the controller 31 to only activate the feedback ANC 33.
(27)
(28) Some aspects perform variations of the process 40 described in
(29) In one aspect, the process 40 may be performed periodically (e.g., once every second, etc.) in order to adaptively configure the ANC filter. In another aspect, the process may be performed in response to sounds detected within the environment and/or actions performed by the user. For instance, the ANC filter may be determined in response to the headphone detecting footfall, or the action in which the user puts a food down while walking. In one aspect, such an action may be detected based on sensor data (e.g., from an onboard accelerometer).
(30)
(31) In order to further reduce the in-ear SPL, the in-ear headphone may implement feedback ANC, as described herein. As a result, to the activation of the feedback ANC (e.g., driving the speaker 6 with an anti-noise signal), there is another change in the in-ear SPL, ΔSPL.sub.ANC (second SPL range). The effect of the feedback ANC may compensate (or reduce) the occlusion effect within frequencies in which the control leak does not effectively reduce the in-ear SPL f.sub.1 and may extend to f.sub.2, where f.sub.2 may be a frequency that is less than f.sub.3. In one aspect, f.sub.2 may be a frequency between 1000-1400 Hz. In another aspect, f.sub.2 may be a frequency between 800-1200 Hz. In another aspect, the reduction of in-ear SPL may extend to h. In other words, ΔSPL.sub.CL may not reduce the in-ear SPL to approximately 0 dB between f.sub.2 and f.sub.3. In that case, ΔSPL.sub.ANC may compensate. In one aspect, ΔSPL.sub.ANC may be as much as 25 dB at a given frequency between f.sub.1 and f.sub.2 (or f.sub.1 and f.sub.3).
(32) Personal information that is to be used should follow practices and privacy policies that are normally recognized as meeting (and/or exceeding) governmental and/or industry requirements to maintain privacy of users. For instance, any information should be managed so as to reduce risks of unauthorized or unintentional access or use, and the users should be informed clearly of the nature of any authorized use.
(33) As previously explained, an aspect of the disclosure may be a non-transitory machine-readable medium (such as microelectronic memory) having stored thereon instructions, which program one or more data processing components (generically referred to here as a “processor”) to perform the network operations and audio signal processing operations described herein, such as feedback ANC operations, transparency operations, and beamforming operations. In other aspects, some of these operations might be performed by specific hardware components that contain hardwired logic. Those operations might alternatively be performed by any combination of programmed data processing components and fixed hardwired circuit components.
(34) While certain aspects have been described and shown in the accompanying drawings, it is to be understood that such aspects are merely illustrative of and not restrictive on the broad disclosure, and that the disclosure is not limited to the specific constructions and arrangements shown and described, since various other modifications may occur to those of ordinary skill in the art. The description is thus to be regarded as illustrative instead of limiting.
(35) In some aspects, this disclosure may include the language, for example, “at least one of [element A] and [element B].” This language may refer to one or more of the elements. For example, “at least one of A and B” may refer to “A,” “B,” or “A and B.” Specifically, “at least one of A and B” may refer to “at least one of A and at least one of B,” or “at least of either A or B.” In some aspects, this disclosure may include the language, for example, “[element A], [element B], and/or [element C].” This language may refer to either of the elements or any combination thereof. For instance, “A, B, and/or C” may refer to “A,” “B,” “C,” “A and B,” “A and C,” “B and C,” or “A, B, and C.”