Adaptive dynamic audio hum extractor and extraction process
11488619 · 2022-11-01
Inventors
Cpc classification
G10L25/18
PHYSICS
G10H3/186
PHYSICS
International classification
G10L25/18
PHYSICS
Abstract
An adaptive dynamic audio hum extractor eliminates line frequency hum components and associated higher harmonics from an audio signal. An audio signal containing line frequency hum can be processed by providing dynamically controlled notch filters at the fundamental line frequency and additional harmonic multiples of the fundamental frequency. The audio signal is detected to provide dynamic control of the depth of the notch filters. Alternatively, an audio signal containing hum can be processed by dividing the spectrum into at least two frequency bands, an unaltered high band combined with a dynamically processed low band. The adaptive dynamically controlled notch filters vary the depth of the notches in relation to the envelope or time averaged level of the bandwidth limited audio signal. This allows masking of the hum components with higher levels of audio, thereby providing transparency devoid of audio path notches.
Claims
1. A process for adaptively removing audio hum components from an input audio signal comprising the steps of: filtering the input audio signal with at least one notch filter at a fundamental hum frequency; detecting the level of the input audio signal to provide a control signal; and dynamically varying the depth of the at least one notch filter in the input audio signal in response to the control signal to provide a maximum notch depth of the at least one notch filter when the input audio signal level is low and a minimum notch depth of the at least one notch filter when the input audio signal level is high.
2. A process according to claim 1, the step of filtering comprising the sub steps of: delaying the input audio signal with a time delay equal to the inverse of the fundamental power line frequency; varying the level of the delayed input audio signal in relation to the control signal to produce a dynamically varying delayed signal; inverting the dynamically varied delayed signal; and summing the inverted dynamically varied delayed signal with the input audio signal to produce dynamic notch filtering.
3. A process according to claim 1 further comprising the step of filtering the input audio signal with at least one other notch filter at at least one corresponding additional harmonic multiple that contains hum components to provide a maximum notch depth of the at least one other notch filter when the input audio signal level is low and a minimum notch depth of the at least one other notch filter when the input audio signal level is high.
4. A process for adaptively removing audio hum components from an input audio signal comprising the steps of: filtering the input audio signal with at least one notch filter at a fundamental hum frequency and with at least one additional harmonic multiple containing hum components; detecting the level of the input audio signal to provide a control signal; and dynamically varying the depth of the at least one notch filter in the input audio signal in response to the control signal to provide a maximum notch depth of the at least one notch filter when the input audio signal level is low and minimum notch depth of the at least one notch filter when the input audio signal level is high.
5. A process for adaptively removing audio hum components from an input audio signal comprising the steps of: dividing the spectrum of the input audio signal into a low-band audio signal and high-band audio signal; filtering the low-band audio signal with at least one notch filter at a fundamental hum frequency; detecting the level of the low-band audio signal to provide a low-band control signal; and dynamically varying the depth of the at least one notch filter in the low-band audio signal in response to the low-band control signal to provide a maximum notch depth of the at least one notch filter when the input audio signal level is low and a minimum notch depth of the at least one notch filter when the input audio signal level is high.
6. A process according to claim 5 further comprising the step of combining the high-band audio signal with the dynamically varying low-band signal to produce an output signal.
7. A process for adaptively removing audio hum components from an input audio signal comprising the steps of: dividing a spectrum of the input audio signal into a low-band audio signal, a band-pass audio signal and a high-band audio signal; filtering the low-band audio signal with at least one notch filter at a fundamental hum frequency; detecting the level of the low-band audio signal to provide a low-band control signal; dynamically varying the depth of the at least one notch filter in the low-band audio signal in response to the low-band control signal to provide a maximum notch depth of the at least one notch filter when the low-band audio signal level is low and a minimum notch depth of the at least one notch filter when the low-band audio signal level is high; filtering the band-pass audio signal with at least one notch filter at an interval of the fundamental hum frequency; detecting the level of the band-pass audio signal to provide a band-pass control signal; dynamically varying the depth of the at least one notch filter in the band-pass audio signal in response to the band-pass control signal to provide a maximum notch depth of the at least one notch filter in the band-pass audio signal when the band-pass audio signal level is low and a minimum notch depth of the at least one notch filter when the band-pass audio signal level is high.
8. A process according to claim 7 further comprising the step of combining the high-band audio signal with the dynamically varying low-band signal to produce an output signal.
9. A process for adaptively removing audio hum components from an input audio signal comprising the steps of: altering the input audio signal to provide a processed audio signal; dividing the spectrum of the input audio signal into a band-pass audio signal and a low-band audio signal; detecting the level of the low-band audio signal to provide a low-band control signal; detecting the level of the band-pass audio signal to provide a band-pass control signal; dividing the spectrum of the processed audio signal into low-band, band-pass and high-pass audio signal paths; filtering the output of the processed low-band audio signal path with at least one notch filter at a fundamental line frequency; dynamically varying the depth of the at least one notch filter in the low-band audio signal path in response to the low-band control signal to provide a maximum notch depth of the at least one notch filter in the low-band audio signal when the low-band audio signal level is low and a minimum notch depth of the at least one notch filter when the low-band audio signal level is high; filtering the output of the processed band-pass audio signal path with at least one notch filter at an interval of the fundamental line frequency; and dynamically varying the depth of the at least one notch filter in the band-pass audio signal in response to the band-pass control signal to provide a maximum notch depth of the at least one notch filter in the band-pass audio signal path when the band-pass audio signal level is low and a minimum notch depth of the at least one notch filter when the band-pass audio signal level is high.
10. A process according to claim 9 further comprising the step of combining the high-band audio signal with the dynamically varying low-band signal to produce an output signal.
11. A process for adaptively removing audio hum components from an input audio signal comprising the steps of: filtering the input audio signal with multiple independent notch filters at a fundamental hum frequency and each additional harmonic frequency at which hum components are audible; dividing the input audio signal into multiple frequency bands, a center of each frequency band being at the fundamental hum frequency or a harmonic frequency of the fundamental hum frequency at which hum components are audible; detecting the level of each of the multiple frequency bands at which hum components are audible to provide corresponding multiple control signals; and dynamically varying the depth of each independent notch filter in the input audio signal in response to the control signal corresponding to the same frequency as the notch filter to provide a maximum notch depth of each notch filter when the input audio signal level in each corresponding frequency band is low and a minimum notch depth of each notch filter when the input audio signal level is high.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Other objects and advantages of the invention will become apparent upon reading the following detailed description and upon reference to the drawings in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11) While the invention will be described in connection with preferred configurations thereof, it will be understood that it is not intended to limit the invention to those configurations or to the details of the construction or arrangement of parts illustrated in the accompanying drawings.
DETAILED DESCRIPTION
(12) In the following detailed description similar element numbers designate corresponding structural parts or functional blocks and similar alpha symbols designate corresponding signals.
(13) The plot of
(14) As shown, the output spectrum of a guitar picks up typical 60 Hz hum and higher order harmonics, producing very undesirable audible hum at the fundamental power line frequency of 60 Hz. If the instrument was not picking up the 60 Hz power line frequency and associated harmonics, the actual noise floor would be greater than −60 db.
(15) The fundamental power line frequency of 60 Hz and each harmonic component occurring at each increasing 60 Hz interval is present. The highest amplitude component is at 180 Hz. Each harmonic above 180 Hz decreases in amplitude. Simply reducing the fundamental line frequency hum component at 60 Hz would have little impact on the audible hum output of the signal because the 180 Hz, 240 Hz and 300 Hz harmonics are the highest amplitude components. The measured hum components and the balance of the harmonics in relation to the fundamental frequency will change with different environments. The requirement to remove the hum components remains the same even though the amplitude relationship of the fundamental power line frequency and harmonic components will change.
(16) Turning to
(17) This method of producing the required notches N at the required frequencies works well for its purpose, but does introduce a negative side effect. The subtle delay plus the additive aspect at the frequencies where no notch occurs adds to the undesirable sonic performance of a static system. The audible spectral change due to the notches combined with the additive delay become destructive to the original audio signal. The end result, therefore, is a final output signal that is perhaps more undesirable than was the original signal with the audible hum components.
(18) It is also possible to generate fixed notches at each required frequency with individual, high-Q notch filters. The sonic performance may increase with the fixed-notch high-Q filter approach, but at a very sizable increase in complexity and required processing power when implemented as a digital signal processing (DSP) algorithm. By bandwidth limiting the high frequency notches N to only that shown in
Adaptive Dynamic Single Frequency Band Hum Extractor
(19) Moving on to
(20) As seen in
(21) The delay 40 is set for a time delay equal to T=1/fh, where fh is the hum frequency to be removed. The output of the delay 40 is a delayed signal S.sub.D with a gain of 1 which is then fed to the input of a variable multiplier 60. In an analog embodiment of the invention, the variable multiplier 60 is a voltage controlled amplifier with a variable gain between 0 and 1. The variable multiplier 60 is dynamically controlled by the detector 50.
(22) The detector 50 is described in detail in previously issued patents including the above-mentioned U.S. Pat. Nos. 7,532,730 and 8,842,852 and, therefore, is not now described in detail. The detector 50 receives the full spectrum signal S.sub.ID to produce an adaptive precision level detected output control signal S.sub.C. The signal S.sub.C has a very fast release response when the audio input signal S.sub.I decays quickly and an adaptively slower response when the audio input signal S.sub.I decays slowly. The amount of ripple in the control signal S.sub.C is reduced to provide extremely low modulation of the variable multiplier 60 under the control of the detector 50 to provide the multiplier output signal S.sub.X. The detector 50 also provides a threshold control signal S.sub.TH to a user-adjustable threshold control 51.
(23) Looking again at both
(24) When no signal with energy above the user-set threshold is present at the input to the analog-to-digital converter ADC 10, the gain of the variable multiplier 60 will be 1. Maximum notch depth D will occur in the output of the summer 70 providing notches N at the fundamental power line frequency PLF and all higher order harmonics H.sub.HF as multiples of the fundamental hum frequency PLF. As the input signal S.sub.I increases above threshold, the depth D of the notches N will decrease, producing a decreasing amount of attenuation at the notch frequencies. With higher level input signals S.sub.I, the notches N completely disappear from the audio signal path. As the input signal S.sub.I decays, the notches N will dynamically increase based on the release response of detector 50. The notches N will adaptively change in depth D based in part on the actual envelope or time-averaged level of the audio input signal S.sub.I, providing a fast response with staccato notes and a slow smooth response with longer sustained notes. With instruments like guitar and bass, this provides enhanced transparency due to the adaptive dynamic operation of the detector 50.
(25) The output signal S.sub.HX of summer 70 is fed to the input of the digital-to-analog converter DAC 90 which provides the final processor output signal S.sub.F. This most simplified embodiment of the hum extractor provides excellent hum extraction when no audio is present and is also useful with very moderate amounts of background hum if the audio signal S.sub.I is capable of effectively masking the hum components H.sub.PLF+H.sub.HF when audio is present.
Adaptive Dynamic Split Band Hum Extractor with a Single Dynamic Band
(26) Turning now to
(27) Looking at
(28) The filters 20 and 30 are typically 4th order Linkwitz Riley high-pass and low-pass filters with a 24 decibel per octave response and a typical corner frequency of 2.4 KHz. The 2.4 KHz frequency is selected to provide hum cancellation up to the typical highest frequency harmonic of line hum. Other filter types can be used without major changes in the system performance but the Linkwitz Riley filter provides more accurate summation of the two frequency bands due to complementary phase shifts of the two bands in this type of filter. Higher order FIR filters with zero phase shift could be used.
(29) The output S.sub.20 of the high-pass filter 20 is fed directly to one positive input of a unity gain summer 80. The output signal S.sub.30 of the low pass filter 30 is applied to the inputs of a delay 40, a detector 50 with a threshold control 51 and a summer 70 as seen and described above in relation to the adaptive dynamic single frequency band hum extractor 100 of
(30) The output signal S.sub.LHX of the summer 70 feeds another positive input of the unity gain summer 80. The summer 80 feeds the combined adaptive dynamic low band signal S.sub.LHX and the unaltered high frequency band signal 52 as a composite output signal S.sub.HX at the input of the digital-to-analog converter DAC 90. The hum components having been removed, the output signal S.sub.F of the digital-to-analog converter DAC 90 is the final output signal of the hum extractor 200.
(31) The single dynamic band hum extractor 200 shown in
Multi-Band Adaptive Dynamic Hum Extractors
(32) For higher levels of hum even more effective operation can be realized by increasing the number of dynamic bands. Considering
(33) One configuration of a multi-band adaptive dynamic hum extractor 300 is seen in
(34) The internal processor P.sub.1 can be any signal processing operation that alters the audio input signal S.sub.ID including, but not limited to, an instrument preamplifier with gain and or distortion, compression and/or equalization. Detecting the direct, unaltered input signal S.sub.I is more desirable since use of the direct input signal before other processing will provide better dynamic range and better tracking for the detectors 50.sub.BP and 50.sub.LP.
(35) The processor P.sub.1 could be omitted, allowing the unaltered output signal from the analog-to-digital converter ADC 10 to directly feed the high-pass filter 20, the band-pass filter 22 and the low-pass filter 30.
(36) Continuing to look at
(37) Continuing with reference to
(38) The internal processor P.sub.1 feeds the input of the filters in the audio path including a high-pass filter 20, a band-pass filter 26 and a low-pass filter 32. These filters 20, 26 and 32 are again designed with Linkwitz Riley response and 24 db per octave slopes as described above.
(39) The output of the high pass filter 20 is un-processed and is fed directly to a positive input of the summing block 80. The output of the band-pass filter 26 is fed to the band-pass delay 40.sub.B. The delay time of delay 40.sub.B is designed so that T=1/fh where fh is equal to the frequency of the hum, typically the power line frequency.
(40) The output of the band-pass delay 40.sub.B feeds the input of the variable multiplier 60.sub.B. The multiplier 60.sub.B is controlled by the band-pass detector 50.sub.BP and provides variable gain between 0 and 1 based on the output of the detector 50.sub.BP. The output of variable multiplier 60.sub.B feeds an inverting input of the summing block 70.sub.B which then feeds the second positive input of the summing block 80.
(41) The output of the low-pass filter 32 is fed to the input of a low-pass delay 40.sub.L. The delay time of delay block 40.sub.L is also designed so that T=1/fh where fh is equal to the power line frequency of the AC line. The output of the band-pass delay block 40.sub.L feeds the input of the variable multiplier 60.sub.L. The multiplier 60.sub.L is controlled by the band-pass detector 50.sub.L and provides variable gain between 0 and 1 based on the output of the detector 50.sub.B. The output of variable multiplier 60.sub.L feeds an inverting input of a summing block 70.sub.L which then feeds a positive input of the summing block 81. The second positive input of the summing block 81 is fed from the output of the summing block 80. The output signal S.sub.HX of summing block 81 is a summation of all three bands with the hum components removed and feeds the input of the digital-to-analog converter DAC 90. The output of the digital-to-analog converter DAC 90 is the final audio output signal S.sub.F of the system.
(42) In operation, the audio input source signal with hum components S.sub.I is fed to the input of the analog-to-digital converter ADC 10. The output signal S.sub.ID feeds the input of the process block P.sub.1, the band-pass filter 22 and the low-pass filter 30. The user adjusts the threshold 51 of the system so as to eliminate any audible hum in the output signal. The audio input signal is split into three bands. The high frequency band is fed directly to the audio output since this band contains no appreciable amount of hum. The mid-frequencies are dynamically processed separately from the low frequencies to improve the subjective masking abilities of the system.
(43) The crossover frequency between the mid-frequencies at the output of the band-pass filter 26 and low-frequencies at the output of the low-pass filter 32 allow the two dynamic bands to provide excellent masking. For example, when a high frequency note is played on an electric guitar with a fundamental frequency above the 350 Hz crossover point, the low-band detector 50.sub.LP will see very little signal level such that the low-frequency band signal path will provide excellent rejection of the low-band hum. The depth D of the low frequency notches N will remain extremely deep, since there is little or no energy detected by the detector 50.sub.L required to change the gain of the variable multiplier 60.sub.L. The mid-band signal will contain adequate spectral energy due to the harmonic content of the instrument so as to mask the high frequency hum components with higher level input signals. By reducing the high-frequency notches N and allowing the masking of the high frequency hum harmonic components by the actual audio signal while also attenuating the low frequency hum components with very deep notches N in the low-frequency signal path, the resulting audio output signal retains all of the proper spectral information without alteration. As the note decays, the depth D of the high frequency notches N will dynamically increase so as to attenuate the high frequency hum harmonic components as they become audible.
(44) The subjective results of the multi-band system are excellent and, even with high amounts of hum intrusion in the input source signal, the audible hum at the output is virtually eliminated. Conversely, if a low frequency signal well below 350 Hz is played, the low frequency signal will provide masking of the low frequency hum until the note decays to the point where the notch depth D increases. The high frequency harmonic spectral energy above the fundamental low frequency note will cause the depth of the high band notches N to decrease momentarily so as to not color the high frequency harmonic spectral balance of the high frequency components. As the high frequency energy in the input audio signal decays, the notches N will increase in depth D so as to attenuate any audible intrusion of the high frequency hum harmonic components.
(45) With proper setting of the user adjustable threshold 51 based on the level of hum present in the input audio source signal S.sub.I, the net results are excellent. The multiband dynamic configuration disclosed provides excellent attenuation of the hum components while further improving the transparency of the final output signal and avoids coloration of the audio signal due to the dynamic operation of the notches N in the multiband audio path.
(46) Moving on to
(47) Moving the processing to an external configuration requires the addition of another analog-to-digital convertor ADC 11 to convert the analog output signal from the external processer P.sub.1 to a digital signal in order to feed the inputs of the high-pass filter 20, the band-pass filter 26 and the low-pass filter 32. With the exception of this change the operation of the embodiment of
(48) This will provide dynamic control of the system based on the direct input signal, not on the output of the external processor P.sub.1. The audio output of the external processor P.sub.1 then feeds the audio processing path of the adaptive dynamic audio hum extractor processor. As described above, with reference to
(49) In any configuration of the invention including those herein disclosed, even higher performance can be realized by increasing the number of adaptive dynamic frequency bands based on the principals described herein. Higher performance configurations with a higher number of dynamic bands will provide extremely transparent operation allowing use in very professional applications such as professional recording and live broadcast. The ultimate performance can be realized by increasing the number of dynamic frequency bands to the point that each individual notch frequency becomes independently dynamic and each notch frequency is implemented with a separate detector and dynamic variable multiplier.
(50) In any configuration of the invention including those herein disclosed, it is possible to use known methods for audio detection, however incorporation of the advantages of the inventions disclosed in U.S. Pat. Nos. 7,532,730 and 8,842,852 combined with the current invention produce a system which becomes adaptive to the actual envelope and time averaged level of the audio input signal thereby producing further enhanced performance and transparency.
(51) In any configuration of the invention including those herein disclosed, masking effectiveness can be increased by reducing the bandwidth of each individual band. For example, with audio signals where the hum is greater in amplitude, playing a single high frequency note may allow the low frequency hum components to become audible since there are no low frequency audio components present to mask the low frequency hum.
(52) Alternative methods are known for deriving a control signal which can be used with the current invention to produce acceptable results without departing from the scope of the current invention. However, higher performance and transparency is achieved by use of the inventions disclosed in the above-identified patents in combination with the current invention to provide increased adaptive and transparent operation.
(53) Thus, it is apparent that there has been provided, in accordance with the invention, an adaptive dynamic hum extractor and extraction process that fully satisfies the objects, aims and advantages set forth above. While the invention has been described in conjunction with specific configurations thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art in light of the foregoing description. Accordingly, it is intended to embrace all such alternatives, modifications and variations as fall to the spirit of the appended claims.