Method And Apparatus For Mitigation Of Outlier Noise

Abstract

The present invention relates to nonlinear signal processing, and, in particular, to method and apparatus for mitigation of outlier noise in the process of analog-to-digital conversion. More generally, this invention relates to adaptive real-time signal conditioning, processing, analysis, quantification, comparison, and control, and to methods, processes and apparatus for real-time measuring and analysis of variables, including statistical analysis, and to generic measurement systems and processes which are not specially adapted for any specific variables, or to one particular environment. This invention also relates to methods and corresponding apparatus for mitigation of electromagnetic interference, and further relates to improving properties of electronic devices and to improving and/or enabling coexistence of a plurality of electronic devices. The invention further relates to post-processing analysis of measured variables and to post-processing statistical analysis.

Claims

1. An apparatus for signal filtering capable of converting an input signal into an output signal, wherein said input signal is a physical signal and wherein said output signal is a physical signal, the apparatus comprising: a) a blanker characterized by a blanking range and operable to receive a blanker input and to produce a blanker output, wherein said blanker output is proportional to said blanker input when said blanker input is within said blanking range, and wherein said blanker output is effectively zero when said blanker input is outside of said blanking range; b) an integrator characterized by an integration time constant and operable to receive an integrator input and to produce an integrator output, wherein said integrator output is proportional to an antiderivative of said integrator input; wherein said blanker input is proportional to a difference signal, wherein said difference signal is the difference between said input signal and said output signal, wherein said integrator input is proportional to said blanker output, and wherein said output signal is proportional to said integrator output.

2. The apparatus of claim 1 wherein said blanking range is a range that effectively excludes outliers of said blanker input.

3. The apparatus of claim 1 further comprising a means of establishing said blanking range, wherein said means comprises a quantile tracking filter operable to receive said blanker input and to produce a quantile tracking filter output.

4. The apparatus of claim 1 further comprising a means of establishing said blanking range, wherein said means comprises a quantile tracking filter operable to receive an input proportional to an absolute value of said blanker input and to produce a quantile tracking filter output.

5. The apparatus of claim 1 further comprising a means of establishing said blanking range, wherein said means comprises a plurality of quantile tracking filters operable to receive said blanker input and to produce a plurality of quantile tracking filter outputs, and wherein said blanking range is a linear combination of said plurality of quantile tracking filter outputs.

6. An apparatus for signal filtering capable of converting an input signal into an output signal, wherein said input signal is a physical signal and wherein said output signal is a physical signal, the apparatus comprising: a) a blanker characterized by a blanking range and operable to receive a blanker input and to produce a blanker output, wherein said blanker output is proportional to said blanker input when said blanker input is within said blanking range, and wherein said blanker output is effectively zero when said blanker input is outside of said blanking range; b) an integrator characterized by an integration time constant and operable to receive an integrator input and to produce an integrator output, wherein said integrator output is proportional to an antiderivative of said integrator input; wherein said blanker input is proportional to a difference signal, wherein said difference signal is the difference between said input signal and said output signal, wherein said integrator input is proportional to said blanker output, and wherein said output signal is proportional to a sum of said integrator input and said integrator output.

7. The apparatus of claim 6 wherein said blanking range is a range that effectively excludes outliers of said blanker input.

8. The apparatus of claim 6 further comprising a means of establishing said blanking range, wherein said means comprises a quantile tracking filter operable to receive said blanker input and to produce a quantile tracking filter output.

9. The apparatus of claim 6 further comprising a means of establishing said blanking range, wherein said means comprises a quantile tracking filter operable to receive an input proportional to an absolute value of said blanker input and to produce a quantile tracking filter output.

10. The apparatus of claim 6 further comprising a means of establishing said blanking range, wherein said means comprises a plurality of quantile tracking filters operable to receive said blanker input and to produce a plurality of quantile tracking filter outputs, and wherein said blanking range is a linear combination of said plurality of quantile tracking filter outputs.

11. An apparatus for analog-to-digital conversion capable of converting an input signal into an output signal, wherein said input signal is a physical signal characterized by a nominal bandwidth and wherein said output signal is a quantized representation of said input signal, the apparatus comprising: a) a quantizer operable to receive a quantizer input and to produce a quantizer output; b) a nonlinear loop filter operable to receive said input signal and a feedback of said quantizer output and to produce said quantizer input, said nonlinear loop filter further comprising: c) a blanker characterized by a blanking range and operable to receive a blanker input and to produce a blanker output, wherein said blanker output is proportional to said blanker input when said blanker input is within said blanking range, and wherein said blanker output is effectively zero when said blanker input is outside of said blanking range; d) a first integrator characterized by a first integration time constant and operable to receive a first integrator input and to produce a first integrator output, wherein said first integrator output is proportional to an antiderivative of said first integrator input; e) a second integrator characterized by a second integration time constant and operable to receive a second integrator input and to produce a second integrator output, wherein said second integrator output is proportional to an antiderivative of said second integrator input; f) a first 1st order lowpass filter characterized by a lowpass filter bandwidth and a second 1st order lowpass filter characterized by said lowpass filter bandwidth, wherein said lowpass filter bandwidth is much larger than said nominal bandwidth, wherein said first 1st order lowpass filter is operable to receive a first 1st order lowpass filter input and to produce a first 1st order lowpass filter output, and wherein said second 1st order lowpass filter is operable to receive a second 1st order lowpass filter input and to produce a second 1st order lowpass filter output; wherein said first 1st order lowpass filter input is proportional to a difference between said input signal and said feedback of said quantizer output, wherein said second 1st order lowpass filter input is proportional to said feedback of said quantizer output, wherein said blanker input is proportional to said first 1st order lowpass filter output, wherein said first integrator input is proportional to said blanker output, wherein said second integrator input is proportional to a difference between said second integrator output and said second 1st order lowpass filter output, and wherein said quantizer input is proportional to said second integrator output.

12. The apparatus of claim 11 wherein said blanking range is a range that effectively excludes outliers of said blanker input.

13. The apparatus of claim 11 further comprising a means of establishing said blanking range, wherein said means comprises a quantile tracking filter operable to receive said blanker input and to produce a quantile tracking filter output.

14. The apparatus of claim 11 further comprising a means of establishing said blanking range, wherein said means comprises a quantile tracking filter operable to receive an input proportional to an absolute value of said blanker input and to produce a quantile tracking filter output.

15. The apparatus of claim 11 further comprising a means of establishing said blanking range, wherein said means comprises a plurality of quantile tracking filters operable to receive said blanker input and to produce a plurality of quantile tracking filter outputs, and wherein said blanking range is a linear combination of said plurality of quantile tracking filter outputs.

16. The apparatus of claim 11 wherein said first 1st order lowpass filter is further characterized by a gain value and wherein said second 1st order lowpass filter is further characterized by said gain value.

17. The apparatus of claim 16 further comprising a means of establishing gain value, wherein said means comprises a quantile tracking filter operable to receive an input proportional to an absolute value of said blanker input and to produce a quantile tracking filter output.

18. A digital signal processing apparatus comprising a digital signal processing unit configurable to perform one or more functions including a filtering function transforming an input signal into an output filtered signal, wherein said filtering function comprises: a) a blanker function characterized by a blanking range and operable to receive a blanker input and to produce a blanker output, wherein said blanker output is proportional to said blanker input when said blanker input is within said blanking range, and wherein said blanker output is effectively zero when said blanker input is outside of said blanking range; b) an integrator function characterized by an integration time constant and operable to receive an integrator input and to produce an integrator output, wherein said integrator output is proportional to a numerical antiderivative of said integrator input; wherein said blanker input is proportional to a difference signal, wherein said difference signal is the difference between said input signal and said output signal, wherein said integrator input is proportional to said blanker output, and wherein said output filtered signal is proportional to said integrator output.

19. The apparatus of claim 18 wherein said blanking range is a range that effectively excludes outliers of said blanker input.

20. The apparatus of claim 18 further comprising a means of estimating said blanking range, wherein said means comprises a quantile tracking function estimating a quantile of said blanker input.

21. The apparatus of claim 18 further comprising a means of estimating said blanking range, wherein said means comprises a quantile tracking function estimating a quantile of an absolute value of said blanker input.

22. The apparatus of claim 18 further comprising a means of estimating said blanking range, wherein said means comprises a plurality of quantile tracking functions, wherein said plurality of quantile tracking functions estimates a plurality of quantiles of said blanker input, and wherein said blanking range is a linear combination of said plurality of quantiles.

Description

BRIEF DESCRIPTION OF FIGURES

[0024] FIG. 1. ADCs with 1st-order (I) and 2nd-order (II) linear loop filters.

[0025] FIG. 2. Simplified diagram of improving receiver performance in the presence of impulsive interference.

[0026] FIG. 3. Illustrative ABAINF block diagram.

[0027] FIG. 4. Illustrative examples of the transparency functions and their respective influence functions.

[0028] FIG. 5. Block diagrams of CMTFs with blanking ranges [.sub., .sub.+] (a) and V.sub., V.sub.+]/G (b).

[0029] FIG. 6. Resistance of CMTF to outlier noise. The cross-hatched time intervals in panel (c) correspond to nonlinear CMTF behavior (zero rate of change).

[0030] FIG. 7. Illustration of differences in the error signal for the example of FIG. 6. The cross-hatched time intervals indicate nonlinear CMTF behavior (zero rate of change).

[0031] FIG. 8. Simplified illustrated schematic of CMTF circuit implementation.

[0032] FIG. 9. Resistance of the CMTF circuit of FIG. 8 to outlier noise. The cross-hatched time intervals in the lower panel correspond to nonlinear CMTF behavior.

[0033] FIG. 10. Using sums and/or differences of input and output of CMTF and its various intermediate signals for separating impulsive (outlier) and non-impulsive signal components.

[0034] FIG. 11. Illustration of using CMTF with appropriate blanking range for separating impulsive and non-impulsive (background) signal components.

[0035] FIG. 12. Illustrative block diagrams of an ADiC with time parameter T and blanking range [.sub., .sub.+].

[0036] FIG. 13. Simplified illustrative electronic circuit diagram of using CMTF with appropriately chosen blanking range [.sub., .sub.+] for separating incoming signal x(t) into impulsive i(t) and non-impulsive s(t) (background) signal components.

[0037] FIG. 14. Illustration of separating incoming signal x(t) into impulsive i(t) and non-impulsive s(t) (background) components by the circuit of FIG. 13.

[0038] FIG. 15. Illustration of separation of discrete input signal x into impulsive component aux and non-impulsive (background) component. prime using the MATLAB function of 2.5 with appropriately chosen blanking values alpha_p and alpha_m.

[0039] FIG. 16. Illustrative block diagram of a circuit implementing equation (17) and thus tracking a qth quantile of y(t).

[0040] FIG. 17. Illustration of MTF convergence to steady state for different initial conditions.

[0041] FIG. 18. Illustration of QTFs' convergence to steady state for different initial conditions.

[0042] FIG. 19. Illustration of separation of discrete input signal x into impulsive component aux and non-impulsive (background) component prime using the MATLAB function of 3.3 with the blanking range computed as Tukey's range using digital QTFs.

[0043] FIG. 20. Illustrative block diagram of an adaptive intermittently nonlinear filter for mitigation of outlier noise in the process of analog-to-digital conversion.

[0044] FIG. 21. Equivalent block diagram for the filter shown in FIG. 20 operating in linear regime.

[0045] FIG. 22. Impulse and frequency responses of w[k] and w[k]+w[k] used in the subsequent examples.

[0046] FIG. 23. Comparison of simulated channel capacities for the linear processing chain (solid curves) and the CMTF-based chains with =3 (dotted and dashed curves). The dashed curves correspond to channel capacities for the CMTF-based chain with added interference in an adjacent channel. The asterisks correspond to the noise and adjacent channel interference conditions used in FIG. 24.

[0047] FIG. 24. Illustration of changes in the signal time- and frequency domain properties, and in its amplitude distributions, while it propagates through the signal processing chains, linear (points (a), (b), and (c) in panel II of FIG. 21), and the CMTF-based (points I through IV, and point V, in FIG. 20).

[0048] FIG. 25. Alternative topology for signal processing chain shown in FIG. 20.

[0049] FIG. 26. ADC with an CMTF-based loop filter.

[0050] FIG. 27. Modifying the amplitude density of the difference signal xy by a 1st order lowpass filter.

[0051] FIG. 28. Impulse and frequency responses of w[k] and w[k]+(4B.sub.x).sup.1w[k] used in the examples of FIG. 29.

[0052] FIG. 29. Comparative performance of ADCs with linear and nonlinear analog loop filters.

[0053] FIG. 30. Resistance of ADC with CMTF-based loop filter to increase in impulsive noise.

[0054] FIG. 31. Outline of ADC with adaptive CMTF-based loop filter.

[0055] FIG. 32. Comparison of simulated channel capacities for the linear processing chain (solid lines) and the CMTF-based chains with =1.5 (dotted lines). The meaning of the asterisks is explained in the text.

[0056] FIG. 33A. Reduction of the spectral density of impulsive noise in the signal baseband without affecting that of the signal of interest.

[0057] FIG. 33B. Reduction of the spectral density of impulsive noise in the signal baseband without affecting that of the signal of interest. (Illustration similar to FIG. 33A with additional interference in an adjacent channel.)

[0058] FIG. 34. Illustrative signal chains for a ADC with linear loop and decimation filters (panel (a)), and for a ADC with linear loop filter and ADiC-based digital filtering (panel (b)).

[0059] FIG. 35. Illustrative time-domain traces at points I through VI of FIG. 34, and the output of the ADC with linear loop and decimation filters for the signal affected by AWGN only (w/o impulsive noise).

[0060] FIG. 36. Illustrative signal chains for a ADC with linear loop and decimation filters (panel (a)), and for a ADC with linear loop filter and CMTF-based digital filtering (panel (b)).

[0061] FIG. 37. Illustrative time-domain traces at points I through VI of FIG. 36, and the output of the ADC with linear loop and decimation filters for the signal affected by AWGN only (w/o impulsive noise).

[0062] FIG. 38. Illustrative signal chains for a ADC with linear loop and decimation filters (panel (a)), and for a ADC with linear loop filter and ADiC-based digital filtering (panel (b)), with additional clipping of the analog input signal.

[0063] FIG. 39. Illustrative time-domain traces at points I through VI of FIG. 38, and the output of the ADC with linear loop and decimation filters for the signal affected by AWGN only (w/o impulsive noise).

[0064] FIG. 40. Illustrative signal chains for a ADC with linear loop and decimation filters (panel (a)), and for a ADC with linear loop filter and CMTF-based digital filtering (panel (b)), with additional clipping of the analog input signal.

[0065] FIG. 41. Illustrative time-domain traces at points I through VI of FIG. 40, and the output of the ADC with linear loop and decimation filters for the signal affected by AWGN only (w/o impulsive noise).

[0066] FIG. 42. Analog (panel (a)) and digital (panel (b)) ABAINF deployment for mitigation of non-Gaussian (e.g. outlier) noise in the process of analog-to-digital conversion.

[0067] FIG. 43. Analog (panel (a)) and digital (panel (b)) ABAINF-based outlier filtering in ADCs.

ABBREVIATIONS

[0068] ABAINF: Analog Blind Adaptive Intermittently Nonlinear Filter; A/D: Analog-to-Digital; ADC: Analog-to-Digital Converter (or Conversion); ADiC: Analog Differential Clipper; AFE: Analog Front End; AGC: Automatic Gain Control; ASIC: Application-Specific Integrated Circuit: ASSP: Application-Specific Standard Product; AWGN: Additive White Gaussian Noise;

[0069] BAINF: Blind Adaptive Intermittently Nonlinear Filter; BER: Bit Error Rate, or Bit. Error Ratio;

[0070] CDL: Canonical Differential Limiter: CDMA: Code Division Multiple Access; CMTF: Clipped Mean Tracking Filter; COTS: Commercial Off-The-Shelf;

[0071] DSP: Digital Signal Processing/Processor;

[0072] EMC: electromagnetic compatibility; EMI: electromagnetic interference;

[0073] FIR: Finite Impulse Response; FPGA: Field Programmable Gate Array;

[0074] HSDPA: High Speed Downlink Packet. Access;

[0075] IC: Integrated Circuit; I/Q: In-phase/Quadrature; IQR: interquartile range;

[0076] MAD: Mean/Median Absolute Deviation; MATLAB: MATrix LABoratory (numerical computing environment and fourth-generation programming language developed by Math-Works); MTF: Median Tracking Filter;

[0077] NDL: Nonlinear Differential Limiter;

[0078] OOB: Out-Of-Band;

[0079] PDF: Probability Density Function; PSD: Power Spectral Density;

[0080] QTF: Quartile (or Quantile) Tracking Filter;

[0081] RF: Radio Frequency; RFI: Radio Frequency Interference; RMS: Root Mean Square; RRC: Root Raised Cosine; RX: Receiver;

[0082] SNR: Signal-to-Noise Ratio;

[0083] UWB: Ultra-wideband;

[0084] VGA: Variable-Gain Amplifier;

1 Analog Intermittently Nonlinear Filters for Mitigation of Outlier Noise

[0085] In the simplified illustration that follows, our focus is not on providing precise definitions and rigorous proof of the statements and assumptions, but on outlining the general idea of employing intermittently nonlinear filters for mitigation of outlier (e.g. impulsive) noise, and thus improving the performance of a communications receiver in the presence of such noise.

1.1 Motivation and Simplified System Model

[0086] Let us assume that the input noise affecting a baseband signal of interest with unit power consists of two additive components: (i) a Gaussian component with the power P.sub.G in the signal passband, and (ii) an outlier (impulsive) component with the power P.sub.i in the signal passband. Thus if a linear antialiasing filter is used before the analog-to-digital conversion (ADC), the resulting signal-to-noise ratio (SNR) may be expressed as (P.sub.G+P.sub.i).sup.1.

[0087] For simplicity, let us further assume that the outlier noise is white and consists of short (with the characteristic duration much smaller than the reciprocal of the bandwidth of the signal of interest) random pulses with the average inter-arrival times significantly larger than their duration, yet significantly smaller than the reciprocal of the signal bandwidth. When the bandwidth of such noise is reduced to within the baseband by linear filtering, its distribution would be well approximated by Gaussian [41]. Thus the observed noise in the baseband may be considered Gaussian, and we may use the Shannon formula [42] to calculate the channel capacity.

[0088] Let us now assume that we use a nonlinear antialiasing filter such that it behaves linearly, and affects the signal and noise proportionally, when the baseband power of the impulsive noise is smaller than a certain fraction of that of the Gaussian component, P.sub.iP.sub.G (0) resulting in the SNR (P.sub.G+P.sub.i).sup.1. However, when the baseband power of the impulsive noise increases beyond P.sub.G, this filter maintains its linear behavior with respect to the signal and the Gaussian noise component, while limiting the amplitude of the outlier noise in such a way that the contribution of this noise into the baseband remains limited to P.sub.G<P.sub.i. Then the resulting baseband SNR would be [(1+)P.sub.G].sup.1>(P.sub.G+P.sub.i).sup.1. We may view the observed noise in the baseband as Gaussian, and use the Shannon formula to calculate the limit on the channel capacity.

[0089] As one may see from this example, by disproportionately affecting high-amplitude outlier noise while otherwise preserving linear behavior, such nonlinear antialiasing filter would provide resistance to impulsive interference, limiting the effects of the latter, for small e, to an insignificant fraction of the Gaussian noise. FIG. 2 illustrates this with a simplified diagram of improving receiver performance in the presence of impulsive interference by employing such analog nonlinear filter before the ADC. In this illustration, =0.2.

2 Analog Blind Adaptive Intermittently Nonlinear Filters (ABAINFs) with the Desired Behavior

[0090] The analog nonlinear filters with the behavior outlined in 1.1 may be constructed using the approach shown in FIG. 3, which provides an illustrative block diagram of an Analog Blind Adaptive Intermittently Nonlinear Filter (ABAINF).

[0091] In FIG. 3, the influence function [43] .sub..sup.+(x) is represented as .sub..sup.+(x)=x.sub..sup.+(x), where .sub..sup.+(x) is a transparency function with the characteristic transparency range [.sub., .sub.+]. We may require that .sub..sup.++(x) is effectively (or approximately) unity for .sub.x.sub.+, and that .sub..sup.+ (|x|) decays to zero (e.g. monotonically) for x outside of the range [.sub., .sub.+].

[0092] As one should be able to see in FIG. 3, a (nonlinear) differential equation relating the input x(t) to the output x(t) of an ABAINF may be written as

[00003]$\begin{array}{cc}\frac{d}{\mathrm{dt}}.Math.=\frac{1}{}.Math.{}_{{}_{-}}^{{}_{+}}\left(x-\right)=\frac{x-}{}.Math.{}_{{}_{-}}^{{}_{+}}\left(x-\right),& \left(10\right)\end{array}$

where is the ABAINF's time parameter (or time constant).

[0093] One skilled in the art will recognize that, according to equation (10), when the difference signal x(t)(t) is within the transparency range [.sub., .sub.+], the ABAINF would behave as a 1st order linear lowpass filter with the 3 dB corner frequency 1/(2), and, for a sufficiently large transparency range, the ABAINF would exhibit nonlinear behavior only intermittently, when the difference signal extends outside the transparency range.

[0094] If the transparency range [.sub., .sub.+] is chosen in such a way that it excludes outliers of the difference signal x(t)(t), then, since the transparency function .sub..sup.+(x) decays to zero for x outside of the range [.sub., .sub.+], the contribution of such outliers to the output (t) would be depreciated.

[0095] It may be important to note that outliers would be depreciated differentially, that is, based on the difference signal x(t)(t) and not the input signal x(t).

[0096] The degree of depreciation of outliers based on their magnitude would depend on how rapidly the transparency function .sub..sup.+(x) decays to zero for x outside of the transparency range. For example, as follows from equation (10), once the transparency function decays to zero, the output (t) would maintain a constant value until the difference signal x(t)(t) returns to within non-zero values of the transparency function.

[0097] FIG. 4 provides several illustrative examples of the transparency functions and their respective influence functions.

[0098] One skilled in the art will recognize that a transparency function with multiple transparency ranges may also be constructed as a product of (e.g. cascaded) transparency functions, wherein each transparency function is characterized by its respective transparency range.

2.1 A Particular ABAINF Example

[0099] As an example, let us consider a particular ABAINF with the influence function of a type shown in FIG. 4(iii), for a symmetrical transparency range [.sub., .sub.+]=[, ]:

[00004]$\begin{array}{cc}{}_{}=x.Math..Math.{}_{}\left(x\right)=x\{\begin{array}{cc}1& \mathrm{for}.Math.\left|x\right|\\ \frac{}{\left|x\right|}& \mathrm{otherwise}\end{array},& \left(11\right)\end{array}$

where 0 is the resolution parameter (with units amplitude), 0 is the time parameter (with units time), and 0 is the rate parameter (with units amplitude per time).

[0100] For such an ABAINF, the relation between the input signal x(t) and the filtered output signal (t) may be expressed as

[00005]$\begin{array}{cc}\stackrel{.}{}=\frac{x-}{}\left[\left(-\left|x-\right|\right)+\frac{}{\left|x-\right|}.Math.\left(\left|x-\right|-\right)\right],& \left(12\right)\end{array}$

where (x) is the Heaviside unit step function [30].

[0101] Note that when |x| (e.g., in the limit .fwdarw.) equation (12) describes a 1st order analog linear lowpass filter (RC integrator) with the time constant (the 3 dB corner frequency 1/(2)). When the magnitude of the difference signal |x| exceeds the resolution parameter , however, the rate of change of the output is limited to the rate parameter , and no longer depends on the magnitude of the incoming signal x(t), providing an output insensitive to outliers with a characteristic amplitude determined by the resolution parameter . Note that for a sufficiently large this filter would exhibit nonlinear behavior only intermittently, in response to noise outliers, while otherwise acting as a 1st order linear lowpass filter.

[0102] Further note that for =/ equation (12) corresponds to the Canonical Differential Limiter (CDL) described in [9, 10, 24, 32], and in the limit .fwdarw.0 it corresponds to the Median Tracking Filter described in 3.1.

[0103] However, an important distinction of this ABAINF from the nonlinear filters disclosed in [9, 10, 24, 32] would be that the resolution and the rate parameters are independent from each other. This may provide significant benefits in performance, ease of implementation, cost reduction, and in other areas, including those clarified and illustrated further in this disclosure.

2.2 Clipped Mean Tracking Filter (CMTF)

[0104] The blanking influence function shown in FIG. 4(i) would be another particular example of the ABAINF outlined in FIG. 3, where the transparency function may be represented as a boxcar function,

.sub..sup.+(x)=(x.sub.)(x.sub.+).(13)

[0105] For this particular choice, the ABAINF may be represented by the following 1st order nonlinear differential equation:

[00006]$\begin{array}{cc}\frac{d}{\mathrm{dt}}.Math.=\frac{1}{}.Math.{}_{{}_{-}}^{{}_{+}}\left(x-\right),& \left(14\right)\end{array}$

where the blanking function .sub..sup.+(x) may be defined as

[00007]$\begin{array}{cc}{}_{{}_{-}}^{{}_{+}}\left(x\right)=\{\begin{array}{cc}x& \mathrm{for}.Math..Math.{}_{-}x{}_{+}\\ 0& \mathrm{otherwise}\end{array},& \left(15\right)\end{array}$

and where [.sub., .sub.+] may be called the blanking range.

[0106] We shall call an ABAINF with such influence function a 1st order Clipped Mean Tracking Filter (CMTF).

[0107] A block diagram of a CMTF is shown in FIG. 5 (a). In this figure, the blanker implements the blanking function .sub..sup.+(x).

[0108] In a similar fashion, we may call a circuit implementing an influence function .sub..sup.+(x) a depreciator with characteristic depreciation (or transparency, or influence) range [.sub., .sub.+].

[0109] Note that, forb>0,

[00008]$\begin{array}{cc}{b}^{-1}.Math.{}_{{}_{-}}^{{}_{+}}\left(\mathrm{bx}\right)={}_{\frac{{}_{-}}{b}}^{\frac{{}_{+}}{b}}\left(x\right),& \left(16\right)\end{array}$

and thus, if the blanker with the range [V.sub., V.sub.+] is preceded by a gain stage with the gain G and followed by a gain stage with the gain G.sup.1, its apparent (or equivalent) blanking range would be [V.sub., V.sub.+]/G, and would no longer be hardware limited. Thus control of transparency ranges of practical ABAINF implementations may be performed by automatic gain control (AGC) means. This may significantly simplify practical implementations of ABAINF circuits (e.g. by allowing constant hardware settings for the transparency ranges). This is illustrated in FIG. 5(b) for the CMTF circuit.

[0110] FIG. 6 illustrates resistance of a CMTF (with a symmetrical blanking range [, ]) to outlier noise, in comparison with a 1st order linear lowpass filter with the same time constant (panel (a)), and with the CDL with the resolution parameter and .sub.0= (panel (b)). The cross-hatched time intervals in the lower panel (panel (c)) correspond to nonlinear CMTF behavior (zero rate of change of the output). Note that the clipping (i.e. zero rate of change of the CMTF output) is performed differentially, based on the magnitude of the difference signal x(t)(t) and not that of the input signal x(t).

[0111] We may call the difference between a filter output when the input signal is affected by impulsive noise and an ideal output (in the absence of impulsive noise) an error signal. Then the smaller the error signal, the better the impulsive noise suppression. FIG. 7 illustrates differences in the error signal for the example of FIG. 6. The cross-hatched time intervals indicate nonlinear CMTF behavior (zero rate of change).

2.3 Illustrative CMTF Circuit

[0112] FIG. 8 provides a simplified illustration of implementing a CMTF by solving equation (14) in an electronic circuit.

[0113] FIG. 9 provides an illustration of resistance of the CMTF circuit of FIG. 8 to outlier noise. The cross-hatched time intervals in the lower panel correspond to nonlinear CMTF behavior.

[0114] While FIG. 8 illustrates implementation of a CMTF in an electronic circuit comprising discrete components, one skilled in the art will recognize that the intended electronic functionality may be implemented by discrete components mounted on a printed circuit board, or by a combination of integrated circuits, or by an application-specific integrated circuit (ASIC). Further, one skilled in the art will recognize that a variety of alternative circuit topologies may be developed and/or used to implement the intended electronic functionality.

2.4 Using CMTFs for Separating Impulsive (Outlier) and Non-Impulsive Signal Components with Overlapping Frequency Spectra: Analog Differential Clippers (ADiCs)

[0115] In some applications it may be desirable to separate impulsive (outlier) and non-impulsive signal components with overlapping frequency spectra in time domain.

[0116] Examples of such applications would include radiation detection applications, and/or dual function systems (e.g. using radar as signal of opportunity for wireless communications and/or vice versa).

[0117] Such separation may be achieved by using sums and/or differences of the input and the output of a CMTF and its various intermediate signals. This is illustrated in FIG. 10.

[0118] In this figure, the difference between the input to the CMTF integrator (signal (t) at point III) and the CMTF output may be designated as a prime output of an Analog Differential Clipper (ADiC) and may be considered to be a non-impulsive (background) component extracted from the input signal. Further, the signal across the blanker (i.e. the difference between the blanker input x(t)(t) and the blanker output (t)) may be designated as an auxiliary output of an ADiC and may be considered to be an impulsive (outlier) component extracted from the input signal.

[0119] FIG. 11 illustrates using a CMTF with an appropriately chosen blanking range for separating impulsive and non-impulsive (background) signal components. Note that the sum of the prime and the auxiliary ADiC outputs would be effectively identical to the input signal, and thus the separation of impulsive and non-impulsive components may be achieved without reducing signal's bandwidth.

[0120] FIG. 12 provides illustrative block diagrams of an ADiC with time parameter and blanking range [.sub., .sub.+].

[0121] FIG. 13 provides a simplified illustrative electronic circuit diagram of using a CMTF/ADiC with an appropriately chosen blanking range [a.sub., .sub.+] for separating incoming signal x(t) into impulsive i(t) and non-impulsive s(t) (background) signal components, and FIG. 14 provides an illustration of such separation by the circuit of FIG. 13.

2.5 Numerical Implementations of ABAINFs/CMTFs/ADiCs

[0122] Even though an ABAINF is an analog filter by definition, it may be easily implemented digitally, for example, in a Field Programmable Gate Array (FPGA) or software. A digital ABAINF would require very little memory and would be typically inexpensive computationally, which would make it suitable for real-time implementations.

[0123] An example of a numerical algorithm implementing a finite-difference version of a CMTF/ADiC may be given by the following MATLAB function:

TABLE-US-00001 function [chi,prime,aux] = CMTF_ADiC(x,t,tau,alpha_p,alpha_m) chi = zeros(size(x)); aux = zeros(size(x)); prime = zeros(size(x)); dt = diff(t); chi(1) = x(1); B = 0; for i = 2:length(x); dX = x(i) chi(i1); if dX>alpha_p(i1) B = 0; elseif dX<alpha_m(i1) B = 0; else B = dX; end chi(i) = chi(i1) + B/(tau+dt(i1))*dt(i1); % numerical antiderivative prime(i) = B + chi(i1); aux(i) = dX B; end return

[0124] In this example, x is the input signal, t is the time array, tau is the CMTF's time constant. alpha_p and alpha_m are the upper and the lower, respectively, blanking values, chi is the CMTF's output, aux is the extracted impulsive component (auxiliary ADiC output), and prime is the extracted non-impulsive (background) component (prime ADiC output).

[0125] Note that we retain, for convenience, the abbreviations ABAINF and/or ADiC for finite-difference (digital) ABAINF and/or ADiC implementations.

[0126] FIG. 15 provides an illustration of separation of a discrete input signal x into an impulsive component aux and a non-impulsive (background) component prime using the above MATLAB function with appropriately chosen blanking values alpha_p and alpha_m.

[0127] A digital signal processing apparatus performing an ABAINF filtering function transforming an input signal into an output filtered signal would comprise an influence function characterized by a transparency range and operable to receive an influence function input and to produce an influence function output, and an integrator function characterized by an integration time constant and operable to receive an integrator input and to produce an integrator output, wherein said integrator output is proportional to a numerical antiderivative of said integrator input.

[0128] A hardware implementation of a digital ABAINF/CMTF/ADiC filtering function may be achieved by various means including, but not limited to, general-purpose and specialized microprocessors (DSPs), microcontrollers, FPGAs, ASICs, and ASSPs. A digital or a mixed-signal processing unit performing such a filtering function may also perform a variety of other similar and/or different functions.

3 Quantile Tracking Filters as Robust Means to Establish the ABAINF Transparency Range(s)

[0129] Let y(t) be a quasi-stationary bandpass (zero-mean) signal with a finite interquartile range (IQR), characterised by an average crossing rate of the threshold equal to some quantile q, 0<q<1, of y(t). (See [33, 34] for discussion of quantiles of continuous signals, and [44, 45] for discussion of threshold crossing rates.) Let us further consider the signal Q.sub.q(t) related to y(t) by the following differential equation:

[00009]$\begin{array}{cc}\frac{d}{\mathrm{dt}}.Math.Q_q=\frac{A}{T}.Math.\left[\mathrm{sgn}\left(y-Q_q\right)+2.Math.q-1\right],& \left(17\right)\end{array}$

where A is a constant (with the same units as y and Q.sub.q), and T is a constant with the units of time. According to equation (17), Q.sub.q(t) is a piecewise-linear signal consisting of alternating segments with positive (2qA/T) and negative (2(q1)A/T) slopes. Note that Q.sub.q(t)const for a sufficiently small A/T (e.g., much smaller than the product of the IQR and the average crossing rate of y(t) and its qth quantile), and a steady-state solution of equation (17) can be written implicitly as

(Q.sub.qy)q,(18)

where (x) is the Heaviside unit step function [30] and the overline denotes averaging over some time interval T>>. Thus Q.sub.q would approximate the qth quantile of y(t) [33, 34] in the time interval T.

[0130] We may call an apparatus (e.g. an electronic circuit) effectively implementing equation (17) a Quantile Tracking Filler.

[0131] Despite its simplicity, a circuit implementing equation (17) may provide robust means to establish the ABAINF transparency range(s) as a linear combination of various quantiles of the difference signal (e.g. its 1st and 3rd quartiles and/or the median). We will call such a circuit for q= a Median Tracking Filter (MTF), and for q= and/or q= a Quartile Tracking Filter (QTF).

[0132] FIG. 16 provides an illustrative block diagram of a circuit implementing equation (17) and thus tracking a qth quantile of y(t). As one may see in the figure, the difference between the input y(t) and the quantile output Q.sub.q(t) forms the input to an analog comparator which implements the function A sgn(y(t)Q.sub.q(t)). In reference to FIG. 16, we may call the term (2q1) A added to the integrator input as the quantile setting signal. A sum of the comparator output and the quantile setting signal forms the input of an integrator characterized by the time constant T, and the output of the integrator forms the quantile output Q.sub.q(t).

3.1 Median Tracking Filter

[0133] Let x(t) be a quasi-stationary signal characterized by an average crossing rate of the threshold equal to the second quartile (median) of x(t). Let us further consider the signal Q.sub.2(t) related to x(t) by the following differential equation:

[00010]$\begin{array}{cc}\frac{d}{\mathrm{dt}}.Math.Q_2=\frac{A}{T}.Math.\mathrm{sgn}\left(x-Q_2\right),& \left(19\right)\end{array}$

where A is a constant with the same units as x and Q.sub.2, and T is a constant with the units of time. According to equation (19). Q.sub.2(t) is a piecewise-linear signal consisting of alternating segments with positive (A/T) and negative (A/T) slopes. Note that Q.sub.2(t)const for a sufficiently small A/T (e.g., much smaller than the product of the interquartile range and the average crossing rate of x(t) and its second quartile), and a steady-state solution of equation (19) may be written implicitly as

(Q.sub.2x),(20)

where the overline denotes averaging over some time interval T>><>.sup.1. Thus Q.sub.2 approximates the second quartile of x(t) in the time interval T, and equation (19) describes a Median Tracking Filter (MTF). FIG. 17 illustrates the MTF's convergence to the steady state for different initial conditions.

3.2 Quartile Tracking Filters

[0134] Let y(t) be a quasi-stationary bandpass (zero-mean) signal with a finite interquartile range (IQR), characterised by an average crossing rate <> of the threshold equal to the third quartile of y(t). Let us further consider the signal Q.sub.3(t) related to y(t) by the following differential equation:

[00011]$\begin{array}{cc}\frac{d}{\mathrm{dt}}.Math.Q_3=\frac{A}{T}\left[\mathrm{sgn}\left(y-Q_3\right)+\frac{1}{2}\right],& \left(21\right)\end{array}$

where A is a constant (with the same units as y and Q.sub.3), and T is a constant with the units of time. According to equation (21), Q.sub.3(t) is a piecewise-linear signal consisting of alternating segments with positive (3A/(2T)) and negative (A/(2T)) slopes. Note that Q.sub.3(t)const for a sufficiently small A/T (e.g., much smaller than the product of the IQR and the average crossing rate <> of y(t) and its third quartile), and a steady-state solution of equation (21) may be written implicitly as

(Q.sub.3y),(22)

where the overline denotes averaging over some time interval T><>.sup.1. Thus Q.sub.3 approximates the third quartile of y(t) [33, 34] in the time interval T.

[0135] Similarly, for

[00012]$\begin{array}{cc}\frac{d}{\mathrm{dt}}.Math.Q_1=\frac{A}{T}\left[\mathrm{sgn}\left(y-Q_1\right)-\frac{1}{2}\right]& \left(23\right)\end{array}$

a steady-state solution may be written as

(Q.sub.2y),(24)

and thus Q.sub.1 would approximate the first quartile of y(t) in the time interval T.

[0136] FIG. 18 illustrates the QTFs' convergence to the steady state for different initial conditions.

[0137] One skilled in the art will recognize that (1) similar tracking filters may be constructed for other quantiles (such as, for example, terciles, quintiles, sextiles, and so on), and (2) a robust range [.sub., .sub.+] that excludes outliers may be constructed in various ways, as, for example, a linear combination of various quantiles.

3.3 Numerical Implementations of ABAINFs/CMTFs/ADiCs Using Quantile Tracking Filters as Robust Means to Establish the Transparency Range

[0138] For example, an ABAINF/CMTF/ADiC with an adaptive (possibly asymmetric) transparency range [.sub., .sub.+] may be designed as follows. To ensure that the values of the difference signal x(t)(t) that lie outside of [.sub., .sub.+] are outliers, one may identify [.sub., .sub.+] with Tukey's range [46], a linear combination of the 1st (Q.sub.1) and the 3rd (Q.sub.3) quartiles of the difference signal:

[.sub.,.sub.+]=[Q.sub.1(Q.sub.3Q.sub.1),Q.sub.3+(Q.sub.3Q.sub.1)].(25)

where is a coefficient of order unity (e.g. =1.5).

[0139] An example of a numerical algorithm implementing a finite-difference version of a CMTF/ADiC with the blanking range computed as Tukey's range of the difference signal using digital QTFs may be given by the MATLAB function CMTF_ADiC_alpha below.

[0140] In this example, the CMTF/ADiC filtering function further comprises a means of tracking the range of the difference signal that effectively excludes outliers of the difference signal, and wherein said means comprises a QTF estimating a quartile of the difference signal:

TABLE-US-00002 function [chi,prime,aux,alpha_p,alpha_m] = CMTF_ADiC_alpha(x,t,tau,beta,mu) chi = zeros(size(x)); aux = zeros(size(x)); prime = zeros(size(x)); alpha_p = zeros(size(x)); alpha_m = zeros(size(x)); dt = diff(t); chi(1) = x(1); Q1 = x(1); Q3 = x(1); B = 0; for i = 2:length(x); dX = x(i) chi(i1); %-------------------------------------------------------------------- % Update 1st and 3rd quartile values: Q1 = Q1 + mu*(sign(dXQ1)0.5)*dt(i1); % numerical antiderivative Q3 = Q3 + mu*(sign(dXQ3)+0.5)*dt(i1); % numerical antiderivative %-------------------------------------------------------------------- % Calculate blanking range: alpha_p(i) = Q3 + beta*(Q3Q1); alpha_m(i) = Q1 beta*(Q3Q1); %-------------------------------------------------------------------- if dX>alpha_p(i) B = 0; elseif dX<alpha_m(i) B = 0; else B = dX; end chi(i) = chi(i1) + B/(tau+dt(i1))*dt(i1); % numerical antiderivative prime(i) = B + chi(i1); aux(i) = dX B; end return

[0141] FIG. 19 provides an illustration of separation of discrete input signal x into impulsive component aux and non-impulsive (background) component prime using the above MATLAB function of 3.3 with the blanking range computed as Tukey's range using digital QTFs. The upper and lower limits of the blanking range are shown by the dashed lines in panel (b).

3.4 Adaptive Influence Function Design

[0142] The influence function choice determines the structure of the local nonlinearity imposed on the input signal. If the distribution of the non-Gaussian technogenic noise is known, then one may invoke the classic locally most powerful (LMP) test [47] to detect and mitigate the noise. The LMP test involves the use of local nonlinearity whose optimal choice corresponds to

[00013]$g_{l_o}\left(n\right)=-\frac{f^{}\left(n\right)}{f\left(n\right)},$

where (n) represents the technogenic noise density function and (n) is its derivative. While the LMP test and the local nonlinearity is typically applied in the discrete time domain, the present invention enables the use of this idea to guide the design of influence functions in the analog domain. Additionally, non-stationarity in the noise distribution may motivate an online adaptive strategy to design influence functions.

[0143] Such adaptive online influence function design strategy may explore the methodology disclosed herein. In order to estimate the influence function, one may need to estimate both the density and its derivative of the noise. Since the difference signal x(t)(t) of an ABAINF would effectively represent the non-Gaussian noise affecting the signal of interest, one may use a bank of N quantile tracking filters described in 3 to determine the sample quantiles (Q.sub.1, Q.sub.2, . . . , Q.sub.N) of the difference signal. Then one may use a non-parametric regression technique such as, for example, a local polynomial kernel regression strategy to simultaneously estimate (1) the time-dependent amplitude distribution function (D, t) of the difference signal, (2) its density function (D, t), and (3) the derivative of the density function (D, t)/D.

4 Adaptive Intermittently Nonlinear Analog Filters for Mitigation of Outlier Noise in the Process of Analog-to-Digital Conversion

[0144] Let us now illustrate analog-domain mitigation of outlier noise in the process of analog-to-digital (A/D) conversion that may be performed by deploying an ABAINF (for example, a CMTF) ahead of an ADC.

[0145] An illustrative principal block diagram of an adaptive CMTF for mitigation of outlier noise disclosed herein is shown in FIG. 20. Without loss of generality, here it may be assumed that the output ranges of the active components (e.g. the active filters, integrators, and comparators), as well as the input range of the analog-to-digital converter (A/D), are limited to a certain finite range, e.g., to the power supply range V.sub.c.

[0146] The time constant may be such that 1/(2) is similar to the corner frequency of the anti-aliasing filter (e.g., approximately twice the bandwidth of the signal of interest B.sub.x), and the time constant T should be two to three orders of magnitude larger than B.sub.x.sup.1. The purpose of the front-end lowpass filter would be to sufficiently limit the input noise power. However, its bandwidth may remain sufficiently wide (i.e. >>1) so that the impulsive noise is not excessively broadened.

[0147] Without loss of generality, we may further assume that the gain K is constant (and is largely determined by the value of the parameter , e.g., as K{square root over ()}), and the gains G and g are adjusted (e.g. using automatic gain control) in order to well utilize the available output ranges of the active components, and the input range of the A/D. For example, G and g may be chosen to ensure that the average absolute value of the output signal (i.e., observed at point IV) is approximately V.sub.c/5, and the average value of Q*.sub.2(t) is approximately constant and is smaller than V.sub.c.

4.1 CMTF Block

[0148] For the Clipped Mean Tracking Filter (CMTF) block shown in FIG. 20, the input x(t) and the output (t) signals may be related by the following 1st order nonlinear differential equation:

[00014]$\begin{array}{cc}\frac{d}{\mathrm{dt}}.Math.=\frac{1}{}.Math.{}_{\frac{V_c}{g}}\left(x-\right),& \left(26\right)\end{array}$

where the symmetrical blanking function .sub.(x) may be defined as

[00015]$\begin{array}{cc}{}_{}\left(x\right)=\{\begin{array}{cc}x& \mathrm{for}.Math.\left|x\right|\\ 0& \mathrm{otherwise}.Math.\end{array},& \left(27\right)\end{array}$

and where the parameter is the blanking value.

[0149] Note that for the blanking values such that |x(t)(t)|V.sub.c/g for all t, equation (26) describes a 1st order linear lowpass filter with the corner frequency 1/(2), and the filter shown in FIG. 20 operates in a linear regime (see FIG. 21). However, when the values of the difference signal x(t)(t) are outside of the interval [V.sub.c/g, V.sub.c/g], the rate of change of (t) is zero and no longer depends on the magnitude of x(t)(t). Thus, if the values of the difference signal that lie outside of the interval [V.sub.c/g, V.sub.c/g] are outliers, the output, (t) would be insensitive to further increase in the amplitude of such outliers. FIG. 6 illustrates resistance of a CMTF to outlier noise, in comparison with a 1st order linear lowpass filter with the same time constant. The shaded time intervals correspond to nonlinear CMTF behavior (zero rate of change). Note that the clipping (i.e. zero rate of change of the CMTF output) is performed differentially, based on the magnitude of the difference signal |x| and not that of the input signal x.

[0150] In the filter shown in FIG. 20 the range [V.sub.c/g, V.sub.c/g] that excludes outliers is obtained as Tukey's range [46] for a symmetrical distribution, with V.sub.c/g given by

[00016]$\begin{array}{cc}\frac{{\mathrm{VB}}_c}{g}=\left(1+2.Math.\right).Math.Q_2^{*},& \left(28\right)\end{array}$

where Q*.sub.2 is the 2nd quartile (median) of the absolute value of the difference signal |x(t)(t)|, and where is a coefficient of order unity (e.g. =3). While in this example we use Tukey's range, various alternative approaches to establishing a robust interval [V.sub.c/g, V.sub.c/g] may be employed.

[0151] In FIG. 20, the MTF circuit receiving the absolute value of the blanker input and producing the MTF output, together with a means to maintain said MTF output at approximately constant value (e.g. using automatic gain control) and the gain stages preceding and following the blanker, establish a blanking range that effectively excludes outliers of the blanker input.

[0152] It would be important to note that, as illustrated in panel I of FIG. 21, in the linear regime the CMTF would operate as a 1st order linear lowpass filter with the corner frequency 1/(2). It would exhibit nonlinear behavior only intermittently, in response to outliers in the difference signal, thus avoiding the detrimental effects, such as instabilities and intermodulation distortions, often associated with nonlinear filtering.

4.2 Baseband Filter

[0153] In the absence of the CMTF in the signal processing chain, the baseband filter following the A/D would have the impulse response w[k] that may be viewed as a digitally sampled continuous-time impulse response w(t) (see panel II of FIG. 21). As one may see in FIG. 20, the impulse response of this filter may be modified by adding the term {dot over (w)}[k], where the dot over the variable denotes its time derivative, and where {dot over (w)}[k] may be viewed as a digitally sampled continuous-time function {dot over (w)}(t). This added term would compensate for the insertion of a 1st order linear lowpass filter in the signal chain, as illustrated in FIG. 21.

[0154] Indeed, from the differential equation for a 1st order lowpass filter it would follow that h.sub.*(w+{dot over (w)})=w, where the asterisk denotes convolution and where h.sub.(t) is the impulse response of the 1st order linear lowpass filter with the corner frequency 1/(2). Thus, provided that is sufficiently small (e.g., T1/(2B.sub.aa), where B.sub.aa is the nominal bandwidth of the anti-aliasing filter), the signal chains shown in panels I and II of FIG. 21 would be effectively equivalent. The impulse and frequency responses of w[k] (a root-raised-cosine filter with the roll-off factor , bandwidth 5B.sub.x/4, and the sampling rate 8B.sub.x) and w[k]+{dot over (w)}[k](with =1/(4B.sub.x)) used in the subsequent examples of this section are shown in FIG. 22.

4.3 Comparative Performance Examples

4.3.1 Simulation Parameters

[0155] To emulate the analog signals in the simulated examples presented below, the digitisation rate was chosen to be significantly higher (by about two orders of magnitude) than the A/D sampling rate.

[0156] The signal of interest is a Gaussian baseband signal in the nominal frequency rage [0, B.sub.x]. It is generated as a broadband white Gaussian noise filtered with a root-raised-cosine filter with the roll-off factor and the bandwidth 5B.sub.x/4.

[0157] The noise affecting the signal of interest is a sum of an Additive White Gaussian Noise (AWGN) background component and white impulsive noise i(t). In order to demonstrate the applicability of the proposed approach to establishing a robust interval [V.sub.c/g, V.sub.c/g] for asymmetrical distributions, the impulsive noise is modelled as asymmetrical (unipolar) Poisson shot noise:

[00017]$\begin{array}{cc}i\left(t\right)=\left|v\left(t\right)\right|\underset{k=1}{\overset{}{.Math.}}.Math..Math.\left(t-t_k\right),& \left(29\right)\end{array}$

where v(t) is AWGN noise, t.sub.k is the k-th arrival time of a Poisson point process with the rate parameter , and (x) is the Dirac -function [31]. In the examples below, =2B.sub.x.

[0158] The A/D sampling rate is 8B.sub.x (that assumes a factor of 4 oversampling of the signal of interest), the A/D resolution is 12 bits, and the anti-aliasing filter is a 2nd order Butterworth lowpass filter with the corner frequency 2B.sub.x. Further, the range of the comparators in the QTFs is A=V.sub.c, the time constants of the integrators are 7=1/(4B.sub.x) and T=100/B.sub.x. The impulse responses of the baseband filters w[k] and w[k]+{dot over (w)}[k] are shown in the upper panel of FIG. 22.

[0159] The front-end lowpass filter is a 2nd order Bessel with the cutoff frequency /(2). The value of the parameter is chosen as =16, and the gain of the anti-aliasing filter is K={square root over ()}=4. The gains G and g are chosen to ensure that the average absolute value of the output signal (i.e., observed at point IV in FIG. 20 and at point (c) in FIG. 21) is approximately V.sub.c/5, and

[00018]$Q_2^{*}\left(t\right)\frac{V_c}{1+2.Math.}=\mathrm{const}.$

4.3.2 Comparative Channel Capacities

[0160] For the simulation parameters described above, FIG. 23 compares the simulated channel capacities (calculated from the baseband SNRs using the Shannon formula [42]) for various signal+noise compositions, for the linear signal processing chain shown in panel II of FIG. 21 (solid curves) and the CMTF-based chain of FIG. 20 with 3=3 (dotted curves).

[0161] As one may see in FIG. 23 (and compare with the simplified diagram of FIG. 2), for a sufficiently large both linear and the CMTF-based chains provide effectively equivalent performance when the AWGN dominates over the impulsive noise. However, the CMTF-based chains are insensitive to further increase in the impulsive noise when the latter becomes comparable or dominates over the thermal (Gaussian) noise, thus providing resistance to impulsive interference.

[0162] Further, the dashed curves in FIG. 23 show the simulated channel capacities for the CMTF-based chain of FIG. 20 (with =3) when additional interference in an adjacent channel is added, as would be a reasonably common practical scenario. The passband of this interference is approximately [3B.sub.x, 4B.sub.x], and the total power is approximately 4 times (6 dB) larger that that of the signal of interest. As one may see in FIG. 23, such interference increases the apparent blanking value needed to maintain effectively linear CMTF behaviour in the absence of the outliers, reducing the effectiveness of the impulsive noise suppression (more noticeably for higher AWGN SNRs).

[0163] It may be instructive to illustrate and compare the changes in the signal's time and frequency domain properties, and in its amplitude distributions, while it propagates through the signal processing chains, linear (points (a), (b), and (c) in panel II of FIG. 21), and the CMTF-based (points I through IV, and point V, in FIG. 20). Such an illustration is provided in FIG. 24. In the figure, the dashed lines (and the respective cross-hatched areas) correspond to the ideal signal of interest (without noise and adjacent channel interference), and the solid lines correspond to the signal+noise+interference mixtures. The leftmost panels show the time domain traces, the rightmost panels show the power spectral densities (PSDs), and the middle panels show the amplitude densities. The baseband power of the AWGN is one tenth of that of the signal of interest (10 dB AWGN SNR), and the baseband power of the impulsive noise is approximately 8 times (9 dB) that of the AWGN. The value of the parameter for Tukey's range is =3. (These noise and adjacent channel interference conditions, and the value =3, correspond to the respective channel capacities marked by the asterisks in FIG. 23).

[0164] Measure of Peakedness

[0165] In the panels showing the amplitude densities, the peakedness of the signal+noise mixtures is measured and indicated in units of decibels relative to Gaussian (dBG). This measure is based on the classical definition of kurtosis [48], and for a real-valued signal may be expressed in terms of its kurtosis in relation to the kurtosis of the Gaussian (aka normal) distribution as follows [9, 10]:

[00019]$\begin{array}{cc}{K}_{\mathrm{dBG}}\left(x\right)=10.Math.\lg \left[\frac{{\left(x-x\right)}^4}{3.Math.{{\left(x-x\right)}^2}^2}\right],& \left(30\right)\end{array}$

where the angular brackets denote the time averaging. According to this definition, a Gaussian distribution would have zero dBG peakedness, while sub-Gaussian and super-Gaussian distributions would have negative and positive dBG peakedness, respectively. In terms of the amplitude distribution of a signal, a higher peakedness compared to a Gaussian distribution (super-Gaussian) normally translates into heavier tails than those of a Gaussian distribution. In the time domain, high peakedness implies more frequent occurrence of outliers, that is, an impulsive signal.

[0166] Incoming Signal

[0167] As one may see in the upper row of panels in FIG. 24, the incoming impulsive noise dominates over the AWGN. The peakedness of the signal+noise mixture is high (14.9 dBG), and its amplitude distribution has a heavy tail at positive amplitudes.

[0168] Linear Chain

[0169] The anti-aliasing filter in the linear chain (row (b)) suppresses the high-frequency content of the noise, reducing the peakedness to 2.3 dBG. The matching filter in the baseband (row (c)) further limits the noise frequencies to within the baseband, reducing the peakedness to 0 dBG. Thus the observed baseband noise may be considered to be effectively Gaussian, and we may use the Shannon formula [42] based on the achieved baseband SNR (0.9 dB) to calculate the channel capacity. This is marked by the asterisk on the respective solid curve in FIG. 23. (Note that the achieved 0.9 dB baseband SNR is slightly larger than the ideal 0.5 dB SNR that would have been observed without clipping the outliers of the output of the anti-aliasing filter by the A/D at +1.)

[0170] CMTF-Based Chain

[0171] As one may see in the panels of row V, the difference signal largely reflects the temporal and the amplitude structures of the noise and the adjacent channel signal. Thus its output may be used to obtain the range for identifying the noise outliers (i.e. the blanking value V.sub.c/g). Note that a slight increase in the peakedness (from 14.9 dBG to 15.4 dBG) is mainly due to decreasing the contribution of the Gaussian signal of interest, as follows from the linearity property of kurtosis.

[0172] As may be seen in the panels of row II, since the CMTF disproportionately affects signals with different temporal and/or amplitude structures, it reduces the spectral density of the impulsive interference in the signal passband without significantly affecting the signal of interest. The impulsive noise is notably decreased, while the amplitude distribution of the filtered signal+noise mixture becomes effectively Gaussian.

[0173] The anti-aliasing (row III) and the baseband (row IV) filters further reduce the remaining noise to within the baseband, while the modified baseband filter also compensates for the insertion of the CMTF in the signal chain. This results in the 9.3 dB baseband SNR, leading to the channel capacity marked by the asterisk on the respective dashed-line curve in FIG. 23.

4.4 Alternative Topology for Signal Processing Chain Shown in FIG. 20

[0174] FIG. 25 provides an illustration of an alternative topology for signal processing chain shown in FIG. 20, where the blanking range is determined according to equation (36).

[0175] One skilled in the art will recognize that the topology shown in FIG. 20 and the topology shown in FIG. 25 both comprise a CMTF filter (transforming an input signal x(t) into an output signal (t)) characterized by a blanking range, and a robust means to establish said blanking range in such a way that it excludes the outliers in the difference signal x(t)(t).

[0176] In FIG. 25, two QTFs receive a signal proportional to the blanker input and produce two QTF outputs, corresponding to the 1st and the 3rd quartiles of the QTF input. Then the blanking range of the blanker is established as a linear combination of these two outputs.

5 ADC with CMTF-Based Loop Filter

[0177] While 4 discloses mitigation of outlier noise in the process of analog-to-digital conversion by ADiCs/CMTFs deployed ahead of an ADC, CMTF-based outlier noise filtering of the analog input signal may also be incorporated into loop filters of analog-to-digital converters.

[0178] Let us consider the modifications to a 2nd-order ADC depicted in FIG. 26. (Note that the vertical scales of the shown fragments of the signal traces vary for different, fragments.) We may assume from here on that the 1st order lowpass filters with the time constant and the impulse response h.sub.(t) shown in the figure have a bandwidth (as signified by the 3 dB corner frequency) that is much larger than the bandwidth of the signal of interest B.sub.x, yet much smaller than the sampling (clock) frequency F.sub.s. For example, the bandwidth of h.sub.(t) may be approximately equal to the geometric mean of B.sub.x and F.sub.s, resulting in the following value for :

[00020]$\begin{array}{cc}\frac{1}{2.Math..Math.\sqrt{B_x.Math.F_s}}.& \left(31\right)\end{array}$

[0179] As one may see in FIG. 26, the first integrator (with the time constant ) is preceded by a (symmetrical) blanker, where the (symmetrical) blanking function B.sub.(x) may be defined as

[00021]$\begin{array}{cc}{}_{}\left(x\right)=\{\begin{array}{cc}x& \mathrm{for}.Math.\left|x\right|\\ 0& \mathrm{otherwise}\end{array},& \left(32\right)\end{array}$

and where is the blanking value.

[0180] As shown in the figure, the input x(t) and the output y(t) may be related by

[00022]$\begin{array}{cc}\frac{d}{\mathrm{dt}}.Math.\stackrel{\_}{h_{}*y}=\frac{1}{}.Math.\stackrel{\_}{{}_{}\left(h_{}*\left(x-y\right)\right)},& \left(33\right)\end{array}$

where the overlines denote averaging over a time interval between any pair of threshold (including zero) crossings of D (such as, e.g., the interval T shown in FIG. 26), and the filter represented by equation (33) may be referred to as a Clipped Mean Tracking Filler (CMTF). Note that without the time averaging equation (33) corresponds to the ABAINF described by equation (12) with =0, where x and replaced by h.sub.*x and h.sub.*y, respectively.

[0181] The utility of the 1st order lowpass filters h.sub.(t) would be, first, to modify the amplitude density of the difference signal xy so that for a slowly varying signal of interest x(t) the mean and the median values of h.sub.*(xy) in the time interval T would become effectively equivalent, as illustrated in FIG. 27. However, the median value of h.sub.*(xy) would be more robust when the narrow-band signal of interest is affected by short-duration outliers such as broadband impulsive noise, since such outliers would not be excessively broadened by the wide-band filter h.sub.(t). In addition, while being wide-band, this filter would prevent the amplitude of the background noise observed at the input of the blanker from being excessively large.

[0182] With given by equation (31), the parameter may be chosen as

[00023]$\begin{array}{cc}\frac{1}{4.Math..Math..Math.B_x.Math.}\frac{1}{2}.Math.\sqrt{\frac{F_s}{B_x}},& \left(34\right)\end{array}$

and the relation between the input and the output of the ADCs with a CMTF-based loop filter may be expressed as

x(tt)((w+{dot over (w)})*y)(t).(35)

[0183] Note that for large blanking values such that |h.sub.*(xy) for all t, according to equation (33) the average rate of change of h.sub.*y would be proportional to the average of the difference signal h.sub.*(xy). When the magnitude of the difference signal h.sub.*(xy) exceeds the blanking value , however, the average rate of change of h.sub.*y would be zero and would no longer depend on the magnitude of h.sub.*x, providing an output that would be insensitive to outliers with a characteristic amplitude determined by the blanking value .

[0184] Since linear filters are generally better than median for removing broadband Gaussian (e.g. thermal) noise, the blanking value in the CMTF-based topology should be chosen to ensure that the CMTF-based ADC performs effectively linearly when outliers are not present, and that it exhibits nonlinear behavior only intermittently, in response to outlier noise. An example of a robust approach to establishing such a blanking value is outlined in 5.2.

[0185] One skilled in the art will recognize that the modulator depicted in FIG. 26 comprises a quantizer (flip-flop), a blanker, two integrators, and two wide-bandwidth 1st order lowpass filters, and the (nonlinear) loop filter of this modulator is configured in such a way that the value of the quantized representation (signal y(t)) of the input signal x(t), averaged over a time interval T comparable with an inverse of the nominal bandwidth of the signal of interest, is effectively proportional to a nonlinear measure of central tendency of said input signal x(t) in said time interval T.

5.1 Simplified Performance Example

[0186] Let us first use a simplified synthetic signal to illustrate the essential features, and the advantages provided by the ADC with the CMTF-based loop filter configuration when the impulsive noise affecting the signal of interest dominates over a low-level background Gaussian noise.

[0187] In this example, the signal of interest consists of two fragments of two sinusoidal tones with 0.9V amplitudes, and with frequencies B.sub.x and B.sub.x/8, respectively, separated by zero-value segments. While pure sine waves are chosen for an ease of visual assessment of the effects of the noise, one may envision that the low-frequency tone corresponds to a vowel in a speech signal, and that the high-frequency tone corresponds to a fricative consonant.

[0188] For all ADCs in this illustration, the flip-flop clock frequency is F.sub.s=NB.sub.x, where N=1024. For the 2nd-order loop filter in this illustration =(4B.sub.x).sup.1. The time constant of the 1st order lowpass filters in the CMTF-based loop filter is =(2B.sub.x{square root over (N)}).sup.1=(64B.sub.x).sup.1, and =16 (resulting in =(4B.sub.x).sup.1). The parameter is chosen as =V.sub.c. The output y[k] of the ADC with the 1st-order linear loop filter (panel I of FIG. 1) is filtered with a digital lowpass filter with the impulse response w[k]. The outputs of the ADCs with the 2nd-order linear (panel II of FIG. 1) and the CMTF-based (FIG. 5) loop filters are filtered with a digital lowpass filter with the impulse response w[k]+(4B.sub.x).sup.1{dot over (w)}[k]. The impulse and frequency responses of w[k] and w[k]+(4B.sub.x).sup.1{dot over (w)}[k] are shown in FIG. 28.

[0189] As shown in panel I of FIG. 29, the signal is affected by a mixture of additive white Gaussian noise (AWGN) and white impulse (outlier) noise components, both band-limited to approximately B.sub.x{square root over (N)} bandwidth. As shown in panel II, in the absence of the outlier noise, the performance of all ADC in this example is effectively equivalent, and the amount of the AWGN is such that the resulting signal-to-noise ratio for the filtered output is approximately 20 dB in the absence of the outlier noise. The amount of the outlier noise is such that the resulting signal-to-noise ratio for the filtered output of the ADC with a 1st-order linear loop filter is approximately 6 dB in the absence of the AWGN.

[0190] As one may see in panels III and IV of FIG. 29, the linear loop filters are ineffective in suppressing the impulsive noise. Further, the performance of the ADC with the 2nd-order linear loop filter (see panel IV of FIG. 29) is more severely degraded by high-power noise, especially by high-amplitude outlier noise such that the condition |x(tt)+(w*v)(t)|<V.sub.c is not satisfied for all t. On the other hand, as may be seen in panel V of FIG. 29, the ADC with the CMTF-based loop filter improves the signal-to-noise ratio by about 13 dB in comparison with the ADC with the 1st-order linear loop filter, thus removing about 95% of the impulsive noise.

[0191] More importantly, as may be seen in panel III of FIG. 30, increasing the impulsive noise power by an order of magnitude hardly affects the output of the ADC with the CMTF-based loop filter (and thus about 99.5% of the impulsive noise is removed), while further exceedingly degrading the output of the ADC with the 1st-order linear loop filter (panel II).

5.2 ADC with Adaptive CMTF

[0192] A CMTF with an adaptive (possibly asymmetric) blanking range [a.sub., ac] may be designed as follows. To ensure that the values of the difference signal h.sub.T*(xy) that lie outside of [.sub., .sub.+] are outliers, one may identify [a.sub., .sub.+] with Tukey's range [46], a linear combination of the 1st (Q.sub.1) and the 3rd (Q.sub.3) quartiles of the difference signal (see [33, 34] for discussion of quantiles of continuous signals):

[.sub.,.sub.+]=[Q.sub.1(Q.sub.3Q.sub.1),Q.sub.3+(Q.sub.3Q.sub.1)],(36)

where is a coefficient of order unity (e.g. =1.5). From equation (36), for a symmetrical distribution the range that excludes outliers may also be obtained as [.sub., .sub.+]=[, ], where is given by

=(1+2)Q*.sub.2,(37)

and where Q*.sub.2 is the 2nd quartile (median) of the absolute value (or modulus) of the difference signal |h.sub.*(xy)|.

[0193] Alternatively, since 2Q*.sub.2=Q.sub.3Q.sub.1 for a symmetrical distribution, the resolution parameter may be obtained as

=(+)(Q.sub.3Q.sub.1),(38)

where Q.sub.3Q.sub.1 is the interquartile range (IQR) of the difference signal.

[0194] FIG. 31 provides an outline of a ADC with an adaptive CMTF-based loop filter. In this example, the 1st order lowpass filters are followed by the gain stages with the gain G, while the blanking value is set to V.sub.c. Note that

[00024]$\begin{array}{cc}{}_{V_c}\left(\mathrm{Gx}\right)=G.Math..Math.{}_{\frac{V_c}{G}}\left(x\right),& \left(39\right)\end{array}$

and thus the apparent (or equivalent) blanking value would be no longer hardware limited. As shown in FIG. 31, the input x(t) and the output y(t) may be related by

[00025]$\begin{array}{cc}\frac{d}{\mathrm{dt}}.Math.\stackrel{\_}{h_{}*y}=\frac{1}{}.Math.\stackrel{\_}{{}_{\frac{V_c}{G}}\left(h_{}*\left(x-y\right)\right)}.& \left(40\right)\end{array}$

[0195] If an automatic gain control circuit maintains a constant output V.sub.c/(1+2) of the MTF circuit in FIG. 31, then the apparent blanking value =V.sub.c/G in equation (40) may be given by equation (37).

5.2.1 Performance Example

[0196] Simulation Parameters

[0197] To emulate the analog signals in the examples below, the digitization rate is two orders of magnitude higher than the sampling rate F.sub.s. The signal of interest is a Gaussian baseband signal in the nominal frequency rage [0, B.sub.x]. It is generated as a broadband white Gaussian noise filtered with a root-raised-cosine filter with the roll-off factor and the bandwidth 5B.sub.x/4. The noise affecting the signal of interest is a sum of an AWGN background component and white impulsive noise i(t). The impulsive noise is modeled as symmetrical (bipolar) Poisson shot noise:

[00026]$\begin{array}{cc}i\left(t\right)=v\left(t\right).Math.\underset{k=1}{\overset{}{.Math.}}.Math..Math.\left(t-t_k\right),& \left(41\right)\end{array}$

where v(t) is AWGN noise, t.sub.k is the k-th arrival time of a Poisson process with the rate parameter , and (x) is the Dirac -function [31]. In the examples below, =B.sub.x. The gain C is chosen to maintain the output of the MTF in FIG. 31 at V.sub.c/(1+2), and the digital lowpass filter w[k] is the root-raised-cosine filter with the roll-off factor and the bandwidth 5B.sub.x/4. The remaining hardware parameters are the same as those in 5.1. Further, the magnitude of the input x(t) is chosen to ensure that the average absolute value of the output signal is approximately V.sub.c/5.

[0198] Comparative Channel Capacities

[0199] For the simulation parameters described above, FIG. 32 compares the simulated channel capacities (calculated from the baseband SNRs using the Shannon formula [42]) for various signal+noise compositions, for the linear signal processing chain (solid lines) and the CMTF-based chain of FIG. 31 with =1.5 (dotted lines).

[0200] As one may see in FIG. 32 (and compare with the simplified diagram of FIG. 2), linear and the CMTF-based chains provide effectively equivalent performance when the AWGN dominates over the impulsive noise. However, the CMTF-based chains are insensitive to further increase in the impulsive noise when the latter becomes comparable or dominates over the thermal (Gaussian) noise, thus providing resistance to impulsive interference.

[0201] Disproportionate Effect on Baseband PSDs

[0202] For a mixture of white Gaussian and white impulsive noise, FIG. 33A illustrates reduction of the spectral density of impulsive noise in the signal baseband without affecting that of the signal of interest. In the figure, the solid lines correspond to the ideal signal of interest (without noise), and the dotted lines correspond to the signal+noise mixtures. The baseband power of the AWGN is one tenth of that of the signal of interest (10 dB AWGN SNR), and the baseband power of the impulsive noise is approximately 8 times (9 dB) that of the AWGN. The value of the parameter for Tukey's range is =1.5. As may be seen in the figure, for the CMTF-based chain the baseband SNR increases from 0.5 dB to 9.7 dB.

[0203] For both the linear and the CMTF-based chains the observed baseband noise may be considered to be effectively Gaussian, and we may use the Shannon formula [42] based on the achieved baseband SNRs to calculate the channel capacities. Those are marked by the asterisks on the respective solid and dotted curves in FIG. 32.

[0204] FIG. 33B provides a similar illustration with additional interference in an adjacent channel. Such interference increases the apparent blanking value needed to maintain effectively linear CMTF behavior in the absence of the outliers, slightly reducing the effectiveness of the impulsive noise suppression. As a result, the baseband SNR increases from 0.5 dB to only 8.5 dB.

6 ADCs with Linear Loop Filters and Digital ADiC/CMTF Filtering

[0205] While 5 describes CMTF-based outlier noise filtering of the analog input signal incorporated into loop filters of analog-to-digital converters, the high raw sampling rate (e.g. the flip-flop clock frequency) of a ADC (e.g. two to three orders of magnitude larger than the bandwidth of the signal of interest) may be used for effective ABAINF/CMTF/ADiC-based outlier filtering in the digital domain, following a modulator with a linear loop filter.

[0206] FIG. 34 shows illustrative signal chains for a ADC with linear loop and decimation filters (panel (a)), and for a ADC with linear loop filter and ADiC-based digital filtering (panel (b)). As may be seen in panel (a) of FIG. 34, the quantizer output of a ADC with linear loop filter would be filtered with a linear decimation filter that would typically combine lowpass filtering with downsampling. To enable an ADiC-based outlier filtering (panel (b)), a wideband (e.g. with bandwidth approximately equal to the geometric mean of the nominal signal bandwidth B.sub.x and the sampling frequency F.sub.s) digital filter is first applied to the output of the quantizer. The output of this filter is then filtered by a digital ADiC (with appropriately chosen time parameter and the blanking range), followed by a linear lowpass/decimation filter.

[0207] FIG. 35 shows illustrative time-domain traces at points I through VI of FIG. 34, and the output of the ADC with linear loop and decimation filters for the signal affected by AWGN only (w/o impulsive noise). In this example, a 1st order modulator is used, and the quantizer produces a 1-bit output shown in panel II. The digital wideband filter is a 2nd order IIR Bessel filter with the corner frequency approximately equal to the geometric mean of the nominal signal bandwidth B.sub.x and the sampling frequency F.sub.s. The time parameter of the ADiC is approximately (4B.sub.x).sup.1, and the same lowpass/decimation filter is used as for the linear chain of FIG. 34 (a).

[0208] FIG. 36 shows illustrative signal chains for a ADC with linear loop and decimation filters (panel (a)), and for a ADC with linear loop filter and CMTF-based digital filtering (panel (b)). To enable a CMTF-based outlier filtering (panel (b)), a wideband digital filter is first applied to the output of the quantizer. The output of this filter is then filtered by a digital CMTF (with the time constant and appropriately chosen blanking range), followed by a linear lowpass filtering (with the modified impulse response w[k]+{dot over (w)}[k]) combined with decimation.

[0209] FIG. 37 shows illustrative time-domain traces at points I through VI of FIG. 36, and the output of the ADC with linear loop and decimation filters for the signal affected by AWGN only (w/o impulsive noise). In this example, a 1st order modulator is used, and the quantizer produces a 1-bit output shown in panel II. The digital wideband filter is a 2nd order IIR Bessel filter with the corner frequency approximately equal to the geometric mean of the nominal signal bandwidth B and the sampling frequency F.sub.s. The time parameter of the CMTF is =(4B.sub.x).sup.1, and the impulse response of the lowpass filter in the decimation stage is modified as w[k]+(4B.sub.x).sup.1 {dot over (w)}[k].

[0210] To prevent excessive distortions of the quantizer output by high-amplitude transients (especially for high-order modulators), and thus to increase the dynamic range of the ADC and/or the effectiveness of outlier filtering, an analog clipper (with appropriately chosen clipping values) should precede the modulator, as schematically shown in FIGS. 38 and 40.

[0211] FIG. 38 shows illustrative signal chains for a ADC with linear loop and decimation filters (panel (a)), and for a ADC with linear loop filter and ADiC-based digital filtering (panel (b)), with additional clipping of the analog input signal.

[0212] FIG. 39 shows illustrative time-domain traces at points I through VI of FIG. 38, and the output of the ADC with linear loop and decimation filters for the signal affected by AWGN only (w/o impulsive noise). In this example, a 1st order modulator is used, and the quantizer produces a 1-bit output. The digital wideband filter is a 2nd order IIR Bessel filter with the corner frequency approximately equal to the geometric mean of the nominal signal bandwidth B.sub.x and the sampling frequency F.sub.s. The time parameter of the ADiC is approximately (4B.sub.x).sup.1, and the same lowpass/decimation filter is used as for the linear chain of FIG. 38 (a).

[0213] FIG. 40 shows illustrative signal chains for a ADC with linear loop and decimation filters (panel (a)), and for a ADC with linear loop filter and CMTF-based digital filtering (panel (b)), with additional clipping of the analog input signal.

[0214] FIG. 41 shows illustrative time-domain traces at points I through VI of FIG. 40, and the output of the ADC with linear loop and decimation filters for the signal affected by AWGN only (w/o impulsive noise). In this example, a 1st order modulator is used, and the quantizer produces a 1-bit output. The digital wideband filter is a 2nd order IIR Bessel filter with the corner frequency approximately equal to the geometric mean of the nominal signal bandwidth B.sub.x and the sampling frequency F.sub.s. The time parameter of the CMTF is =(4B.sub.x).sup.1, and the impulse response of the lowpass filter in the decimation stage is modified as w[k]+(4B.sub.x).sup.1{dot over (w)}[k].

7 Additional Comments

[0215] It should be understood that the specific examples in this disclosure, while indicating preferred embodiments of the invention, are presented for illustration only. Various changes and modifications within the spirit and scope of the invention should become apparent to those skilled in the art from this detailed description. Furthermore, all the mathematical expressions, diagrams, and the examples of hardware implementations are used only as a descriptive language to convey the inventive ideas clearly, and are not limitative of the claimed invention.

[0216] Further, one skilled in the art will recognize that the various equalities and/or mathematical functions used in this disclosure are approximations that are based on some simplifying assumptions and are used to represent quantities with only finite precision. We may use the word effectively (as opposed to precisely) to emphasize that only a finite order of approximation (in amplitude as well as time and/or frequency domains) may be expected in hardware implementation.

[0217] Ideal Vs. Real Blankers

[0218] For example, we may say that an output of a blanker characterized by a blanking value is effectively zero when the absolute value (modulus) of said output is much smaller (e.g. by an order of magnitude or more) than the blanking range.

[0219] In addition to finite precision, a real blanker may be characterized by various other non-idealities. For example, it may exhibit hysteresis, when the blanker's state depends on its history.

[0220] For a real blanker, when the value of its input x extends outside of its blanking range [.sub., .sub.+], the value of its transparancy function would decrease to effectively zero value over some finite range of the increase (decrease) in x. If said range of the increase (decrease) in x is much smaller (e.g. by an order of magnitude or more) than the blanking range, we may consider such a real blanker as being effectively described by equations (15), (27) and/or (32).

[0221] Further, in a real blanker the change in the blanker's output may be lagging, due to various delays in a physical circuit, the change in the input signal. However, when the magnitude of such lagging is sufficiently small (e.g. smaller than the inverse bandwidth of the input signal), and provided that the absolute value of the blanker output decreases to effectively zero value, or restores back to the input value, over a range of change in x much smaller than the blanking range (e.g. by an order of magnitude or more), we may consider such a real blanker as being effectively described by equations (15), (27) and/or (32).

7.1 Mitigation of Non-Gaussian (e.g. Outlier) Noise in the Process of Analog-to-Digital Conversion: Analog and Digital Approaches

[0222] Conceptually, ABAINFs are analog filters that combine bandwidth reduction with mitigation of interference. One may think of non-Gaussian interference as having some temporal and/or amplitude structure that distinguishes it form a purely random Gaussian (e.g. thermal) noise. Such structure may be viewed as some coupling among different frequencies of a non-Gaussian signal, and may typically require a relatively wide bandwidth to be observed. A linear filter that suppresses the frequency components outside of its passband, while reducing the non-Gaussian signal's bandwidth, may destroy this coupling, altering the structure of the signal. That may complicate further identification of the non-Gaussian interference and its separation from a Gaussian noise and the signal of interest by nonlinear filters such as ABAINFs.

[0223] In order to mitigate non-Gaussian interference efficiently, the input signal to an ABAINF would need to include the noise and interference in a relatively wide band, much wider (e.g. ten times wider) than the bandwidth of the signal of interest. Thus the best conceptual placement for an ABAINF may be in the analog part of the signal chain, for example, ahead of an ADC, or incorporated into the analog loop filter of a ADC. However, digital ABAINF implementations may offer many advantages typically associated with digital processing, including, but not limited to, simplified development and testing, configurability, and reproducibility.

[0224] In addition, as illustrated in 3.3, a means of tracking the range of the difference signal that effectively excludes outliers of the difference signal may be easily incorporated into digital ABAINF implementations, without a need for separate circuits implementing such a means.

[0225] While real-time finite-difference implementations of the ABAINFs described above would be relatively simple and computationally inexpensive, their efficient use would still require a digital signal with a sampling rate much higher (for example, ten times or more higher) than the Nyquist rate of the signal of interest.

[0226] Since the magnitude of a noise affecting the signal of interest would typically increase with the increase in the bandwidth, while the amplitude of the signal+noise mixture would need to remain within the ADC range, a high-rate sampling may have a perceived disadvantage of lowering the effective ADC resolution with respect to the signal of interest, especially for strong noise and/or weak signal of interest, and especially for impulsive noise. However, since the sampling rate would be much higher (for example, ten times or more higher) than the Nyquist rate of the signal of interest, the ABAINF output may be further filtered and downsampled using an appropriate decimation filter (for example, a polyphase filter) to provide the desired higher-resolution signal at lower sampling rate. Such a decimation filter may counteract the apparent resolution loss, and may further increase the resolution (for example, if the ADC is based on modulators).

[0227] Further, a simple (non-differential) hard or soft. clipper may be employed ahead of an ADC to limit the magnitude of excessively strong outliers in the input signal.

[0228] As discussed earlier, mitigation of non-Gaussian (e.g. outlier) noise in the process of analog-to-digital conversion may be achieved by deploying analog ABAINFs (e.g. CMTFs or ADiCs) ahead of the anti-aliasing filter of an ADC, or by incorporating them into the analog loop filter of a ADC, as illustrated in FIGS. 42(a) and 43(a), respectively.

[0229] Alternatively, as illustrated in FIG. 42(b), a wider-bandwidth anti-aliasing filter may be employed ahead of an ADC, and an ADC with a respectively higher sampling rate may be employed in the digital part. A digital ABAINF (e.g. CMTF or ADiC) may then be used to reduce non-Gaussian (e.g. impulsive) interference affecting a narrower-band signal of interest. Then the output of the ABAINF may be further filtered with a digital filter, (optionally) downsampled, and passed to the subsequent digital signal processing.

[0230] Prohibitively low (e.g. 1-bit) amplitude resolution of the output of a modulator would not allow direct application of a digital ABAINF. However, since the oversampling rate of a modulator would be significantly higher (e.g. by two to three orders of magnitude) than the Nyquist rate of the signal of interest, a wideband (e.g. with bandwidth approximately equal to the geometric mean of the nominal signal bandwidth B.sub.7 and the sampling frequency F.sub.s) digital filter may be first applied to the output of the quantizer to enable ABAINF-based outlier filtering, as illustrated in FIG. 43(b).

[0231] It may be important to note that the output of such a wideband digital filter would still contain a significant amount of high-frequency digitization (quantization) noise. As follows from the discussion in 3, the presence of such noise may significantly simplify using quantile tracking filters as a means of determining the range of the difference signal that effectively excludes outliers of the difference signal.

[0232] The output of the wideband filter may then be filtered by a digital ABAINF (with appropriately chosen time parameter and the blanking range), followed by a linear lowpass/decimation filter.

7.2 Comments on Modulators

[0233] The 1st order modulator shown in panel I of FIG. 1 may be described as follows. The input D to the flip-flop, or latch, is proportional to an integrated difference between the input signal x(t) of the modulator and the output Q. The clock input to the flip-flop provides a control signal. If the input D to the flip-flop is greater than zero,D>0, at, a definite portion of the clock cycle (such as the rising edge of the clock), then the output Q takes a positive value V.sub.c, Q=V.sub.c. If D<0 at a rising edge of the clock, then the output Q takes a negative value V.sub.c, Q=V.sub.c. At other times, the output Q does not change. It may be assumed that Q is the compliment of Q and Q=Q.

[0234] Without loss of generality, we may require that if D=0 at a clock's rising edge, the output Q retains its previous value.

[0235] One may see in panel I of FIG. 1 that the output Q is a quantized representation of the input signal, and the flip-flop may be viewed as a quantizer. One may also see that the integrated difference between the input signal of the modulator and the output Q (the input D to the flip-flop) may be viewed as a particular type of a weighted difference between the input and the output signals. One may further see that the output Q is indicative of this weighted difference, since the sign of the output values (positive or negative) is determined by the sign of the weighted difference (the input D to the flip-flop).

[0236] One skilled in the art will recognize that the digital quantizer in a modulator may be replaced by its analog equivalent (i.e. Schmitt trigger, or comparator with hysteresis).

[0237] Also, the quantizer may be realized with an N-level comparator, thus the modulator would have a log.sub.2(N)-bit output. A simple comparator with 2 levels would be a 1-bit quantizer; a 3-level quantizer may be called a 1.5-bit quantizer; a 4-level quantizer would be a 2-bit quantizer; a 5-level quantizer would be a 2.5-bit quantizer.

7.3 Comparators, Discriminators, Clippers, and Limiters

[0238] A comparator, or a discriminator, may be typically understood as a circuit or a device that only produces an output when the input exceeds a fixed value.

[0239] For example, consider a simple measurement process whereby a signal x(t) is compared to a threshold value D. The ideal measuring device would return 0 or 1 depending on whether x(t) is larger or smaller than D. The output of such a device may be represented by the Heaviside unit step function (Dx(t)) [30], which is discontinuous at zero. Such a device may be called an ideal comparator, or an ideal discriminator.

[0240] More generally, a discriminator/comparator may be represented by a continuous discriminator function .sub.(x) with a characteristic width (resolution) a such that lim.sub..fwdarw.0.sub.(x)=(x).

[0241] In practice, many different circuits may serve as discriminators, since any continuous monotonic function with constant unequal horizontal asymptotes would produce the desired response under appropriate scaling and reflection. For example, the voltage-current characteristic of a subthreshold transconductance amplifier [49, 50] may be described by the hyperbolic tangent function, .sub.(x)=A tan h(x/). Note that

[00027]${\lim }_{.fwdarw.0}.Math.\frac{{\stackrel{~}{}}_{}\left(x\right)-A}{2.Math.A}=\left(x\right),$

and thus such an amplifier may serve as a discriminator.

[0242] When <<A, a continuous comparator may be called a high-resolution comparator.

[0243] A particularly simple continuous discriminator function with a ramp transition may be defined as

[00028]$\begin{array}{cc}{}_{g,A}\left(x\right)=\{\begin{array}{cc}\mathrm{gx}& \mathrm{for}.Math..Math.g\left|x\right|A\\ A.Math..Math.\mathrm{sgn}\left(x\right)& \mathrm{otherwise}\end{array},& \left(42\right)\end{array}$

where g may be called the gain of the comparator, and A is the comparator limit.

[0244] Note that a high-gain comparator would be a high-resolution comparator.

[0245] The ramp comparator described by equation (42) may also be called a clipping amplifier (or simply a clipper) with the clipping value A and gain g.

[0246] For asymmetrical clipping values .sub.+ (upper) and a.sub. (lower), a clipper may be described by the following clipping function C.sub..sup.+(x):

[00029]$\begin{array}{cc}{}_{{}_{-}}^{{}_{+}}\left(x\right)=\{\begin{array}{cc}{}_{+}& \mathrm{for}.Math..Math.x>{}_{+}\\ {}_{-}& \mathrm{for}.Math..Math.x<{}_{-}\\ x& \mathrm{otherwise}\end{array}.& \left(43\right)\end{array}$

[0247] It may be assumed in this disclosure that the outputs of the active components (such as, e.g., the active filters, integrators, and the gain/amplifier stages) may be limited to (or clipped at) certain finite ranges, for example, those determined by the power supplies, and that the recovery times from such saturation may be effectively negligible.

7.4 Nonlinear Measures of Central Tendency

[0248] A measure of central tendency would be a single value that attempts to describe a set, of data by identifying the central position within that set of data. As such, measures of central tendency are sometimes called measures of central location. They are also may be classed as summary statistics. The mean (often called the average), or weighted mean (weighted average) would be the most typically used measure of central tendency, and, when the weights do not depend on the data values, it may be considered a linear measure of central tendency.

[0249] An example of a (generally) nonlinear measure of central tendency would be the quasiarithmetic mean or generalized -mean [51].

[0250] Other nonlinear measures of central tendency may include such measures as a median or a truncated mean value, or an L-estimator [46, 52, 53].

[0251] One skilled in the art will recognize that an output of a CMTF may be considered to be a nonlinear measure of central tendency of its input.

7.5 Mitigation of Non-Impulsive Non-Gaussian Noise

[0252] The temporal and/or amplitude structure (and thus the distributions) of non-Gaussian signals are generally modifiable by linear filtering, and non-Gaussian interference may often be converted from sub-Gaussian into super-Gaussian, and vice versa, by linear filtering [9, 10, 32, e.g.]. Thus the ability of the ADiCs/CMTFs disclosed herein, and ADCs with analog nonlinear loop filters, to mitigate impulsive (super-Gaussian) noise may translate into mitigation of non-Gaussian noise and interference in general, including sub-Gaussian noise (e.g. wind noise at microphones). For example, a linear analog filter may be employed as an input front end filter of the ADC to increase the peakedness of the interference, and the ADCs with analog nonlinear loop filter may perform analog-to-digital conversion combined with mitigation of this interference. Subsequently, if needed, a digital filter may be employed to compensate for the impact of the front end filter on the signal of interest.

REFERENCES

[0253] [1] M. Stojanovic and J. Preisig. Underwater acoustic communication channels: Propagation models and statistical characterization. In IEEE Communications Magazine, volume 47, pages 84-89, January 2009. [0254] [2] J. S. G. Panaro, F. R. B. Lopes, L. M. Barreira, and F. E. Souza. Underwater acoustic noise model for shallow water communications. In XXX Simpsio Brasileiro de Telecomunicaes (SBrT 2012), Brazil, 13-16 Sep. 2012. [0255] [3] G. B. Kinda, Y. Simard, C. Gervaise, J. I. Mars, and L. Fortier. Arctic underwater noise transients from sea ice deformation: Characteristics, annual time series, and forcing in Beaufort Sea. The Journal of the Acoustical Society of America, 138(4):2034-2045, October 2015. [0256] [4] J. D. Parsons. The Mobile Radio Propagation Channel. Wiley, Chichester, 2 edition, 2000. [0257] [5] X. Yang and A. P. Petropulu. Co-channel interference modeling and analysis in a Poisson field of interferers in wireless communications. IEEE Transactions on Signal Processing, 51 (1):64-76, 2003. [0258] [6] A. V. Nikitin. On the impulsive nature of interchannel interference in digital communication systems. In Proc. IEEE Radio and Wireless Symposium, pages 118-121, Phoenix, Ariz. 2011. [0259] [7] A. V. Nikitin. On the interchannel interference in digital communication systems, its impulsive nature, and its mitigation. EURASIP Journal on Advances in Signal Processing, 2011(137), 2011. [0260] [8] A. V. Nikitin, M. Epard, J. B. Lancaster, R. L. Lutes, and E. A. Shumaker. Impulsive interference in communication channels and its mitigation by SPART and other nonlinear filters. EURASIP Journal on Advances in Signal Processing, 2012(79), 2012. [0261] [9] A. V. Nikitin, R. L. Davidchack, and T. J. Sobering. Adaptive analog nonlinear algorithms and circuits for improving signal quality in the presence of technogenic interference. In Proceedings of IEEE Military Communications Conference 2013, San Diego, Calif., 18-20 Nov. 2013. [0262] [10] A. V. Nikitin, R. L. Davidchack, and J. E. Smith. Out-of-band and adjacent-channel interference reduction by analog nonlinear filters. EURASIP Journal on Advances in Signal Processing, 2015(12), 2015. [0263] [11] J. Carey. Noise wars: Projected capacitance strikes back against internal noise. EDN, pages 61-65. Jan. 19, 2012. [0264] [12] T. B. Gabrielson. Mechanical-thermal noise in mnicromrachined acoustic and vibration sensors. IEEE Transactions on Electron Devices, 40(5):903-909, 1993. [0265] [13] F. Mohd-Yasin, D. J. Nagel. and C. E. Korman. Noise in MEMS. Measurement Science and Technology, 21(012001), 2010. [0266] [14] S. H. Ardalan and J. J. Paulos. An analysis of nonlinear behavior in delta-sigma modulators. IEEE Transactions on Circuits and Systems, CAS-34(6), 1987. [0267] [15] E. Janssen and A. van Roermund. Look-Ahead Based Sigma-Delta Modulation. Springer, 2011. [0268] [16] A. Chopra. Modeling and Mitigation of Interference in Wireless Receivers with Multiple Antennae. Phd thesis, The University of Texas at Austin, December 2011. [0269] [17] I. Shanthi and M. L. Valarmathi. Speckle noise suppression of SAR image using hybrid order statistics filters. International Journal of Advanced Engineering Sciences and Technologies (IJAEST), 5(2):229-235, 2011. [0270] [18] R. Dragomir, S. Puscoci, and D. Dragomir. A synthetic impulse noise environment for DSL access networks. In Proceedings of the 2nd International conference on Circuits, Systems, Control, Signals (CSCS'11), pages 116-119, 2011. [0271] [19] V. Guillet, G. Lamarque, P. Ravier, and C. Lger. Improving the power line communication signal-to-noise ratio during a resistive load commutation. Journal of Communications, 4(2):126-132, 2009. [0272] [20] M. Katayama, T. Yamazato, and H. Okada. A mathematical model of noise in narrow-band power line communication systems. IEEE J. Sel. Areas Commun., 24(7):1267-1276, 2006. [0273] [21] M. Nassar, J. Lin, Y. Mortazavi, A. Dabak, I. H. Kim, and B. L. Evans. Local utility power line communications in the 3-500 kHz band: Channel impairments, noise, and standards. IEEE Signal Processing Magazine, 29(5):116-127, 2012. [0274] [22] M. Nassar, A. Dabak, II Han Kim, T. Pande, and B. L. Evans. Cyclostationary noise modeling in narrowband powerline communication for Smart Grid applications. In 2012 IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP), pages 3089-3092, 25-30 Mar. 2012. [0275] [23] J. Lin, M. Nassar, and B. L. Evans. Impulsive noise mitigation in powerline communications using sparse Bayesian learning. IEEE Journal on Selected Areas in Communications, 31(7):1172-1183, 2013. [0276] [24] A. V. Nikitin, D. Scutti, B. Natarajan, and R. L. Davidchack. Blind adaptive analog nonlinear filters for noise mitigation in powerline communication systems. In Proc. IEEE International Symposium on Power Line Communications and Its Applications (ISPLC 2015), Austin, Tex., 29-31 Mar. 2015. [0277] [25] S. A. Bhatti, Q. Shan, R. Atkinson, M. Vieira, and I. A. Glover. Vulnerability of Zigbee to impulsive noise in electricity substations. In General Assembly and Scientific Symposium, 2011 XXXth URSI, 13-20 Aug. 2011. [0278] [26] S. R. Mallipeddy and R. S. Kshetrimayum. Impact of UWB interference on IEEE 802.11a WLAN system. In National Conference on Communications (NCC), 2010. [0279] [27] C. Fischer. Analysis of cellular CDMA systems under UWB interference. In International Zurich Seminar on Communications, pages 130-133, 2006. [0280] [28] K. Slattery and H. Skinner. Platform Interference in Wireless Systems. Elsevier, 2008. [0281] [29] F. Leferink, F. Silva, J. Catrysse, S. Batterman, V. Beauvois, and A. Roc'h. Man-made noise in our living environments. Radio Science Bulletin, (334):49-57, September 2010. [0282] [30] R. Bracewell. The Fourier Transform and Its Applications, chapter Heaviside's Unit Step Function, H(x), pages 61-65. McGraw-Hill, New York, 3rd edition, 2000. [0283] [31] P. A. M. Dirac. The Principles of Quantum Mechanics. Oxford University Press, London, 4th edition, 1958. [0284] [32] A. V. Nikitin. Method and apparatus for signal filtering and for improving properties of electronic devices. U.S. Pat. No. 8,489,666 (16 Jul. 2013), U.S. Pat. No. 8,990,284 (24 Mar. 2015), U.S. Pat. No. 9,117,099 (Aug. 25, 2015), U.S. Pat. No. 9,130,455 (8 Sep. 2015), and U.S. Pat. No. 9,467,113 (11 Oct. 2016). [0285] [33] A. V. Nikitin and R. L. Davidchack. Signal analysis through analog representation. Proc. R. Soc. Lond. A, 459(2033):1171-1192, 2003. [0286] [34] A. V. Nikitin and R. L. Davidchack. Adaptive approximation of feedback rank filters for continuous signals. Signal Processing, 84(4):805-811, 2004. [0287] [35] A. V. Nikitin and R. L. Davidchack. Method and apparatus for analysis of variables. U.S. Pat. No. 7,133,568 (Nov. 7, 2006) and U.S. Pat. No. 7,242,808 (Jul. 10, 2007). [0288] [36] A. V. Nikitin. Method and apparatus for real-time signal conditioning, processing, analysis, quantification, comparison, and control. U.S. Pat. No. 7,107,306 (Sep. 12, 2006), U.S. Pat. No. 7,418,469 (Aug. 26, 2008), and U.S. Pat. No. 7,617,270 (Nov. 10, 2009). [0289] [37] A. V. Nikitin. Method and apparatus for adaptive real-time signal conditioning and analysis. U.S. Pat. No. 8,694,273 (Apr. 8, 2014). [0290] [38] G. I. Bourdopoulos, A. Pnevmatikakis. V. Anastassopoulos, and T. L. Deliyannis. Delta-Sigma Modulators: Modeling. Design and Applications. Imperial College Press, London, 2003. [0291] [39] W. Kester, editor. Data Conversion Handbook. Elsevier, Oxford, 2005. [0292] [40] Y. Geerts, M. Steyaert, and W. M. C. Sansen. Design of Multi-Bit Delta-Sigma A/D Converters. The Springer International Series in Engineering and Computer Science. Springer US, 2006. [0293] [41] A. V. Nikitin. Pulse Pileup Effects in Counting Detectors. Phd thesis, University of Kansas, Lawrence, 1998. [0294] [42] C. E. Shannon. Communication in the presence of noise. Proc. Institute of Radio Engineers, 37(1):10-21, January 1949. [0295] [43] F. R. Hampel. The influence curve and its role in robust estimation. J. Am. Slat. Assoc., 69(346):383-393, 1974. [0296] [44] S. O. Rice. Mathematical analysis of random noise. Bell System Technical Journal, 23: 282-332, 1944. Ibid. 24:46-156, 1945. Reprinted in: Nelson Wax, editor, Selected papers on noise and stochastic processes. Dover, N.Y., 1954. [0297] [45] A. V. Nikitin, R. L. Davidchack, and T. P. Armstrong. The effect of pulse pile-up on threshold crossing rates in a system with a known impulse response. [0298] [46] J. W. Tukey. Exploratory Data Analysis. Addison-Wesley, 1977. [0299] [47] H. V. Poor. An Introduction to signal detection and estimation theory. Springer, 1998. [0300] [48] M. Abramowitz and I. A. Stegun, editors. Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables. 9th printing. New York: Dover, 1972. [0301] [49] C. Mead. Analog VLSI and neural systems. Addison-Wesley, 1989. [0302] [50] K. Urahama and T. Nagao. Direct analog rank filtering. IEEE Trans. Circuits Syst.-I. 42(7):385-388, July 1995. [0303] [51] V. M. Tikhomirov, editor. Selected Works of A. N. Kolmogorov, volume I: Mathematics and Mechanics, pages 144-146. Springer Netherlands, 1991. [0304] [52] P. J. Huber. Robust Statistics. Wiley Series in Probability and Statistics. Wiley, 2005. [0305] [53] S. V. Vaseghi. Advanced Digital Signal Processing and Noise Reduction. Wiley, 4th edition, 2008.

[0306] Regarding the invention being thus described, it will be obvious that the same may be varied in many ways. Such variations are not to be regarded as a departure from the spirit and scope of the invention, and all such modifications as would be obvious to one skilled in the art are intended to be included within the scope of the claims. It is to be understood that while certain now preferred forms of this invention have been illustrated and described, it is not limited thereto except insofar as such limitations are included in the following claims.