Method to estimate multi-periodic signals and detect their features in interference
11088877 · 2021-08-10
Assignee
Inventors
Cpc classification
H04L25/03171
ELECTRICITY
International classification
H04L25/02
ELECTRICITY
H04L25/03
ELECTRICITY
Abstract
Techniques, systems, architectures, and methods for providing improved feature detection of signals, especially those in relatively high interference regions, thereby allowing for earlier and longer range detection of communications and radar signals are herein provided. The techniques utilize a general framework of total variation denoising, where signals are assumed to be sparse in a combination of their first or higher order derivatives, to increase signal-to-interference ratio, which is followed by cyclostationarity detection, which is used to estimate signal features, including the period of the signals of interest and their modulation type.
Claims
1. A feature detection system, the system comprising: at least one processor in operative communication with a signal source, said processor further comprising at least one non-transitory storage medium, wherein the at least one non-transitory storage medium contains instructions configured to cause the processor to: apply a generalized total variation denoising approach to a signal received from said signal source; perform a cyclostationarity detection on the signal after the generalized total variation denoising approach has been applied thereto; and output statistics regarding the signal.
2. The system of claim 1, wherein the signal source is a receiver configured to receive electromagnetic radiation.
3. The system of claim 1, wherein said statistics regarding the signal are selected from the group consisting of peak values, locations of peaks and troughs, periodicity or lack thereof, aperiodicity, spectral signature, and peak values at different periodicities.
4. The system of claim 1, wherein the generalized total variation denoising approach comprises a minimization of a cost function.
5. The system of claim 4, wherein the cost function comprises a data fidelity term and a regularization function.
6. The system of claim 5, wherein the regularization function is selected from the group consisting of l.sub.1 norm or l.sub.0 norm, nuclear norm, sparsity promoting functions, non-convex penalties, group sparse functions, total variation, mixed norms, Huber loss functions, sparsity in a transform domain, sparsity using prior knowledge, and structure in time-frequency transforms.
7. The system of claim 4 wherein the cost function is formulated from a Bayesian estimation theory perspective and estimates the signal in the absence of noise.
8. The system of claim 7 wherein the signal in the absence of noise is estimated using a maximum a posteriori estimate.
9. The system of claim 1 wherein the generalized total variation denoising of a one-dimensional signal, x, corrupted by additive white Gaussian noise, n, to give y=n+x is defined by the following optimization problem:
10. The system of claim 9 wherein said operators are linear filters in matrix form, forming a difference matrix.
11. The system of claim 10 wherein rows of the difference matrix are written as a filter.
12. The system of claim 11 wherein said filter is a notch filter.
13. The system of claim 11 wherein said filter is selected from the group consisting of high pass filters, low pass filters, and band pass filters.
14. The system of claim 10 wherein the generalized total variation denoising function comprises two parts, a first part being a least square data-fidelity term and a second part being a penalty function that penalizes the total variation of the signal.
15. The system of claim 1 wherein said statistics regarding the signal comprise statistics relevant to detection and classification of a waveform.
16. The system of claim 1 wherein said statistics regarding the signal comprise an identification of a transmitter.
17. A method of feature detection of a signal, the method comprising: receiving a signal; applying a generalized total variation denoising function to the signal; performing cyclostationarity detection on the signal after the generalized total variation denoising approach has been applied thereto; and outputting statistics regarding the signal, wherein the generalized total variation denoising function comprises two parts, a first part being a least square data-fidelity term and a second part being a penalty function that penalizes the total variation of the signal, wherein the generalized total variation denoising approach further comprises minimization of a cost function, and wherein the cost function comprises a data fidelity term and a regularization function.
18. The method of claim 17 wherein the generalized total variation denoising of a one-dimensional signal, x, corrupted by additive white Gaussian noise, n, to give y=n+x is defined by the following optimization problem:
19. A feature detection apparatus, the apparatus comprising: a receiver configured to receive electromagnetic radiation; at least one processor in operative communication with said receiver, said processor further comprising at least one non-transitory storage medium, wherein the at least one non-transitory storage medium contains instructions configured to cause the processor to: apply a generalized total variation denoising approach to a signal received from said receiver; perform cyclostationarity detection on the signal after the generalized total variation denoising approach has been applied thereto; and output features regarding the signal, wherein said features allow for detection and classification of the signal characteristics, wherein the generalized total variation denoising approach comprises two parts, a first part being a least square data-fidelity term and a second part being a penalty function that penalizes the first or/and higher order total variation denoising of the signal, wherein the generalized total variation denoising approach comprises minimization of a cost function, wherein the cost function comprises a data fidelity term and a regularization function.
20. The apparatus of claim 19 wherein the generalized total variation denoising of a one-dimensional signal, x, corrupted by additive white Gaussian noise, n, to give y=n+x is defined by the following optimization problem:
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13) These and other features of the present embodiments will be understood better by reading the following detailed description, taken together with the figures herein described. The accompanying drawings are not intended to be drawn to scale. For purposes of clarity, not every component may be labeled in every drawing.
DETAILED DESCRIPTION
(14) A variety of acronyms are used herein to describe both the subject of the present disclosure and background therefore. A brief listing of such acronyms along with their meaning, for the purposes of the present disclosure, is provided below:
(15) TABLE-US-00001 AWGN - Additive White Gaussian Noise - a basic noise model used in information theory to mimic the effect of many random processes that occur in nature. The modifiers denote specific characteristics: Additive, because it is added to any noise that might be intrinsic to an information system; White refers to the idea that it is uniform across all frequency bands. It is an analogy to the color white, which has uniform emissions at all frequencies in the visible spectrum; and Gaussian because it has a normal distribution in the time domain with an average time domain value of zero. BPSK - Binary Phase Shift Keying, a two phase modulation scheme, where the 0's and 1's in a binary message are represented by two different phase states in the carrier signal. CS Signals - Cylostationary Signals - A class of random signals whose statistical properties change periodically with time and are generated by some periodic mechanism. CSD - Cyclostationarity Detector - A bi-linear function that, when applied to CS signals, can provide signal characteristics such as periodicity, frequency and other features. CSD is known and described in the following references, which are herein incorporated by reference, in their entirety, for all purposes: Gardner, William A. Cyclostationarity in communications and signal processing. STATISTICAL SIGNAL PROCESSING INC YOUNTVILLE CA, 1994; and Kim, Kyouwoong, et al. “Cyclostationarity approaches to signal detection and classification in cognitive radio.” 2007 2nd IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks. IEEE, 2007. CPS - Cyclic Power Spectrum - A linear power density function that is a function of frequency and indexed by the cyclic frequency. Es - Mean Symbol Energy. Generalized Generalized Total Variation Denoising - A Signal TVD - Processing optimization technique that penalizes variation of the signal, its derivatives, or combinations thereof in regard to noise to estimate the noise. I/Q Data The real (I) and imaginary (Q) samples of the constellation for the modulation type used. Used for modulation of data on a carrier wave, especially simultaneous encoding (modulation) of different data streams onto a carrier signal and later separation (demodulation) of those signals. LPI Low Probability of Intercept - Refers to waveforms and radars that employ measures to avoid detection by passive radar detection equipment (such as a radar warning receiver (RWR) or electronic support receiver) while it is searching for a target or engaged in target tracking, necessitating the use of advanced signal processing techniques for detection. MAP - Maximum a Posteriori - an estimate of an unknown quantity that equals the mode of the posterior distribution. No - Noise. P.sub.d - Probability of Detection. P.sub.fa - Probability of False Alarm. ROC - Receiver Operating Characteristic Curve - a graphical plot that illustrates the diagnostic ability of a binary classifier system as its discrimination threshold is varied. SNR - Signal to Noise Ration or the Ratio of a signal to background noise. SOI - Signal of Interest. TVD - Total Variation Denoising - A Signal Processing optimization technique that penalizes the variation of the signal in combination with its first derivative coefficients, which are assumed to be sparse, to estimate the signal.
(16) Furthermore, for the purposes of the present disclosure, a cylostationary process is one that arises from periodic phenomena that gives rise to random data whose statistical characteristics vary periodically with time. For example, in telecommunications, telemetry, radar, and sonar applications, periodicity is due to modulation, sampling, multiplexing, and coding operations. In mechanics it is due, for example, to gear rotation. In radio astronomy, periodicity results from revolution and rotation of planets and on pulsation of stars. In econometrics, it is due to seasonality. Finally, in atmospheric science it is due to the rotation and revolution of the earth. Such processes may also be referred to as periodically correlated processes.
(17) Now referring specifically to
(18) In one example the signal source 104 comes from a receiver coupled to an antenna that receives various incoming RF signals. The receiver, in one example, has various receiver components such as filters, mixers, amplifiers and also an analog-to-digital converter to convert analog signals to digital signals. After a digitization process, the receive signal, in embodiments, comprises complex in-band and quadrature band (I/Q) complex signals. Other methods to obtain complex I/Q signals, including direct conversion receive (DCR), where the RF signal is directly converted to (I/Q) samples, are also used, in embodiments. In still other embodiments, the receiver obtains complex I/Q signals.
(19) The processor can be one or more processors coupled to a memory or non-transitory storage medium 106 that contains various software routines configured to carry out the methods and techniques described herein. In one exemplary embodiment, the digital signals from the signal source 104 are processed through the GTVD, which denoises the signals, thereby enhancing the signal-to-interference ratio for the feature estimation of the signal of interest.
(20)
(21) More specifically, to determine features of a data source “x” from a received signal “y” (e.g. its cycles, its modulation type, etc.), in accordance with embodiments of the present disclosure, we start with an optimization pre-step process that minimizes the following cost function among all possible values of vector x.
(22)
(23) In Equation 1, above, θ is a data-fidelity term and φ is a regularization function.
(24) Cost functions, which may also be referred to as optimization cost functions, such as that shown in Equation 1, may be formulated in terms of analysis or synthesis regularization terms or a mixture thereof. Exemplary embodiments described herein are meant to describe specific, exemplary cases of the formulation of optimization costs functions and the choice of analysis or synthesis terms or a combination thereof and are not meant to be limiting.
(25) Alternatively, an optimization cost function may be formulated from a Bayesian estimation theory perspective and estimate the desired signal (e.g. through a Maximum a Posteriori (MAP) estimate). Such alternative formulations of the cost function and corresponding solutions may be derived by those skilled in the art based on the example embodiments of the optimization cost function formulation presented herein, which are intended to be exemplary and non-limiting.
(26) The regularization function, in embodiments, may be defined as a combination of regularization functions with different regularization parameter weights. The regularization function is used to penalize undesirable characteristics of the signal. The regularization functions may be any one of l.sub.1 norm or l.sub.0 norm, nuclear norm, other sparsity promoting functions including the l.sub.1 norm, non-convex penalties, group sparse functions, total variation, mixed norms, Huber loss functions, sparsity in a transform domain such as wavelets and Fourier domain, sparsity using prior knowledge such as clutter maps, structure in time-frequency transforms, etc. The regularization functions may further be determined depending on the signals being separated.
(27) Now regarding the Generalized Total variation Denoising (GTVD) 202 that is discussed herein, as used herein, GTVD 202 should be understood to refer to an optimization-based, non-linear filtering method that is well-suited for the estimation of signals that are sparsified with respect to some filters corrupted by additive white Gaussian noise and an example of a cost function, such as that shown in Equation 1. As a non-limiting example, the generalized total variation denoising (GTVD) of a signal x consisting of N samples is corrupted by Additive White Gaussian Noise (AWGN) n to give y=n+x, is defined by the optimization problem:
(28)
(29) In an optimization problem such as that shown in equation 2, the optimization problem does not usually have a closed-form solution and must be solved iteratively. Here: φ are regularization functions; α.sub.i are integers (although they can be defined as fractions); D.sub.i are operators, which may be linear filters represented in matrix form; and λ.sub.i are regularization parameters.
(30) A particular, non-limiting example form of Equation (2) is written below for the total variation denoising problem:
(31)
(32) In equation 3, a is a real number and D is a difference matrix. For α=1, D is the (N−1)×N difference matrix where the first row is [−1 1 zeros(1,N−2)]. D.sup.2 is similarly defined as a (N−2)×N matrix with the first row [−1 2 −1 zeros(1,N−3)]. Each additional row is then shifted by one zero to the right, relative to the previous row. The rows of the difference matrix, D, can be written as any filter, including a notch filter, as a particular frequency band.
(33) Overall, the GTVD function of embodiments is composed of two parts, the first part being a least square data-fidelity term and the second part being a regularization function that penalizes the total variation of the signal with respect to a combination of derivatives of the signals. Since the L1 norm is convex, we obtain a solution to the optimization problem for all regularization values λ>0. Example algorithms to solve Equations (2) and (3) can be found in the publication “Proximal splitting methods in signal processing” and would be known to one of ordinary skill in the art (Combettes, Patrick L., and Jean-Christophe Pesquet. “Proximal splitting methods in signal processing.” Fixed-point algorithms for inverse problems in science and engineering. Springer, New York, N.Y., 2011. 185-212).
(34) Integration of the solution of Equation (3) with a cyclostationarity detector (CSD) shows a significant improvement in detection of signal features.
(35) Next, we derive and present a particular example of estimating the desired signal in noise in the GTVD framework proposed herein where we assume the I/Q signal received is a digital signal and that y=x+n, where x is the desired multi-periodic signal and n is white Gaussian noise.
(36) The assumption for our optimization is that the signal is sparse in its first and second derivative. This should be understood to describe a single pulse, periodic train of pulses, or multiple periodic signal with a rise-time that is a function of linear or/and quadratic time samples, followed by a constant envelope, followed by a fall-time that is a function of a linear and quadratic time.
(37) An example of such a signal is shown in
(38)
(39) Here y is the noisy signal, x is the desired estimated signal, D and D.sup.2 are defined above, and λ.sub.1 and λ.sub.2 are regularization parameters that penalize the amount of first-order and second-order derivative sparsity. The regularization parameters are obtained, in embodiments, through training and cross-validation tests of actual signals relative to their corrupted noisy versions for various interference, noise, and signal-power ratios.
(40) An iterative solution of the estimate of x, denoted by {circumflex over (x)}, which was obtained through Majorization Minimization, a classical optimization technique, is described below and drawn in
(41) Each estimate of x at each iteration k, is denoted by x.sub.k.
(42) First a noisy I/Q sampled data from the A/D is obtained and denoted by y; y is assumed to consist of y=x+n, where n denotes noise and x is the multi-periodic signal of interest. This y is the sampled waveform described in
(43) The MM approach consists of finding a convex Majorizer G.sub.k(x) for F(x) such that:
Gk(x)≥F(x) for all possible values of x Equation (5)
and that it agrees with F(x) for each iteration loop,
Gk(x.sub.k)≥F(x.sub.k) Equation (6)
(44) In each iteration of the loop of the iterative optimization, the solution of:
(45)
is obtained. x.sub.k is guaranteed to converge to a global minimum of F(x).
(46) A solution for x.sub.k, can then be obtained using Equation 8, shown below.
(47)
(48) Further manipulation of Equation (8), such as manipulation of the multiplicative inverse term multiplying y to obtain x.sub.k, may be used to improve the numerical stability of the matrix inverse in embodiments where:
Δ.sub.k=diag(|Dx.sub.k-1|) and ∇.sub.k=diag(|D.sup.2x.sub.k-1|) (Equation 9)
and where diag(z) denotes a diagonal matrix whose diagonal elements consists of the vector z.
(49) The steps of obtaining an iterative solution of the optimization of Equation (4), in accordance with embodiments of the present disclosure, are as follows: 1) Set k=1 2) Initialize x.sub.1=y (other initialization values for x.sub.1 may be used) 3) For k=2 until convergence a. Evaluate Δ.sub.k (Equation 9) b. Evaluate ∇.sub.k (Equation 9) c. Evaluate x.sub.k (Equation 8) d. Evaluate convergence criteria 4) Obtain {circumflex over (x)} as an estimate of x
(50) It should be noted that, in Step 3d, one can setup a tolerance that evaluates the successive difference of the solution obtained in the current loop x.sub.k relative to the previous loop x.sub.k-1 relative to a norm, such as the L2 norm. Alternatively, one can choose a number of iterations N.sub.loop based to run the iterative optimization solution and obtain N.sub.loop through cross-validation tests. Yet another method is to evaluate the difference of successive F(x.sub.k) values relative to a norm, such as the L2 norm and stop the number of iterations at a desired tolerance threshold. Still other methods to evaluate the convergence to the unique solution would be known to those knowledgeable in the relevant arts.
(51) Finally, when {circumflex over (x)} is obtained, it is used as an input to a feature detector, in embodiments the cyclostationarity detector described below.
(52) Now, as an experiment, take the waveform shown in
(53) These teachings, while generally applicable, are particularly useful in the context of intercepting Low Probability of Intercept (LPI) waveforms. This is because such techniques allow the waveform characteristics (e.g. period) to be determined over a shorter interval of time at lower SNR ratios.
(54) Now referring to
(55) Now regarding GTVD combined with CSD and simulation, simulations of the joint detection algorithm were performed to model the effectiveness of using TVD as a pre-process to CSD. The following parameters were used as simulation input parameters: Input file 4800 bps BPSK waveform Stepped through algorithm from −5 dB to 10 dB Es/No in increments of 1 dB 100 trials computed for each increment In each iteration, four sets detection metrics were produced Cylostationarity Detection for Noise Only Cylostationarity Detection for BPSK Signal TVD Algorithm followed by Cylostationarity Detection for Noise Only TVD Algorithm followed by Cylostationarity Detection for BPSK Signal
(56) The output of the simulation captured the statistical metrics used as a basis for detection. This result was captured by running the CSD algorithm against a period of time when the input BPSK signal was present and an identical period of time where the signal was not present (Noise Only).
(57) Extraction of the peak values, locations, and statistics provides information to determine the presence of a periodic waveform. To characterize the results, in embodiments, several iterations are performed, such that a set of Receiver Operating Characteristics (ROC) curves can be generated.
(58) A typical set of detection metrics from the CSD is shown in
(59) To evaluate the effectiveness of the TVD algorithm, the CSD was run for all iterations, alongside the joint TVD and CSD algorithms.
(60)
(61)
(62) Detection metrics used in this model are the maximum value above mean. There are many other methods that can be employed to generate detection metrics, as would be known to one of ordinary skill in the art. Two examples would be to use the number of standard deviations above the mean or to use the max value above an adaptive threshold.
(63) The foregoing description of the embodiments of the present disclosure has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the present disclosure to the precise form disclosed. Many modifications and variations are possible in light of this disclosure. It is intended that the scope of the present disclosure be limited not by this detailed description, but rather by the claims appended hereto.
(64) A number of implementations have been described. Nevertheless, it will be understood that various modifications may be made without departing from the scope of the disclosure. Although operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results.