Analog-to-digital converters employing continuous-time chaotic internal circuits to maximize resolution-bandwidth product—CT TurboADC
11394391 · 2022-07-19
Inventors
Cpc classification
H03M1/508
ELECTRICITY
H03M1/1235
ELECTRICITY
H03M1/144
ELECTRICITY
International classification
H03M1/06
ELECTRICITY
Abstract
An analog-to-digital conversion devices and methods that approach a linear relationship between resolution and oversampling rate. The process involves modulating an input analog signals with an essentially chaotic encoding signal that is deterministic, aperiodic in that it lacks spectral tones above a threshold, and bounded. The resulting encoded signal is quantized into a bit stream and decoded by applying to that bit stream a non-linear estimation related to said chaotic signal to thereby produce an output representing said input analog signal in digital form.
Claims
1. An analog-to-digital converter (ADC), comprising: a port for an input analog signal; a source configured to provide a continuous-time chaotic encoding signal that is deterministic, aperiodic above a threshold, and bounded; an encoder configured to encode said input analog signal with said chaotic signal to thereby produce an encoded analog signal; a quantizing circuit configured to quantize said encoded analog signal into a bit stream; and a decoder configured to apply to said bit stream a non-linear estimation related to said chaotic signal to thereby produce an output representing said input analog signal in digital form; wherein aperiodic above a threshold refers to lacking spectral tones above a threshold.
2. The ADC of claim 1, wherein said input analog signal is sampled at an oversampling rate (OSR) and said output signal has a resolution R proportional to OSR.
3. The ADC of claim 1, wherein the output signal has a resolution R that varies linearly with a bandwidth BW of the ADC.
4. The ADC of claim 1, wherein the chaotic encoding signal is generated by a chaotic oscillator based on negative-Gm LC-tank oscillator.
5. The ADC of claim 1, wherein the chaotic encoding signal is generated by a continuous-time chaotic Chua circuit.
6. The ADC of claim 1, wherein the decoder producing an output representing said input analog signal in digital form is implemented as a neural-network.
7. The ADC of claim 1, wherein: the input analog signal is sampled at an OSR; output signal has a resolution R that (1) is proportional to OSR; or (2) varies linearly with a bandwidth BW of the ADC; the chaotic encoding signal is generated by either (1) a chaotic oscillator based on negative-Gm LC-tank oscillator; or (2) a continuous-time chaotic Chua circuit; and, the decoder producing an output representing said input analog signal in digital form is implemented as a neural-network.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
DETAILED DESCRIPTION
(7) A synergy of two distinct fields (Information theory on one side and the principles and methods of A/D conversion on the other) has led to a mathematical framework that, among other things, helped derive fundamental theoretical limits on the resolution-bandwidth product of Analog-to-digital converters (ADC) and also helped prove essential and often unexpected results [12]. For example, it is traditionally assumed that the quantization noise in ADCs is independent of the input analog signal. As a direct consequence to this assumption, the effective number of bits (ENOB) or resolution is always proportional to log.sub.2 (OSR), where the OSR is the oversampling ratio. By using Information theory tools, it has been discovered that this assumption is fundamentally flawed, and that the quantization noise is instead fully dependent on the input analog signal because its entropy is zero given the input analog signal, so that the resolution can be instead proportional to OSR. This represents a paradigm shift in understanding A/D conversion methods and leads to novel methods of conversion. This patent specification introduces a novel class of ADC, termed Continuous-Time TurboADC (CT TurboADC), that can trade resolution and bandwidth on the fly while preserving their product constant and equal or nearly equal to the fundamental theoretical limit with minimal use of analog front-end resources and power. Thanks to their simple front-end design (as simple as the 1st order ΔΣ modulator) and ease of integration, the CT TurboADCs described in the patent specification can replace many traditional ADC methods and even enable new applications such as software defined radio, direct RF signal conversion in communications, radar, ultrasound, and MRI imaging systems.
(8)
(9) An ADC could be described as a communication system, as shown in
(10) Theorem 1. Capacity: Maximum information rate at the output of an ADC employing M comparators operated at f.sub.c comparisons per second is equal to M*f.sub.c bits per second. This maximum information rate is defined as a Conversion Capacity C.sub.ADC.
(11) Theorem 2. Existence: There exists at least one ADC that can operate at the C.sub.ADC regardless of the input signal statistics. This type of ADC is termed TurboADC with reference to Turbo codes in communications that are able to approach Shannon's channel capacity.
(12) Theorem 3. Necessary condition: An ADC can achieve the conversion capacity if the autocorrelation function of the input to its internal comparator(s) is a delta function (i.e., white spectral properties) regardless of the input signal statistics.
(13) Consequently, two properties of a TurboADC can be derived.
(14) Corollary 1. The internal analog filter of a TurboADC that encodes the input signal before it is fed to the comparator, must be a non-linear filter (or a non-linear mapping).
(15) Corollary 2. The output of the comparator in a TurboADC is a sequence of independent uniformly distributed bits.
(16) Theorem 4. Oversampling: If an ADC operates at its capacity and the input analog signal is oversampled by a factor of OSR=f.sub.c/2f.sub.in, the effective resolution in the baseband is equal to OSR bits.
(17) Perhaps the most interesting and unexpected property of a TurboADC is the one described in Theorem 4. It states that the resolution of a TurboADC is proportional to the OSR. In contrast, traditional oversampling ΔΣ ADC's achieve effective resolution that is proportional to log.sub.2(OSR). Clearly, for the same resolution, a TurboADC may operate at an exponentially lower sampling rate than the ΔΣ ADC's. Also, from Theorem 4 flows a conclusion that resolution of a TurboADC trades linearly with its bandwidth such that the R-BW product is constant and equal to C.sub.ADC. For example, to increase the resolution from 8 to 16 bits, a 2nd-order ΔΣ ADC would have to increase its sampling rate by a factor of 9.1 while a TurboADC would only have to double it (5 times reduction in power), which could prove crucial in battery-operated IoT devices. On the other hand, for the same technology node and power consumption, TurboADC may achieve data rates significantly higher than other ADC methods, which may enable new high-speed conversion applications. Finally, from Theorems 1 and 3 we prove the following theorem.
(18) Theorem 5. Chaotic encoder: In order to achieve the theoretical limit to the R-BW product (the capacity) irrespective of the input signal statistics, the ADC's internal analog filter should be a deterministic system with aperiodic and bounded state trajectories for all input signal statistics—a chaotic system.
(19) Proof. First, a proof of deterministic property of the analog filter (or encoder). As in [13], mutual information between the comparator's 1-bit output y[n] and the analog input V.sub.in[n] is defined as,
I(V.sub.in[n],y[n])=H(y[n]|y[n−1], . . . y[1])−H(y[n]|y[n−1], . . . y[1],V.sub.in[n], . . . V.sub.in[1]) (1)
(20) Since the first term H (y[n]|y[n−1], . . . y[1]) can be at most equal to 1 bit, the mutual information term is maximized if and only if the second term is equal to zero. The second term is zero if and only if the state of the encoder is fully described given the input analog signal (i.e., it is not stochastic). Second, the state boundedness can be proved by contradiction. If the state is unbounded it must grow to either positive infinite or negative infinite (not both). Otherwise, its bandwidth would grow to infinity, which cannot be the case with discrete-time systems. Therefore, if the state becomes unbounded the output from the comparator y[n] would be a constant value that carries no information (i.e., information rate falls below the capacity). Third, according to Theorem 3, since the state value over its trajectory must have a delta autocorrelation function it must follow aperiodic orbits (i.e., random-like nature). Finally, if an analog encoder is to produce an output that has white spectrum (aperiodic orbits) for any input signal statistics, it should do so even in the limiting case where the input signal is a delta function with the maximum bandwidth of f.sub.s/2. In this case, the input signal affects only the initial state of the analog encoder and the subsequent state values continue to change on their own over aperiodic orbits. Therefore, it must be sensitive to initial conditions—a “Butterfly effect”. An alternative limiting case, when the input analog signal is a DC signal, would lead to the same requirement about the analog encoder.
(21) Discrete-Time TurboADC: This prior-art on a discrete-time implementation of TurboADC is described in detail in [13] and it is provided here as background information. First, a simple discrete-time dyadic transformation (or Bernoulli map) that can give rise to chaotic behavior is considered. The phase space of this simple map is shown in
(22)
(23) The state s[n] remains bounded in the [−aVref, aVref) interval and trajectory is deterministic in absence of electronic noise. For certain values of the gain (e.g., a=2) and initial state the map exhibits a true chaotic behavior with the Lyapunov exponent equal to log(2). A block schematic of the described DT TurboADC based on the modified Bernoulli chaotic map in Eqs. (3) is shown in
(24) The following example emphasizes the significance of this difference between the Cyclic ADC and DT TurboADC. Let us assume that a Cyclic ADC is designed for a sampling rate of f.sub.s=8 MHz with 4-bit resolution. For each of the input signal samples, the Cyclic ADC produces 4 bits after cycling through four comparisons (i.e., comparator operates at f.sub.c=32 MHz), followed by resetting the internal state to a new input signal value. If we now assume that the actual analog signal applied to the Cyclic ADC is bandlimited to 1 MHz (OSR=4), the best resolution that the Cyclic ADC can achieve in this case is 5 bits after averaging four original 4-bit samples. At the same time, if the DT TurboADC operates at the same speed (f.sub.c=32 MHz) and the input signal bandwidth is 1 MHz, the resolution will be 16 bits, which is a surprisingly significant improvement of 11 bits over the Cyclic ADC. Additionally, the TurboADC would require much simpler anti-aliasing filter.
(25) Continuous-Time TurboADC (CT TurboADC): As described in this application, TurboADC's can be implemented with a continuous-time (CT) chaotic circuit for the purpose of achieving significantly higher conversion rates. Continuous-time electronic circuits are typically significantly faster than discrete-time counterparts, which are typically strongly frequency compensated to avoid oscillatory and overshoot behavior at their output). Examples of CT chaotic circuits are Chua circuits [15]-[17] and chaotic oscillators based on -Gm LC-tank oscillator [18]-[19]. Work in [19] demonstrates a -G.sub.m LC-tank oscillator in 0.35 um BiCMOS technology exhibiting chaotic behavior up to 5 GHz. If used in a CT TurboADC, this circuit has the potential to achieve a direct RF signal conversion up to the same bandwidth. Example applications that could benefit from the CT TurboADC are Bluetooth, mobile phones, personal networks, and other low-power radio communications as well as C-band radars for battlefield and ground surveillance, as well as missile-control. The -G.sub.m LC-tank oscillator may be able to generate chaotic behavior in the range of tens of GHz in more advanced technologies, [20]-[24] (e.g., for W-band radars).
(26) If implemented in 65 nm CMOS technology, the design may achieve bandwidth of 5 GHz with at least 8 bits of resolution in the baseband for direct RF conversion of ISM band signals up to 2.54 GHz for use in Bluetooth, WiFi, and other low-power short-range radio communications. To the best of our knowledge, CT TurboADC's are the first attempt to extend the Cyclic and SAR ADC's, which are always implemented with discrete-time switched-capacitor (or switched-current) circuits, to the continuous-time domain for much increased conversion speed and RBW products.
(27) In another embodiment of the present invention, the CT Turbo ADC can be implemented by using a continuous-time chaotic circuit based on, so-called, Chua-circuit, as shown in
(28) Baseband Decoding. The single-bit stream y[n] produced by the comparator in CT TurboADC's must be decoded to produce a meaningful multi-bit representation of the input analog signal V.sub.in(t) in baseband. Contrary to Cyclic ADC, where there is a one-to-one correspondence between the amplitude bits of the input signal samples and information bits at the output of the comparator (e.g., V.sub.in[n]≈V.sub.ref(b.sub.02.sup.−N+b.sub.12.sup.(N-1)+b.sub.22.sup.−(N-2)+ . . . + b.sub.N-12.sup.−1, where V.sub.in[n] are the samples of a continuous-time input signal V.sub.in(t) sampled at time period T.sub.s=1/f.sub.s, V.sub.ref is the reference voltage, b.sub.k are the output information bits (total of N) with b.sub.0 being the least significant bit), the CT TurboADC produces information bits that are affected by many past input signal samples. Therefore, input signal baseband samples V.sub.in[n] must be estimated from the comparator's single-bit output stream. Unlike the ΔΣ ADC where the baseband multi-bit input signal samples V.sub.in[n] are estimated with the help of a linear decimation filter, the CT TurboADC is a non-linear system, and so the baseband signal must be estimated with the help of non-linear estimation methods. In one embodiment of the CT TurboADC invention, the continuous-time state-space equations describing trajectory of the chaotic system's state variable(s) are discretized in time to form a discrete-time model of the CT TurboADC with the sampling frequency f.sub.s. Together with the output bit stream y[n] from the CT TurboADC, the discrete-time model representing the state-space trajectory of the continuous-time chaotic circuit is applied to non-linear estimation methods as a prior knowledge for the purpose of estimating multi-bit representation of the input analog signal in baseband similar to decoding methods in Discrete-Time TurboADC's as described in [12]. For example, a non-linear estimation method could be implemented to iterate between two estimation steps as in Projections onto Convex Sets methods. The following illustrates the iterative approach to finding an estimate of the continuous-time input analog signal V.sub.in(t) applied to the CT TurboADC:
(29) Step 1: Initiate the estimate {tilde over (V)}.sub.in.sup.b[n] of length equal to M samples to zero or other appropriate initial value (where M is chosen as a decoding window so that the estimate of an input analog signal V.sub.in(t) is produced in blocks of length M).
(30) Step 2: Find an estimate {tilde over (V)}.sub.in.sup.a[n] of length M of the continuous-time input signal V.sub.in(t) closest to {tilde over (V)}.sub.in.sup.b [n], e.g., in least-squares sense, such that when passed through the discrete-time state-space model of the CT Turbo ADC produces y.sup.a[n] that is the same (or similar) as the original sequence y[n] generated by the comparator of the CT Turbo ADC and supplied to the decoder as prior knowledge;
(31) Step 3: Project the estimate {tilde over (V)}.sub.in.sup.a[n] from Step 2 to the nearest estimate {tilde over (V)}.sub.in.sup.b[n] that satisfies prior knowledge about V.sub.in(t) (e.g., bandlimitation of V.sub.in(t) or that V.sub.in(t) is a linear combination of known orthogonal basis functions).
(32) Step 4: Repeat Steps 2 and 3 until satisfactory convergence is achieved.
(33) In another embodiment of the present invention, the non-linear decoder of the output bit stream y[n] from the CT Turbo ADC is decoded by using a recurrent neural network, as illustrated in
(34) The new class of ADCs, termed CT TurboADC, that is described above is capable of achieving fundamental theoretical limit to the resolution-bandwidth product (or conversion capacity). The discussion above shows that a TurboADC should employ a deterministic chaotic circuit to achieve the capacity. A continuous-time implementation of TurboADC with the front-end circuit complexity similar to a simple 1.sup.st order continuous-time ΔΣ modulator is also described. Ability to maintain resolution in the baseband that is proportional to the OSR (defined as the ratio between one half the sampling frequency and the input analog signal's bandwidth) surpassing all existing ADC methods, whose resolution is proportional to log.sub.2(OSR), opening up possibilities for new data conversion applications such as high-speed direct RF signal conversion in radar, high-speed communications, and medical imaging.
(35) Although the foregoing has been described in some detail for purposes of clarity, it will be apparent that certain changes and modifications may be made without departing from the principles thereof. It should be noted that there are many alternative ways of implementing both the processes and apparatuses described herein.
(36) Accordingly, the present embodiments are to be considered as illustrative and not restrictive, and the body of work described herein is not to be limited to the details given herein, which may be modified within the scope and equivalents of the appended claims.
REFERENCES
(37) [1] B. Murmann, “ADC Performance Survey 1997-2020,” [Online]. Available: http://web.stanford.edu/˜murmann/adcsurvey.html. [2] C. Shannon, The Mathematical Theory of Communication, USA, IL, Urbana:Univ. Illinois Press, 1998. [3] E. Martens et al., “A 48-dB DR 80-MHz BW 8.88-GS/s bandpass ΔΣ ADC for RF digitization with integrated PLL and polyphase decimation filter in 40 nm CMOS,” 2011 Symposium on VLSI Circuits—Digest of Technical Papers, Honolulu, Hi., 2011, pp. 40-41. [4] I. Galton and H. T. Jensen, “Delta-Sigma modulator based A/D conversion without oversampling,” in IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing, vol. 42, no. 12, pp. 773-784, December 1995. [5] M. Mishali, Y. C. Eldar, O. Dounaevsky, E. Shoshan, “Xampling: Analog to digital at sub-nyquist rates”, IET Circuits Devices Syst., vol. 5, no. 1, pp. 8-20, January 2011. [6] M. Marijan and Z. Ignjatovic, “Code division parallel delta-sigma A/D converter with probabilistic iterative decoding,” Proceedings of 2010 IEEE International Symposium on Circuits and Systems, Paris, 2010, pp. 4025-4028. [7] M. Marijan and Z. Ignjatovic, “Reconstruction of oversampled signals from the solution space of delta-sigma modulated sequences,” 2011 IEEE 54th International Midwest Symposium on Circuits and Systems (MWSCAS), Seoul, 2011, pp. 1-4. [8] M. Marijan and Z. Ignjatovic, “Non-Linear Reconstruction of Delta-Sigma Modulated Signals: Randomized Surrogate Constraint Decoding Algorithm,” in IEEE Transactions on Signal Processing, vol. 61, no. 21, pp. 5361-5373, Nov. 1, 2013. [9] P. M. Aziz, H. V. Sorensen, J. vn der Spiegel, “An overview of sigma-delta converters,” IEEE Signal Processing Magazine, vol. 13, no. 1, pp. 61-84, January 1996. [10] R. H. Walden, “Analog-to-digital converter survey and analysis,” in IEEE Journal on Selected Areas in Communications, vol. 17, no. 4, pp. 539-550, April 1999. [11] S. Norsworthy, R. Schreier, G. Temes, G. C., and IEEE Circuit & Systems Society, Delta-Sigma data converters: theory, design, and simulation, IEEE Press, 1997. [12] Ignjatovic Z., Zhang Y. (2019) Analog-to-Digital Converters Employing Chaotic Internal Circuits to Maximize Resolution-Bandwidth Product—Turbo ADC. In: In V., Longhini P., Palacios A. (eds) Proceedings of the 5th International Conference on Applications in Nonlinear Dynamics. Understanding Complex Systems. Springer, Cham. https://doi.org/10.1007/978-3-030-10892-2_20 [13] Z. Ignjatovic and M. Sterling, “Information-Theoretic Approach to A/D Conversion,” in IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 60, no. 9, pp. 2249-2262, September 2013. [14] Q. Li and Q. Liu, “Simple chaos-based ADC with only one opamp,” 2012 International Conference on Systems and Informatics (ICSAI2012), Yantai, 2012, pp. 824-827, doi: 10.1109/ICSA1.2012.6223136. [15] L. O. Chua, M. Komuro, and T. Matsumoto, “The double-scroll family,” IEEE Trans. Circuits Syst. 1, vol. CAS-33, pp. 1072-1118, October 1986. [16] L. O. Chua, W. Wu, A. Huang, and G. Zhong, “A universal circuit for studying and generating chaos-part II: Strange attractors,” IEEE Trans. Circuits Syst. 1, vol. 40, pp. 745-761, July 1993. [17] M. E. Yalcin, J. A. K. Suykens and J. Vandewalle, “True random bit generation from a double-scroll attractor,” in IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 51, no. 7, pp. 1395-1404, July 2004. [18] S. Ozoguz, A. S. Elwakil and S. Ergun, “Cross-coupled chaotic oscillators and application to random bit generation,” in IEEE Proceedings—Circuits, Devices and Systems, vol. 153, no. 5, pp. 506-510, October 2006. [19] A. S. Demirkol, V. Tavas, S. Ozoguz and A. Toker, “High frequency chaos oscillators with applications,” 2007 18th European Conference on Circuit Theory and Design, Seville, 2007, pp. 1026-1029. [20] Hussein, S. Vasadi, M. Soliman and J. Paramesh, “19.3 A 50-to-66 GHz 65 nm CMOS all-digital fractional-N PLL with 220 fsrms jitter,” 2017 IEEE International Solid-State Circuits Conference (ISSCC), San Francisco, Calif., 2017, pp. 326-327. [21] S. Yoo, S. Choi, J. Kim, H. Yoon, Y. Lee and J. Choi, “19.2 A PVT-robust −39dBc 1 kHz-to-100 MHz integrated-phase-noise 29 GHz injection-locked frequency multiplier with a 600 μW frequency-tracking loop using the averages of phase deviations for mm-band 5G transceivers,” 2017 IEEE International Solid-State Circuits Conference (ISSCC), San Francisco, Calif., 2017, pp. 324-325. [22] J. Zhang et al., “85-to-127 GHz CMOS Signal Generation Using a Quadrature VCO with Passive Coupling and Broadband Harmonic Combining for Rotational Spectroscopy,” IEEE J. Solid-State Circuits, vol. 50, no. 6, pp. 1361-1371, June 2015. [23] M. Adnan and E. Afshari, “A 247-to-263.5 GHz VCO with 2.6 mW Peak Output Power and 1.14% DC-to-RF Efficiency in 65 nm Bulk CMOS,” ISSCC Dig. Tech papers, pp. 262-263, February 2014. [24] H. Koo et al., “Design and Analysis of 239 GHz CMOS Push-Push Transformer-Based VCO with High Efficiency and Wide Tuning Range,” IEEE Trans. Circuits and Systems-I, vol. 62, no. 7, pp. 1883-1893, July 2015.