Optical reservoir computing system and method of using the same
11907811 ยท 2024-02-20
Assignee
Inventors
Cpc classification
G06N3/0675
PHYSICS
International classification
G06E3/00
PHYSICS
Abstract
An optical reservoir computing (ORC) system has a near-UV light emitting diode modulator (LED-M), a beam expander (BE), a fluorescer array (FA), an optical integrator (OA), a liquid crystal spatial light modulator (LC-SLM), and a photo-detector array (PDA). The LED-M receives an input electrical signal and outputs an optical signal passing through the BE, being made incident upon the FA, being processed in the OA, and being multiplexed onto the LC-SLM. Non-Linearity is introduced by overlapping responses to input signals by the FA. High Dimensionality is provided by the random but fixed time-wavelength multiplexing onto an imaging plane by a Fresnel-Kohler Integrator (FKI). Fading Memory is provided by different decay time constants of the fluorescers. A method of using the ORC system comprises the steps of minimizing an error function of difference between a measured state of the PDA and a target state of the PDA by a regression model.
Claims
1. An optical reservoir computing (ORC) system comprising a light emitting diode modulator (LED-M); a fluorescer array (FA); an optical integrator (OA); a liquid crystal spatial light modulator (LC-SLM); and a photo-detector array (PDA); wherein an optical signal from the LED-M, is made incident upon the FA, is processed in the OA, multiplexed onto the LC-SLM, and converted to an set of electrical signals in the PDA.
2. The ORC system of claim 1, wherein a beam expander (BE) is placed between the LED-M and FA to facilitate optimal distribution of light intensity on the FA.
3. The ORC system of claim 1, wherein the PDA comprises a plurality of photo-diodes.
4. The ORC system of claim 1 further comprising a field-programmable gate array (FPGA); an electronic controller; and a plurality of read-out channels connected to the PDA; wherein the LC-SLM, the PDA, the FPGA, and the electronic controller form a feedback loop.
5. The ORC system of claim 1, wherein the OA is a Fresnel-Kohler integrator (FKI) comprising a Fresnel lens and a spherical lens concentrator.
6. The ORC system of claim 1, wherein the PDA includes an amplifier, and a conditioning and discriminating circuit; and wherein the FPGA outputs data to an external electronic device.
7. The ORC system of claim 1, wherein an input signal to the LED-M is a predetermined electrical signal with a frequency in a range from one kHz to ten gigahertz; wherein the LED-M comprises a near ultraviolet photodiode; and wherein the predetermined electrical signal modulates the near ultraviolet photodiode so as to generate the optical signal.
8. The ORC system of claim 7, wherein the optical signal from LED-M is a light beam with a wavelength in a range from two hundred nanometers to four hundred and fifty nanometers.
9. The ORC system of claim 1, wherein each fluorescer unit of the fluorescer array FA is characterized by a distinct emission characteristic in a spectral band in a range from fifty nanometers to four hundred nanometers and a decay time in a range from one nano-second to one milli-second.
10. The ORC system of claim 1, further comprising a field-programmable gate array (FPGA); an electronic controller; and a plurality of read-out channels connected to the PDA; wherein the LC-SLM, the PDA, the FPGA, and the electronic controller form a feedback loop; and wherein the LC-SLM operates in a transmissive mode, and attenuation of each of a plurality of pixels is controlled by an output electrical signal from the electronic controller directed by the FPGA.
11. The ORC system of claim 1, wherein a beam expander (BE) is placed between the LED-M and FA to facilitate optimal distribution of light intensity on the FA; and wherein the BE is a quartz concave lens.
12. The ORC system of claim 1, wherein each element of the FA is characterized by a different fluorescence time constant and different emission spectrum from other elements of the fluorescer array.
13. The ORC system of claim 1, wherein a beam expander (BE) is placed between the LED-M and FA to facilitate optimal distribution of light intensity on the FA; wherein the ORC system further comprises a housing; and wherein an entirety of the LED-M, the BE, the FA, the OA, the LC-SLM, and the PDA are enclosed by the housing.
14. The ORC system of claim 1, wherein a beam expander (BE) is placed between the LED-M and FA to facilitate optimal distribution of light intensity on the FA; wherein the ORC system is packaged in a planar electronic chip packaging; and wherein a top cover of the package serves as the optical integrator.
15. The ORC system of claim 1, wherein each element of the FA comprises a respective fluorescer dissolved in a relaxation ionic liquid.
16. The ORC system of claim 15, wherein each element of the FA is quartz and is immobilized in a UV-transparent matrix.
17. A method of training the ORC system of claim 1, wherein outputs of the PDA for input signals of interest and input representative noise are processed by the FPGA and attenuations of different pixels of the LC-SLM are performed through an electronic controller so that a resulting feedback loop provides sufficient code separation between noise and signal in the outputs of the PDA.
18. The method of training the ORC system of claim 17, wherein each pattern of signal is differentiated from noise by fixing the attenuations of different pixels of the LC-SLM.
19. The method of training the ORC system of claim 17, wherein an incoming electrical signal coming through the system is sorted by the FPGA based on the training to be recognized or discarded, based on pre-trained states of the attenuation of LC-SLM pixels.
20. A method of using the ORC system of claim 1, the method comprising the steps of providing a copy of output of the PDA to a field-programmable gate array (FPGA); controlling the LC-SLM through an electronic controller; and programming and training the FPGA by a computer.
21. The method of claim 20, wherein the programming and training the FPGA includes minimization of an error function of difference between a measured state of the PDA and a target state of the PDA by a regression model.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
DETAILED DESCRIPTION OF THE INVENTION
(8)
(9) An optical signal from the LED-M 110 passes through the BE 120, is made incident upon the FA 140, is processed in the FKI 160, and is multiplexed onto the LC-SLM 180, which selectively masks the incoming light and illuminates the PDA 190.
(10)
(11) An optical signal from the LED-M 210 passes through the BE 220, is made incident upon the FA 240, is processed in the FKI 260, and is multiplexed onto the LC-SLM 280. In examples of the present disclosure, the LC-SLM 280, the PDA 290, the FPGA 292, and the controller 294 form a feedback loop. The elements of LC-SLM 280 are tuned to have different attenuations based on the learning from analysis of PDA 290 signals by FPGA 292.
(12) In examples of the present disclosure, the input signal 202 to the LED-M 210 is an electronic signal, representing the cognitive data that needs to be processed. The data may be fed at any frequency of interest, but specifically in the range from 1 kHz to 10 GHz. The processing can be done in real time (such as WiFi signature detection) or off-line (such as face recognition from photographs). The LED-M 210 comprises a near-ultraviolet photodiode, with wavelength of emission between 200 and 450 nm. The electronic signal modulates the near-ultraviolet photodiode so as to generate the optical signal, thus achieving the electro-optic conversion, so that the reservoir computing can now happen in the optical domain.
(13) In examples of the present disclosure, the optical integrator 260 is an FKI. The PDA 290 includes photodiodes, and electronics for amplification, shaping and discrimination of the optical signal. The FPGA 292 outputs data to an external data processing and controlling device 298, which may be a computer. The FPGA 292 also controls the pixels of the LC-SLM which does a fixed or programmable masking of FKI 260 output before it goes to PDA 290.
(14) In examples of the present disclosure, the optical signal from LED-M is a modulated light beam with a wavelength in a range from 200 nm to 450 nm. The input electronic signal for cognitive processing is converted to the near-ultraviolet optical signal with the LED-M 210. In examples of the present disclosure, the LED-M 210 includes a 280 nm LED (for example, XR-280 from RAYVIO Corporation) and a high-speed LED driver (for example, ONET4201LD from TEXAS INSTRUMENTS Incorporated). In examples of the present disclosure, the optical signal is a non-linear function of the input electrical signal, for example, see Modeling Laser-Diode Non-linearity in a Radio-over-Fibre Link, Pre-print, Research Gate, 2003, by Baghersalimi et al. This electro-optic conversion is non-linear, which contributes to the non-linearity (NL) of signal transformation required for Reservoir Computing.
(15)
(16) A modern technique to create and tune elements of the FA is to dissolve a strong fluorescer in a relaxation ionic liquid (see U.S. Pat. No. 9,568,623) to obtain the desired temporal and spectral behavior. For example, from
(17) In examples of the present disclosure, fluorescer compounds can be selected to have emission time constants starting from nano-seconds to sub-seconds, thus making this architecture suitable not just for RF signals (ns resolution), but also for audio (micro-sec) and seismic (milli-sec) signals.
(18) Conversion of electrical to optical signal through LED-M 210 and FA 240 is mathematically depicted in
P.sub.opt=.sub.n=0.sup.3.sub.n{A(t)T.sub.th}.sup.n (1)
Where A(t) is the amplitude function of the input electrical signal u(t), I.sub.th is the threshold current of the LED-M, and .sub.n are the coefficients of electro-optic modulation, which are empirical constants for the LED-M type.
When this optical signal P.sub.opt 424 from LED-M 210 is expanded with the BE 220 and made incident on the FA 240, each of the FA 240's elements fluoresce differently in response. The response function of a single element of FA 240, FA.sub.out is generally described as a function of time t and wavelength band :
FA.sub.out(t,)=P.sub.opt.Math.e.sup.t/().Math..sub.p=0.sup.NH(tt.sub.p) (2)
where () is the fluorescence decay time constant for wavelength band , N is the number of incoming signal pulses, p is the index of the pulse in the sequence of pulses, t.sub.p is the time at which the p'th pulse was generated. The Heaviside function H is defined as:
(19)
where k is known as the logistic factor.
The exponential term e.sup.t/() provides the Fading Memory (FM) and the Heaviside function .sub.p=0.sup.NH(tt.sub.p) provides the Non-Linearity (NL). The sequence of the input signal (one-dimensional) is now encoded in both, time and wavelength. The tensor that describes the fluorescer array (FA) 240 is [FA].sup., as shown in
(20) All the 16 time-wavelength emission outputs are made incident on the Fresnel-Kohler Integrator (FKI), one example of integrator 260, in
(21) Due to the spectral dispersion of the Fresnel lens and convergence by the aspheric lens, the FKI 260 system as a whole creates a near-uniform illumination on the target plane () by coupling all the input sources in spectral () and temporal () dimensions in a non-linear, complex, but fixed manner. The tensor that describes the FKI 260 is [FKI].sup., as shown in
(22) FKI 260 images the signal on to the LC-SLM 280 of
(23) Light going through the LC-SLM 280 is made incident upon the PDA 290 of
(24) A copy of the PDA 290 outputs is fed into an FPGA 292 of
(25) The dimensional expansion of information and squashing works in the following manner and depicted in
(26) The dimensional compression to output nodes and training works in the following manner. Image of the FKI 260 is presented to the imaging plane 580, which is the input surface of the LC-SLM 280. The LC-SLM provides a tunable transformation with attenuation in 2 spatial dimensions, denoted as , . Since in this implementation there are only 44 segments in the LC-SLM 280, the number of elements in dimensions , is [44]=16. The tensor that describes the transformation through LC-SLM 280 is [SLM].sub..sup.. A large dimensional compression happens at this stage, since the , information is lost giving rise to the SLM tuning for attenuation. The output nodes are just the segments of the LC-SLM, and their dimensionality is , which is [44]=16. There are just 16 output nodes which need to be tuned for training of the ORC without altering the 400,000 internal nodesa fundamental feature of Reservoir Computing.
(27) The output of the LC-SLM 280 is presented to the PDA 290, which converts the optical signals back into the electrical domain. In this implementation, the PDA 290 is a matrix of 2 dimensions A, B of [33]=9 photo-diodes. The spatial information is further compressed from , : [44] to A, B: [33]. Since the photo-detectors are blind to the different wavelengths, the information is completely collapsed and integrated into the response of photo-detector. The squashing of the nodes, a typical feature of neural nets, can be applied here by under or over-saturating the photo-detector response under desired conditions. The time information is also shaped and integrated to a slower time vector T. The photo-detector transformation tensor is therefore written as [PD].sub..sup.TAB.
(28) The electrical signal after being further processed in PDA 290 is read by the FPGA 292. The information read by the FPGA has two spatial dimensionsthe plurality of PDA elements, namely A, B: [33]. It also has a temporal dimension T. In this implementation, the temporal resolution of the FPGA is 10 nano-seconds, processing signals that can be 10-110 nano-seconds widetherefore the vector T is 10 elements long. The final information matrix from FPGA has a dimensionality of 3; T,A,B: [1033].
(29) In this implementation, the dimensionality expansion and compression is summarized as follows.
[FA].sup..Math.[FKI].sup..Math.[SLM].sub..sup..Math.[PD].sub..sup.TAB[FPGA].sup.TAE (4)
(30) This is where the output weights are applied from training. The LC-SLM 280 does a resolution-compression from to , depicted by the transformation tensor [SLM].sub..sup. of
(31) Training algorithm for this device is rather simple, since the RC is all in optical domain. The input signature is u(t), which gets transcribed on the LC-SLM 280 as X(t,,x,y). The weights that are applied by virtue of the LC-SLM 280 attenuation are W(x,y). The PDA 290 outputs constitute the final read-out Y(T,x,y).
(32) Generally, if plurality is defined as P, then: P(x)>>P(x)>P(x) and P(y)>>P(y)>P(y). Also, time scale T>>time scale of t.
(33) The SP property of RC desires that for different u(t), there would be distinct classes of Y(T,x,y). The W are needed to be trained to achieve that. W is recursively trained by minimizing the error function E.
(34)
(35) In this notation, Y is the PDA 290 state and Y.sup.target is the desired state when SP is achieved. The training method iterates until SP is achieved.
(36) Regression methods are used to minimize the error function. The methods will regress on the tensor W(x,y), such that: W(xy). X=Y
(37) First, simple Linear Regression methods are tried to find W, using regular inverse and Penrose inverse:
WX=Y.Math.W=(YX.sup.T)(XX.sup.T).sup.1 (6)
WX=Y.Math.W=(YX.sup.T)(XX.sup.T).sup.+(7)
(38) For better results, Ridge Regression method is used, with a regularization parameter , such that:
W=(YX.sup.T)(XX.sup.T+I).sup.1 (8)
(39) Other well-known minimization techniques borrowed from the fields of Echo State Networks and Liquid State Machines can be used if the above methods do not produce the desired result. Training will be deemed complete when desired SP is achieved for a certain number of different signature signals.
(40)
(41)
(42) Those of ordinary skill in the art may recognize that modifications of the embodiments disclosed herein are possible. For example, a package size of an optical reservoir computing system may vary. Other modifications may occur to those of ordinary skill in this art, and all such modifications are deemed to fall within the purview of the present invention, as defined by the claims.