Optical synapses
11562221 · 2023-01-24
Assignee
Inventors
- Stefan Abel (Zurich, CH)
- Bert Jan Offrein (Schoenenberg, CH)
- Antonio La Porta (Kilchberg, CH)
- Pascal Stark (Thalwil, CH)
Cpc classification
G11C13/0011
PHYSICS
G11C11/42
PHYSICS
G06N3/0675
PHYSICS
G02F1/19
PHYSICS
G11C13/0007
PHYSICS
International classification
G02F1/19
PHYSICS
G11C11/42
PHYSICS
Abstract
An optical synapse comprises a memristive device for non-volatile storage of a synaptic weight dependent on resistance of the device, and an optical modulator for volatile modulation of optical transmission in a waveguide. The memristive device and optical modulator are connected in control circuitry which is operable, in a write mode, to supply a programming signal to the memristive device to program the synaptic weight and, in a read mode, to supply an electrical signal, dependent on the synaptic weight, to the optical modulator whereby the optical transmission is controlled in a volatile manner in dependence on programmed synaptic weight.
Claims
1. An optical synapse comprising: a memristive device for non-volatile storage of a synaptic weight dependent on resistance of the device; and an optical modulator for volatile modulation of optical transmission in a waveguide; and the memristive device and optical modulator being connected in control circuitry which is operable, in a write mode, to supply a programming signal to the memristive device to program the synaptic weight and, in a read mode, to supply an electrical signal, dependent on the synaptic weight, to the optical modulator whereby the optical transmission is controlled in a volatile manner in dependence on programmed synaptic weight.
2. The optical synapse of claim 1, wherein the control circuitry includes decoupling circuitry for electrically decoupling the optical modulator from the memristive device in the write mode.
3. The optical synapse of claim 1, wherein the memristive device is connected in a voltage divider and the electrical signal supplied to the optical modulator in the read mode is dependent on an output signal of the voltage divider.
4. The optical synapse of claim 1, wherein the memristive device and optical modulator are integrated in a monolithic integrated circuit.
5. The optical synapse of claim 1, wherein the optical modulator comprises an electro-optic modulator and the electrical signal comprises a drive voltage for the electro-optic modulator.
6. The optical synapse of claim 5, wherein the electro-optic modulator includes an optical phase shifter comprising a ferroelectric material, optically coupled to the waveguide, disposed between a pair of electrodes for applying the electrical signal, and wherein the control circuitry includes decoupling circuitry for electrically decoupling the optical modulator from the memristive device to inhibit ferroelectric domain switching in the ferroelectric material in the write mode.
7. The optical synapse of claim 6, wherein the ferroelectric material comprises one of barium titanate, lithium niobate, and lead zirconate titanate.
8. The optical synapse of claim 6, wherein the memristive device and optical modulator are integrated in a monolithic integrated circuit and the memristive device is formed on one of the electrodes.
9. The optical synapse of claim 6, wherein the memristive device and optical modulator are integrated in a monolithic integrated circuit and the memristive device is formed on a ferroelectric layer.
10. The optical synapse of claim 1, wherein the optical modulator comprises a thermo-optic modulator and the electrical signal comprises a drive current for a heater of the thermo-optic modulator.
11. The optical synapse of claim 10, wherein the thermo-optic modulator includes an optical phase shifter and the heater comprises a metal layer, in thermal contact with the waveguide, disposed between a pair of contacts for applying the electrical signal.
12. The optical synapse of claim 11, wherein the memristive device and optical modulator are integrated in a monolithic integrated circuit and the memristive device is formed on one of the contacts.
13. The optical synapse of claim 1, wherein the optical modulator comprises a Mach-Zehnder interferometer.
14. The optical synapse of claim 1, wherein the optical modulator comprises a plasmonic modulator.
15. The optical synapse of claim 1, wherein the control circuitry includes synapse control logic, responsive to synaptic control signals, which is operable to vary, in dependence on the synaptic control signals, electrical signals supplied to the optical modulator in the read mode to implement a desired short-term plasticity effect.
16. The optical synapse of claim 15, wherein: the waveguide is arranged to transmit optical input signals from a pre-synaptic node to a post-synaptic node of a neuromorphic network in which the post-synaptic node transmits optical output signals in dependence on the optical input signals received thereby; and the synaptic control signals are dependent on at least one selected from a group consisting of: the optical input signals, and the optical output signals.
17. The optical synapse of claim 15, wherein the synapse control logic is further operable to vary, in dependence on the synaptic control signals, programming signals supplied to the optical modulator in the write mode to implement a desired long-term plasticity effect.
18. The optical synapse of claim 17, wherein: the waveguide is arranged to transmit optical input signals from a pre-synaptic node to a post-synaptic node of a neuromorphic network in which the post-synaptic node transmits optical output signals in dependence on the optical input signals received thereby; and the synaptic control signals are dependent on at least one selected from a group consisting of: the optical input signals, and the optical output signals.
19. A neuromorphic network comprising a plurality of nodes in which pairs of nodes are interconnected via respective waveguides for transmission of optical signals between nodes of each pair, wherein each waveguide includes an optical synapse comprising: a memristive device for non-volatile storage of a synaptic weight dependent on resistance of the device; and an optical modulator for volatile modulation of optical transmission in the waveguide; and the memristive device and optical modulator being connected in control circuitry which is operable, in a write mode, to supply a programming signal to the memristive device to program the synaptic weight and, in a read mode, to supply an electrical signal, dependent on the synaptic weight, to the optical modulator whereby the optical transmission is controlled in a volatile manner in dependence on programmed synaptic weight.
20. The neuromorphic network of claim 19, wherein the control circuitry of each synapse includes decoupling circuitry for electrically decoupling the optical modulator from the memristive device of the synapse in the write mode.
21. The neuromorphic network of claim 19, wherein the memristive device of each synapse is connected in a voltage divider and the electrical signal supplied to the optical modulator of the synapse in the read mode is dependent on an output signal of the voltage divider.
22. The neuromorphic network of claim 19, wherein the optical modulator of each synapse comprises an electro-optic modulator and the electrical signal comprises a drive voltage for the electro-optic modulator.
23. The neuromorphic network of claim 19, wherein the optical modulator of each synapse comprises a thermo-optic modulator and the electrical signal comprises a drive current for a heater of the thermo-optic modulator.
24. The neuromorphic network of claim 19, wherein the control circuitry of each synapse includes synapse control logic, responsive to synaptic control signals, which is operable to vary, in dependence on the synaptic control signals, electrical signals supplied to the optical modulator in the read mode to implement a desired short-term plasticity effect.
25. The neuromorphic network of claim 24, wherein the synapse control logic is further operable to vary, in dependence on the synaptic control signals, programming signals supplied to the optical modulator of the synapse in the write mode to implement a desired long-term plasticity effect.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
DETAILED DESCRIPTION
(13) The schematic of
(14) The synapse of
(15) The programmable resistance of memristive device 2 may exploit a variety of physical mechanisms well-known in the art, including filamentary switching, electrochemical switching, ferroelectric switching and resistance properties of PCM materials. Device 2 may comprise one or more resistive memory elements, or cells, such as PCM cells and resistive RAM (RRAM) cells, including oxide/metal-oxide RRAM cells, conductive bridge RRAM cells and carbon RRAM cells. The basic operating principle of such cells relies on the reversible, non-volatile change in resistance characteristics of one or more material layers disposed between two electrodes. The overall resistance, and hence conductivity of the cell, can be varied by application of programming pulses via the electrodes. By way of example,
(16) Numerous physical mechanisms, including migration of metal ions, oxygen ions, metal precipitates or graphene clusters through various material layers, as well as Joule heating of PCM materials, may be employed in resistive memory elements. One or more cells can be arranged in a variety of known circuit configurations to provide desired programmable resistance characteristics. In general, therefore, memristive device 2 may comprise one or more resistive memory cells of any desired type, and device properties can be readily tuned to give desired weight-storage characteristics.
(17) Optical modulator 3 may be an absorptive or refractive modulator whereby optical transmission in waveguide 4 is modulated via volatile variation of an absorption coefficient or refractive index (i.e. the real part of the complex refractive index) of the waveguide. Preferred embodiments exploit refractive optical modulators. These can be efficiently implemented with optical phase shifters which vary the phase of light in a portion of the waveguide by refractive index variation controlled by the electrical drive signal V.sub.drive or I.sub.drive. The resulting phase modulation can be converted to amplitude modulation, for example by an interferometer.
I.sub.out=I.sub.in[1+cos(2π/(n.sub.a−n.sub.b)/λ)]/2
where I.sub.in and I.sub.out are the optical input and output intensity respectively, and λ is the wavelength of the transmitted light.
(18) Refractive index modulation in phase shifter 23 may exploit an electro-optic or thermo-optic effect.
(19) Ferroelectric materials such as BTO exhibit a change in refractive index n in the presence of an applied electric field E according to:
n(E)=n−rn.sup.3E/2−n.sup.3E.sup.2/2
where the term rn.sup.3E/2 denotes the electro-optic (Pockels) effect with Pockels coefficient r, and the term ξn.sup.3E.sup.2/2 denotes the Kerr effect with Kerr constant ξ. The Pockels effect dominates in such materials, and refractive index variation in the presence of a static bias voltage V.sub.drive can be expressed as:
(20)
where
(21)
results from me Pockels effect. By way of example, for a static field and 45° waveguide orientation relative to the main crystalline axes of BTO,
(22)
(23)
(24) By way of example, memristive device 31 may be implemented by an RRAM memory cell with a resistance range of 10 kΩ to 100 kΩ. Programming of device resistance R.sub.1 in this range can be effected by a pulse generator generating different numbers p of programming pulses, e.g. 10 ns pulses of amplitude in the range 2V to 4V, in a pulse train V.sub.W in the write mode. The read voltage V.sub.R is set to a sufficiently low level, e.g. 0.2V, to avoid changing the programmed state of device 31 in the read mode. With this configuration, V.sub.O=0.07V to 0.17V in the read mode, and V.sub.drive=A.sub.1.Math.A.sub.2.Math.V.sub.O=1.82V to 4.42V with R.sub.3=1 kΩ and R.sub.4=25 kΩ.
(25) The voltage divider of the synapse control circuitry allows the memristive device output to be tuned to the desired operating range of the optical phase shifter for the read operation. The decoupling circuitry in synapse 30 inhibits transfer of programming pulses to optical phase shifter 23, protecting the modulator from potentially adverse effects of these pulses. In particular, a potential problem with use of ferroelectric Pockels materials in phase shifter 23 is that the high-voltage pulses V.sub.W can cause polarization flipping in the ferroelectric domains of these materials, causing a non-volatile change in refractive index. To inhibit this ferroelectric domain switching, the applied bias voltage must stay either positive or negative, and the programming pulses must be decoupled from the phase-shifter electrodes. The control circuitry of
(26)
(27) Application of drive current I.sub.drive to heater 41 causes a change ΔT in temperature T of waveguide 43 and a consequent change in refractive index n of the silicon. The change ΔT in waveguide temperature increases with temperature change ΔT.sub.H of the heater, where ΔT.sub.H∝(I.sub.drive).sup.2R.sub.H, with R.sub.H being resistance of the heater (which may itself be temperature dependent). The resulting refractive index of the silicon waveguide can be approximated as:
(28)
where
(29)
is me thermo-optic coefficient. As illustration, for a silicon waveguide at room temperature and with wavelength
(30)
(31) An optical synapse using the
(32) The memristive device and optical modulator can be readily integrated with the synapse control circuitry in a monolithic integrated circuit as indicated schematically in
(33)
(34) The optical synapses described above can be fabricated using well-known material processing techniques. These synapses can be fabricated as integrated photonic structures for neuromorphic networks in which arrays of optical synapses implement the vector-matrix computations required for propagation of weighted signals over successive layers of the network. Control signals for programming and read mode operation may be generated by global signal generators in these structures. Such integrated synapse arrays offer extremely high-speed, low power implementations of neuromorphic networks.
(35) While exemplary components are described above for efficient integrated synapse structures, synapses embodying the disclosure may use various other components. For example, electro-optic phase shifters may employ other ferroelectric materials, such as lithium niobate or PZT (lead zirconate titanate), and may exploit the Pockels and/or Kerr effect for refractive index modulation. Electro-optic phase-shifters can also exploit other mechanisms, such as PIN (p-type, intrinsic, n-type) diode structures, for refractive index variation. Optical modulators can also be implemented in other ways, e.g. using directional couplers and optical resonators such as ring resonators. Modulators may include additional material layers and may also vary other optical properties, e.g. optical absorption, as will be apparent to those skilled in the art. In all implementations, characteristics of the non-volatile electrical and volatile optical subsystems can be tuned independently for desired synaptic performance.
(36) While embodiments described above use photonic modulators, plasmonic modulators may be used in other embodiments. The structures can operate at very low voltages and can be very small.
(37) Independence of the electrical and optical subsystems may also be exploited to implement desired synaptic plasticity effects. Such effects will be explained in more detail with reference to
(38) Synaptic plasticity effects may be implemented in networks employing synapses embodying the disclosure as illustrated schematically in
(39) Synapse control logic 82 can also be adapted to vary programming signals supplied to the optical modulator in the write mode in dependence on synaptic control signals from the detectors. Here, control logic 82 can vary the programming signals to implement a desired long-term plasticity effect. Programming signals can be varied by controlling one or a combination of the number, amplitude and duration of pulses V.sub.W supplied to memristive device in the write mode, thereby varying the long-term synaptic weight w. Again, such an LTP effect may in general depend on synaptic control signals from one or both of detectors D.sub.pre, D.sub.post. For example, the LTP effect of
(40) Synapse control logic 82 may be implemented, in general, by hardware or software or a combination thereof and suitable implementations will be apparent to those skilled in the art. By dynamically adjusting operation in this way, the non-volatile weighting and volatile optical modulation in synapse 80 can be independently tuned to implement desired long- and short-term synaptic dynamics.
(41) The descriptions of the various embodiments of the present disclosure have been presented for purposes of illustration, but are not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement over technologies found in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.