NEUROMORPHIC HARDWARE APPARATUS BASED ON A RESISTIVE MEMORY ARRAY

Abstract

A neuromorphic hardware apparatus based on a resistive memory array includes a resistive memory array in which a plurality of synaptic resistor elements are arranged. Each synaptic resistor element is changed in its resistance value depending on a voltage pulse applied thereto and stores the resistance value for a predetermined time. The apparatus also includes a neuron circuit configured to receive an output signal from the resistive memory array and to output a voltage signal to another resistive memory array. The neuron circuit includes a temperature compensation unit, which compensates for an output voltage of the resistive memory array on the basis of an operating temperature of the resistive memory array. Even when a resistive memory array outputs an abnormal output depending on an operating temperature, by compensating a neuron circuit for an input value, it is possible to prevent an operation error from occurring.

Claims

1. A neuromorphic hardware apparatus based on a resistive memory array, the neuromorphic hardware apparatus comprising: a resistive memory array in which a plurality of synaptic resistor elements are arranged, each synaptic resistor element being changed in its resistance value depending on a voltage pulse applied thereto and storing the resistance value for a predetermined time; and a neuron circuit configured to receive an output signal from the resistive memory array and output a voltage signal to another resistive memory array, wherein the neuron circuit includes a temperature compensation unit, which compensates for an output voltage of the resistive memory array on the basis of an operating temperature of the resistive memory array.

2. The neuromorphic hardware apparatus of claim 1, wherein the resistive memory array is arranged in the form of a crossbar array, and the temperature compensation unit is connected to an output terminal of each column of the resistive memory array.

3. The neuromorphic hardware apparatus of claim 2, wherein the temperature compensation unit includes a transimpedance amplifier (TIA) which performs amplification by converting a current signal into a voltage signal.

4. The neuromorphic hardware apparatus of claim 3, wherein a feedback resistor of the transimpedance amplifier is an element, which has the same property as operating property of the resistive memory array depending on a temperature, by having a value according to the following equation: $R_F\left(T\right)=\frac{R_0}{\alpha \left(T\right)}$ where R.sub.F(T) is a feedback resistance value at the operating temperature, R.sub.o is an initial resistance value of the feedback resistor at a room temperature, and α(T) is a set value based on operating temperature data of the feedback resistor.

5. The neuromorphic hardware apparatus of claim 4, wherein the neuron circuit comprises: an ADC converter configured to receive an output voltage compensated for by the temperature compensation unit and convert the received output voltage into a digital voltage signal; an activation function unit configured to apply an activation function of a neuron to the digital voltage signal; and a pulse generator configured to output a voltage signal to be transferred to the another resistive memory array.

6. A neuromorphic hardware apparatus based on a resistive memory array, the neuromorphic hardware apparatus comprising: a resistive memory array in which a plurality of synaptic resistor elements are arranged, each synaptic resistor element being changed in its resistance value depending on a voltage pulse applied thereto and storing the resistance value for a predetermined time; a neuron circuit configured to receive an output signal from the resistive memory array and output a voltage signal to another resistive memory array; and a temperature compensation unit connected to the resistive memory array and configured to compensate for an output voltage of the resistive memory array on the basis of an operating temperature of the resistive memory array and input the compensated output voltage to the neuron circuit.

7. The neuromorphic hardware apparatus of claim 6, wherein the resistive memory array is arranged in the form of a crossbar array, and the temperature compensation unit is connected to an output terminal of each column of the resistive memory array.

8. The neuromorphic hardware apparatus of claim 7, wherein the temperature compensation unit includes a transimpedance amplifier (TIA), which performs amplification by converting a current signal into a voltage signal.

9. The neuromorphic hardware apparatus of claim 8, wherein a feedback resistor of the transimpedance amplifier is an element, which has the same property as operating property of the resistive memory array depending on a temperature, by having a value according to the following equation: $R_F\left(T\right)=\frac{R_0}{\alpha \left(T\right)}$ where R.sub.F(T) is a feedback resistance value at the operating temperature, R.sub.o is an initial resistance value of the feedback resistor at a room temperature, and α(T) is a set value based on operating temperature data of the feedback resistor.

10. The neuromorphic hardware apparatus of claim 9, wherein the neuron circuit comprises: an ADC converter configured to receive an output voltage compensated for by the temperature compensation unit and convert the received output voltage into a digital voltage signal; an activation function unit configured to apply an activation function of a neuron to the digital voltage signal; and a pulse generator configured to output a voltage signal to be transferred to the another resistive memory array.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0030] FIG. 1 is a diagram schematically illustrating neuron circuits, which configure a hardware apparatus of the present disclosure.

[0031] FIG. 2 is a diagram schematically illustrating the configuration of current sensing circuits of FIG. 1.

[0032] FIG. 3 is a diagram illustrating a measured value Mea. in which a conductance G of a resistive element follows the Arrhenius equation depending on a temperature.

[0033] FIG. 4 is a cumulative probability graph for conductance, depending on a temperature variation, of resistive elements having a specific resistance value in an array as shown, illustrating simulation data obtained by applying a temperature variation model measured in a single element.

[0034] FIG. 5 is a diagram showing that the distribution of a current as the output of a resistive memory array abnormally increases depending on a variation in operating temperature.

[0035] FIGS. 6 and 7 are diagrams illustrating transmission paths of output currents of resistive memory arrays.

[0036] FIG. 8 is a diagram illustrating a resistive memory array and a temperature compensation unit according to an embodiment of the present disclosure.

[0037] FIG. 9 is a diagram illustrating an array output current, which abnormally increases, and illustrating a feedback resistance value, which is adjusted depending on a temperature.

[0038] FIG. 10 is a diagram comparing operations of 10 output layer neurons when a specific MNIST handwritten image is inputted to a hardware neural network.

[0039] FIG. 11 is a graph illustrating the cumulative distribution function of the operations of neurons for 100 test image inputs.

[0040] FIG. 12 is a graph comparing the accuracies of entire neuromorphic hardware depending on a temperature.

DESCRIPTION OF SPECIFIC EMBODIMENTS

[0041] In order to fully understand the present disclosure and operational advantages of the present disclosure and objects attained by practicing the present disclosure, reference should be made to the accompanying drawings that illustrate embodiments of the present disclosure and to the description in the accompanying drawings. When a component, device, element, or the like of the present disclosure is described as having a purpose or performing an operation, function, or the like, the component, device, or element should be considered herein as being “configured to” meet that purpose or to perform that operation or function.

[0042] In describing embodiments of the present disclosure, known technologies or repeated descriptions may be reduced or omitted to avoid unnecessarily obscuring the gist of the present disclosure.

[0043] FIG. 1 is a diagram schematically illustrating neuron circuits, which configure a hardware apparatus of the present disclosure. FIG. 2 is a diagram schematically illustrating the configuration of current sensing circuits of FIG. 1 and FIGS. 6 and 7 are diagrams illustrating transmission paths of output currents of resistive memory arrays.

[0044] FIG. 8 is a diagram illustrating a resistive memory array and a temperature compensation unit according to an embodiment of the present disclosure.

[0045] Hereinafter, a neuromorphic hardware apparatus based on a resistive memory array according to an embodiment of the present disclosure is described with reference to FIGS. 1-8.

[0046] The neuromorphic hardware apparatus based on a resistive memory array of the present disclosure configures an artificial neural network for machine learning and comprises neuron circuits and a resistive memory array serving as a synapse element, which connects the neuron circuits.

[0047] The neuron circuit receives a current signal from the resistive memory array, converts the current signal into a digital voltage signal, and, after activation processing, outputs a voltage signal to a next resistive memory array.

[0048] In other words, as shown in FIG. 1, the neuron circuit converts an input current into a digital voltage signal by an ADC converter, applies an activation function of a neuron to the converted digital voltage signal in an activation function unit, and outputs a voltage signal to be transferred to a next resistive memory array in a pulse generator.

[0049] A resistive memory array 110, as shown in FIG. 8, comprises a plurality of rows and a plurality of columns in the form of a crossbar array. The resistive memory array 110 generates a current by performing matrix-vector multiplication (MVM) by an applied voltage and transfers the generated current to the neuron circuit.

[0050] In the resistive memory array 110 in the form of a crossbar array, a plurality of synaptic resistor element 111 are coupled and arranged between row lines and column lines. Each synaptic resistor element 111 is an element whose resistance value linearly varies depending on an applied voltage and each synaptic resistor element 111 has a property of storing the resistance value for a predetermined time.

[0051] However, the conductance of the synaptic resistor element 111 varies depending on an operating temperature and an output current value varies depending on the varied conductance.

[0052] In this way, when an output current is abnormally generated, the artificial neural network cannot be stably operated.

[0053] In order to cope with this problem, the neuron circuits of the present disclosure include current sensing circuits and each current sensing circuit includes a temperature compensation unit 210. The temperature compensation unit 210 compensates for an output current depending on a temperature and inputs the compensated output current to the neuron circuit.

[0054] The temperature compensation unit 210 may be configured between the neuron circuit and the resistive memory array 110, separately from the neuron circuit.

[0055] The current sensing circuit includes the temperature compensation unit 210, a sense amplifier, and a temperature dependent element.

[0056] Therefore, in contrast to that a current from a resistive memory array 110 is inputted to a neuron circuit as shown in FIG. 6, a current is compensated for by the temperature compensation unit 210 and the compensated current is inputted to a neuron circuit as shown in FIG. 7.

[0057] When a current signal is converted into a voltage signal, the sense amplifier functions to regulate the amplification of a signal by adjusting a gain.

[0058] The temperature dependent element is an element whose conductance varies depending on a temperature and thus the temperature dependent element may sense the degree of a temperature variation.

[0059] The temperature compensation unit 210 is connected to each column of the resistive memory array 110 as shown in FIG. 8. The temperature compensation unit 210 may be a transimpedance amplifier (TIA)-current to voltage converter, which performs amplification by converting a current signal into a voltage signal. The temperature compensation unit 210 automatically adjusts a resistance value of the resistive memory array 110 by a feedback resistor R.sub.F depending on a temperature variation, so as to compensate for an output voltage.

[0060] In more detail, a conductance G of the synaptic resistor element 111 varies in proportion to α(T) depending on a temperature as in Equation 1.

G(T)=G.sub.0.Math.α(T)  [Equation 1]

[0061] An output current I(T) by the temperature compensation unit 210 is as follows.

I(T)=ΣVG(T)=α(T)ΣVG.sub.0  [Equation 2]

[0062] When the feedback resistor 211 is set as in the following Equation 3, an output voltage V.sub.TIA(T) by the temperature compensation unit 210 is outputted regardless of α(T), as in Equation 4.

[00003]$\begin{array}{cc}{R}_F\left(T\right)=\frac{R_0}{\alpha \left(T\right)}& \left[\mathrm{Equation}3\right]\end{array}$

[0063] Here, R.sub.o is a total resistance value of each column of a resistive memory array 110, R.sub.F varies depending on a, and a is a set value based on operating temperature data of the resistive memory array 110.

V.sub.TIA(T)=R.sub.F(T)×ΣVG(T)=R.sub.0ΣVG.sub.0  [Equation 4]

[0064] Namely, based on an element having temperature dependence of reaction such as the synaptic resistor element 111, output is performed as the output voltage V.sub.TIA(T) is amplified by the reciprocal term of α(T) in the transimpedance amplifier.

[0065] As such, when the conductance G of the synaptic resistor element 111 in the resistive memory array 110 is changed by α(T) times an existing conductance Go, an output current of a specific line of the resistive memory array 110 is also changed by α(T) times an existing output current I.sub.o. In this way, the temperature compensation unit 210 compensates for an abnormal output current of the resistive memory array 110, by amplifying or scaling the abnormal output current by 1/α(T) before the abnormal output current is inputted to a neuron circuit. Accordingly, an output voltage is stably outputted without being affected by a temperature and is normally transferred to the neuron circuit.

[0066] FIGS. 9-12 show simulation results compared with a case where there is no temperature compensation unit, in order to verify the effect of the temperature compensation unit 210. Through these simulation results, it may be seen that, even when a temperature rises, a network stably operates as in an operation under a room temperature.

[0067] FIG. 9 is a diagram illustrating an array output current, which abnormally increases, and illustrating a feedback resistance value, which is adjusted depending on a temperature. It may be seen that by a resultant compensation effect, an output (blue) of a neuron is constantly maintained depending on a temperature.

[0068] FIG. 10 is a diagram comparing operations of 10 output layer neurons when a specific MNIST handwritten image is inputted to a hardware neural network. It may be seen that outputs, when there is no temperature compensation unit, do not recognize a correct answer. By contrast, outputs, when there is a temperature compensation unit 210, recognize the signal of a neuron numbered 8 as a strongest correct answer.

[0069] FIG. 11 is a graph illustrating the cumulative distribution function of the operations of neurons for 100 test image inputs. It may be seen that, even when a temperature rises, the output of a neuron operates in a normal region due to the effect of the temperature compensation unit 210.

[0070] FIG. 12 is a graph comparing the accuracies of entire neuromorphic hardware depending on a temperature. It may be seen that an accuracy rapidly decreases depending on a temperature when there is no temperature compensation unit but an accuracy is maintained even when a temperature rises when there is a temperature compensation unit 210.

[0071] As is apparent from the above description, according to the neuromorphic hardware apparatus based on a resistive memory array 110 of the present disclosure, even when a resistive memory array 110 outputs an abnormal output depending on an operating temperature, by compensating a neuron circuit for an input value, it is possible to prevent an operation error from occurring. This results in a stable operation of an artificial neural network.

[0072] While the present disclosure has been described with reference to the accompanying drawings, it should be apparent to those having ordinary skill in the art that various changes and modifications can be made without departing from the spirit and scope of the present disclosure without being limited to the embodiments disclosed herein. Accordingly, it should be noted that such alternations or modifications fall within the claims of the present disclosure, and the scope of the present disclosure should be construed on the basis of the appended claims.