Figures
Abstract
In this work, we propose a new memristor SPICE model that accounts for the typical synaptic characteristics that have been previously demonstrated with practical memristive devices. We show that this model could account for both volatile and non-volatile memristance changes under distinct stimuli. We then demonstrate that our model is capable of supporting typical STDP with simple non-overlapping digital pulse pairs. Finally, we investigate the capability of our model to simulate the activity dependence dynamics of synaptic modification and present simulated results that are in excellent agreement with biological results.
Citation: Li Q, Serb A, Prodromakis T, Xu H (2015) A Memristor SPICE Model Accounting for Synaptic Activity Dependence. PLoS ONE 10(3): e0120506. https://doi.org/10.1371/journal.pone.0120506
Academic Editor: Gennady Cymbalyuk, Georgia State University, UNITED STATES
Received: October 30, 2014; Accepted: January 23, 2015; Published: March 18, 2015
Copyright: © 2015 Li et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper.
Funding: 1. National Natural Science Foundation of China, 61171017, http://www.nsfc.gov.cn/. L.Q. and X.H. 2. Engineering and Physical Sciences Research Council EP/K017829/1, http://www.epsrc.ac.uk/. A.S. and T.P. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Recently, it has been demonstrated that the memristor is a promising candidate for implementing single device based artificial synapses [1–4] as its memristance depends not only on instantaneous external inputs but also on its past history [5]. Furthermore, the capability of single memristors to exhibit key ‘synapse-like’ behaviors such as long-term potentiation (LTP), long-term depression (LTD), and even spike-timing-dependent plasticity (STDP) have been experimentally demonstrated in solid-state memristive devices [1–4].
What is missing is an empirical model that is capable of capturing the experimentally observed synaptic behaviors. The availability of such model would greatly facilitate the development of memristor-based neuromorphic applications [6], [7]. Current established memristor models [8], [9] only feature non-volatile internal state variables [3], [10]. As a result, they can only partially capture the rich variety of observed ‘synapse-like’ characteristics when biased with specifically designed overlapping spike-like waveforms [11], which requires additional complex circuits to generate.
We have previously proposed a memristor model to account for the volatile memristance dynamics [3]. Here, we further improve this model by incorporating a synaptic activity dependence module. Moreover, it is worth highlighting that our new model can simulate both typical STDP [12], [13] and LTD/LTP dependence on spike-pair frequency [14] within the context of simple, non-overlapping digital pulse pair stimulation. This has significant ramifications for memristor-based neuromorphic applications as it enables a reduction in circuitry complexity and power dissipation.
In this paper, we first show that our model, with all extra features, can still produce the memristor signature I-V pinched-hysteresis loop. We then show that the model could account for both volatile and non-volatile memristance changes in response to stimuli with appropriately defined amplitude and width. Then, we exploit the model for simulating pair-based STDP behavior and exploring its dependence on the input pulse width, amplitude and model parameters. Finally, we monitored the overall memristance change after the application of a bipolar pulse-pair train as a function of the pulse-pair frequency, with simulation results correlating well with synaptic activity dependence (i.e. the phenomenon of synaptic modification dependence on overall pre/post spike frequency) as observed in biological synapses [14].
Activity Dependence Model
The model examined in this work consists of five modules (Fig. 1), which are easy to implement in a SPICE environment.
Parameters utilized in simulations are: Ron = 1Ω, Roff = 100kΩ, Rinit = 5kΩ, ε = 106, Cx = 5mF, Rx = 1Ω, Cy = 0.15F, Cz = 1F, Rz = 3mΩ, Cw = 1F, Rw = 0.35Ω, B+ = −B− = 0.35nV, k = 0.33e10, α = 0.706, β = 1e8, γ = 2, p = 0.5, j = 2 and m = 0.62. The initial condition of four internal variables are set as x0 = y0 = (Roff − Rinit) / (Roff − Ron), and z0 = w0 = 0.
Module I
Interface: In module I, the memristance of the modelled device as seen by external circuitry is generated by a series combination of the fixed Ron resistor and a voltage-controlled voltage source Emem, whose terminal voltage is controlled by node potential vx ∊ [0,1] of the module II as:
(1)
Module II
Instantaneous memristance: The purpose of modules II-V is only to solve differential equations and thus have no physical equivalent in the system. In contrast to Biolek’s memristor model [8], module II features a leak path to account for volatile dynamics and specified by the values of Cx and Rx. In the absence of external stimuli, the instantaneous memristance decays exponentially to the resting memristance (defined by vy in module V) as:
(2)
where f(vx) is a rectangular window function defined in [9] that confines the instantaneous memristance Rmem within the [Mmin,Mmax] interval. The window function takes the value f(M) = 1 in the interval M ∊ (0,1), but for M ∊ {0,1}, vx is restricted to changing towards the inside of the allowed memristance interval. ε is a constant that is inherited from Biolek's μv/(2D2) constant parameter [8] and is effectively a `lumped constant' that introduces the effects of device geometry and fabrication into the system of equations.
Module III
Driving effort: Cz and Rz form a leaky integrator with state variable vz integrating all external driving efforts, in this case the external driving voltage across the memristor vmem as:
(3)
Module IV
Activity dependence: In practical memristors, Joule heating is expected to significantly affect memristor dynamics as it would determine the annihilation of conductive percolation channels within active cores [15], [16]. Thus, we included within our model a new, activity dependence module to account for the influence of activity-dependent thermal accumulation on memristor dynamics [16]. This is implemented by introducing state variable vw, which integrates the absolute power dissipation via a leaky progress defined by Cw and Rw as:
(4)
Module V
Resting memristance: Purpose-built functions allow the driving variable vz and activity dependence variable vw plug into the system and influence the resting memristance as:
(5)
Function f(vy) is the rectangular window function that restricts vy within the maximum/minimum memristance limits and is also used in module II.
Function ϕ determines the dependence of resting memristance on the driving effort being applied to the device. In this manuscript, we modified Pershin’s threshold window function [9] to allow the definition of two distinct operating regions. Specifically, when the effort variable vz lies in within the positive and negative bipolar thresholds B+ and B−, the memristor would be operated in ‘sub-threshold mode’ and the resting memristance would not change at all. In contrast, when vz is above B+ or below B−, the memristor would operate in bipolar mode where the values of ϕ would be in proportion to the amount by which the effort exceeds the bipolar threshold in both directions. Function ϕ is given by:
(6)
Where k is a scaling constant and m is the factor that determines the specific curve shape.
Function h determines the influence of the activity dependence variable (vw) on resting memristance. In this manuscript, the specific form of function h is set up based on activity dependence data of biological synapses as per [14]. We constructed a two-valued function that depends on the sign of the driving effort variable vz, as:
(7)
Where a, β, γ are the scaling constants, while p and j set up the specific curve shape.
Finally, it is worth stressing that in our model, windowing, drivability and activity dependence operate on vy in a multiplicative fashion in order to render the system less complicated whilst still allowing the exhibition of important biomimetic behavior.
Results and Discussion
3.1. Memristive I-V response
To verify the memristive characteristics of our proposed model, we employed a sinusoid stimulus at two different frequencies. The attained pinched hysteresis I-V curves shown in Fig. 2A are the typical fingerprint of bipolar resistive switching [5], with the loop area shrinking at higher frequency (10ω0). The corresponding resistance response is illustrated in Fig. 2B with results demonstrating that the prominence of resistive switching is significantly reduced at higher frequencies, which correlates with memristor theory.
(a) Simulated pinched hysteresis I-V responses at frequencies of ω0 and 10ω0. (b) Corresponding memristance as a function of applied voltage.
3.2. Volatile and non-volatile memristance dynamics
One of the typical characteristics of memristive devices is the non-volatile resistance change under external stimuli [5], [17]. However, this may not always apply for practical devices. Recently, it has been experimentally demonstrated that under weak stimulus, memristance could be driven into a temporary state and then decay back to the original level [3], [18]. Thus, in our proposed model, both volatile and non-volatile resistance dynamics have been taken into consideration.
Initially, we explore the volatile response of the model by applying relatively weak stimuli. Fig. 3A illustrates the normalized volatile conductance change in response to three positive pulses (4V, 10μs) and its dependence on pulse intervals. Conductance initially increases (during each pulse stimulus) and subsequently decays towards its original value (between stimuli). Moreover, the volatile dynamics are sensitive to the employed pulse interval, as we have experimentally demonstrated previously [3].
For both cases, pulse amplitude and width were fixed at 4V, 10μs and the system remains fully volatile. (b) Transition from volatile to non-volatile dynamics due to a change in pulse width (10 μs to 20μs). (c) Transition from volatile to non-volatile dynamics due to a change in pulse amplitude (4V to 6V).
We further explore the model to evaluate non-volatile memristance dynamics under stronger driving efforts. In specific, the stronger driving efforts were implemented via increasing either pulse width (10 μs to 20μs) or amplitude (4V to 6V) with results demonstrated in Fig. 3B and 3C, respectively. In both cases, the volatile dynamics now transfer to non-volatile change at the 3rd pulse event. This phenomenon stems from the different mechanisms that produce the rates of change of volatile variable vx and non-volatile variable vy. In case of weak stimuli, the rate of change of vx is relatively larger and that accentuates the volatile dynamics. In contrast, when biased with stronger stimuli, the elevated rate of change of non-volatile variable vy would outweigh that of vx and the contribution of the volatile decay circuit (Cx and Rx) would thus become insignificant. In this case, the model resembles a Biolek-type, fully non-volatile SPICE model more closely.
3.3. Spike-timing-dependent plasticity
We also employed bipolar digital pulse pairs to represent spike pairs, as depicted in Fig. 4A. In each specific pair, the ‘Pre’- and ‘Post’- spikes were represented by a positive and a negative pulse respectively with magnitude A and width twidth, while the inter-pulse interval (IPI) was set to tgap. Initially, we employed single pulse pairs whilst sweeping IPI between −50ms and 50ms in steps of 0.5ms to demonstrate the capability of our model in capturing STDP, and the dependence of STDP on pulse width and magnitude. The STDP curves shown in Fig. 4B were attained by varying pulse widths (8μs, 9μs and 10μs) at fixed a amplitude of 2V, while the results of Fig. 4C were attained by varying pulse potentials (1.5V, 2.0V and 2.5V) at a fixed pulse width of 10μs. In both cases, the conductance changes were calculated based on the initial and final values of non-volatile memristance (vy) in each simulation cycle. Clearly, both pulse width and magnitude significantly affect the pair-based STDP, which are attributed to the threshold switching characteristics of our model. In specific, when relatively ‘weak’ (in both pulse width and magnitude) stimuli are employed, the drive effort variable vz cannot exceed the bipolar switching thresholds (B+ and B−) and thus no significant potentiation or depression is observed for all IPI values. In contrast, when the pulsing width or magnitude was increased to values where vz could exceed these thresholds, good quality STDP curves could be attained to resemble the biological ones presented by Bi and Poo [12], [13]. This set of results is in agreement with experimental data captured from TiO2-based solid-state memristors that we have published previously in [19]. It should be noted that the peaks of the STDP curve in Fig. 4B and 4C are rather flat indicating that at short intervals, the influence of the second pulse in the pair on drive effort variable vz is completely counteracted by the still-present effects of the first pulse.
A, twidth, and tgap represent pulse magnitude, width, and inter-pulse interval. For all bipolar pulse pair-based simulations, we use m = 1 in function ϕ of module V. All other parameters were kept same as previously stated values. (b) and (c) Simulated STDP results for varying stimulus width and amplitude. (d) STDP results for varying Rz values indicating different decay constants of the STDP curve with increasing inter-pulse interval.
We further explored the impact of driving effort module circuit parameters on STDP. Notably, the time constant of the Rz / Cz leaky integrator is given by:
(8)
Fig. 4D illustrates simulated STDP curves with varying Rz in the driving effort module at pulse amplitude and width of 2V, 10μs respectively. It is clear that distinct Rz values can significantly affect both the peak amplitudes and the decay constants of the STDP curve. In case of larger Rz (5mΩ), drive effort leakage is limited, thus the corresponding STDP curve will attain higher STDP peak amplitude and decay more slowly as absolute IPI increases. In contrast, a smaller Rz (5mΩ) would accelerate leakage and result in low STDP peak amplitude and faster decay with IPI.
As a result of the construction of the driving effort module, our model tends to respond symmetrically to positive and negative pulses, which results in the symmetric STDP curves in Fig. 4. Nonetheless, it has been demonstrated that synapses possess temporally asymmetric STDP, i.e. respond distinctly to pre-post and post-pre spiking patterns [12], [13]. Moreover, the STDP curves attained from practical memristive devices are also asymmetric [20]. Therefore, we further expand this model to break the STDP symmetry by dividing the driving effort module into two individual sub-modules responding differently to opposite pulse polarities. As illustrated in Fig. 5A, two individual driving modules were set up to process positive and negative inputs separately. The overall driving effort variable vz is now given by:
(9)
The overall drive effort variable vz equals the sum of vz+ and vz−. (b) and (c) Asymmetric STDP curves attained by employing different resistance values in the two driving sub-modules and modifying bipolar threshold values (B+ = 0.31nV, B− = −0.27nV) to compensate for STDP curve drift. Inset: Corresponding STDP curves with original bipolar threshold values (B+ = −B− = 0.35nV).
The STDP asymmetry arises by using different Rz values in the two sub-modules. Nonetheless, it should be noted that changing Rz values results in STDP curve drift. For example, a decrease in Rz+ tends to shift the entire STDP curve downwards whilst a decrease in Rz− has the opposite effect as depicted in the inset of Fig. 5B and 5C. In our model, we compensate for STDP curve drift by optimizing the threshold for each set of Rz± components and input pulse specifications. Specifically, we balanced the STDP curve back to zero in Fig. 5B by setting B+ to 0.31nV, while B− was changed to −0.27 nV in Fig. 5C. Clearly, in the former case the smaller Rz+ (1mΩ) intensifies leakage for positive pulses only and eventually results a symmetry break of the STDP curve. A similar response is attained for smaller Rz− (1mΩ) in the latter case.
3.4. Activity dependence
We further verified the capability of our model to capture the dependence of synaptic modification on the repetition frequency of spike pair stimuli as observed in biology [14]. As depicted in Fig. 6A, 60 biphasic pulse pairs were emitted at intervals of T = 1 / f, where f is the frequency in Hz. Each pulse pair consisted of two pulses of 2V magnitude and 10μs duration, while IPI was fixed at 3ms for both post-pre- and pre-post-type stimuli. Frequency f was swept from 0.5Hz to 50Hz in steps of 0.5Hz with results illustrated in Fig. 6B. The degree of potentiation observed after the application of the stimulus is correlated to the increase of pulse pair repetition frequency for the pre-post case. In contrast, post-pre pairs result in depression at low frequencies up to 21.5Hz (for the case of Rw = 0.45Ω), beyond which point we obtain potentiation. The simulation results are in great agreement with the experimental data from real synapses [14]. It is worth pointing that circuit parameters Rw and Cw in the activity dependence module can be conceived as factors determining the rate of heat dispersion inside the memristor and could thus accentuate or blunt the observed frequency dependence, as demonstrated in Fig. 6B.
In each pulse pair, the pulse parameters were set as A = 2V, twidth = 10μs, and tgap = ±3ms for pre-post and post-pre pairs respectively. (b) Dependence of overall conductance modification after application of the input pulse pair train on pulse pair frequency.
Conclusion
In conclusion, we have established a new memristor SPICE model that is capable of capturing volatile and non-volatile memristance dynamics, pair-based STDP, and synaptic activity dependence. It is worth stressing that all simulations were implemented by employing simple, non-overlapping voltage pulses, which allows this model to emulate the aforementioned biological synaptic protocols on systems that use electronically convenient non-overlapping bias signals. This indicates that there is no need to build complex circuitry for generating tailor-made spike waveforms, and thus make it possible to investigate memristor based synaptic emulators and neuromorphic applications with standard digital circuitry.
Acknowledgments
We are thankful for helpful discussions with Dr. Ali Khiat in Nano Research Group, Department of Electronic and Computer Science, University of Southampton.
Author Contributions
Conceived and designed the experiments: QL AS TP XH. Performed the experiments: QL AS. Analyzed the data: QL AS TP XH. Contributed reagents/materials/analysis tools: QL AS. Wrote the paper: QL AS TP XH.
References
- 1. Jo SH, Chang T, Ebong I, Bhadviya BB, Mazumder P, et al. Nanoscale memristor device as synapse in neuromorphic systems. Nano letters. 2010;10: 1297–1301. pmid:20192230
- 2. Li Y, Zhong Y, Xu L, Zhang J, Xu X, et al. Ultrafast Synaptic Events in a Chalcogenide Memristor. Scientific Reports. 2013;3: 1619. pmid:23563810
- 3. Berdan R, Lim C, Khiat A, Papavassiliou C, Prodromakis T. A Memristor SPICE Model Accounting for Volatile Characteristics of Practical ReRAM. Electron Device Letters, IEEE. 2014;35: 135–137.
- 4. Wang ZQ, Xu HY, Li XH, Yu H, Liu YC, et al. Synaptic learning and memory functions achieved using oxygen ion migration/diffusion in an amorphous InGaZnO memristor. Advanced Functional Materials. 2012;22: 2759–2765.
- 5. Chua L. Memristor-the missing circuit element. IEEE Transactions on Circuit Theory. 1971;18: 507.
- 6.
Chang T, Sheridan P, Lu W. Modeling and implementation of oxide memristors for neuromorphic applications. Cellular Nanoscale Networks and Their Applications (CNNA), 2012 13th International Workshop on. 2012: 29–31.
- 7. Giacomo I, Bernabé LB, Robert L, George D, Themistoklis P. Integration of nanoscale memristor synapses in neuromorphic computing architectures. Nanotechnology. 2013;24: 384010. pmid:23999381
- 8. Biolek Z, Biolek D, Biolkova V. SPICE model of memristor with nonlinear dopant drift. Radioengineering. 2009;18: 210.
- 9.
Pershin YV, Di Ventra M. SPICE model of memristive devices with threshold. arXiv preprint arXiv. 2012:12042600.
- 10. Ascoli A, Corinto F, Senger V, Tetzlaff R. Memristor model comparison. Circuits and Systems Magazine, IEEE. 2013;13: 89–105.
- 11. Zamarreño RC, Camuñas ML, Pérez CJ, Masquelier T, Serrano GT, et al. On spike-timing-dependent-plasticity, memristive devices, and building a self-learning visual cortex. Frontiers in neuroscience. 2011;5: 26. pmid:21442012
- 12. Bi GQ, Poo MM. Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. The Journal of neuroscience. 1998;18: 10464–10472. pmid:9852584
- 13. Dan Y, Poo MM. Spike timing-dependent plasticity: from synapse to perception. Physiological reviews. 2006;86: 1033–1048. pmid:16816145
- 14.
Pfister JP, Gerstner W. Beyond Pair-Based STDP: a Phenomenological Rule for Spike Triplet and Frequency Effects. In Advances in neural information processing systems. 2005: 1081–1088.
- 15. Fursina A, Sofin R, Shvets I, Natelson D. Origin of hysteresis in resistive switching in magnetite is Joule heating. Physical Review B. 2009;79: 245131.
- 16. Kumar S, Pickett MD, Strachan JP, Gibson G, Nishi Y, et al. Local Temperature Redistribution and Structural Transition During Joule‐Heating‐Driven Conductance Switching in VO2. Advanced Materials. 2013;25: 6128–6132. pmid:23868142
- 17. Strukov DB, Snider GS, Stewart DR, Williams RS. The missing memristor found. Nature. 2008;453: 80–83. pmid:18451858
- 18. Chang T, Jo SH, Lu W. Short-Term Memory to Long-Term Memory Transition in a Nanoscale Memristor. ACS Nano. 2011;5: 7669–7676. pmid:21861506
- 19.
Serb A, Berdan R, Khiat A, Shari L, Vasilaki E, et al. Memristors as synapse emulators in the context of event-based computation. Circuits and Systems (ISCAS), 2014 IEEE International Symposium on. 2014: 2085–2088.
- 20. Williamson A, Schumann L, Hiller L, Klefenz F, Hoerselmann I, et al. Synaptic behavior and STDP of asymmetric nanoscale memristors in biohybrid systems. Nanoscale. 2013;5: 7297–7303. pmid:23817887