Contrasting the effects of adaptation and synaptic filtering on the timescales of dynamics in recurrent networks

Neural activity in awake behaving animals exhibits a vast range of timescales that can be several fold larger than the membrane time constant of individual neurons. Two types of mechanisms have been proposed to explain this conundrum. One possibility is that large timescales are generated by a network mechanism based on positive feedback, but this hypothesis requires fine-tuning of the strength or structure of the synaptic connections. A second possibility is that large timescales in the neural dynamics are inherited from large timescales of underlying biophysical processes, two prominent candidates being intrinsic adaptive ionic currents and synaptic transmission. How the timescales of adaptation or synaptic transmission influence the timescale of the network dynamics has however not been fully explored. To address this question, here we analyze large networks of randomly connected excitatory and inhibitory units with additional degrees of freedom that correspond to adaptation or synaptic filtering. We determine the fixed points of the systems, their stability to perturbations and the corresponding dynamical timescales. Furthermore, we apply dynamical mean field theory to study the temporal statistics of the activity in the fluctuating regime, and examine how the adaptation and synaptic timescales transfer from individual units to the whole population. Our overarching finding is that synaptic filtering and adaptation in single neurons have very different effects at the network level. Unexpectedly, the macroscopic network dynamics do not inherit the large timescale present in adaptive currents. In contrast, the timescales of network activity increase proportionally to the time constant of the synaptic filter. Altogether, our study demonstrates that the timescales of different biophysical processes have different effects on the network level, so that the slow processes within individual neurons do not necessarily induce slow activity in large recurrent neural networks.

Introduction Adaptive behavior requires processing information over a vast span of timescales [1], ranging from micro-seconds for acoustic localisation [2], milliseconds for detecting changes in the visual field [3], seconds for evidence integration [4] and working memory [5], to hours, days or years in the case of long-term memory. Neural activity in the brain is matched to the computational requirements imposed by behavior, and consequently displays dynamics over a similarly vast range of timescales [6][7][8]. Since the membrane time constant of an isolated neuron is of the order of tens of milliseconds, the origin of the long timescales observed in the neural activity has been an outstanding puzzle.
Two broad classes of mechanisms have been proposed to account for the existence of long timescales in the neural activity. The first class relies on non-linear collective dynamics that emerge from synaptic interactions between neurons in the local network. Such mechanisms have been proposed to model a variety of phenomena that include working memory [9], decision-making [10] and slow variability in the cortex [11]. In those models, long timescales emerge close to bifurcations between different types of dynamical states, and therefore typically rely on the fine tuning of some parameter [12]. An alternative class of mechanisms posits that long timescales are directly inherited from long time constants that exist within individual neurons, at the level of hidden internal states [13]. Indeed biophysical processes at the cellular and synaptic level display a rich repertoire of timescales. These include short-term plasticity that functions at the range of hundreds of milliseconds [14,15], a variety of synaptic channels with timescales from tens to hundreds of milliseconds [16][17][18][19], ion channel kinetics implementing adaptive phenomena [20], calcium dynamics [21] or shifts in ionic reversal potentials [22]. How the timescales of these internal processes affect the timescales of activity at the network level has however not been fully explored.
In this study, we focus on adaptative ion-channel currents, which are known to exhibit timescales over several orders of magnitude [23][24][25]. We contrast their effects on recurrent network dynamics with the effect of the temporal filtering of inputs through synaptic currents, which also expands over a large range of timescales [26]. To this end, we extend classical rate models [27][28][29][30] of randomly connected recurrent networks by including for each individual unit a hidden variable that corresponds to either the adapting of the synaptic current. We systematically determine the types of collective activity that emerge in such networks. We then compare the timescales on the level of individual units with the activity within the network.

Results
We consider N coupled inhibitory and excitatory units whose dynamics are given by two variables: the input current x i and a slow variable s i or w i that accounts for the synaptic filtering or adaptation current respectively. The instantaneous firing rate of each neuron is obtained by applying a static non-linearity ϕ(x) to the input current at every point in time. For simplicity, we use a positive and bounded threshold-linear transfer function where [�] + indicates the positive part, γ is the activation threshold and ϕ max the maximum firing rate. Single neuron adaptation is described by the variable w(t) that low-pass filters the linearized firing rate with a timescale τ w , slower than the membrane time constant τ m , and feeds it back with opposite sign into the input current dynamics (see Methods). The dynamics of the i-th adaptive neuron are given by t m _ x i ðtÞ ¼ À x i ðtÞ þ P N j¼1 J ij �ðx j ðtÞÞ À g w w i ðtÞ þ I i ðtÞ t w _ w i ðtÞ ¼ À w i ðtÞ þ x i ðtÞ À g; ( where I i (t) is the external input current to neuron i. Synaptic filtering consists in low-pass filtering the synaptic input received by a cell with time constant τ s , before it contributes to the input current. The dynamics of the i-th neuron in a network with synaptic filtering are t m _ x i ðtÞ ¼ À x i ðtÞ þ s i ðtÞ t s _ s i ðtÞ ¼ À s i ðtÞ þ P N j¼1 J ij �ðx j ðtÞÞ þ I i ðtÞ: ( The matrix element J ij corresponds to the synaptic coupling strength from neuron j onto neuron i. In this study we focus on neuronal populations of inhibitory and excitatory units, whose connectivity is sparse, random, with constant in-degree: all neurons receive exactly the same number of excitatory and inhibitory connections, C E and C I , as in [31][32][33]. All excitatory synapses have equal strength J and all inhibitory neurons −gJ. Furthermore, we consider the large network limit where the number of synaptic neurons N is large while keeping the excitatory and inhibitory inputs C E and C I fixed.

Single unit: Timescales of dynamics
In the models studied here the input current of individual neurons is described by a linear system. Thus, their activity is fully characterized by the response h(t) to a brief impulse signal, i.e. the linear filter. When such neurons are stimulated with a time-varying input I(t), the response is the convolution of the filter with the input, x(t) = (h � I)(t). These filters can be determined analytically for both neurons with adaptation or synaptic filtering and directly depend on the parameters of these processes. Analyzing the differences that these two slow processes produce in the linear filters is useful for studying the differences in the response of adaptive and synaptic filtering neurons to temporal stimuli (Fig 1A), and will serve as a reference for comparison to the effects that emerge at the network level.
In particular, the filter of a neuron with synaptic filtering, h s (t), is the sum of two exponentially decaying filters of opposite signs and equal amplitude, with time constants τ s and τ m : where Θ(t) is the Heaviside function (see Methods). Thus, the current response of a neuron to an input pulse received from an excitatory presynaptic neuron is positive and determined by two different timescales. The response first grows with timescale τ m , so that the neuron cannot respond to any abrupt changes in the synaptic input faster than this timescale, and then decreases back to zero with timescale τ s (grey curves, Fig 1B).
The adaptation filter is given as well by the linear combination of two exponential functions. In contrast to the synaptic filter, since the input in the adaptive neuron model affects directly the current variable x i (t), there is an instantaneous change in the firing rate to an input delta-function (red curves, Fig 1B). The timescales of the two exponentials can be calculated as ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi When the argument of the square root in Eq (5) is negative, the two timescales correspond to a pair of complex conjugate numbers, so that the filter is an oscillatory function whose amplitude decreases monotonically to zero at a single timescale. If the argument of the square root is positive, for slow enough adaptation, the two timescales are real numbers and correspond to exponential functions of opposing signs of decaying amplitude. However, the amplitudes of these two exponentials are different (see Methods). To illustrate this, we focus on the limit of large adaptation time constants with respect to the membrane time constant, where the two exponential functions evolve with timescales that decouple the contribution of the membrane Effects of adaptation and synaptic filtering on the timescales of recurrent networks time constant and the adaptation current. In that limit, the adaptive filter reads The amplitude of the slow exponential is inversely related to its timescale so that the integral of this mode is fixed, and independent of the adaptation time constant. This implies that a severalfold increase of the adaptation time constant does not lead to strong changes in the single neuron activity for time-varying signals ( Fig 1A). Furthermore, we can characterize the timescale of the single neuron response as the sum of the exponential decay timescales weighed by their relative amplitude, and study how this characteristic timescale evolves as a function of the time constants of either the synaptic or the adaptive current ( Fig 1C). For adaptive neurons, the activity timescale is bounded as a consequence of the decreasing amplitude of the slow mode, i.e. increasing the adaptation time constant beyond a certain value will not lead to a slower response. In contrast, the activity of an individual neuron with synaptic filtering scales proportionally to the synaptic filter time, since the relative amplitudes of the two decaying exponentials are independent of the time constants.
When any of the two neuron types are stimulated with white Gaussian noise, the variance in the response is always smaller than the input variance, due to the low pass filtering properties of the neurons. However, this gain in the variance of the input currents is modulated by the different neuron parameters (Fig 1D). For a neuron with synaptic filtering, the gain is inversely proportional to the time constant τ s . In contrast, for a neuron with adaptation, increasing the adaptation time constant has the opposite effect of increasing the variance of the current response. This is because when the adaptation time constant increases, the amplitude of the slow exponential decreases accordingly, and the low-pass filtering produced by this slow component is weaker. Following the same reasoning, increasing the adaptation coupling corresponds to strengthening the low-pass filtering performed by adaptation, so that the variance decreases (Fig 1D, dashed vs full red curves).

Population-averaged dynamics
In the absence of any external input, a non-trivial equilibrium for the population averaged activity emerges due to the recurrent connectivity of the network. The equilibrium firing rate is identical across network units, since all units are statistically equivalent. We can write the input current x 0 at the fixed point as the solution to the transcendental equation for the network with adaptation, and to for synaptic filtering (see Methods). Based on Eq (7), we find that the adaptation coupling g w reduces the mean firing rate of the network, independently of whether the network is dominated by inhibition or excitation (Fig 2A). Synaptic filtering instead does not play any role in determining the equilibrium activity of the neurons, since Eq (8) is independent of the synaptic filtering parameter τ s . We next study the stability and dynamics of the equilibrium firing rate in response to a small perturbation uniform across the network, x i (t) = x 0 + δx(t). Because of the fixed indegree of the connectivity matrix, the linearized dynamics of each neuron are identical, so that the analysis of the homogeneous perturbation on the network reduces to the study of a two-dimensional deterministic system of differential equations which corresponds to the dynamics of the population-averaged response (see Methods). The stability and timescales around equilibrium depend on the two eigenvalues of this linear 2D-system. More specifically, the fixed point is stable to a homogeneous perturbation if the two eigenvalues of the dynamic system have negative real part, in which case the inverse of the unsigned real part of the eigenvalues determines the timescales of the response. For both the network with synaptic filtering and the network with adaptive neurons, the order parameter of the connectivity that determines the stability of the fixed point is the effective recurrent coupling J(C E − gC I ) each neuron receives, resulting from the sum of all input synaptic connections. A positive (negative) effective coupling corresponds to a network where recurrent excitation (inhibition) dominates and the recurrent input provides positive (negative) feedback [32,33].
For networks with synaptic filtering, we find that the synaptic time constant does not alter the stability of the equilibrium state, so that the effective coupling alone determines the stability of the population-averaged activity. As the effective input coupling strength is increased, the system undergoes a saddle-node bifurcation when the effective input is J(C E − gC I ) = 1 ( Fig  2C). In other words, the strong positive feedback loop generated by the excitatory recurrent connections destabilizes the system.
To analyze the timescales elicited by homogeneous perturbations, we calculate the eigenvalues and eigenvectors of the linearized dynamic system (see Methods). We find that for inhibition-dominated networks (J(C E − gC I ) < 0), the network shows population-averaged activity at timescales that interpolate between the membrane time constant and the synaptic time constant. As the effective coupling is increased, the slow timescale at the network level can be made arbitrarily slow by tuning the effective synaptic coupling close to the bifurcation value, a well-known network mechanism to achieve slow neural activity [12].
In the limit of very slow synaptic timescale, the two timescales of the population-averaged activity are so that the timescale τ − is proportional to the membrane time constant and τ + is proportional to the slow synaptic time constant, effectively decoupling the two timescales. The relative contribution of these two timescales is the same, independently of the time constant τ s , as we found in the single neuron analysis. The network with adaptation shows different effects on the population-averaged activity. First, the presence of adaptation modifies the region of stability: the system is stable when the effective recurrent input J(C E − gC I ) is less than the minimum of 1 + g w and 1 þ t m t w (see Methods). Therefore, the stability region is larger than for the network with synaptic filtering ( Fig  2B vs Fig 2C). In other words, the effective excitatory feedback required to destabilize the network is larger due to the counterbalance provided by adaptation. Moreover, adaptation allows the network to undergo two different types of bifurcations as the effective input strength increases, depending on the adaptation parameters. One possibility is a saddle-node bifurcation, as in the synaptic case, which takes place when J(C E − gC I ) = 1 + g w . Beyond that instability all neurons in the network saturate. The other possible bifurcation, which happens if t m t w < g w , at an effective coupling strength J C E À gC I ð Þ ¼ 1 þ t m t w , is a Hopf bifurcation: the fixed point of network becomes unstable, leading in general to oscillating dynamics of the population-averaged response. Note that in the limit of very slow adaptation, the system can only undergo a Hopf bifurcation ( Fig 2B).
The two timescales of the population-averaged activity in the stable regime for the adaptive network decouple the two single neuron time constants when adaptation is much slower than the membrane time constant. In this limit, up to first order of the adaptive time ratio t m t w , the two activity timescales are Similar to the single neuron dynamics, the amplitude of the slow mode, corresponding to τ − , decreases as τ w is increased, so that the contribution of the slow timescale is effectively reduced when τ w is very large. On the contrary, the mode corresponding to τ + , proportional to the membrane time constant can be tuned to reach arbitrarily large values. This network mechanism to obtain slow dynamics does not depend on the adaptation properties.

Heterogeneous activity
Linear stability analysis. Previous studies have shown that random connectivity can lead to heterogeneous dynamics where the activity of each unit fluctuates strongly in time [29,[33][34][35]. To assess the effects of additional hidden degrees of freedom on the emergence and timescales of such fluctuating activity, we examine the dynamics when each unit is perturbed independently away from the equilibrium, x i (t) = x 0 + δx i (t). By linearizing the full 2N-dimensional dynamics around the fixed point, we can study the stability and timescales of the activity characterized by the set of eigenvalues of the linearized system, λ s and λ w for the network with synaptic filtering neurons and adaptation, respectively. These sets of eigenvalues are determined by a direct mapping to the eigenvalues of the connectivity matrix, λ J (see Methods). The eigenvalues λ J of the connectivity matrices considered are known in the limit of large networks [33,36]: they are enclosed in a circle of radius J ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffiffi C E þ g 2 C I p , except for an outlier that corresponds to the population-averaged dynamics, studied in the previous section. Therefore, we can map the circle that encloses the eigenspectrum λ J into a different shape in the space of eigenvalues λ s/w (insets Fig 3). In order to determine the stability of the response to the perturbation, we assess whether the real part of the eigenspectrum λ s/w is negative at all possible points. Furthermore, the type of bifurcation is determined by whether the curve enclosing the eigenvalues λ s,w crosses the imaginary axis at zero frequency or at a finite frequency when the synaptic coupling strength is increased, leading respectively to a zero-frequency or to a Hopf bifurcation [37].
The order parameter of the connectivity that affects the stability and dynamics of the network is now the radius of the circle of eigenvalues λ J , i.e. J ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi . This parameter is the standard deviation of the synaptic input weights of a neuron (see Methods), which contrasts with the order parameter of the population-averaged response, that depends on the mean of the synaptic input weights. The mean and standard deviation of the synaptic connectivity can be chosen independently, so that while the population-averaged activity remains stable, the individual neurons might not display stable dynamics. To analyze solely the heterogeneous response of the network to the perturbation, we focus in the following on network connectivities whose population-averaged activity is stable, i.e. the effective synaptic coupling is inhibitory or weakly excitatory. Effects of adaptation and synaptic filtering on the timescales of recurrent networks We find that in the network with synaptic filtering, the eigenspectrum λ s always crosses the stability bound through the real axis, which takes place when the spectral radius of the connectivity is one, J ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffiffi C E þ g 2 C I p ¼ 1.
Thus the system undergoes a zero-frequency bifurcation similar to randomly connected networks without hidden variables [29,33,35,38], leading to strong fluctuations at the single neuron level that are self-sustained by the network connectivity (Fig 3Bii-3Biv). The critical coupling at which the equilibrium firing rate loses stability is independent of the synaptic time constant, i.e. synaptic filtering does not affect the stability of heterogeneous responses ( Fig 4A). However, the synaptic time constant τ s affects the timescales at which the system returns to equilibrium after a perturbation, because the eigenvalues λ s (see Eq (69) in Methods) depend explicitly on τ s . For a network with adaptive neurons, we calculate the eigenspectrum λ w and find that the transition to instability Re(λ w ) = 0 can happen either at zero frequency or at a finite frequency (see Methods), leading to a Hopf bifurcation (as in inset Fig 3Aiii). In particular, the network dynamics undergo a Hopf bifurcation when ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi so that strong adaptation coupling and slow adaptation time constants lead to a finite frequency bifurcation. In particular, if the coupling g w is larger than ffi ffi ffi 5 p À 2 � 0:236, only the Hopf bifurcation is possible, since by construction t m t w < 1. We can also calculate the frequency of oscillations at the Hopf bifurcation. We find that, for slow adaptive currents, the Hopf frequency is inversely related to the adaptation time constant (Fig 4B), so that slower adaptation currents produce slower oscillations at the bifurcation.
Adaptation also increases the stability of the equilibrium firing rate to a heterogeneous perturbation, in comparison to a network with synaptic filtering (Fig 4C). This can be intuitively explained in geometrical terms by analyzing how adaptation modifies the shape of the eigenspectrum λ w with respect to the circular eigenspectrum of the connectivity matrix λ J .
The Hopf bifurcation leads to the emergence of a new dynamical regime in the network (Fig 3Aiv), which is studied in the following section. Right at the Hopf bifurcation, the system shows marginal oscillations at a single frequency that can be reproduced in finite-size simulations whenever only one pair of complex conjugate eigenvalues is unstable (Fig 3Aiii). Effects of adaptation and synaptic filtering on the timescales of recurrent networks Fluctuating activity: Dynamical mean field theory. The classical tools of linear stability theory applied so far can only describe the dynamics of the system up to the bifurcation. To study the fluctuating regime, we take a different approach and focus on the temporal statistics of the activity, averaged over different connectivity matrices: we determine the mean and autocorrelation function of the single neuron firing rate, and characterize the timescale of the fluctuating dynamics [29,[33][34][35][38][39][40]. For large networks, the dynamics can be statistically described by applying dynamical mean field theory (DMFT), which approximates the deterministic input to each unit by an independent Gaussian noise process. The full network is then reduced to a two-dimensional stochastic differential equation, where the first and second moments of the noise must be calculated self-consistently. We solve the self-consistent equations using a numerical iterative procedure, similar to the schemes followed in [34,[41][42][43][44] (see Methods for an explanation of the iterative algorithm and its practical limitations).
For the network with synaptic filtering, we find that the autocorrelation function of the firing rates in the fluctuating regime corresponds to a monotonically decreasing function ( Fig  5A), qualitatively similar to the correlation obtained in absence of synaptic filtering [33]. This fluctuating state has often been referred to as rate chaos and shows non-periodical heterogeneous activity which is intrinsically generated by the network connectivity. The main effect of synaptic filtering is on the timescale of these fluctuations. When the synaptic time constant is much larger than the membrane time constant, the timescale of the network activity is proportional to the synaptic time constant τ s , as indicated by the linear dependence between the halfwidth of the autocorrelation function and the synaptic timescale τ s , when all other network parameters are fixed (Fig 5B).
For the network with adaptation, we focus on large adaptation time constant τ w , where the network dynamics always undergo a Hopf bifurcation. The autocorrelation function in such a case displays damped oscillations (Fig 5C). The decay in the envelope of the autocorrelation function is due to the chaotic-like fluctuations of the firing rate activity.
We define the time lag at which the envelope of the autocorrelation function decreases as the timescale of the network dynamics (see Methods). The timescale of the activity increases as the adaptation timescale is increased, when all the other parameters are fixed (Fig 5D). However, this activity timescale saturates for large values of the adaptation timescale: the presence of very slow adaptive currents, beyond a certain value, will not slow down strongly the network activity. This saturation value depends on the connectivity strength. Effects of noise. The networks studied so far, for a fixed connectivity matrix, are completely deterministic. We next study the effects of additional white noise inputs to each neuron, as a proxy towards understanding recurrent networks of spiking neurons with adaptation and synaptic filtering. On the mean-field level, such noise is equivalent to studying a recurrent network whose neurons fire action potentials as a Poisson process with instantaneous firing rate ϕ(x i (t)) [35,45].
Numerical simulations show that in the stable regime the additive external noise generates weak, fast stationary dynamics around the fixed point (Fig 6Ai and 6Bi). The timescale of these fluctuations and their amplitude depend on the distance of the eigenspectrum to the stability line, so that the stable fluctuations for weak synaptic coupling standard deviation (Fig 6Ai) are smaller in amplitude than those for larger coupling standard deviation (Fig 6Aii), whose eigenspectrum is closer to the stability boundary. For adaptation, in the fluctuating regime beyond the Hopf bifurcation, the network activity shows again a combination of fluctuating activity and oscillations.
We further extend the DMFT analysis to account for the additional variance of the external white noise sources (see Methods). The autocorrelation function of the firing rates, as predicted by DMFT, does not vary drastically when weak noise is added to the network, except for very short time lags, at which white noise introduces fast fluctuations (see Fig 7). For the network with adaptation, the autocorrelation function of the firing rates still shows damped oscillations (Fig 7A), while for the network with synaptic filtering, similarly, weak noise does not affect much the decay of the autocorrelation function ( Fig 7D). Very strong external noise on the other hand will reduce the effect of the underlying recurrent dynamics of the rate network, since the signal to noise ratio in the synaptic input of all neurons is low.
For a fixed external noise intensity, reducing the adaptation coupling or increasing the adaptation time constant increases the variance of the firing rate (Fig 7B), which resembles the dependence of the variance gain for individual neurons (Fig 1D). Conversely, slower synaptic filtering reduces the variance of the neuron's firing rates. This is because in the network with synaptic filtering the noise is also filtered at the synapses -in the limit of very large τ s , the whole white noise is filtered out-whereas in the network with adaptation the noise affects directly the input current, without being first processed by the adaptation variable.
However, the timescale of the activity is nonetheless drastically affected by strong noise. External noise adds fast fluctuations on top of the intrinsically generated dynamics of the heterogeneous network with adaptation or synaptic filtering. If the noise is too strong, the effective timescale of the activity takes into account mostly this fast component. In that limit, the Effects of adaptation and synaptic filtering on the timescales of recurrent networks timescale of the activity is almost independent of the synaptic or adaptive time constants ( Fig  7C and 7F, largest noise intensity).

Discussion
We examined dynamics of excitatory-inhibitory networks in which each unit had a hidden degree of freedom that represented either firing-rate adaptation or synaptic filtering. The core difference between adaptation and synaptic filtering was how external inputs reached the single-unit activation variable that represents the membrane potential. In the case of adaptation, the inputs directly entered the activation variable, which was then filtered by the hidden, adaptive variable through a negative feedback loop. In the case of synaptic filtering, the external inputs instead reached first the hidden, synaptic variable and were therefore low-pass filtered before being propagated in a feed-forward fashion to the activation variable. While both mechanisms introduce a second timescale in addition to the membrane time constant, our main finding is that the interplay between those two timescales is very different in the two situations. Surprisingly, in presence of adaptation, the membrane timescale remains the dominant one in the dynamics, while the contribution of the adaptation timescale appears to be weak. In contrast, in a network with synaptic filtering, the dominant timescale of the dynamics is directly set by the synaptic variable, and the overall dynamics are essentially equivalent to a network in which the membrane time-constant is replaced with the synaptic one.
We used a highly abstracted model, in which each neuron is represented by membrane current that is directly transformed into a firing-rate through a non-linear transfer function. This class of models has been popular for dissecting dynamics in excitatory-inhibitory [27,28,[46][47][48] or randomly-connected networks [29,30,33], and for implementing computations [49,50]. Effects of adaptation in this framework have to our knowledge not been examined so far, but see [51] for a simultaneously and independently developed study of adaptation in networks of multidimensional rate units with random Gaussian connectivity. We therefore extended the standard rate networks by introducing adaptation in an equally abstract fashion [24], as a hidden variable specified solely by a time constant and a coupling strength. Different values of those parameters can be interpreted as corresponding to different specific membrane conductances that implement adaptation, e.g. the calcium dependent potassium I ahp current or the slow voltage-dependent potassium current I m , which are known to exhibit timescales over several orders of magnitude [52,53]. To cover the large range of adaptation timescales observed in experiments [23], it would be straightforward to superpose several hidden variables with different time constants. Our approach could also be easily extended to include simultaneously adaptation and synaptic filtering.
A number of previous works have studied the effects of adaptation within more biologically constrained, integrate-and-fire models. These works have in particular examined the effects of adaptation on the spiking statistics [54][55][56], firing-rate response [57,58], synchronisation [25,56,[59][60][61], perceptual bistability [62] or single-neuron coding [63,64]. In contrast, we have focused here on the relation between the timescales of adaptation and those of network dynamics. While our results rely on a simplified firing-rate model, we expect that they can be directly related to networks of spiking neurons by exploiting quantitative techniques for mapping adaptive integrate-and-fire models to effective firing rate descriptions [65].
A side result of our analysis is the finding that strong coupling in random recurrent networks with adaptation generically leads to a novel dynamical state, in which individual units exhibit a mixture of oscillatory and strong temporal fluctuations. The characteristic signature of this dynamical state is a damped oscillation found in the auto-correlation function of singleunit activity. In contrast, classical randomly connected networks lead to a fluctuating, chaotic state in which the auto-correlation function decays monotonically [29,[33][34][35]. Note that the oscillatory activity of different units is totally out of phase, so that no oscillation is seen at the level of population activity. This dynamical phenomenon is analogous to heterogeneous oscillations in anti-symmetrically connected networks with delays [37]. In both cases, the oscillatory dynamics emerge through a bifurcation in which a continuum of eigenvalues crosses the instability line at a finite-frequency. Similar dynamics can be also found in networks in which the connectivity is a superposition of a random and a rank two structured part [33]. In that situation, the heterogeneous oscillations however originate from a Hopf bifurcation due to an isolated pair of eigenvalues that correspond to the structured part of the connectivity.
Our main aim here was to determine how hidden variables could induce long timescales in randomly-connected networks. Long timescales could alternatively emerge from non-random connectivity structure. As extensively investigated in earlier works, one general class of mechanism relies on setting the connectivity parameters close to a bifurcation that induces arbitrarily long timescales [12,29]. Another possibility is that non-random features of the connectivity, such as the over-representation of reciprocal connections [66,67] slow down the dynamics away from any bifurcation. A recent study [68] has indeed found such a slowing-down. Weak connectivity structures of low-rank type provide yet another mechanism for the emergence of long timescales. Indeed, rank-two networks can generate slow manifolds corresponding to ring attractors provided a weak amount of symmetry is present [69].
Ultimately, the main reason for looking for long timescales in the dynamics is their potential role in computations performed by recurrent networks [70,71]. Recent works have proposed that adaptive currents may help implement computations in spiking networks by either introducing slow timescales or reducing the amount of noise due to spiking [72,73]. Our results suggest that synaptic filtering is a much more efficient mechanism to this end than adaptation. Identifying a clear computational role for adaptation in recurrent networks therefore remains an open and puzzling question.

Network model
We compare the dynamics of two different models: a recurrent network with adaptive neurons, and a recurrent network with synaptic filtering. Each model is defined as a set of 2N coupled differential equations. The state of the i-th neuron is determined by two different variables, the input current x i (t) and the adaptation (synaptic) variable w i (t) (s i (t)).
Adaptation. The dynamics of the recurrent network with adaptive neurons are given by where ϕ(x) is a monotonically increasing non-linear function that transforms the input current into firing rate. In this study, we use a threshold-linear transfer function with saturation: In Eq (14) adaptation in single neuron rate models is defined as a low-pass filtered version with timescale τ w of the neuron's firing rate ϕ(x i (t)), and is fed back negatively into the input current, with a strength that we call the adaptation coupling g w . For the sake of mathematical tractability, we linearize the dynamics of the adaptation variable by linearizing the transfer function (Eq 15), ϕ(x i (t)) � x i (t) − γ. Therefore, the dynamics of the network model with adaptation studied here read t m _ x i ðtÞ ¼ À x i ðtÞ À g w w i ðtÞ þ I i ðtÞ t w _ w i ðtÞ ¼ À w i ðtÞ þ x i ðtÞ À g; ( Note that this approximation allows for adaptation to increase the input current of a neuron, when the neuron's current is below the activation threshold γ.
Synaptic filtering. For the recurrent network with synaptic filtering, the dynamics are In Eqs (14), (16) and (17), I(t) represents the total external input received by the neuron. In general, we are interested in the internally generated dynamical regimes of the network, so that the input is given by the synaptic inputs The matrix element J ij indicates the coupling strength of the j-th neuron onto the i-th neuron. The connectivity matrix is sparse and random, with constant in-degree [32,33,74]: all neurons receive the same number of input connections C, from which C E are excitatory and C I inhibitory. All excitatory synapses have coupling strength J while the strength of all inhibitory synapses is −gJ. Moreover, each neuron can only either excite or inhibit the rest of the units in the network, following Dale's principle. Therefore, the total effective input coupling strength, which is the same for all neurons, is We used the parameters in Table 1 for all figures unless otherwise specified.

Single neuron dynamics
The dynamics of each individual neuron are described by a two-dimensional linear system, which implies that the input current response x(t) to a time-dependent input I(t) is the convolution of the input with a linear filter h(τ) that depends on the parameters of the linear system: In general, for any linear dynamic system _ zðtÞ ¼ Az þ bðtÞ, where A is a square matrix in R N�N and b(t) is a N-dimensional vector, the dynamics are given by where Θ(t) is the Heaviside function. Thus, comparing Eqs (21) and (20), the linear filter is determined by the elements of the so-called propagator matrix P(t) = e At Θ(t). Synaptic filtering. For a single neuron wit synaptic filtering, the dynamics are given by Eq (17), where the input I i (t) represents the external current. We write the response in its vector form (x(t), s(t)) T and the input as (0, I(t)) T . The dynamic matrix is The linear filter, h s (t 0 ), is given by the entries of the propagator matrix that links the input I (t) to the output element x(t), which are in this case only the entry in row one and column two: h s (t 0 ) = [P(t 0 )] 12 . To compute the required entry of the propagator, we diagonalize the dynamic matrix A = VDV −1 . The matrix D is a diagonal matrix with the eigenvalues of matrix A in the diagonal entries, and V is a matrix whose columns are the corresponding eigenvectors. Applying the identity e tVDV À 1 ¼ Ve tD V À 1 and the definition of propagator we obtain that The two timescales of the activity are defined by the inverse of the eigenvalues of the system, which coincide with τ m and τ s . Every time a pulse is given to the neuron, both modes get activated with equal amplitude and opposing signs, as indicated by Eq 23. This means that there is a fast ascending phase after a pulse, at a temporal scale τ m , and a decay towards zero with timescale τ s . Adaptation. The dynamics of a single adaptive neuron are determined by Eq (16), where I i (t) is the external input to the neuron. We apply the same procedure to determine the timescales of the response of an adaptive neuron to time-dependent perturbations. The dynamic matrix for an adaptive neuron reads Its eigenvalues are ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi and the eigenvectors ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi The eigenvalues are complex if and only if g w > (4τ m τ w ) −1 (τ w − τ m ) 2 , and in that case their real part is 1 2t m t w t m þ t w ð Þ. As the adaptive time constant becomes slower, at a certain critical adaptation time constant both eigenvalues become real. We are interested in the behavior when the adaptation time constant is large. The absolute value of the inverse of the eigenvalues determines the time constants of the dynamics. Therefore, for large τ w we can calculate the two real eigenvalues to first order of t À 1 In this limit of slow adaptation, the time constant of one eigenmode is proportional to τ w , whereas the second mode scales with τ m . We are interested in the amplitude of each mode with respect to the other.
By explicitly calculating the first entry of the propagator matrix we obtain the adaptive filter in terms of the eigenvectors and eigenvalues, where we use the notation x þ 1 to indicate the first component of the eigenvector associated to the eigenvalue λ + . Approximating to leading order of t À 1 w the eigenvectors in Eq (26), we obtain the eigenvectors Then, using Eqs (29), (30) and (31), we determine the linear filter: Interestingly, in contrast with synaptic filtering, the amplitude of the two modes are not equal. The amplitude of the slow mode (first term in Eq 32), whose timescale is proportional to τ w , decays proportionally to t À 1 w with respect to the fast mode, when τ w � τ m (2g w + 1). Therefore, the area under the linear filter corresponding to this mode is independent of τ w for very large adaptation time constants: It follows that, if the adaptation timescale is increased, its relative contribution to the activity will decrease by the same factor, so that very slow adaptive currents will effectively be masked by the fast mode.

Equilibrium activity
The two systems possess a non-trivial equilibrium state at which the input current of all units stays constant. Since all units are statistically equivalent, the equilibrium activity is the same for all units. For synaptic filtering, the input current at equilibrium is given by a transcendental equation, that is obtained by setting to zero the left hand side of Eq (17): This equilibrium coincides with the fixed point of the system without synaptic filtering. For adaption, instead, from Eq (16) we obtain that the equilibrium is determined by We further assume unless otherwise specified that the fixed point of the system is in the linear regime of the transfer function, so that ϕ(x) = x − γ. In that case x 0 = (J(C E − gC I ) − g w ) (x 0 − γ), so that larger adaptation coupling corresponds to weaker input currents, i.e. decreasing stationary firing rate. The adaptation time constant does not affect the fixed point.

Dynamics of homogeneous perturbations
We study the neuronal dynamics in response to a small perturbation uniform across the network Synaptic filtering. Linearizing Eq 17 we obtain where we use the notation � 0 0 ≔ d�ðxÞ dx j x 0 . Because the perturbation δx in Eq (37) is independent of j, using Eq (19) the dynamics for all units are equivalent to the population-averaged dynamics and are given by From Eq (38) we can define the dynamic matrix The only difference in the linearized dynamics of the population-averaged current with respect to the single neuron dynamics (Eq 22) is the non-diagonal entry � 0 0 JðC E À gC I Þ. When either the derivative at the fixed point cancels, or when the total effective input is zero, the population dynamics equals the dynamics of a single neuron. The eigenvalues of the population-averaged dynamics are ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi and the eigenvectors ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi For very large synaptic time constants, the eigenvalues are approximated to leading order as Approximating as well the eigenvectors to leading order, we obtain the filter of the linear response to weak homogeneous perturbations reads: Note that the amplitude of the two exponential terms is the same, independently of the effective coupling and time constants. Adaptation. For the system with adaptive neurons, the linearized system reads As for the network with synaptic filtering, the dynamics of the perturbation are equivalent for each unit, so that we can write down the dynamic matrix for the population-averaged response to homogeneous perturbations The difference with respect to the linear single neuron dynamics (Eq 48) is that the effective recurrent coupling appears now in the first diagonal entry of the dynamic matrix.
When the fixed point is located within the linear range of the transfer function, the derivative is one, so that we do not further specify the factor � 0 0 in the following equations. Consequently, the dynamics of the system to small perturbations do not depend on the exact value of the fixed point, which does not hold for more general transfer functions.
The eigenvalues of the system read ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffiffi with eigenvectors ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi In the limit of very slow adaptation, given that the two eigenvalues are real, they can be approximated to leading order as and the corresponding eigenvectors read Therefore, if the perturbation is stable (see next section) we can write down the corresponding linear filter as The area under the slow mode is again independent of the adaptation time constant in this limit,

Stability of homogeneous perturbations
The equilibrium point is stable when the real part of all eigenvalues is negative. Equivalently, in a two dimensional system -as it is the case for the population-averaged dynamics-, the dynamics are stable when the trace of the dynamic matrix is negative and the determinant positive.
Synaptic filtering. In the system with synaptic filtering, the trace and determinant are The trace is therefore always negative. The determinant is positive, and therefore the population-averaged dynamics are stable, when the effective coupling J(C E − gC I ) is smaller than unity. In contrast, if the effective coupling is larger than unity, i.e. if positive feedback is too strong, the equilibrium firing rate is unstable, so that any small perturbation to the equilibrium firing rate will lead the system to a different state. Right at the critical effective coupling, one eigenvalues is zero and the other one equals Tr s , implying that the population-averaged dynamics undergo a saddle-node bifurcation. Beyond the bifurcation, the network reaches a state where the firing rates of all neurons saturate. Adaptation. In the adaptive population dynamics, the recurrent connectivity has a different effect on the stability of the adaptive population dynamics. The trace and determinant of the dynamic matrix are Both the timescale τ w and the strength g w of adaptation affect the trace and determinant of the dynamic matrix, and therefore the stability. The system is unstable if the determinant is negative (one positive and one negative real eigenvalue) or if the determinant is positive and the trace is positive. The determinant is negative, and therefore the system becomes unstable through a saddle-node bifurcation, when J(C E − gC I ) > 1 + g w . Note that the adaptation strength increases the stability of the system: a stronger positive feedback loop is required to destabilize the fixed point, in comparison to the network with synaptic filtering. The determinant and trace are positive if J(C E − gC I ) < 1 + g w but J C E À gC I ð Þ > 1 þ t m t w , respectively, leading to a Hopf bifurcation: the system produces sustained marginal oscillations at the bifurcation in response to small perturbations around the fixed point. Beyond the Hopf bifurcation, the oscillations are maintained in time, unless the system shows a fixed point when all neurons saturate ( . This fixed point exists if x 0 > ϕ max + γ.

Heterogeneous activity
We next study the network dynamics beyond the population-averaged activity, along modes where different units have different amplitudes. We study perturbations of the type We define the 2N-dimensional vector x ¼ ðdx 1 ; :::; dx 1 N ; dw 1 1 ; :::; dw 1 N Þ T . Since the dynamics of each unit is now different, the dynamic matrix of the linearized system, A, is described by a squared matrix of dimensionality 2N. Therefore, the perturbations generate dynamics along 2N different modes whose timescales are determined by the eigenvalues of the matrix A. The eigenvalues are determined by the characteristic equation |A − λI| = 0. In order to calculate these eigenvalues, we make use of the following identity which holds for any block matrix Z = A − λI, that is composed by the four square matrices P,Q, R, and S and the block S is invertible: Consequently, if we set Eq (63) to zero, since we assumed that |S| 6 ¼ 0, we obtain The identity in Eq (63) can be shown by using the decomposition together with the fact that when a non-diagonal block is zero. The determinant of such a matrix is the product of determinants of the diagonal blocks. Synaptic filtering. The dynamical matrix for the network with synaptic filtering, obtained by linearizing Eq (17), is The matrix J is the connectivity matrix. Again, we assume in the following that the fixed point is located in the linear range of the transfer function, so that � 0 0 ¼ 1. (64) and (66), reads

The characteristic equation, obtained by combining Eqs
where λ J are the eigenvalues of the connectivity matrix. Solving for λ J we obtain the equation which maps the eigenvalues of the synaptic filtering network dynamics λ s onto the eigenvalues of the connectivity matrix λ J , In contrast, solving for the eigenvalues of the dynamic matrix λ s we obtain the inverse mapping In other words, Eqs 69 and 68 constitute two different approaches to assessing the stability of the system [37]. One approach is to examine whether the domain of eigenvalues λ s resulting from Eq (69) intersect the line Re (λ s ) = 0 (Fig 3, insets in B). The eigenvalues λ J of the connectivity matrix are distributed within a circle in the complex plane, whose radius is proportional to the synaptic strength, l J < J ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffiffi C E þ g 2 C I p plus an outlier real eigenvalue at J(C E − gC I ) that corresponds to the homogeneous perturbations studied above (see [36]). We focus in this section on the bulk of eigenvalues that corresponds to modes of activity with different amplitudes for different units. We can therefore parametrize the eigenvalues λ J as l J ðyÞ ¼ J ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffiffi and introduce the parametrization into Eq (69) to obtain an explicit expression for the curve approximate up to first order of � x and second order of � y we obtain the parabola Repeating the same procedure for the circle of eigenvalues, with radius r = 1 + g w we obtain By requiring the circle of eigenvalues to be interior to the boundary curve (for the same � x , � 2 y;circle < � 2 y;sb ), we obtain that the instability parabola is exterior to the circle, therefore the system undergoes a zero-frequency bifurcation (S1C Fig), when which simplifies to ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi In the limit of the adaptation timescale approaching the membrane time constant, the left side of the inequality above approaches one. Introducing this value in Eq 84, we find that for adaptive couplings stronger than g w > ffi ffi ffi 5 p À 2 only a Hopf bifurcation is possible.

Dynamical mean field theory
The linearization of the dynamical system from the previous section is only valid up to the instability boundary. A commonly used method to study the dynamics that arise beyond the bifurcation is dynamical mean field theory (DMFT) [29,[33][34][35][39][40][41]. DMFT approximates the deterministic input to each element of the system by a Gaussian stochastic process, whose first and second moment are determined self-consistently. The dynamics of the i-th neuron in the synaptic and adaptive network are approximated as where ξ i (t) is a Gaussian variable. In the thermodynamic limit, the noise sources are independent between neurons, so that for The next step is to determine the self-consistent equations, that links the distribution of ξ i to the statistics of the original system in Eqs (16) and (17). First, we relate the statistics of the noise, currents x i and rates ϕ(x i ) based on the dynamics. Then, we close the equations by explicitly assuring that the transfer function relates the currents and the rates.
To determine the first moment of the noise, we apply that ξ i (t) = ∑ j J ij ϕ(x j (t)) and average over the population, as in [33]. The first moment of the noise then obeys We calculate next the relation for the second moment of the noise, which again is the same as in [33]: where C(τ) = hϕ i (t)ϕ i (t + τ)i. These equations show that the first and second moment of the Gaussian sources do not depend on the identity of neuron i, so that all neurons are statistically equivalent. Thus, we can reduce the full 2N-deterministic system to a two-variable stochastic system, describing a prototypical neuron in the network.
The Eqs (87) and (88) describe how the noise is related to the properties of the connectivity and the statistics of the rates ϕ(x). The next step is to calculate how the first and second moment of the noise are related to the statistics of the input current, which we write as μ ≔ [x i ] for the first moment and Δ(τ) ≔ [x i (t) x i (t + τ)] − μ 2 for the second moment.
For the mean of the input current, averaging over units Eqs (85) and (86) and introducing the result in (87) for the synaptic and adaptive system respectively, we obtain ð89Þ We find that such an iterative method applied to the systems studied here converges to a solution for the parameters of the noise after a few iterations, independently of the noise properties used in the initial step.
The drawbacks of this iterative scheme are that the two-dimensional system needs to be simulated several times at each iteration in order to determine the first and second order statistics of the input current and the firing rate, which is in general a computationally costly operation. We also find that the method converges more robustly to the solution (given the fact that both the trial length in the simulation and the number of trials are finite), at the expense of initial speed convergence, when the first and second moments of the noise are only partially updated at each iteration, so that and similarly for the second-moment equation, where α is a parameter between zero and one.
In this work, we used α = 0.6. This method is inefficient for very large adaptation and synaptic time constants, since it requires simulating with both a fine temporal resolution (faster than the membrane time constant) over very large intervals (much larger than the slow adaptive/synaptic timescale). Another drawback of the iterative method is that its convergence is based on the assumption that smooth changes in the noise statistics lead to smooth changes in the statistics of the firing rates. In general, close to a bifurcation, this requirement may not hold.
Dynamics with intrinsic noise. We next study how white Gaussian noise, independent between neurons and intrinsic to each unit in the network, affects the dynamics of the system. On the mean-field level, this is equivalent to studying a network where each neuron spikes at a Poisson process whose rate varies in time as ϕ(x i (t)) [35]. The additional input to each neuron, whose dynamics are given in Eqs (2) and (3), is now where [η i ] = 0, and Z i t ð ÞZ j t þ t ð Þ which is the same result as Eq (87). The second moment of the stochastic process is the sum of the variance generated by the recurrent connections and the variance of the intrinsic noise Accordingly, the iterative scheme now takes into account the equation above, so that the equation for the second moment of the self-consistent relation (Eq 98) reads when there is intrinsic noise ½xðtÞxðt þ tÞ� ðkþ1Þ ¼ J 2 C E þ g 2 C I ð Þ C ðkÞ t ð Þ À h�i Adding white noise produces a discontinuity in the derivative of the autocorrelation function of the firing rates at zero lag (Fig 7A and 7D). This can be shown by integrating explicitly both sides of the Eqs (91) and (92) around zero when the external noise is added. It results in the condition Since the autocorrelation function is a symmetric function, _ Dð0 þ Þ ¼ À _ Dð0 þ Þ, leading to Thus, the autocorrelation function of the input current decays linearly at zero time lag with a slope proportional to the external noise intensity, which also extends to the autocorrelation function of the firing rate.

Definition of the timescale of the activity
The activity of multivariable dynamical systems ranges over several timescales. In particular, for stable linear systems, the timescales of the activity are given by the inverse of the absolute values of the real part of the eigenvalues. As we showed before, for single adaptive or synaptic neurons, the activity consists of two modes that evolve at two different timescales. However, the relative contribution of each of the excited modes can make one timescale more predominant than the other, as it happens for slow adaptation time constant, which becomes effectively undetectable in the single neuron dynamics.
In this work, we calculate the timescale of the activity for linear systems as the average of the timescales of the activated input current modes, weighed by their contribution (Fig 1). For a linear system with filter h t ð Þ ¼ P k a k e À t t k , the correlation time is For large networks, which are high-dimensional non-linear systems, we define the main timescale of the activity as the time lag at which the autocorrelation function has decayed to a fraction e À 1 2 of its maximum (Figs 5 and 7): where E[C(τ)] is the envelope of the autocorrelation function, calculated as the norm of its analytic signal, computed using the Hilbert transform. This corresponds to the width of the envelope at which the autocorrelation decays to e −0.5 of its value. For an exponentially decaying correlation function, this measure corresponds to the decay time constant. For a Gaussian envelope, this measure would correspond to two times its standard deviation, 2σ.
Supporting information S1 Fig. Geometrical description of the bifurcation of the heterogeneous activity. A: Instability bound for the system with synaptic filtering (grey line, Eq 72) and eigenspectrum for the weakest unstable synaptic coupling J. For any parameter combination, the instability bound, a parabola, is first touched by the growing circle of eigenvalues at ω = 1 and value J ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffi ffiffi C E þ g 2 C I p ¼ 1: B: Three different configurations of the instability bound for the system with adaptation in the complex plane of eigenvalues of the connectivity matrix, λ J . The black dots indicate the intersection between the instability boundary (full red line) and the eigenspectrum of λ J (dashed black line) with weakest coupling that is unstable. (i) The instability boundary intersects the real axis twice, leading to a Hopf bifurcation. (ii) It intersects the real axis just once and still leads to a Hopf bifurcation, because the intersection with the real axis is not the closest point of the curve to the origin. (iii) It intersects the real axis once and leads to a zero-frequency bifurcation, because the crossing of the real axis is the closest point to the origin. In (ii) and (iii) we draw the parabolic approximation of the instability bound (red dashed line, Eq 82). If the curvature of this parabola is exterior to the λ J eigenspectrum, as in (iii), the system undergoes a zero-frequency bifurcation. C: Oscillatory frequency at which the network with adaptation undergoes a bifurcation. To the right of the white line (Eq 84), the network displays a Hopf bifurcation, whereas to the left, the bifurcation happens at zero-frequency. The triangles indicate the parameter combinations used in B. (TIF)