## Figures

## Abstract

We report the phenomenon of frequency clustering in a network of Hodgkin-Huxley neurons with spike timing-dependent plasticity. The clustering leads to a splitting of a neural population into a few groups synchronized at different frequencies. In this regime, the amplitude of the mean field undergoes low-frequency modulations, which may contribute to the mechanism of the emergence of slow oscillations of neural activity observed in spectral power of local field potentials or electroencephalographic signals at high frequencies. In addition to numerical simulations of such multi-clusters, we investigate the mechanisms of the observed phenomena using the simplest case of two clusters. In particular, we propose a phenomenological model which describes the dynamics of two clusters taking into account the adaptation of coupling weights. We also determine the set of plasticity functions (update rules), which lead to multi-clustering.

**Citation: **Röhr V, Berner R, Lameu EL, Popovych OV, Yanchuk S (2019) Frequency cluster formation and slow oscillations in neural populations with plasticity. PLoS ONE 14(11):
e0225094.
https://doi.org/10.1371/journal.pone.0225094

**Editor: **Gennady Cymbalyuk,
Georgia State University, UNITED STATES

**Received: **July 18, 2019; **Accepted: **October 29, 2019; **Published: ** November 14, 2019

**Copyright: ** © 2019 Röhr et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Data Availability: **All relevant data are within the manuscript.

**Funding: **VR, SY and RB acknowledge the financial support by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) - Project 384950143, Project 411803875 and Project 308748074. OVP acknowledges the support by the European Union’s Horizon 2020 Research and Innovation Programme under Grant Agreement 826421 (VirtualBrainCloud). ELL acknowledges the financial support by the São Paulo Research Foundation (processes FAPESP 2016/23398-8 and 2017/13502-5). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

**Competing interests: ** The authors have declared that no competing interests exist.

## Introduction

Clustering of the dynamics and coupling is observed at several scales of the brain structure and function. For example, in the data measured by the functional magnetic resonance imaging (fMRI), the brain networks form functional clusters that can be seen in the matrices of the functional and effective connectivities for task-based and task-free (resting state) paradigms [1–6]. Clustering has also been observed for dynamic functional connectivity, where the time courses of the connectivity exhibit a few discrete states with well pronounced clusters [7]. Disruption of such clustered states of connectivity may be associated with some brain disorders [8, 9]. It is therefore important to investigate the emergence of clustering in neural populations that we address in this study.

Neural networks are able to adapt their structure depending on the activity of the nodes or external stimuli [10]. One of the possible mechanisms of such an adaptation, which may lead to persistent changes in neural connections and relate to learning and memory, is synaptic plasticity [11]. The efficacy of synapses to transmit the electrical potential between neurons may increase or decrease depending on the mutual neural activity, which results in short- or long-term potentiation or, respectively, depression of synapses [12, 13]. An example is spike timing-dependent plasticity (STDP) which describes the synaptic weight change as a function of the difference of spiking times between pre- and post-synaptic neurons [14–18].

One of the famous plasticity rules, the Hebbian rule, assumes that the modifications of the synaptic weights are driven by correlations in the firing activity of pre- and post-synaptic neurons. More specifically, it assumes that those connections are potentiated, for which one neuron contributes to the firing of another [11]. Nevertheless, in many publications, the Hebbian rule is considered in a more narrow sense of a closeness between the spiking times: the smaller the distances between the spikes are the higher is the potentiation of the corresponding synapse [19, 20]. In this work, we are dealing with spike-based learning rules rather than rate-based.

Previous studies of neural networks with STDP showed that such networks can evolve and create various coupling structures. For instance, the weights can exhibit stable localized spatial structures, that can be interpreted as receptive fields [21]. These structures can be either unidirectionally of bidirectionally coupled, depending on the plasticity rule or external input properties. The STDP mechanism plays an important role in temporal coding of information by spikes [14, 21]. On the one hand, a synchronized firing in neural ensembles with STDP can be stabilized through potentiation of synaptic coupling by stimulation-induced transient synchronization of neurons [22–25]. On the other hand, a desynchronized state can lead to a depression of synaptic weights [22, 23]. Thus, neural networks with plasticity are prone to a co-existence of different stable dynamical and structural states, which may be realized by choosing appropriate initial conditions or stimulation procedures.

Human brain networks demonstrate different degrees of modularity, sometimes with hierarchical features [26–30]. Recently, a hierarchical clustering was observed in phenomenological models of adaptive networks of phase oscillators [31–33]. As a result of an adaptation, the network evolved into groups of strongly-connected clusters, while the coupling between the groups was depressed. The stability analysis of such clusters reveals [33, 34] that the preferred stable cluster configuration corresponds to significantly different sizes of the clusters. The dynamics within each cluster are frequency-synchronized, while the frequencies between clusters differ. Thus, self-organized emergence of clusters leads to the emergence of different collective frequencies in the system. The multi-stability of such clusters was also observed in ensembles of Morris-Lecar bursting neurons with STDP in [35].

In this paper we report on the phenomenon of clustering with respect to connectivity and frequencies in a network of adaptively coupled Hodgkin-Huxley (HH) neurons. The spike timing-dependent adaptation is considered to be symmetric as experimentally found for hippocampal synapses [36] and can also be derived from asymmetric STDP for an “effective time window” [37]. Then the observed clusters are bidirectionally coupled [35]. Splitting of a neural population to a few clusters synchronized at different frequencies could lead to a slow waxing and waning of the amplitude of the mean field, where the clusters transiently gather together and move apart as the time evolves [35]. The frequency of such a modulation of the mean neural activity could be much smaller than the firing rate of individual neurons and depends on the differences between the clusters’ frequencies. The emergence of synchronized clusters could explain the origin of the low-frequency modulation of the spectral power of macroscopic brain signals like local field potentials (LFP) or electroencephalographic (EEG) signals in higher frequency bands, which also correlates with slow oscillations of the blood oxygen level-dependent (BOLD) signal measured by fMRI [38–41]. Several other modeling studies have also reported on clustering in the neural populations with plasticity [35, 42, 43]. These clusters have been observed for different models that ranged from simple phase oscillators to the models of spiking and bursting neurons and demonstrate stability with respect to heterogeneity of the interacting neurons and random perturbations [35, 42, 43]. In this paper we provide a simple phenomenological model and explain a mechanism governed by synaptic plasticity of the stabilization of such clusters in a neural population.

The structure of the paper is as follows. In the first section we present the model. The next section shows numerically observed multi-clusters. The detailed mechanisms of the stability of frequency clusters is explained afterwards using the simplest case of two clusters. Then we propose a phenomenological model, which describes the dynamics of two clusters taking into account the adaptation of the weights. The model is shown to reflect not only qualitative, but also some basic quantitative properties of the two-cluster formation. We also determine the set of plasticity functions (update rules), which lead to the clustering.

## Materials and methods

### Model

The network of *N* HH neurons is described by the following system [24, 25, 44, 45]
(1)
Here *V*_{i} is the potential of the *i*-th neuron with the corresponding equilibrium potentials *E*_{Na} = 50mV, *E*_{K} = −77mV, and *E*_{l} = −54.4mV. *C* = 1*μF*/*cm*^{2}. Our choice of *E*_{r} = 20mV corresponds to the excitatory neurons. *m*, *h*, and *n* are gating variables, and their dynamics depend on opening and closing rates

The parameters are *g*_{Na} = 120mS/cm^{2}, *g*_{K} = 36mS/cm^{2}, and *g*_{l} = 0.3mS/cm^{2}. The constant current *I*_{i} is set to 9*μA*/*cm*^{2} so that the individual neurons are identical and oscillatory.

The synaptic input current from *j*-th neuron is scaled by the synaptic strength *κ*_{ij}, which changes due to plasticity. The adaptation of *κ*_{ij} occurs discontinuously whenever one of the neurons *i* or *j* spikes. More specifically, the discontinuous change is given by the following plasticity function
(2)
where Δ*t*_{ij} = *t*_{i} − *t*_{j} is the spike time difference between the postsynaptic and presynaptic neurons; *δ* > 0 is a small parameter determining the size of the single update; *κ*_{max} > 0 is the maximal coupling; and the plasticity function [14–16, 21] is
(3)
with positive parameters *c*_{p}, *τ*_{p}, *c*_{d}, and *τ*_{d}. We also assume no autapses and set *κ*_{ii} = 0.

Example of the considered plasticity function *W* used in our simulations is shown in Fig 1. This is a symmetric function, which corresponds to a potentiation of the coupling weights of the neurons with highly correlated firing. As we will discuss at the end of the results section, there is a family of plasticity functions of similar form that allow for the frequency clustering.

## Results

### Numerical observation of synchrony and frequency clustering

In order to investigate the dynamics of network (1), we initialize the neurons and the coupling randomly and integrate the system numerically. For the parameter values *τ*_{p} = 2, *τ*_{d} = 5, *c*_{p} = 2, *c*_{d} = 1.6, and *κ*_{max} = 1.5 we observe two phenomena: complete synchronization and the emergence of frequency clusters hierarchical in size, see Figs 2 and 3, respectively.

Evolution of the coupling matrix *κ*_{ij}(*t*) starting from random initial conditions and converging to a completely synchronous state. Panel (A) shows initial coupling matrix, (B) the coupling matrix after the transient *t* = 2000ms. Raster plot of spiking times at the beginning of simulations (C) and after the transient (D). The asymptotic state (B,D) is a completely synchronized spiking with all coupling weights *κ*_{ij} potentiated to *k*_{max}. Other parameters *N* = 200, *τ*_{p} = 2, *τ*_{d} = 5, *c*_{p} = 2, *c*_{d} = 1.6, and *κ*_{max} = 1.5.

Evolution of the coupling matrix *κ*_{ij}(*t*) starting from random initial conditions and converging to frequency clusters hierarchical in size. Panel (A) shows initial coupling matrix, (B) the coupling matrix after the transient *t* = 5600ms, and (C) *t* = 20000ms. (B-F) Corresponding raster plots of spike times. The asymptotic state (C,F) is a hierarchical cluster state with the coupling weights *κ*_{ij} potentiated to *k*_{max} within each cluster and small or zero otherwise. Other parameters as in Fig 2. The oscillators are ordered accordingly to their mean frequency.

Fig 2(A) shows the initial coupling weights, and Fig 2(C) illustrates the spike times of the neurons at the beginning of the simulation. One can observe that while the neurons start with an incoherent spiking, they enhance the coherence already after a few spikes due to the interaction between them as well as the plasticity. The plasticity potentiates the connections of neurons that fire together. A complete synchronization is established and the coupling weights increase to *κ*_{max} after a transient (Fig 2(B) and 2(D)). In a completely synchronized state, the individual neurons spike simultaneously, hence, the spike time differences Δ*t*_{ij} = 0.

The emergence of frequency clusters is shown in Fig 3 for two clusters. The system in Fig 3 possesses the same parameters as in Fig 2, and the difference is just another realization of random initial conditions. In contrast to the synchronized state, the final state shown in Fig 3(F) consist of two groups of synchronized neurons. These cluster states also manifest themselves as two groups of strongly coupled elements in the coupling matrix *κ* (Fig 3(C)). The coupling weights between the neurons from the different groups is very small or zero.

We observe that the largest cluster is formed rather quickly as time evolves, whereas the formation of the small cluster takes much more time. This is illustrated in Fig 4, where the time courses of the mean coupling within each of the two clusters are shown. The average coupling within the big cluster reaches its maximum fast (at *t* ≈ 1000, solid curve in Fig 4), whereas the smaller cluster in Fig 3(C) and 3(F) is formed through the merging of transient clusters and finally establishes at *t* ≈ 17000 (dashed curve in Fig 4).

Formation of individual clusters over time (corresponds to the dynamical scenario in Fig 3). The dashed and solid curves depict the time course of the mean coupling within the small and big clusters, respectively.

For the states with more clusters, each new formed cluster is significantly smaller than the previous one, see Fig 5, where three clusters are shown. The spiking period of the cluster appears to be proportional to its size: the bigger the cluster the larger is the period. Simulation of the cases with even more clusters becomes computationally expensive due to large transients.

Example of a three-cluster state for *N* = 500, *τ*_{p} = 2, *τ*_{d} = 5, *c*_{p} = 2, *c*_{d} = 1.6, and *κ*_{max} = 1.5 with a random initial distribution of *κ*_{ij} in [0, 0.75].

#### Clustering with independent random input.

To investigate the robustness of our findings, we added an *α*-train as additional independent random input to the membrane potential *V*_{i} of every neuron:
(4)

The Eq (4) models a postsynaptic potential (PSP) that is received by the neuron at certain random times *τ*_{i,k}. The inter-spike interval is Gaussian distributed . *α* is set to 24/〈Δ*τ*_{i,k}〉.

The numerical simulations Fig 6 show that the clustering is still observed under the influence of random input of intensity *I*. More specifically, for sufficiently weak perturbations with *I* < 0.01, all three clusters survive (Fig 6(A)). With increasing the amplitude *I*, the clusters start to decouple. The smaller clusters are affected first (Fig 6(B)–6(D)), they start desynchronizing at *I* = 0.01. The biggest cluster keeps shrinking in size while *I* is increased and finally for *I* = 0.07 the whole network decouples (Fig 6(E)).

### Two clusters in more detail

In this section we numerically show that depending on the relative size of the two clusters, such two-cluster states can be either dynamically stable or transient leading to complete synchronization. In order to investigate the cluster stability, we initialize the system in a two cluster state with the number of neurons *N*_{s} in the small cluster and *N*_{b} = *N* − *N*_{s} in the big cluster. The total number of neurons is set to *N* = 50. The inter-cluster couplings are set to zero initially while the intra-cluster couplings equals *κ*_{max}. All neurons in the same cluster are initialized with the same initial conditions, so the clusters are fully synchronized at *t* = 0.

Fig 7(A) shows frequency difference of two uncoupled clusters as a function of the size of the small cluster. The frequency difference demonstrates an almost linear dependence on the cluster size and decays as the size of the smaller cluster increases. Moreover, we also observe that clusters with sufficiently different sizes are stable while the clusters of similar sizes, in the considered case with *N*_{s} > 8, are transient, merge into a single cluster and eventually lead to a stable completely synchronous state, see Fig 8.

(A)Difference between synchronization frequencies of the two clusters for different size of the smaller cluster *N*_{s}. (B) Time until cluster fusion for different initial size of the smaller cluster *N*_{s}.

Evolution of the coupling matrix for *N* = 50 and the number of neurons *N*_{s} = 8 (A)-(C) and *N*_{s} = 9 (D)-(F) in the small cluster. In panels (A)-(C) the clusters are stable, while in (D)-(F) they are merging to one synchronous cluster. (G, H) Time courses of the spiking synchronization frequencies of small (*N*_{s} neurons) and large (*N*_{b} neurons) clusters depicted by dashed and solid curves, respectively, for (G) *N*_{s} = 8 and *N*_{b} = 42 and (H) *N*_{s} = 9 and *N*_{b} = 41. Parameter *κ*_{max} = 1.0.

Although the threshold of how different the clusters should be in order to be stable is certainly model dependent, the synchronization of similar clusters is a general property. The merging of two clusters can be explained qualitatively as follows. Initially uncoupled clusters evolve each with their natural frequencies Ω_{s} and Ω_{b}. If their sizes are different, then Ω_{s} ≠ Ω_{b}, and the clusters arrive in-phase periodically with the ‘beating’ frequency ΔΩ = Ω_{b} − Ω_{s}. As soon as such an in-phase episode occurs, the interspike intervals Δ*t*_{ij} between any two neurons from different clusters become small and, hence, due to the plasticity rule *W* (see Eq (2) and Fig 1) the inter-cluster coupling weights increase. Moreover, the duration of such an in-phase episode depends on the frequency difference between the clusters. As a result, for a small frequency difference ΔΩ, the time interval where the clusters are practically in-phase is sufficiently long in order to potentiate the coupling weights to their maximum value. This unites the two clusters into one. In contrast, for large ΔΩ, such an episode is short, and the inter-cluster coupling remains small, which keeps the clusters oscillating at different frequencies in a stable manner.

Fig 8(A)–8(C) displays an example of two-cluster stable state with *N*_{s} = 8. Starting from the two-cluster state, after *t* = 1500ms, the coupling between the clusters increases, see Fig 8(B) due to the “in-phase episode” when the clusters are synchronous. Afterwards, however, the inter-cluster coupling weights return to their initial configuration (Fig 8(C)), since the spike time differences for neurons from different clusters are again far enough apart to cause the depression of the inter-cluster synapses. Such a process is repeated every time the clusters meet and is typical for the stable cluster states. A typical case of transient clusters is presented in Fig 8(D)–8(F) for *N*_{s} = 9. The inter-cluster coupling is again potentiated when the clusters meet, but it does not decrease again, and the clusters merge in a single cluster of a fully coupled and synchronized regime (Fig 8(F)). The transient time that could be elapsed until the cluster fusion depends on the cluster size as illustrated in Fig 7(B).

Fig 8(G) and 8(H) show how the spiking frequency of the clusters change over time. During the in-phase episode, the cluster with the higher natural spiking rate slows down significantly, while the slower cluster (with larger number of neurons *N*_{b}) speeds up a little. For a stable cluster state the cluster frequencies again deviate from each other (Fig 8(G)), whereas all neurons fire with the same frequency when the clusters unite into one (Fig 8(H)). We found this phenomenon for different numbers of neurons and different *κ*_{max}. Increasing *κ*_{max} increases the initial period difference, but the behavior in general stays the same.

Fig 9 shows the dynamics of the mean synaptic activity of the network in the case of two stable clusters, which models the dynamics of LFP. During the in-phase episodes of the two clusters, *S*(*t*) has a higher amplitude, because both clusters spike synchronously. The maximum amplitude is generated by maximum synchronization in the network. The low amplitude of *S*(*t*), on the other hand, corresponds to the time intervals when the clusters are out of phase. In the latter case, the mean synaptic activity shows two peaks, the higher peak is generated by the larger cluster and the lower by the smaller one, see Fig 9(B). For the considered case, the synchronized oscillations of individual neurons in the clusters take place at a time scale of several milliseconds (period ∼15 ms, Fig 9(B)), see also Fig 8(G) and 8(H). The neurons are tonically spiking. The frequency difference ΔΩ between clusters is, however, of the order of sub-Hz, because the corresponding cluster frequencies are close to each other (Fig 8(G) and 8(H)). Then the modulation of *S*(*t*) is observed at a much slower timescale of a few seconds, which is of two orders of magnitude slower than the intrinsic neural firing, see Fig 9(A), as observed in empirical data of the brain activity [40, 41].

Mean synaptic activity *S*(*t*) of the neural population in the case of stable two cluster state. Panel (A) shows the dynamics of *S*(*t*) on the time interval of 12 s, where modulation of the amplitude (blue line) is visible, while the fast oscillations are not recognized on this timescale. The maximum amplitude corresponds to the two clusters being synchronised, while the low amplitude corresponds to the clusters being out of phase. Panel (B) shows the zoom of a small time interval. The modulation takes place on the timescale which is two orders of magnitude larger than the individual spikes of *S*(*t*) as well as individual neural spikes in both clusters. Cluster frequencies *ω*_{1} = 0.065012 kHz and *ω*_{2} = 0.065416 kHz. The corresponding period of modulation is *T* ≈ 2.5*s*.

In the following section, a phenomenological model is introduced in order to further investigate the dynamics of two clusters.

### Phenomenological model

#### Model derivation.

In this section we introduce a reduced qualitative model for the coupling and phase difference of two clusters. The model is based on the assumption that oscillators are synchronized identically within each cluster and the coupling between the clusters is weak. As a result, the interaction between oscillatory clusters can be described in the framework of two coupled phase oscillators that are interacting via their phase differences [46–49]
(5) (6)
where *ω*_{1} and *ω*_{2} are the natural frequencies of the individual clusters, *F*_{1} and *F*_{2} are effective interaction functions. For the phase difference *φ* = *φ*_{1} − *φ*_{2}, this system reads
(7)
where *ω* = *ω*_{1} − *ω*_{2} is the difference of the natural frequencies, and *F*(*φ*) = *F*_{1}(*φ*) − *F*_{2}(−*φ*).

Since the clusters are synchronized for a sufficiently small frequency mismatch *ω*, the periodic interaction function *F*(*φ*) must satisfy *F*(0) = 0 and *F*′(0) > 0. The latter means that there is a stable equilibrium *φ* = 0 for small *ω*. Aiming at a qualitative insight, we further simplify the model by assuming that *F*(*φ*) = *σ* sin(*φ* + *α*), where sin *φ* can be viewed as a first Fourier harmonic of the interaction function and *σ* as an effective coupling weight. The parameter *α* = sin^{−1}(*ω*/*σ*_{max}) is a constant phase shift assuring that the phase difference of the synchronized cluster is zero. In fact, for small *ω*, this parameter is also small and it does not play important role in the qualitative behavior of the model apart from a small shift of the synchronized state to *φ* = 0.

Another component of the model is the plasticity-driven changes of the coupling *σ*. In order to derive the equation for *σ*, we consider the STDP update in the case of a periodic motion of the clusters. We assume that the coupling *σ* is proportional to an averaged coupling between the clusters. This is a natural assumption in the case of weakly coupled systems. Let us find out how the update of the intercluster coupling depends on the phase difference *φ*. For a given phase difference *φ* and the frequencies , (here we introduced the mean frequency ), the spiking period of the both clusters can be approximated as up to small terms of order *ω*, and the distance Δ*T* between the spikes of two clusters

Since the spike time differences Δ*T* and *T* − Δ*T* occur recursively, see Fig 10(B), the updates per unit time sum to the function
(8)
where
(9)

(A) Update function *G*(*φ*) for *τ*_{p} = 2, *τ*_{d} = 5, *c*_{p} = 2, and *c*_{d} = 1.6. (B) Schematic spiking of two oscillators with spike time difference Δ*T* and periods close to *T*.

Since the update of *σ* is proportional to the obtained function, and taking into account the smallness of *δ*, this update can be written as , where *ε* is a small parameter of the coupling adaptation that controls the scale separation between the fast dynamics of the clusters and the slow dynamics of the coupling.

Additionally, the coupling strength *σ*(*t*) should be bounded to the interval [0, *σ*_{max}] by imposing cut-off conditions. More specifically, the derivative is discontinuous at the boundaries *σ* = 0 and *σ* = *σ*_{max}, i.e. for *σ* = 0 and for *σ* = *σ*_{max}. The considered cut-off corresponds to “hard” bound conditions [50]. Another possibility would be “soft” or “multiplicative” bounds [51], when the update is proportional to the distance to the boundary. We consider here the hard bound, since it corresponds to the hard bound of the STDP rule for HH system.

The final phenomenological model reads as follows
(10) (11)
with frequency mismatch *ω* > 0 and *α* = sin^{−1}(*ω*/*σ*_{max}).

#### Properties of the model.

Phase space of system (10)–(11) is two dimensional with (*φ*, *σ*) ∈ *S*^{1} × [0, *σ*_{max}]. The nullclines are given by *G*(*φ*) = 0 for and *σ* = *ω*/sin(*φ* + *α*) for in the internal points of the phase space. For the parameter values as in Fig 11, the *φ*-nullcline corresponds to the two lines *φ* = *φ** ≈ 0.23 and *φ* = −*φ**, while the *σ*-nullcline to a U-shaped nonlinear curve (grey lines in Fig 11).

Phase portraits of model (10)–(11) for (A) monostable regime of complete synchronization; (B) co-existence of stable synchronized and clustered states; and (C) bifurcation moment of transition between the phase portraits illustrated in (A) and (B). The basins of attraction of the synchronized regime (point *S*), clustered state (limit cycle indicated by thick black curve) and the saddle fixed point (*φ**, *σ**) are depicted by gray, blue, and white colors, respectively. The nullclines of the system and stable and unstable manifolds of the saddle point are indicted by the thin gray and black curves, respectively. Parameters (A) *ω* = 0.037 kHz, (B) *ω* = 0.06 kHz, (C) *ω* ≈ 0.455 Hz, and the other parameters *τ*_{p} = 2, *τ*_{d} = 5, *c*_{p} = 2, *c*_{d} = 1.6, and *ε* = 0.08.

There is just one fixed point (*φ**, *σ** = *ω*/sin *φ**) of saddle-type within the region *σ* ∈ (0, *σ*_{max}). This point is given by the intersection of the nullclines. Fig 11 shows this fixed point and its stable and unstable separatrixes (black lines). An additional fixed point as well as periodic attractor emerge in system (10)–(11) due to the non-smoothness at the boundaries. More specifically, three situations are observed:

**(I)**: One globally stable fixed point*S*= (0,*σ*_{max}) which corresponds to the fusion of the two clusters into one. The coupling*σ*=*σ*_{max}and the phase difference is zero at the fixed point, see Fig 11. All orbits are approaching this stable fixed point with time. This corresponding phase portrait is shown in Fig 11(A).**(II)**: Coexistence of the stable fixed point*S*= (0,*σ*_{max}) and a stable periodic orbit, see Fig 11(B). As in the case (I), the fixed point corresponds to the merging of two clusters. The periodic orbit corresponds to two simultaneously existing clusters. The clusters possess different frequencies and, as a result, the phase difference is not bounded and rotate along the circular direction*φ*. Part of the periodic orbit is located on the boundary*σ*= 0, i.e. vanishing inter-cluster coupling. The coupling*σ*(*t*) increases between −*φ** and*φ** and decreases otherwise. In fact, one can parameterise the coupling*σ*by the phase*φ*on the periodic attractor. In the case when*σ*(*φ**) <*σ**, the solution returns to the boundary*σ*= 0, moves along it till the orbit reaches the point (−*φ**, 0), and the periodic motion repeats.**(III)**: When max_{φ}*G*(*φ*) < 0 then there exists globally stable periodic solution*φ*=*ωt*+*φ*_{0},*σ*= 0. In such a case, the fixed point on the boundary disappears. Formally, this corresponds to an uncoupling between the clusters. However, in the original HH system, this parameter regime corresponds to complete uncoupling of all oscillators because of the depression of all synapses.

In fact, the parameter boundary between the cases (I) and (II) is determined by the condition *σ*(*φ**) = *σ**, which can be interpreted geometrically as hitting the point (−*φ**, 0) by the stable manifold of the saddle equilibrium point, see Fig 11(C). In this special case, the saddle equilibrium attracts the whole set of points from the phase space that is below the stable manifolds, see white area in Fig 11(C). In case (II), the separation between the basins of attraction of the fixed point and the periodic orbit are given by the saddle equilibrium and its stable manifolds. A sufficient condition for the case (III) is given by *c*_{d} ≥ *c*_{p} and *τ*_{d} ≥ *τ*_{p}. Under these conditions *G*(*φ*) ≤ 0 for all *φ*.

Summarizing, the case (II) corresponds to the situation when clusters are stable and do not merge into one. For this, initial conditions must belong to the basin of attraction of the periodic solution (Fig 11(B), blue domain). The analysis of the phenomenological model indicates that the cluster case always coexists with stable complete synchronization.

#### Comparison of the model and cluster dynamics in HH network.

In order to compare dynamics of the phenomenological model (10)–(11) and the original system (1)–(2), we ran a series of simulations of the HH network for parameter values that allow for a stable two-cluster solution. The phases of the clusters are calculated as , where {*t*_{1}, …, *t*_{n}, …} are spiking times with *t*_{k} < *t*_{k+1} [47]. Correspondingly, the phase difference is *φ*_{HH}(*t*) = *φ*_{1}(*t*) − *φ*_{2}(*t*). The coupling measure *σ*_{HH} is given by the mean inter-cluster coupling.

Extracting the quantities *σ*_{HH} and *φ*_{HH} from the numerically computed solutions of HH system (1)–(3) we obtain a two-dimensional projection of the solution to the plane (*φ*_{HH}, *σ*_{HH}), see Fig 12. The discontinuities in the orbits are related to the discrete STDP updates. Additionally, since the phases *φ*_{1,2}(*t*) can be firstly accessed after the both clusters fired, some of the area of the phase diagram (see white area in Fig 12) was not accessible. This “empty” area corresponds to anti-phase initial conditions, which are very sensitive, and, after each cluster fires, they appear immediately either in the red or blue area. Nevertheless, the behavior has the same qualitative features as in the phenomenological model, compare Figs 11 and 12.

Dynamics of the phase difference between the clusters *φ*_{HH} and mean inter-cluster coupling *σ*_{HH} for the solutions of the HH system (1)–(3) for different initial conditions. *N* = 50 with *N*_{s} = 7 neurons in the small cluster and *N*_{b} = 43 in the big one. Red orbits converge to the regime of complete synchronization, and blue trajectories lead to a stable two-cluster solutions. The nullclines of the phenomenological model are shown in gray. Other parameters: *τ*_{p} = 2, *τ*_{d} = 5, *c*_{p} = 2, *c*_{d} = 1.6, and *κ*_{max} = 1.5.

#### Criteria for the emergence of clusters.

Model (10)–(11) can be used to describe plasticity functions, which lead to multiple clusters. For this, we investigate numerically the condition *σ*(*φ**) = *σ**. More specifically, system (10)–(11) was initialized at the point (−*φ**, 0) and numerically integrated forward in time. If *σ*(*φ**) < *σ**, the two clusters are stable and do not merge. This procedure can be repeated for different parameter values.

In order to restrict the set of plasticity parameters, we fix *τ*_{p} = 2 and *τ*_{d} = 5 and vary *c*_{p} and *c*_{d}. The results of the simulation are shown in Fig 13(A). The white, black and grey parameter areas correspond to the appearance of stable periodic solution of (10)–(11) (case (II)), globally stable fixed point (case (I)) and the case (III), respectively.

Panel (A): system (10)–(11). White region: stable periodic solution coexisting with a stable fixed point, case II. Black region: globally stable fixed point, case I. Grey region: globally stable periodic solution with *σ* = 0. Panel (B): original system (1)–(3). White: stable two-clusters (white); black: stable synchrony and no stable clusters; grey: decoupling of all neurons. Other parameters *τ*_{p} = 2, *τ*_{d} = 5, *N* = 50, *N*_{s} = 7, and *κ*_{max} = 1.

In order to compare the parameter regions obtained for the phenomenological model (Fig 13(A)) with those for the original HH system, we ran numerical simulations of system (1)–(3) with *N* = 50 neurons and *N*_{s} = 7 neurons in the small cluster. Starting from the two-cluster state, we monitor the dynamics of the clusters. Fig 13(B) shows the results: the white region corresponds to the case when the clusters survive and stay apart after the simulation time 3000 ms, black—when the clusters merge into one synchronous group, and grey—when the clusters split into uncoupled neurons. This behaviour stays qualitatively the same for different cluster sizes. However, depending on the frequency difference between the clusters, the set of parameters allowing stable cluster states may change its size.

Comparison of the results for the phenomenological system and the HH system in the Fig 13(A) and 13(B) shows that the phenomenological model provides a reasonable approximation.

## Conclusion

Our results show that adaptive neural networks are able to generate self-consistently dynamics with different frequency bands. In our case, each cluster corresponds to a strongly connected component with a fixed frequency. Due to a sufficiently large difference of the cluster sizes and frequencies, the inter-cluster interactions are depreciated, while the intra-cluster interactions are potentiated. In this study, we describe the mechanisms behind the formation and stabilization of these clusters. In particular, we explain why the significant difference between the cluster sizes is important for the decoupling of the clusters. From a larger perspective, the decoupling of the clusters in our case is analogous to the decoupling of timescales in systems with multiple timescales.

Furthermore, we present a two-dimensional phenomenological model which allows for a detailed study of the clustering mechanisms. Despite of the approximations made by the derivation, the model coincides surprisingly well with the adaptive Hodgkin- Huxley network. Using the phenomenological model, we find parameter regions of the plasticity function, where stable frequency clustering can be observed.

Clustering behavior also emerges at the brain scale, where synchronized communities of brain regions constituting large distributed functional networks can intermittently be formed and dissolved [52, 53]. Such clustering dynamics can shape the structured spontaneous brain activity at rest as measured by fMRI. In this study, we show that slow oscillations based on the modulation of synchronized neural activity can already be formed at the resolution level of a single neural population if adaptive synapses are taken into account. These modulations of the amplitude of the mean field can be generated in a stable manner [Fig 9], see also Ref. [35]. The mechanism relies on fluctuations of the extent of synchronization of tonically firing neurons. This is caused by the splitting of the neural population into clusters and the corresponding cluster dynamics. It might contribute to the emergence of slow brain rhythms of electrical (LFP, EEG) and metabolic (BOLD) brain activity reported by [38–41].

However, other mechanisms for generating slow oscillations are possible. The papers [54, 55] discussed the emergence of slow oscillatory activity (< 1Hz) that can be observed in vivo in the cortex during slow-wave sleep, under anesthesia or in vitro in neural populations. The suggested mechanism relies on the corresponding modulation of the firing of individual neurons, and the slow oscillation at the population level was proposed to be the result of very slow bursting of individual neurons that synchronize across the neural population. In contrast, the present work shows that the slow oscillations of the population mean field can also emerge when the firing of individual neurons is not affected. The neurons may tonically fire at high frequencies. The amplitude of the population mean field then oscillates at much lower frequencies due to the slow modulation caused by the cluster dynamics.

Additionally, we would like to mention that the observed frequency clustering resembles phenomenologically the weak chimera states [56, 57] where clusters with different frequencies are formed in symmetrically coupled oscillators without adaptation. However the properties and mechanisms of the appearance of such clusters are different from those presented here, which are essentially based on the slow adaptation.

To conclude, we observe self-organised emergence of clusters in neural networks with STDP. The clustering splits the neural population into groups synchronised at different frequencies, which determine the dynamics of the clusters. These cluster dynamics might play a role in low frequency oscillations during the resting state and can be described by a two-dimensional model.

## Acknowledgments

VR, SY and RB acknowledge the financial support by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation)—Project 384950143, Project 411803875 and Project 308748074. OVP acknowledges the support by the European Union’s Horizon 2020 Research and Innovation Programme under Grant Agreement 826421 (VirtualBrainCloud). ELL acknowledges the financial support by the São Paulo Research Foundation (processes FAPESP 2016/23398-8 and 2017/13502-5).

## References

- 1. Cole MW, Bassett DS, Power JD, Braver TS, Petersen SE. Intrinsic and Task-Evoked Network Architectures of the Human Brain. Neuron. 2014;83(1):238–251. pmid:24991964
- 2. Marrelec G, Messe A, Giron A, Rudrauf D. Functional Connectivity’s Degenerate View of Brain Computation. PLoS Comput Biol. 2016;12(10):e1005031.
- 3. Bolt T, Nomi JS, Rubinov M, Uddin LQ. Correspondence Between Evoked and Intrinsic Functional Brain Network Configurations. Hum Brain Mapp. 2017;38(4):1992–2007. pmid:28052450
- 4. Zhou Y, Friston KJ, Zeidman P, Chen J, Li S, Razi A. The Hierarchical Organization of the Default, Dorsal Attention and Salience Networks in Adolescents and Young Adults. Cereb Cortex. 2018;28(2):726–737. pmid:29161362
- 5. Fornito A, Harrison BJ, Zalesky A, Simons JS. Competitive and cooperative dynamics of large-scale brain functional networks supporting recollection. Proc Natl Acad Sci U S A. 2012;109(31):12788–12793. pmid:22807481
- 6. Leonardi N, Richiardi J, Gschwind M, Simioni S, Annoni JM, Schluep M, et al. Principal components of functional connectivity: A new approach to study dynamic brain connectivity during rest. Neuroimage. 2013;83:937–950. pmid:23872496
- 7. Allen EA, Damaraju E, Plis SM, Erhardt EB, Eichele T, Calhoun VD. Tracking Whole-Brain Connectivity Dynamics in the Resting State. Cereb Cortex. 2014;24(3):663–676. pmid:23146964
- 8. Damaraju E, Allen EA, Belger A, Ford JM, McEwen S, Mathalon DH, et al. Dynamic functional connectivity analysis reveals transient states of dysconnectivity in schizophrenia. Neuroimage-clinical. 2014;5:298–308. pmid:25161896
- 9. Uhlhaas PJ, Singer W. Neural Synchrony in Brain Disorders: Relevance for Cognitive Dysfunctions and Pathophysiology. Neuron. 2006;52(1):155–168. pmid:17015233
- 10.
Gerstner W, Kistler WM, Naud R, Paninski L. Neuronal dynamics: From single neurons to networks and models of cognition; 2014.
- 11.
Hebb DO. The organization of behavior: A neuropsychological approach. John Wiley & Sons; 1949.
- 12. Brown T, Chapman P, Kairiss E, Keenan C. Long-term synaptic potentiation. Science (80-). 1988;242(4879):724–728.
- 13. Bliss TVP, Collingridge GL. A synaptic model of memory: long-term potentiation in the hippocampus. Nature. 1993;361(6407):31–39. pmid:8421494
- 14. Gerstner W, Kempter R, van Hemmen JL, Wagner H. A neuronal learning rule for sub-millisecond temporal coding. Nature. 1996;383(6595):76–78. pmid:8779718
- 15. Markram H. Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs. Science (80-). 1997;275(5297):213–215.
- 16. Bi Gq, Poo Mm. Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type. J Neurosci. 1998;18(24):10464–10472.
- 17. Abbott LF, Nelson SB. Synaptic plasticity: Taming the beast. Nat Neurosci. 2000;3(11s):1178–1183. pmid:11127835
- 18. Bi Gq, Poo Mm. Synaptic Modification by Correlated Activity: Hebb’s Postulate Revisited. Annu Rev Neurosci. 2001;24(1):139–166.
- 19. Hoppensteadt FC, Izhikevich EM. Synaptic organizations and dynamical properties of weakly connected neural oscillators II. Learning phase information. Biol Cybern. 1996;75(2):129–135.
- 20. Seliger P, Young SC, Tsimring LS. Plasticity and learning in a network of coupled phase oscillators. Phys Rev E. 2002;65(4):041906.
- 21. Clopath C, Büsing L, Vasilaki E, Gerstner W. Connectivity reflects coding: a model of voltage-based STDP with homeostasis. Nat Neurosci. 2010;13(3):344–352. pmid:20098420
- 22. Tass PA, Popovych OV. Unlearning tinnitus-related cerebral synchrony with acoustic coordinated reset stimulation: theoretical concept and modelling. Biol Cybern. 2012;106:27–36. pmid:22350536
- 23. Tass PA, Majtanik M. Long-term anti-kindling effects of desynchronizing brain stimulation: a theoretical study. Biol Cybern. 2006;94(1):58–66. pmid:16284784
- 24. Popovych O, Yanchuk S, Tass PAPA. Self-organized noise resistance of oscillatory neural networks with spike timing-dependent plasticity. Sci Rep. 2013;3(1):2926. pmid:24113385
- 25. Lücken L, Popovych OV, Tass PA, Yanchuk S. Noise-enhanced coupling between two oscillators with long-term plasticity. Phys Rev E. 2016;93(3):032210. pmid:27078347
- 26. Ashourvan A, Telesford QK, Verstynen T, Vettel JM, Bassett DS. Multi-scale detection of hierarchical community architecture in structural and functional brain networks. PLOS ONE. 2019;14(5):1–36.
- 27. Bassett DS, Bullmore E, Verchinski BA, Mattay VS, Weinberger DR, Meyer-Lindenberg A. Hierarchical Organization of Human Cortical Networks in Health and Schizophrenia. Journal of Neuroscience. 2008;28(37):9239–9248. pmid:18784304
- 28. Bassett DS, Greenfield DL, Meyer-Lindenberg A, Weinberger DR, Moore SW, Bullmore ET. Efficient Physical Embedding of Topologically Complex Information Processing Networks in Brains and Computer Circuits. PLOS Computational Biology. 2010;6(4):1–14.
- 29. Betzel RF, Medaglia JD, Papadopoulos L, Baum GL, Gur R, Gur R, et al. The modular organization of human anatomical brain networks: Accounting for the cost of wiring. Network Neuroscience. 2017;1(1):42–68. pmid:30793069
- 30. Lohse C, Bassett DS, Lim KO, Carlson JM. Resolving Anatomical and Functional Structure in Human Brain Organization: Identifying Mesoscale Organization in Weighted Network Representations. PLOS Computational Biology. 2014;10(10):1–17.
- 31. Aoki T, Aoyagi T. Self-organized network of phase oscillators coupled by activity-dependent interactions. Phys Rev E. 2011;84(6):66109.
- 32. Kasatkin DV, Yanchuk S, Schöll E, Nekorkin VI. Self-organized emergence of multilayer structure and chimera states in dynamical networks with adaptive couplings. Phys Rev E. 2017;96(6):062211. pmid:29347359
- 33. Berner R, Schöll E, Yanchuk S. Multi-clusters in networks of adaptively coupled phase oscillators networks. SIAM J Appl Dyn Syst (to appear).
- 34. Berner R, Fialkowski J, Kasatkin D, Nekorkin V, Yanchuk S, Schöll E. Hierarchical frequency clusters in adaptive networks of phase oscillators. Chaos (to appear).
- 35. Popovych OV, Xenakis MN, Tass PA. The Spacing Principle for Unlearning Abnormal Neuronal Synchrony. PLoS One. 2015;10(2):e0117205. pmid:25714553
- 36. Wittenberg GM, Wang SSH. Malleability of Spike-Timing-Dependent Plasticity at the CA3-CA1 Synapse. J Neurosci. 2006;26(24):6610–6617. pmid:16775149
- 37. Kepecs A, van Rossum MCW, Song S, Tagner J. Spike-timing-dependent plasticity: common themes and divergent vistas. Biol Cybern. 2002;87:446–458. pmid:12461634
- 38. Monto S, Palva S, Voipio J, Palva JM. Very Slow EEG Fluctuations Predict the Dynamics of Stimulus Detection and Oscillation Amplitudes in Humans. Journal of Neuroscience. 2008;28(33):8268–8272. pmid:18701689
- 39. Alvarado-Rojas C, Valderrama M, Fouad A, Ihle M, Teixeira C, Sales F, et al. Slow modulations of high-frequency activity (40-140 Hz) discriminate preictal changes in human focal epilepsy. Scientific reports. 2014;4:4545.
- 40. Mantini D, Perrucci MG, Del Gratta C, Romani GL, Corbetta M. Electrophysiological signatures of resting state networks in the human brain. Proc Natl Acad Sci U S A. 2007;104(32):13170–13175. pmid:17670949
- 41. Magri C, Schridde U, Murayama Y, Panzeri S, Logothetis NK. The Amplitude and Timing of the BOLD Signal Reflects the Relationship between Local Field Potential Power at Different Frequencies. J Neurosci. 2012;32(4):1395–1407. pmid:22279224
- 42. Maistrenko YL, Lysyansky B, Hauptmann C, Burylko O, Tass PA. Multistability in the Kuramoto model with synaptic plasticity. Phys Rev E. 2007;75(6):066207. Nonlinearity 2016; 29(5):1468–1486.
- 43. Cateau H, Kitano K, Fukai T. Interplay between a phase response curve and spike-timing-dependent plasticity leading to wireless clustering. Phys Rev E. 2008;77(5):051909.
- 44. Hodgkin A, Huxley A. A quantitative description of membrane current and its application to conduction and excitation in nerve. Bull Math Biol. 1990;52(1-2):25–71. pmid:2185861
- 45. Hansel D, Mato G, Meunier C. Phase Dynamics for Weakly Coupled Hodgkin-Huxley Neurons. Europhys Lett. 1993;23(5):367–372.
- 46.
Hoppensteadt FC, Izhikevich EM. Weakly Connected Neural Networks. Springer-Verlag, New York; 1997.
- 47.
Pikovsky A, Rosenblum M, Kurths J. Synchronization. {A} Universal Concept in Nonlinear Sciences. Cambridge University Press; 2001.
- 48. Guckenheimer J. Isochrons and phaseless sets. J Math Biol. 1975;1(3):259–273. pmid:28303309
- 49.
Winfree AT. The Geometry of Biological Time. vol. 12. Springer; 2001. Available from: http://link.springer.com/10.1007/978-1-4757-3484-3.
- 50. Song S, Miller KD, Abbott LF. Competitive Hebbian learning through spike-timing-dependent synapticplasticity. Nat Neurosci. 2000;3(9):919–926. pmid:10966623
- 51. Rubin J, Lee DD, Sompolinsky H. Equilibrium Properties of Temporally Asymmetric Hebbian Plasticity. Phys Rev Lett. 2001;86(2):364–367. pmid:11177832
- 52. Deco G, Jirsa V, McIntosh AR, Sporns O, Kotter R. Key role of coupling, delay, and noise in resting brain fluctuations. Proc Natl Acad Sci U S A. 2009;106(25):10302–10307. pmid:19497858
- 53. Ponce-Alvarez A, Deco G, Hagmann P, Romani GL, Mantini D, Corbetta M. Resting-State Temporal Synchronization Networks Emerge from Connectivity Topology and Heterogeneity. PLoS Comput Biol. 2015;11(2):UNSP e1004100. pmid:25692996
- 54. Bazhenov M, Timofeev I, Steriade M, Sejnowski TJ. Model of thalamocortical slow-wave sleep oscillations and transitions to activated states. J Neurosci. 2002;22(19):8691–8704. pmid:12351744
- 55. Compte A, Sanchez-Vives MV, McCormick DA, Wang XJ. Cellular and network mechanisms of slow oscillatory activity (< 1 Hz) and wave propagations in a cortical network model. J Neurophysiol. 2003;89(5):2707–2725. pmid:12612051
- 56. Ashwin P, Burylko O. Weak chimeras in minimal networks of coupled phase oscillators. Chaos 2015;25(1):13106.
- 57. Bick C, Ashwin P. Chaotic weak chimeras and their persistence in coupled populations of phase oscillators. Nonlinearity 2016;29(5):1468–1486.