Figures
Abstract
The synchronization of different γ-rhythms arising in different brain areas has been implicated in various cognitive functions. Here, we focus on the effect of the ubiquitous neuronal heterogeneity on the synchronization of ING (interneuronal network gamma) and PING (pyramidal-interneuronal network gamma) rhythms. The synchronization properties of rhythms depends on the response of their collective phase to external input. We therefore determine the macroscopic phase-response curve for finite-amplitude perturbations (fmPRC) of ING- and PING-rhythms in all-to-all coupled networks comprised of linear (IF) or quadratic (QIF) integrate-and-fire neurons. For the QIF networks we complement the direct simulations with the adjoint method to determine the infinitesimal macroscopic PRC (imPRC) within the exact mean-field theory. We show that the intrinsic neuronal heterogeneity can qualitatively modify the fmPRC and the imPRC. Both PRCs can be biphasic and change sign (type II), even though the phase-response curve for the individual neurons is strictly non-negative (type I). Thus, for ING rhythms, say, external inhibition to the inhibitory cells can, in fact, advance the collective oscillation of the network, even though the same inhibition would lead to a delay when applied to uncoupled neurons. This paradoxical advance arises when the external inhibition modifies the internal dynamics of the network by reducing the number of spikes of inhibitory neurons; the advance resulting from this disinhibition outweighs the immediate delay caused by the external inhibition. These results explain how intrinsic heterogeneity allows ING- and PING-rhythms to become synchronized with a periodic forcing or another rhythm for a wider range in the mismatch of their frequencies. Our results identify a potential function of neuronal heterogeneity in the synchronization of coupled γ-rhythms, which may play a role in neural information transfer via communication through coherence.
Author summary
The interaction of a large number of oscillating units can lead to the emergence of a collective, macroscopic oscillation in which many units oscillate in near-unison or near-synchrony. This has been exploited technologically, e.g., to combine many coherently interacting, individual lasers to form a single powerful laser. Collective oscillations are also important in biology. For instance, the circadian rhythm of animals is controlled by the near-synchronous dynamics of a large number of individually oscillating cells. In animals and humans brain rhythms reflect the coherent dynamics of a large number of neurons and are surmised to play an important role in the communication between different brain areas. To be functionally relevant, these rhythms have to respond to external inputs and have to be able to synchronize with each other. We show that the ubiquitous heterogeneity in the properties of the individual neurons in a network can contribute to that ability. It can allow the external inputs to modify the internal network dynamics such that the network can follow these inputs over a wider range of frequencies. Paradoxically, while an external perturbation may delay individual neurons, their ensuing within-network interaction can overcompensate this delay, leading to an overall advance of the rhythm.
Citation: Xu X, Riecke H (2021) Paradoxical phase response of gamma rhythms facilitates their entrainment in heterogeneous networks. PLoS Comput Biol 17(6): e1008575. https://doi.org/10.1371/journal.pcbi.1008575
Editor: Boris S. Gutkin, École Normale Supérieure, College de France, CNRS, FRANCE
Received: November 20, 2020; Accepted: May 18, 2021; Published: June 30, 2021
Copyright: © 2021 Xu, Riecke. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The code and data are available at https://doi.org/10.21985/n2-x1wn-j516.
Funding: This work was funded by the National Institutes of Health, https://www.nidcd.nih.gov/ grant DC015137 to HR and National Science Foundation, Division of Civil, Mechanical and Manufacturing Innovation https://www.nsf.gov/div/index.jsp?div=DMS CMMI-1435358 to HR. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Collective oscillations or rhythms representing the coherent dynamics of a large number of coupled oscillators play a significant role in many systems. In the technological realm they range from laser arrays and Josephson junctions to micromechanical oscillators [1, 2]. Among the important biological examples are the heart rhythm, the circadian rhythm generated by the suprachiasmatic nucleus [3], the segmentation clock controlling the somite formation during development [4], and brain waves [5]. One prominent brain rhythm is the widely observed γ-rhythm with frequencies in the range 30–100Hz. The coherent spiking of the neurons underlying this rhythm likely enhances the downstream impact of the neurons participating in the rhythm. The rhythmic alternation of low and high activity has been suggested to play a significant role in the communication between different brain areas [6, 7]. That communication has also been proposed to be controlled by the coherence of the rhythms in the participating brain areas [8–13].
For collective oscillations or rhythms to play a constructive role in a system they need to respond adequately to external perturbations and stimuli. For instance, for the circadian rhythm it is essential that it is reliably entrained by light and phase-locks to the day-night cycle. Similarly, if rhythms are to play a significant role in the communication between different brain areas, their response to input from other areas represents a significant determinant of their function. Moreover, the stimulation and entrainment of γ-rhythms by periodic sensory input is being considered as a therapeutic approach for some neurodegenerative diseases [14].
Even small perturbations can affect oscillations significantly in that they can advance or delay the oscillations, i.e. they can change the phase of the oscillators. This change typically depends not only on the strength of the perturbation but, importantly, also on the timing of the perturbations and is expressed in terms of the phase response curve (PRC), which has been studied extensively for individual oscillators [15]. For infinitesimal perturbations the PRC can be determined elegantly using the adjoint method [16].
If the collective oscillation of a network of interacting oscillators is sufficiently coherent, that system can be thought of as a single effective oscillator. Consequently, the response of the macroscopic phase of the collective oscillation to external perturbations and the mutual interaction of multiple collective oscillations is of interest. The macroscopic phase-response curve (mPRC) has been obtained in various configurations, including noise-less heterogeneous phase oscillators [17, 18], noisy identical phase oscillators [19, 20], noisy excitable elements [21], and noisy oscillators described by the theta-model [22], which is equivalent to the quadratic integrate-and-fire model for spiking neurons. Recent work has used the exact mean-field theory of [23], which is related to the Ott-Antonsen theory [24, 25] and reduces the dynamics of networks of quadratic integrate-and-fire neurons to two coupled differential equations for the firing rate and the mean voltage, to develop a method to obtain the infinitesimal macroscopic PRC (imPRC) for excitatory-inhibitory spiking networks [26, 27].
A key difference between the response of an individual oscillator to a perturbation and that of a collective oscillation is the fact that the degree of synchrony of the collective oscillation can change as a result of the perturbation, reflecting a change in the relations between the individual oscillators. Thus, the phase response of a collective oscillation to a brief perturbation consists not only of the immediate change in the phases of the individual oscillators caused by the perturbation, but includes also a change in the collective phase that can result from the subsequent convergence back to the phase relationship between the oscillators corresponding to the synchronized state, which is likely to have been changed by the perturbation [18]. Interestingly, it has been observed that the infinitesimal macroscopic phase response can be qualitatively different from the phase response of the individual elements. Thus, even if the individual oscillators have a type-I PRC, i.e. a PRC that is strictly positive or negative, the mPRC of the collective oscillation can be of type II, i.e. it can exhibit a sign change as a function of the phase [21, 22, 28].
Here we investigate the interplay between external perturbations and the internal interactions among neurons in inhibitory and in excitatory-inhibitory networks exhibiting γ-rhythms of the ING- and of the PING-type. We focus on networks comprised of neurons that are not identical, leading to a spread in their individual phases and a reduction in the degree of their synchrony. How does this phase dispersion affect the response of the macroscopic phase of the rhythm to perturbations? Does it modify the ability of the network to follow a periodic perturbation?
We show that the dispersion in the phase together with the within-network interactions among the neurons can be the cause of a paradoxical phase response: an external perturbation that delays each individual neuron can advance the macroscopic rhythm. We identify the following mechanism underlying this paradoxical response: external perturbations that delay individual neurons sufficiently allow the within-network inhibition generated by early-spiking neurons to suppress the spiking of less excited neurons. This results in a reduced within-network inhibition, which reduces the time to the next spike volley, speeding up the rhythm. This paradoxical phase response increases with the neuronal heterogeneity and allows the network to phase-lock to periodic external perturbations over a wider range of detuning. Thus, the desynchronization within the network enhances its synchronizability with other networks. The mechanism is closely related to that underlying the enhancement of synchronization of collective oscillations by uncorrelated noise [29] and the enhanced entrainment of the rhythm of a homogeneous network to periodic input if that input exhibits phase dispersion across the network [30, 31]. We demonstrate and analyze these behaviors for networks of inhibitory neurons (ING-rhythm) and for networks comprised of excitatory and inhibitory neurons (PING-rhythm).
Results
We investigated the impact of neuronal heterogeneity on the response of the phase of γ-rhythms to brief external perturbations and the resulting ability of rhythms to synchronize to periodic input. As described in the Methods, we used networks comprised of minimal linear (IF) and quadratic (QIF) integrate-and-fire neurons that interact with each other through synaptic pulses modeled via delayed double-exponentials. To study ING-rhythms, all neurons were inhibitory and all-to-all coupled, while for the PING-rhythms we used excitatory-inhibitory networks with all-to-all E-I and I-E connections. Throughout, we implemented the neuronal heterogeneity by injecting a different steady bias current Ibias into each neuron. Our analysis suggests that the origin of the neuronal heterogeneity plays only a minor role as long as it leads to a dispersion of their spike times [29].
Paradoxical phase response of heterogeneous networks: ING-Rhythm
In the absence of external perturbations the all-to-all inhibition among the neurons leads to rhythmic firing of the neurons. Due to their heterogeneity they did not spike synchronously but sequentially, as shown in Fig 1A, where the neurons are ordered by the strength of their bias current. The dependence of the phase dispersion on the coefficient of variation of the heterogeneity in the bias current (CV) is shown in S1 Fig. For sufficiently large heterogeneity some neurons never spiked: while the weak bias current they received would have been sufficient to induce a spike eventually, the strong inhibition that was generated by the neurons spiking earlier in the cycle suppressed those late spikes. Neurons with strong bias current could spike multiple times.
(A) Top: spike raster of neurons spiking sequentially in the order of their input strength (increasing with neuron index). Bottom: mean voltage across the network (LFP). (B) External inhibition advanced the rhythm. Top: raster plot of spikes without (black) and with (red) external inhibitory pulse. Bottom: Average of the total inhibitory current each neuron received from the other neurons within the network. I(I) = 20.4 pA, , fnetwork = 47 Hz. In (B), perturbations were made with a square-wave inhibitory current pulse with duration 0.1 ms and amplitude 3200 pA to each neuron, resulting in a 4 mV rapid hyperpolarization.
A brief, inhibitory external input delivered to all neurons (green dashed line in Fig 1B) delayed each neuron. The degree of this individual delay depended on the timing of the input, as is reflected in the PRC of the individual neurons. If the perturbation was applied during the time between the spike volleys, the delay of each neuron had no further consequence and the overall rhythm was delayed. However, if the same inhibitory perturbation arrived during a spike volley (dashed green line in Fig 1B), it could advance the overall rhythm. As illustrated in Fig 1B, only the spiking of the late neurons was delayed by the perturbation. Importantly, with this delay some neurons did not spike before the within-network inhibition triggered by the early-spiking neurons (dashed blue line in Fig 1B) became strong enough to suppress the spiking of the late neurons altogether. With fewer neurons spiking, the all-to-all inhibition within the network was reduced, allowing all neurons to recover earlier, which lead to a shorter time to the next spike volley. If the speed-up was larger than the immediate delay induced by the external inhibition, the overall phase of the rhythm was advanced by the delaying inhibition.
As the example in Fig 1B shows, the paradoxical phase response requires proper timing of the perturbation. We therefore determined quantitatively the macroscopic phase-response curve (mPRC) of the rhythm. To do so we measured computationally the amount a brief current injection shifted the phase of the rhythm (Fig 2A). We defined the phase ϕinh of the perturbation as the normalized time since the first spike in the most recent volley of spikes. Reflecting the strictly positive PRC of the individual IF neurons, without heterogeneity (CV = 0) external inhibition always delayed the rhythm, independent of the timing of the pulse. In contrast, in heterogeneous networks the rhythm could be advanced if the same inhibitory perturbation was applied shortly after the first spikes in the spike volley (ϕinh > 0). Increasing the neuronal heterogeneity enhanced this phase advance, since it shifted the within-network inhibition driven by the leading neurons to earlier times, while it delayed the lagging neurons. As a result, for the same external perturbation, a larger fraction of neurons that would spike in the absence of the external inhibition was sufficiently delayed to have their spikes be suppressed by the within-network inhibition (cf. Fig 1B), reducing the within-network inhibition and with it the time to the next spike volley. To keep the frequency of the unperturbed network fixed in Fig 2A, we reduced the tonic input with increasing heterogeneity, which enhanced the phase advance. However, even if the tonic input was kept fixed, the phase advance increased with heterogeneity (S2 Fig).
(A) Phase shift in response to inhibition for different neuronal heterogeneity but fixed natural frequency (fnetwork = 40Hz). The paradoxical phase advance increased with neuronal heterogeneity. (B) fmPRC changed qualitatively with the amplitude of the perturbation. Left: fmPRC for three different perturbation amplitudes. Right: raster plot of spikes without (black) and with (red) external inhibition. Top: strong perturbation advanced the network. Bottom: weak perturbation applied at the same time as in the top figure. The network was delayed. (C) Maximal phase advance as a function of neuronal heterogeneity and external inhibition strength. The threshold of the inhibition amplitude to obtain an advance decreased with heterogeneity (white line). fnetwork was kept constant (fnetwork = 40Hz). In (A)-(C), perturbations were made with a square-wave inhibitory current pulse with duration 0.1 ms to each neuron. In (A), the amplitude of the current was 1600 pA, resulting in a 2 mV rapid hyperpolarization.
For weak heterogeneity the paradoxical phase response occurred only for sufficiently strong perturbations, i.e. it did not arise in the infinitesimal macroscopic PRC (imPRC). Thus, the phase response changed qualitatively when the amplitude of the perturbation was strong enough to delay the spikes of sufficiently many slow neurons until the self-inhibition of the network set in and suppressed their spikes (Fig 2B). With sufficiently large heterogeneity, the dispersion was large enough that the spikes of the lagging neurons were suppressed by the self-inhibition of the network even in the absence of an external perturbation. In that regime the paradoxical phase response occurred even for infinitesimal perturbations (to the right of the white line in Fig 2C).
The paradoxical phase response was robust with respect to changes in the natural frequency of the network, the coupling strength, and the effective synaptic delay, as long as the rhythm persisted. The paradoxical phase advance increased with decreasing natural frequency of the network, since the inhibition had a stronger effect for lower mean input strength (Fig 3A). Varying the within-network coupling strength by more than a factor of 20 only moderately affected the paradoxical phase response (Fig 3B) and the strength of the rhythm (Fig 3C). With increasing within-network coupling strength, a larger fraction of spiking neurons was delayed, resulting in a larger temporal advance (Fig 3B top). Nevertheless, since the rhythm slowed down with increasing within-network coupling strength (Fig 3C, size of the perturbations in Fig 3B marked in the y-axis tick labels), the phase advance, which was defined as the temporal advance normalized by the period of the LFP, decreased with coupling strength (Fig 3B bottom). Additionally, even without explicit synaptic delay (τd = 0), the effective delay given by the double-exponential synaptic interaction was sufficient to render a paradoxical response (Fig 3D). However, when this effective delay was reduced by decreasing the rise time of the synaptic current, the rhythm itself developed a strong subharmonic component and eventually disintegrated (Fig 3E). In the subharmonic regime the paradoxical phase advance alternated in consecutive cycles of the rhythm.
(A) The phase advance of the fmPRC decreased with the natural frequency (CV(I) = 0.15). (B) The fmPRC did not depend sensitively on the within-network coupling strength W (CV(I) = 0.15, I(I) = 10.8 pA). Top: the temporal advance increased with within-network coupling strength. Bottom: the phase advance decreased with within-network coupling strength. (C) The Fourier spectrum of the LFP as a function of the within-network coupling strength W. Parameters as in (B). (D) Paradoxical phase response in the absence of an explicit delay, τd = 0, for different synaptic rise times (CV(I) = 0.05, I(I) = 15.84 pA). For low
(blue curve), the PRC alternated in subsequent cycles reflecting the subharmonic nature of the rhythm, but it still showed a strong paradoxical component. (E) The Fourier spectrum of the LFP as a function of the synaptic time constant of rise
. With decreasing
, a subharmonic peak emerged and eventually the rhythm disintegrated. Parameters as in D. In (A), (B) and (D), perturbations were made with a square-wave inhibitory current pulse with duration 0.1 ms to each neuron. In (A) and (B), the amplitude of the current was 1600 pA, resulting in a 2 mV rapid hyperpolarization. In (D), the amplitude of the current was 400 pA, resulting in a 0.5 mV rapid hyperpolarization.
Enhancing entrainment of ING-rhythms through neuronal heterogeneity
In order to allow communication by coherence [11, 32], the rhythms in different brain areas need to be sufficiently phase-locked with each other. As a simplification of two interacting γ-rhythms, we therefore investigated the ability of the rhythm in a network to be entrained by a periodic external input, particularly focusing on the possibly facilitating role of neuronal heterogeneity. Motivated by the paradoxical phase response induced by the heterogeneity, we addressed, in particular, the question whether an ING network can be sped up by inhibition to entrain it with a faster network.
The network considered here was the same as that used to analyze the fmPRC. The within-network interaction was an all-to-all inhibition with synaptic delay τd, resulting in a rhythm with natural frequency fnatural. Each neuron received heterogeneous input Ibias and inhibitory periodic pulses with frequency fclock. The latter can be considered as the output of another ING-network and were, in fact, generated that way (Fig 4). We refer to this external input as the ‘clock’. All neurons in the ‘clock’ network received the same input. Thus, their spiking had no dispersion and their spikes were perfectly synchronous. The detuning Δf = fclock − fnatural was a key control parameter.
(A) ING rhythm receives periodic inhibitory input generated from another ‘clock’ ING rhythm. (B) PING rhythm receives periodic excitatory input by its E-population generated from another ‘clock’ PING rhythm.
For periodic input the fmPRC allows the definition of an iterated map for the phase of the network relative to the nth clock cycle. For periodic δ-pulses that map is shown in Fig 5A. For positive detuning, i.e. when the clock is faster than the network, entrainment requires that the phase response is paradoxical in order for the rhythm to be sped up by the inhibition. If the heterogeneity and the resulting phase response are sufficiently large, the maximum of the iterated map crosses the diagonal, generating a stable and an unstable fixed point. The former is the desired entrained state.
(A) Iterated map for the phase of the network relative to the periodic inhibition. Without coupling the network falls back by dΦ in each cycle. For sufficiently large advancing phase response the network can be synchronized by faster periodic inhibition. (B) Top: The bifurcation diagram of the iterated map for
with varying detuning Δf. To the right of the magenta dashed line (Δf = 7.28 Hz) the attractors involve points on both sides of the discountinuity of the map. Bottom from left to right: iterated maps for
for Δf = 0, 2.44, 8.8 Hz. The distance between the diagonal and subdiagonal line represents the detuning between the network and periodic input. In (A), the fmPRC was determined for a δ-pulse perturbation, in (B) for a double-exponential inhibitory current (cf. Eqs (2) and (3)) was used as in Fig 6.
As the detuning is increased the iterated map is shifted downward. This can decrease the slope of the iterated map at the fixed point below -1, destabilizing the fixed point in a period-doubling bifurcation. For periodic pulses comprised of double-exponential inhibitory currents (cf. Eqs (2) and (3)) a rich bifurcation scenario emerged (Fig 5B). Note that the strength of the periodic input is significantly larger than that of the δ-pulses used in Fig 5A. As a result, the map is not continuous and not unimodal (cf. first bottom panel of Fig 5B). Nevertheless, for Δf < 7.17 Hz the attractor remains near the unstable fixed point and displays a period-doubling cascade to chaos and multiple periodic windows. For Δf > 7.28 Hz, however, the attractor includes points on both sides of the discontinuity (cf. third bottom panel in Fig 5B).
Having clarified the role of the fmPRC in the network’s synchronizability and ability to phase-lock, we investigated the role of neuronal heterogeneity in more detail (Fig 6). To do that, we adjusted for each value CV of the input heterogeneity the mean input strength I(I) (cf. Eq (4)) so as to keep the natural frequency fnetwork constant (fnetwork = 44 Hz). Then we determined the extent of synchronization and phase-locking of the network under the influence of periodic inhibitory input as a function of the detuning Δf and neuronal heterogeneity CV. As shown above, with heterogeneity, the fmPRC could be biphasic with the amplitude of the paradoxical phase response increasing with neuronal heterogeneity. Expecting that for sufficiently large heterogeneity an ING-rhythm could be accelerated by a faster periodic inhibition, we tested phase-locking predominantly for positive detuning, corresponding to fclock > fnetwork. We first investigated how neuronal heterogeneity affected the synchronization by comparing the dominant frequency fdom in the Fourier spectrum of the network’s LFP with fclock. In Fig 6A, the color hue indicates the ratio fdom: fclock. For small heterogeneity, fdom was a rational multiple of fclock that depended on the detuning, while for sufficiently large CV the network became synchronized in the sense that fdom = fclock (yellow). The range of Δf allowing synchronization became wider with increasing neuronal heterogeneity, implying that the neuronal heterogeneity enhanced the synchronization of the ING-rhythm. However, note that fdom = fclock did not imply a perfectly synchronized or a 1:1 phase-locked state. In fact, various different subharmonic responses arose: example 2 shows a period-4 state, while in example 3 the dynamics were actually chaotic (Fig 6A) even though fdom = fclock. Motivated by these observations, we divided the states into three types:
- Type 1: fdom ≠ fclock, not synchronized, not phase-locked (Example 4 in Fig 6A).
- Type 2: fdom = fclock with subharmonic response (‘frequency synchronization’). The network may display rational ratio phase-locking with the forcing (Example 2 in Fig 6A) or may be poorly phase-locked (Example 3 in Fig 6A).
- Type 3: fdom = fclock, no subharmonic response, (‘phase synchronization’). The network is 1-to-1 phase-locked with the forcing (Example 1 in Fig 6A).
(A) Synchronization quantified using fdom: fclock with fdom and fclock being the dominant frequencies of the Fourier spectrum of the LFP of the network and the clock, respectively. The neuronal heterogeneity enhanced the synchronization by shifting fdom to fclock. Example 1: Synchronized with 1:1 phase-locking. Example 2: Synchronized with subharmonic response (period 4). Example 3: synchronized with subharmonic response (chaotic). Example 4: Not synchronized. Squares and dashed lines in the iterated map for indicate clock cycles in which the network did not spike (
was arbitrarily set to 2). (B) Subharmonic response. Color hue and saturation indicate the frequency ratio fsub: fclock and the ratio of the Fourier power at these two frequencies. fsub is the frequency of the dominant peak of the network power spectrum that satisfies fsub < fclock. The power ratio is capped at 1. Dashed line marks the value of input heterogeneity used in Fig 5B. (C) Spiking variability and
as a function of neuronal heterogeneity and detuning. Color hue indicates the fraction of clock cycles without spikes in the network. In particular, red indicates that the network spikes in every cycle. Color saturation indicates
. The neuronal heterogeneity enhances the tightness of the phase-locking.
The phase diagram Fig 6A does not differentiate between types 2 and 3. It only shows that neuronal heterogeneity enhanced the synchronization of the network by shifting fdom to fclock. Therefore, we studied whether neuronal heterogeneity also enhanced the synchronization by weakening the subharmonic response and changing the synchronized state from type 2 to type 3, as well as whether the dynamics of the fmPRC shown in the bifurcation diagram Fig 5B could predict the phase relationship between the network and the clock. Using the same simulation setup as in Fig 6A, the subharmonic response is shown in Fig 6B. The color hue indicates the ratio fsub: fclock, where fsub is the frequency of the dominant peak of the LFP power spectrum that satisfies fsub < fclock. The color saturation gives the ratio of the powers at fsub and fclock (capped at 1). Thus, over most of the range of positive detuning and neuronal heterogeneity tested, the fading-away of the color with increasing heterogeneity reveals that the neuronal heterogeneity weakened the subharmonic response. Over a small range of positive detuning, increasing neuronal heterogeneity from small values induced perfect synchronization (type 3) by weakening the subharmonic response with frequency ratio fsub: fclock = 1: 2; the system traversed a continuous period-doubling bifurcation in reverse, with type 2 (red) giving way to type 3 (white). Together with Fig 6A, this showed that neuronal heterogeneity could enhance the synchronization both by making fdom = fclock (from type 1 to type 2) and by weakening the subharmonic response (from type 2 to type 3). The range of detuning where increasing heterogeneity induced a type 3 synchronization became wider for larger synaptic delay within the network (S3 Fig). Note that the bifurcation diagram (Fig 5B) based on the fmPRC agrees well with the subharmonic response marked along the dashed line at CV = 0.1 in Fig 6B, suggesting that the fmPRC can well predict the subharmonic response and persistent phase response of the network.
In addition to enhancing the frequency synchonization, neuronal heterogeneity was also able to increase the tightness of the phase-locking. Over most of the parameter regime investigated, the variance of the phase of the network relative to the periodic input decreased with increasing heterogeneity, as indicated by the decrease in the color saturation in Fig 6C. In fact, for detuning between 0 Hz and 2 Hz the heterogeneity reduced
to 0 (white), corresponding to the 1:1 phase-locked state. Even for the 1:2 phase-locked state (cf. the red area in Fig 6B)
was very small for a range of heterogeneity and detuning (2 Hz to 4 Hz), indicating tight phase locking. Except for type-3 synchronized states the size of the spike volleys varied between clock cycles. In fact, over wide ranges of the parameters the network did not spike in each of the clock cycles, as indicated by the color hue in Fig 6C, which gives the fraction of cycles with no network spikes (e.g. Example 4 in Fig 6A).
Paradoxical phase response and entrainment of PING rhythms
Many γ-rhythms involve not only inhibitory neurons, but arise from the mutual interaction of excitatory (E) and inhibitory (I) neurons (PING rhythm) [33]. The key elements to obtain a paradoxical phase response and the ensuing enhanced synchronization are self-inhibition within the network, neuronal heterogeneity and effective synaptic delay. Since in PING rhythms the connections from excitatory cells (E-cells) to inhibitory cells (I-cells) and back to the E-cells form an effective self-inhibiting loop, we asked whether PING-rhythms can exhibit behavior similar to the behavior we identified for ING-rhythms.
Considering a PING-rhythm generated by an E-I network comprised of IF neurons, we first studied its fmPRC. To avoid that all I-cells receive identical input and therefore spike as a single unit, the I-cells received, in addition to the excitation from the E-cells, heterogeneous, tonic, Gaussian-distributed subthreshold input with mean I(I) = 3.6 pA and CV(I) = 0.167. The phase response of the network was probed by applying an identical external excitatory perturbation to all E-cells and recording the resulting phase shift (cf. Eqs (8) and (9)) of the E-population, averaged across 500 realizations of the subthreshold input to the I-cells (Fig 7A). More specifically, the perturbations consisted of a square-wave excitatory current pulse with amplitude 76 pA and duration 0.1 ms to each E-cell, resulting in a 2 mV rapid depolarization. Without neuronal heterogeneity the external excitation always advanced the phase of the rhythm resulting in an fmPRC that was strictly positive. In the heterogeneous case, however, the PING rhythm exhibited a paradoxical phase response, whereby the collective rhythm was delayed while the individual neurons were advanced by the excitation. The delay was caused by the increase of self-inhibition within the network that was generated by the additional spikes in the E-population, which in turn drove additional spikes in the I-population. In contrast to the fmPRC of the ING-rhythm, this paradoxical phase response was not monotonic in the heterogeneity. While weak heterogeneity resulted in strong delay, the delay decreased with increasing intermediate CV-values and only increased again for larger CV (Fig 7B left top). This non-monotonicity arose because we kept the frequency of the network constant as we increased its heterogeneity. This required a decrease in the tonic input to the E-cells with increasing heterogeneity. For the stronger tonic input used for weak heterogeneity the same external perturbation elicited more additional spikes than it did for strong heterogeneity where the tonic input was weaker (cf. titles of subpanels of Fig 7B). The total number of spikes occurring in each cycle of the unperturbed network also decreased with increasing heterogeneity. Consequently, the relative change in the number of spikes and in the inhibitory synaptic conductance induced by the perturbation were non-monotonic in the heterogeneity. As a result, the phase delay became non-monotonic.
(A) fmPRC of PING networks with constant natural frequency (fnetwork = 41 Hz) but different neuronal heterogeneity. Only with neuronal heterogeneity the phase was delayed by the excitation. (B) Non-monotonicity of the paradoxical delay with constant natural frequency (fnetwork = 41 Hz). B2–4: Top: raster plot of spikes in E-population (input strength increased with cell index). Bottom: mean inhibitory synaptic conductance within the PING network. The titles show the absolute and relative increase in spike number (B2: CV = 0.05, B3: CV = 0.1, B4: CV = 0.2). (C) Subharmonic response of the PING rhythm with periodic excitation as function of neuronal heterogeneity and detuning. fnetwork was fixed at 41 Hz. Color hue and saturation indicate the frequency ratio and power ratio at the frequencies fsuper and fclock of the E-population’s LFP. fsuper was the frequency of the dominant peak of the LFP power spectrum that satisfies fsuper > fclock. The power ratio was capped at 1. Generally, the neuronal heterogeneity enhanced the synchronization of the PING rhythm by weakening subharmonic response. (D) The tightness of the phase-locking (var(Φexc)) as a function of neuronal heterogeneity and detuning. The neuronal heterogeneity enhanced the tightness of the phase-locking. For Δf ∈ [−22Hz, −17.4Hz] the clock was twice as fast as the network, resulting in vanishing var(Φexc).
As for the ING rhythm, we investigated the role of neuronal heterogeneity in the synchonizability and the ability of phase-locking of coupled PING rhythms. In analogy to the ING-case, we considered the case of the E-population of a PING network receiving periodic excitation generated by a clock PING network (Fig 4B). As before, we adjusted the tonic input strength to the E-population to keep the natural frequency of the network constant as we changed its heterogeneity (fnetwork = 41Hz). To probe the impact of the paradoxical phase response on the synchronization we focused on negative detuning for which the periodic external excitation needed to slow down the network in order to achieve phase-locking. Indeed, with increasing heterogeneity the network could become synchronized with the slower clock over a larger range of the detuning as indicated by the fading saturation of the color in Fig 7C. Here the color hue indicates the ratio fsuper: fclock, where fsuper was determined as the frequency with the most power among the frequencies higher than fclock in the Fourier spectrum of the E-population’s LFP. The color saturation indicates the ratio of the power at the frequencies fsuper and fclock. Thus, a color hue closer to green (fsuper: fclock = 1: 1) or with a lower saturation implies better synchronization. By observing how the width of the range of detuning allowing synchronization varied with neuronal heterogeneity, we concluded that, generally, the neuronal heterogeneity enhanced the synchronizability of the PING rhythm by weakening the subharmonic response. Note that for CV ∈ [0, 0.1] the synchonizability of the PING rhythm decreased slightly with neuronal heterogeneity. This was consistent with the nonmonotonicity exhibited by the fmPRC seen in Fig 7B. The neuronal heterogeneity played a similar role in the tightness of the phase-locking as in the synchronizability (Fig 7D).
Paradoxical phase response in QIF networks and their mean-field reduction
To demonstrate the generalizability of our results beyond IF neurons, we studied the collective phase response for networks of QIF neurons, which display biologically more realistic voltage traces. All-to-all coupled networks of QIF neurons have the additional advantage—in the limit of infinitely many neurons and if the heterogeneity of the neurons is chosen to follow a Lorentzian distribution—that they can be captured by an exact mean-field theory (eMFT) that reduces the network to two coupled ordinary differential equations. These equations describe the mean voltage and the mean firing rate of the neurons [23, 34] (see also [25]). This reduction allowed to obtain the imPRC by applying the adjoint method rather than by direct simulation of spiking networks [27]. In [13, 27], this methodology has been applied to study the imPRCs of both PING and ING rhythms in detail, finding good agreement with the direct simulations of the corresponding spiking networks.
Given the importance of the effective synaptic delay for the paradoxical collective phase response, we went beyond [13, 27] and included an effective synaptic delay in the eMFT and studied its impact, combined with that of the neuronal heterogeneity, on the imPRC, obtained by the adjoint method, as well as the fmPRC, obtained by direct simulation of the spiking networks as well as the eMFT.
We introduced the effective synaptic delay via double-exponential synaptic interaction without including an explicit synaptic delay. We first focused on the ING rhythm. Its imPRC, obtained with the adjoint method from the eMFT, agreed well with the fmPRC obtained from weak direct perturbations of the spiking network, regardless of the sign of the perturbation (Fig 8A). Thus, the agreement between the fmPRC for weak perturbations and the imPRC found in [13, 27] carried over to the case with effective synaptic delay. With increasing perturbation amplitude the shape of the fmPRC changed substantially, resulting in strong deviations from the imPRC (Fig 8B). Nevertheless, the fmPRC of the spiking network always agreed well with the fmPRC obtained with the eMFT (Fig 8B).
(A) The imPRC (black line) of the eMFT multiplied by the signed perturbation strength agreed well with the fmPRCs (orange = excitation, blue = inhibition) from the spiking network simulation. The negative component corresponds to a paradoxical phase response, either a delay for excitation (orange) or an advance for inhibition (blue). (B) Even for strong perturbations, the fmPRC obtained from simulations of the eMFT agreed well with that of the spiking network. (C) As in the IF networks, the paradoxical phase response of the eMFT arose from the paradoxical change in the within-network inhibition. Top: external excitation increased the within-network inhibition. Bottom: external inhibition decreased the within-network inhibition. (D) Left: the amplitude of the paradoxical phase response of the imPRC in the eMFT increased with neuronal heterogeneity. Right: for networks with different synaptic coupling strength JII, the imPRCs of their eMFTs always exhibited a paradoxical phase response for arbitrarily weak neuronal heterogeneity. Parameters: voltage perturbations ΔVI were made to the membrane potential or the mean potential variable VI(t) with a square-wave pulse of duration 0.02 ms. In (A), ΔVI = ±0.2. In (B), ΔVI = 2 (left), ΔVI = 4 (right). In (C), ΔVI = ±3. In (A)-(C), ΔI = 3.
Strikingly, due to the effective delay the paradoxical phase response even arose in the imPRC (Fig 8A). Simulation of the eMFT showed that the paradoxical phase response was caused by the paradoxical change in the level of the within-network inhibition: as in the IF-networks with Gaussian heterogeneity, external inhibition decreased the total within-network inhibition while external excitation increased it (Fig 8C). Furthermore, the amplitude of the paradoxical phase response of the imPRC from the eMFT also increased with neuronal heterogeneity (Fig 8D). However, in contrast to the case discussed above where the distribution of the input currents was Gaussian and the paradoxical phase response occurred only for sufficiently strong perturbations or sufficiently strong heterogeneity (Fig 2C), for the Lorentzian distributed input a paradoxical phase response arose in the imPRC, i.e. without a threshold for the perturbation amplitude, even for arbitrarily small neuronal heterogeneity (Fig 8D right). This reflects the fact that in the limit of infinitely many neurons even for small heterogeneity ΔI there were always neurons in the heavy tail of the Lorentz distribution that were on the border between spiking and not spiking for whom an infinitesimal external inhibition was sufficient to suppress their spiking.
For the PING rhythm with effective synaptic delay, we investigated all possible perturbation scenarios: excitation to E-cells, inhibition to E-cells, excitation to I-cells, inhibition to I-cells. For small perturbation amplitudes the imPRC obtained with the adjoint method applied to the eMFT of the E-I network again agreed well with the fmPRC of the spiking E-I network (Fig 9A). We determined the dynamical regime of the eMFT in terms of the heterogeneities of the E-population (ΔE) and of the I-population (ΔI). Similar to the result in [13, 27], the eMFT displayed a Hopf bifurcation when decreasing either neuronal heterogeneity (Fig 9B). Note that for very small heterogeneities the numerical solution diverged (below the orange line in Fig 9B, which corresponds to the black area below the white line in Fig 9C), reflecting an approach to perfect synchrony in the limit of vanishing heterogeneity. Within the oscillatory regime, we studied the influence of ΔE and ΔI on the fmPRC by simulating the eMFT rather than the spiking network. The paradoxical phase response, either an advance under external inhibition or a delay under external excitation, existed in all perturbation scenarios (Fig 9C). As in the ING rhythm, it was caused by a paradoxical change in the level of the within-network inhibition.
(A) The imPRC (black line) of the eMFT multiplied by the signed perturbation strength agreed well with the fmPRCs (orange = excitation, blue = inhibition) from the spiking network simulations when perturbing the E-population (left) or the I-population (right). The negative component corresponds to a paradoxical phase response, either a delay for excitation (orange) or an advance for inhibition (blue). (B) Dynamical regimes of the PING rhythm in the eMFT. (C) The maximal paradoxical phase response obtained from simulations of the eMFT. Paradoxical phase response always existed. The black regions below the white dashed line correspond to the area below the orange line in (B). Parameters: voltage perturbations ΔVE,I were made to the membrane potential or the mean potential variable VE,I(t) with a square-wave pulse of duration 0.02 ms. In (A), ΔVE,I = ±0.2, ΔE = 1, ΔI = 1. In (C), ΔVE,I = ±0.2.
Thus, the results of the IF networks with Gaussian heterogeneity carry over to QIF networks with Lorentzian heterogeneity and their eMFT-description.
Discussion
We have analyzed the response of collective oscillations of inhibitory and of excitatory-inhibitory networks of linear and of quadratic integrate-and-fire neurons to external perturbations. For the QIF networks with Lorentzian heterogeneity we made extensive use of the eMFT that reduces the network dynamics to two coupled ordinary differential equations [23]. For ING- and PING-rhythms we have shown that the combination of neuronal heterogeneity and effective synaptic delay can qualitatively change the phase response compared to the phase response of the individual neurons generating the rhythm. Thus, perturbations that delay the I-cells can paradoxically advance the ING-rhythm and perturbations that advance the E-cells can delay the PING-rhythm. As a result, the macroscopic phase-response curve for finite-amplitude perturbations (fmPRC) of the rhythm can change sign as the phase of the perturbation is changed (type-II), even though the PRC of all individual cells is strictly positive (type-I). This change of the fmPRC enhances the ability of the γ-rhythm to synchronize with other rhythms.
The key element of the mechanism driving the paradoxical phase response and the enhanced synchronization is the cooperation of the external perturbation and the effectively delayed within-network inhibition. In the ING-network a suitably timed external perturbation delays the lagging—but not the early—neurons sufficiently to allow the within-network inhibition triggered by the early neurons to keep the lagging neurons from spiking. This reduces the overall within-network inhibition and with it the duration of the cycle. Thus, the perturbation modifies the internal dynamics of the rhythm, which leads to changes in the phase of the rhythm that can dominate the immediate phase change the perturbation induces. The situation is somewhat similar to that investigated in [18]. There it had been pointed out that an external perturbation of a collective oscillation can lead to changes in its phase in two stages: i) an immediate change of the phases of all oscillators as a direct result of the perturbation and ii) a subsequent slower change in the collective phase resulting from the convergence of the disturbed phases back to the synchronized state. That analysis was based on a network of phase oscillators and could therefore not include a key element of our results, which is the perturbation-induced change in the dynamics within the network that is associated with a change in the number of spiking neurons and induces a change of the period of the rhythm. As discussed in [31, 35], for ING-rhythms such a change in the number of spiking neurons underlies also the enhanced phase-locking found in [30].
Going beyond ING-rhythms, we showed that PING-rhythms can also exhibit a paradoxical phase response via a mechanism that is analogous to that of ING-rhythms. For that analysis we have focused on excitatory-inhibitory networks with only connections between but not within the excitatory and inhibitory populations. For excitatory inputs to the excitatory cells to generate a paradoxical phase response it is necessary that the additional spikes of the excitatory neurons that are caused by the external perturbation induce additional spikes of the inhibitory neurons. This behavior arises if the inibitory population is also allowed to be heterogeneous. Moreover, the within-network inhibition has to be strong enough to be able to suppress the spiking of lagging excitatory neurons. This is, e.g., found in mice piriform cortex, where principal neurons driven by sensory input from the olfactory bulb arriving early during a sniff recruit inhibitory interneurons via long-range recurrent connections, resulting in the global, transient suppression of subsequent cortical activity [36]. A characteristic feature of the paradoxical phase response of the PING rhythm is the extended cycle time following enhanced activation of the excitatory cells. A strong such correlation between the cycle time and the previous LFP amplitude has been observed for the γ-rhythm in hippocampus [37]. To assess whether this rhythm exhibits paradoxical phase response it would be interesting to compare the macroscopic phase response [38] with that of indvidual participating neurons.
In order for the global perturbation to affect the various neurons differently, they have to be at different phases in their cycle. Our analysis suggests that the specific cause for this heterogeneity in the spike times does not play an important role. Indeed, as shown in [29], even fluctuating heterogeneities that are generated by noise rather than static heterogeneities reflecting intrinsic properties of neurons can enhance the synchronization of multiple γ-rhythms in interconnected networks of identical neurons. Note that the noise driving this synchronization is uncorrelated across neurons. The analysis of that system revealed the same mechanism at work as the one identified here.
In various previous analytical and computational analyses it has been found that the dynamics of the macroscopic phase of a collective oscillation can qualitatively differ from that of the microscopic phase [17, 20–22, 28]. Thus, for interacting groups of noisy identical phase oscillators the macroscopic phases of the groups can tend to line up with each other, even if all pair-wise interactions between individual oscillators prefer the antiphase state, and vice versa [20]. An analogous result has been obtained for heterogeneous populations of noiseless oscillators [17].
Qualitative changes have also been found in the macroscopic phase response of rhythms in noisy homogeneous networks when the noise level was changed [21, 22, 28]. Using a Fokker-Planck approach for globally coupled excitable neurons, a type-I mPRC was obtained for weak noise, where the rhythm emerges through a SNIC bifurcation, while a type-II mPRC arose for strong noise that led to a Hopf bifurcation [21]. A similar approach was used to obtain the imPRC via the adjoint method for an extension of the theta-model that implements conductance-based synaptic interactions. Again, although individual theta-neurons have a type-I PRC, a type-II imPRC was obtained for the rhythm, which arose in a Hopf bifurcation [22]. This was also the case in an extension to networks of excitable and inhibitory neurons [28].
Thus, results reminiscent of those presented here have been obtained previously. However, the mechanism underlying them was not addressed in detail and remained poorly understood. We expect that our analysis will provide insight into those systems. The key element of the mechanism discussed here is that due to the dispersion of the spike times, which either results from neuronal heterogeneity or noise, the external perturbation enables the within-network inhibition to suppress the spiking of a larger number of neurons than without it. In our system this was facilitated by the delay with which spikes triggered the within-network inhibition, which allowed some neurons to escape its impact in the absence of the external perturbation, but not in its presence. Our analysis showed, however, that an explicit delay is not necessary; the effective delay resulting from a double-exponential synaptic interaction is sufficient. In fact, when reducing that effective delay the paradoxical phase response did not disappear until the delay was so short that the rhythm itself developed a strong subharmonic component and disintegrated.
In this paper we have focused on two specific, very simple neuronal models, the linear and the quadratic leaky integrate-and-fire model with pulsatile coupling. Both have a type-I PRC, which is non-negative. This makes the paradoxical aspect of the mPRC of the rhythm easier to identify and analyze. For networks comprised of heterogeneous neurons with type-II PRC the mPRC of the collective oscillation is likely to be more complex, since the heterogeneity allows the same input to induce phase shifts with opposite signs for different neurons depending on their phases. However, we expect that the interplay between the within-network inhibition and the external perturbation can again substantially and qualitatively modify the mPRC by changing the number of neurons participating in the rhythm. Previous work on the enhancement of synchronization among γ-rhythms via noise-induced spiking heterogeneity has demonstrated that this enhanced synchronization does not depend sensitively on the neuron type. Comparable results were obtained also with Morris-Lecar neurons for parameters in which the periodic spiking arises from a SNIC-bifurcation, resulting in a type-I PRC for the individual neurons as is the case for integrate-and-fire neurons, but also for parameters for which the spiking is due to a Hopf bifurcation, resulting in a type-II PRC [29].
In [29] the results were also found to be robust with respect to significant changes in the network connectivity (random instead of all-to-all) as well as the reversal potential of the inhibitory synapses, as long as the rhythm itself persisted robustly (cf. [39]). In fact, the coupling did not even have to be synaptic; collective oscillations of relaxation-type chemical oscillators that were coupled diffusively were also shown to exhibit noise-induced synchronization. These results suggest that the paradoxical phase response found here arises in a much wider class of macroscopic collective oscillations.
The strong paradoxical phase response that we demonstrated for heterogeneous networks allows their rhythm to synchronize with a periodic external input over a range of detuning that increases substantially with the neuronal heterogeneity. This is reminiscent of computational results for anterior cingulate cortex that investigated networks of excitatory neurons coupled via a common population of inhibitory neurons. There heterogeneity was also found to enhance the synchrony of rhythms, as measured in terms of coincident spikes within 10ms bins [40].
The heterogeneity-enhanced synchrony we have identified suggests that the coherence of γ-rhythms emerging in different interacting networks could also be enhanced by neuronal heterogeneity. It has been proposed that the coherence of different γ-rhythms, which has been observed to be modified by attention [8], plays an important role in the communication between the corresponding networks [11, 32]. Computational studies have shown that the direction of information transfer between networks depends on the relative phase of their rhythms [12, 13], which can be changed by switching between different base states [41, 42]. Whether the enhanced synchrony resulting from neuronal heterogeneity enhances this information transfer is still an open question.
Disrupted γ-rhythms have been observed in multiple brain regions in neurological diseases, especially Alzheimer’s disease. Optogenetic and sensory periodic stimulation at γ-frequencies has been found to entrain the γ-rhythm in hippocampus and visual cortex, respectively, and has resulted in a significant reduction in total amyloid level [43]. Similar neuro-protective effects of entrainment by external γ-stimulation have also been found for other sensory modalities [14, 44]. This suggests that γ-stimulation by sensory input might be a feasible therapeutic approach. Our results suggest a potential role of neuronal heterogeneity in this context.
From a functional perspective, it has been shown that the noise-induced synchronization mentioned above can facilitate certain learning processes [45]. Specifically, a read-out neuron was considered that received input from neurons in two networks via synapses that exhibited spike-timing dependent plasticity. The two networks were interacting with each other and each of them exhibited a γ-rhythm, albeit at different frequencies. For low noise the two rhythms were not synchronized and the read-out neuron received inputs from the two networks at uncorrelated times. These inputs drove the plasticity inconsistently, leading only to a very slow overall evolution of the synaptic weights, if any. However, for stronger noise the two networks were synchronized, providing a more consistent spike timing that lead to substantial changes in the synaptic weights. As a result, the read-out neuron was eventually only driven by the network that had the larger natural frequency in the absence of the coupling between the networks. It is expected that synchrony by neuronal heterogeneity will have a similar impact.
Methods
The network of integrate-and-fire (IF) neurons
Neuron model.
Both E-cells and I-cells were modeled as leaky IF neurons, each characterized by a membrane potential Vi(t) satisfying
(1)
where Vrest is the resting potential and τE,I the membrane time constants of the E- and I-cells, respectively.
is the total synaptic current that the neuron receives from the other neurons within the network.
is a time-dependent external input that represents perturbations applied to determine the fmPRC or, in the study of synchronization, the periodic input generated by the clock network.
denotes a tonic, neuron-specific excitatory bias current that implements the heterogeneity of the neuron properties, The corresponding conductances are denoted gsyn, gext, and gbias. Upon the ith neuron reaching the spiking threshold Vpeak, the voltage Vi was reset to the fixed value Vreset. Parameters for the neuron were kept fixed throughout all simulations (see Table 1). The local field potential (LFP) of the network was approximated as the mean voltage across all neurons j = 1, …N in the respective population.
Network model.
We studied two types of networks: an ING network and a PING network. The ING network was modeled as an all-to-all inhibitory network of I-cells. The PING network was modeled as a network of
I-cells and
E-cells with all-to-all E-I and I-E connections (i.e., without E-E and I-I connections). In PING, only E-cells received external input Iext(t).
To gain insight into the interaction between two ING rhythms, we considered the simplified situation in which all neurons in the network received strictly periodic input I(ext), which was generated by another ING network (‘clock’). Similarly, for PING rhythms, the E-cells of the PING network received strictly periodic excitatory input I(ext) from another PING network through all-to-all connection between their E-populations.
Synaptic currents.
We used delayed double-exponential conductance-based currents to model the excitatory and the inhibitory synaptic inputs from neuron j to neuron i,
(2)
with the two exponentials
satisfying
(3)
where Vrev,j is the synaptic reversal potential corresponding to the synapse type, Wij the dimensionless synaptic strength, and δ the Dirac δ-function. All synapses of the same type (I-I, I-E, E-I) were equally strong. The time constants of
satisfied
. The synaptic current was normalized to render the time integral independent of the synaptic time constants
. The inhibitory synaptic currents had a slower decay than the excitatory ones (cf. Table 1). We included an explicit synaptic delay τd in the model. Every spike of the presynaptic neuron j at time
triggered a jump in both
, making the synaptic conductance rise continuously after a synaptic delay τd.
External periodic inputs were also modeled as double-exponential conductance-based currents with gsyn in (2) and (3) replaced by gext. The time constants and delay were as for the within-network synaptic inputs.
Heterogeneous tonic input.
The bias currents of the ING network were Gaussian distributed around I(I) with a coefficient of variation CV(I) and arranged in increasing order,
(4)
where erf is the error function to implement the Gaussian distribution of the heterogeneity. For the PING network, all E-cells received a heterogeneous bias
with mean I(E) and a coefficient of variation CV(E). Similarly, the bias currents
to the I-cells were characterized by their mean I(I) and their coefficient of variation CV(I). Without the excitatory input from E-cells, the voltage of I-cells remained below the spiking threshold. In our investigation of the impact of the neuronal heterogeneity on the phase response and entrainment of the PING rhythm we kept CV(I) fixed and varied CV(E).
Macroscopic phase-response curve for finite-amplitude perturbations (fmPRC)
ING rhythm.
For a single ING network, we applied a single inhibitory δ-pulse to each neuron at time tinh (dashed green line in Fig 1B) and recorded the resulting phase shift Δφ. The amplitude of the inhibitory perturbation to each neuron was the same. The phase of the inhibition relative to the rhythm was defined as
(5)
where T was the period of the network LFP and
the time of the first spike in the spike volley of the unperturbed network that was closest to tinh. The phase shift Δϕ resulting from the perturbation was given by
(6)
where
is the time of the first spike in the corresponding volley in the perturbed network. Δϕ and ϕinh were taken to be in the range [−0.5 0.5). Positive Δϕ indicated that the network was advanced by the perturbation, while negative indicated a delay.
The periodic input (‘clock’) that was used to test the synchronizability of the ING-rhythm was generated by a homogeneous ING network. The phase of the network relative to the periodic input in the nth clock cycle was defined by
(7)
where
was the time of the first spike in the spike volley of the network in the nth cycle and
the time of the spike of the clock. In contrast to the definition of ϕinh in (5), the definition of
included the delay τd, since the inhibition generated by the clock arrived with delay τd in the network.
PING rhythm.
To probe the phase response of the PING network we used the same approach as for the ING rhythm, except that we used excitatory instead of inhibitory δ-pulses and applied them only to the E-cells. The phase of the excitation ϕexc and the resulting phase shift Δϕ were determined similarly as in the case of the ING rhythm,
(8)
(9)
where
and
were the times of the first spike in the respective spike volleys of the E-population.
Analogous to , the phase of the network during the nth clock cycle was defined by
(10)
The tonic input to the I-cells in the PING network was heterogeneous with Gaussian distribution, and fixed throughout: I(I) = 3.6 pA, CV(I) = 0.167.
Networks of quadratic integrate-and-fire (QIF) neurons and their exact mean-field reduction
Neuron model.
The QIF neuron [47] is characterized by a membrane potential Vi(t) satisfying
(11)
where τE,I are the membrane time constants of the E- and I-cells, respectively. IE,I(t) is the total synaptic current that the E-, I- neurons receive from the other neurons within the network. Upon the ith neuron reaching the spiking threshold Vpeak, the voltage Vi is reset to the fixed value Vreset. In order to facilitate the analysis of the reduction, the limit Vpeak → ∞, Vreset → −∞ is taken. Analogous to (4), the tonic, external bias currents
implement the heterogeneity of the neuron properties and are distributed according to a Lorentzian distribution,
(12)
with η1 < η2 < … < ηN. Here
is the mean value in the principal value sense and ΔE,I the half-width of the distribution of η for the E- and I-cells, respectively. Note that the heavy tail of the Lorentzian distribution implies that—for arbitrary
and Δ with sufficiently many neurons to resolve the tail—there are always neurons receiving extremely weak input and unable to overcome the within-network inhibition to spike. Parameters for the neuron were kept fixed throughout all simulations (see Table 2). Again, in the spiking network, the local field potential (LFP) of the network was approximated as the mean voltage across all neurons in the respective population.
Network model.
We studied two types of QIF-networks: an ING network and a PING network. The ING network was modeled as an all-to-all inhibitory network of I-cells. The PING network was modeled as a network of
I-cells and
E-cells with all-to-all E-I and I-E connections (i.e., without E-E and I-I connections).
Synaptic currents.
In the ING rhythm, the total synaptic current I(t) to each I-cell is the recurrent inhibition:
(13)
In the PING network, the total synaptic current I(t) to each E-cell is the inhibition from the I-cells,
(14)
and that to each I-cell is given by the excitation from the E-cells,
(15)
Here sαβ(t) denotes the synaptic variable characterizing the synapse from the population β to the population α. In order to include the effective synaptic delay, we assumed that each spike triggers a double-exponential current. Extending [13], the synaptic variable sαβ(t) is therefore modeled by
(16)
with sαβ,1(t) and sαβ,2(t) satisfying
(17)
(18)
Here Jαβ is the synaptic strength. The time constants τ1, τ2 of sαβ,1(t), sαβ,2(t) satisfy τ2 > τ1. rE,I(t) are the population firing rates of the E- and I-populations, respectively.
The mean-field theory.
As shown in [23], in the limit of infinitely many neurons, the system Eqs (11) and (12) is described by coupled equations for the mean potential and population firing rate,
(19)
where VE,I(t) is the mean potential and rE,I(t) the population firing rate of the respective populations.
So, with the synaptic current defined in Eqs (14)–(18), the ING network is reduced to
(20)
while the PING network is reduced to
(21)
Infinitesimal macroscopic PRC (imPRC) of the reduced network.
For a dynamical system like Eqs (20) and (21), within the parameter regime admitting a stable limit cycle, the adjoint method can be applied to determine the macroscopic phase response for infinitesimal perturbations to the limit cycle [16]. To be consistent with the fmPRC obtained with the direct simulation of the spiking network, we adjusted the normalization condition to make the phase range from 0 to 1. Due to the Lorentzian distribution used for the QIF network input, some neurons spike incessantly, making it impossible to define the beginning of a spike volley. We therefore defined phase 0 as the peak of the synaptic variable sII(t) = sII,2(t) − sII,1(t) for the ING rhythm and as the peak of sEI(t) = sEI,2(t) − sEI,1(t) for the PING rhythm. The phase shift Δϕ resulting from the perturbation was given by the time difference between the peaks of sII(t) (ING rhythm) or sEI(t) (PING rhythm) in the perturbed and the unperturbed system normalized by the period.
Supporting information
S1 Fig. Dependence of the phase dispersion on the heterogeneity of the bias current.
The phase dispersion was determined as the time difference between the first and the last spike in the same spike volley normalized by the period. Blue: fixed natural frequency (fnetwork = 40Hz) for different neuronal heterogeneity. Red: fixed mean input strength (I(I) = 15.8 pA) for different neuronal heterogeneity. For CV ≥ 0.075 (dashed line), some neurons spike more than once in a cycle.
https://doi.org/10.1371/journal.pcbi.1008575.s001
(EPS)
S2 Fig. fmPRC of heterogeneous ING networks for fixed steady current (I(I) = 15.8 pA) instead of fixed frequency (cf. Fig 2A).
The paradoxical phase advance increased with neuronal heterogeneity.
https://doi.org/10.1371/journal.pcbi.1008575.s002
(EPS)
S3 Fig. Subharmonic response of the ING rhythm with a longer synaptic delay within the network (τd = 5 ms) receiving periodic inhibitory input.
For each value of the input heterogeneity, the natural frequency fnetwork was kept constant (fnetwork = 44 Hz) by adjusting the mean input strength I(I). The range of detuning where increasing heterogeneity induced a type 3 synchronization became wider compared to Fig 6B, where τd = 3 ms. W(ext) = 1.2 × 10−3.
https://doi.org/10.1371/journal.pcbi.1008575.s003
(EPS)
References
- 1. Bruesselbach H, Jones DC, Mangir MS, Minden M, Rogers JL. Self-organized coherence in fiber laser arrays. Optics Letters. 2005;30(11):1339–1341.
- 2. Wiesenfeld K, Colet P, Strogatz SH. Synchronization Transitions in a Disordered Josephson Series Array. Phys Rev Lett. 1996;76(3):404–407.
- 3. Liu C, Weaver DR, Strogatz SH, Reppert SM. Cellular Construction of a Circadian Clock: Period Determination in the Suprachiasmatic Nuclei. Cell. 1997;91(6):855–860.
- 4. Venzin OF, Oates AC. What are you synching about? Emerging complexity of Notch signaling in the segmentation clock. Developmental Biology. 2020;460(1):40–54.
- 5. Wang XJ. Neurophysiological and Computational Principles of Cortical Rhythms in Cognition. Physiol Rev. 2010;90(3):1195–1268.
- 6. Börgers C, Epstein S, Kopell NJ. Background gamma rhythmicity and attention in cortical local circuits: a computational study. Proc Natl Acad Sci U S A. 2005;102(19):7002–7007.
- 7. Börgers C, Kopell NJ. Gamma oscillations and stimulus selection. Neural Comput. 2008;20(2):383–414.
- 8. Bosman CA, Schoffelen JM, Brunet N, Oostenveld R, Bastos AM, Womelsdorf T, et al. Attentional stimulus selection through selective synchronization between monkey visual areas. Neuron. 2012;75:875–888. pmid:22958827
- 9. Roberts MJ, Lowet E, Brunet NM, Ter Wal M, Tiesinga P, Fries P, et al. Robust Gamma Coherence between Macaque V1 and V2 by Dynamic Frequency Matching. Neuron. 2013;78(3):523–536. pmid:23664617
- 10. Buzsaki G, Schomburg EW. What does gamma coherence tell us about inter-regional neural communication? Nature Neuroscience. 2015;18(4):484–489.
- 11. Fries P. Rhythms for Cognition: Communication through Coherence. Neuron. 2015;88:220–235.
- 12. Palmigiano A, Geisel T, Wolf F, Battaglia D. Flexible information routing by transient synchrony. Nature Neuroscience. 2017;20:1014–1022.
- 13. Dumont G, Gutkin B. Macroscopic phase resetting-curves determine oscillatory coherence and signal transfer in inter-coupled neural circuits. PLoS Computational Biology. 2019;15:e1007019.
- 14. Adaikkan C, Middleton SJ, Marco A, Pao PC, Mathys H, Kim DNW, et al. Gamma Entrainment Binds Higher-Order Brain Regions and Offers Neuroprotection. Neuron. 2019;102:929–943.e8. pmid:31076275
- 15.
Schultheiss NW, Butera RJ. Phase Response Curves in Neuroscience. Springer; 2012.
- 16. Brown E, Moehlis J, Holmes P. On the Phase Reduction and Response Dynamics of Neural Oscillator Populations. Neural Comput. 2004;16(4):673–715.
- 17. Kawamura Y, Nakao H, Arai K, Kori H, Kuramoto Y. Phase synchronization between collective rhythms of globally coupled oscillator groups: noiseless nonidentical case. Chaos (Woodbury, NY). 2010;20:043110.
- 18. Levnajic Z, Pikovsky A. Phase resetting of collective rhythm in ensembles of oscillators. Physical Review E, Statistical, nonlinear, and soft matter physics. 2010;82:056202.
- 19. Kawamura Y, Nakao H, Arai K, Kori H, Kuramoto Y. Collective Phase Sensitivity. Phys Rev Lett. 2008;101(2):024101.
- 20. Kawamura Y, Nakao H, Arai K, Kori H, Kuramoto Y. Phase Synchronization Between Collective Rhythms of Globally Coupled Oscillator Groups: Noisy Identical Case. Chaos. 2010;20(4):043109.
- 21. Kawamura Y, Nakao H, Kuramoto Y. Collective phase description of globally coupled excitable elements. Physical Review E, Statistical, nonlinear, and soft matter physics. 2011;84:046211.
- 22. Kotani K, Yamaguchi I, Yoshida L, Jimbo Y, Ermentrout GB. Population dynamics of the modified theta model: macroscopic phase reduction and bifurcation analysis link microscopic neuronal interactions to macroscopic gamma oscillation. J R Soc Interface. 2014;11(95):20140058.
- 23. Montbrió E, Pazó D, Roxin A. Macroscopic Description for Networks of Spiking Neurons. Phys Rev X. 2015;5:021028.
- 24. Ott E, Antonsen TM. Low dimensional behavior of large systems of globally coupled oscillators. Chaos. 2008;18(3):037113.
- 25. Luke TB, Barreto E, So P. Complete Classification of the Macroscopic Behavior of a Heterogeneous Network of Theta Neurons. Neural Computation. 2013;25(12):3207–3234.
- 26. Hannay KM, Booth V, Forger DB. Collective phase response curves for heterogeneous coupled oscillators. Physical Review E. 2015;92(2):022923.
- 27. Dumont G, Ermentrout GB, Gutkin B. Macroscopic phase-resetting curves for spiking neural networks. Physical Review E. 2017;96:042311.
- 28. Akao A, Ogawa Y, Jimbo Y, Ermentrout GB, Kotani K. Relationship between the mechanisms of gamma rhythm generation and the magnitude of the macroscopic phase response function in a population of excitatory and inhibitory modified quadratic integrate-and-fire neurons. Physical Review E. 2018;97(1):012209.
- 29. Meng JH, Riecke H. Synchronization by uncorrelated noise: interacting rhythms in interconnected oscillator networks. Scientific Reports. 2018;8:6949.
- 30. White JA, Banks MI, Pearce RA, Kopell NJ. Networks of interneurons with fast and slow gamma-aminobutyric acid type A (GABA(A)) kinetics provide substrate for mixed gamma-theta rhythm. Proceedings of the National Academy of Sciences of the United States of America. 2000;97(14):8128–8133.
- 31. Serenevy AK, Kopell NJ. Effects of Heterogeneous Periodic Forcing on Inhibitory Networks. SIAM Journal on Applied Dynamical Systems. 2013;12(3):1649–1684.
- 32. Fries P. A Mechanism for Cognitive Dynamics: Neuronal Communication Through Neuronal Coherence. Trends Cogn Sci. 2005;9(10):474–480.
- 33. Bartos M, Vida I, Jonas P. Synaptic mechanisms of synchronized gamma oscillations in inhibitory interneuron networks. Nature Reviews Neuroscience. 2007;8(1):45–56.
- 34. Montbrio E, Pazo D. Exact Mean-Field Theory Explains the Dual Role of Electrical Synapses in Collective Synchronization. Physical Review Letters. 2020;125(24):248101.
- 35. Cannon J, McCarthy MM, Lee S, Lee J, Börgers C, Whittington MA, et al. Neurosystems: brain rhythms and cognitive processing. The European Journal of Neuroscience. 2014;39:705–719. pmid:24329933
- 36. Bolding KA, Franks KM. Recurrent cortical circuits implement concentration-invariant odor coding. Science (New York, NY). 2018;361.
- 37. Atallah BV, Scanziani M. Instantaneous Modulation of Gamma Oscillation Frequency by Balancing Excitation with Inhibition. Neuron. 2009;62(4):566–577.
- 38. Akam T, Oren I, Mantoan L, Ferenczi E, Kullmann DM. Oscillatory dynamics in the hippocampus support dentate gyrus-CA3 coupling. Nature Neuroscience. 2012;15(5):763–768.
- 39. Börgers C, Krupa M, Gielen S. The Response of a Classical Hodgkin-Huxley Neuron to an Inhibitory Input Pulse. J Comput Neurosci. 2010;28(3):509–526.
- 40. Adams NE, Sherfey JS, Kopell NJ, Whittington MA, LeBeau FEN. Hetereogeneity in Neuronal Intrinsic Properties: A Possible Mechanism for Hub-Like Properties of the Rat Anterior Cingulate Cortex during Network Activity. Eneuro. 2017;4(1):UNSP e0313–16.2017.
- 41. Witt A, Palmigiano A, Neef A, El Hady A, Wolf F, Battaglia D. Controlling the oscillation phase through precisely timed closed-loop optogenetic stimulation: a computational study. Front Neural Circuits. 2013;7:49.
- 42. Kirst C, Timme M, Battaglia D. Dynamic information routing in complex networks. Nature Communications. 2016;7:11061.
- 43. Iaccarino HF, Singer AC, Martorell AJ, Rudenko A, Gao F, Gillingham TZ, et al. Gamma frequency entrainment attenuates amyloid load and modifies microglia. Nature. 2016;540(7632):230–+. pmid:27929004
- 44. Martorell AJ, Paulson AL, Suk HJ, Abdurrob F, Drummond GT, Guan W, et al. Multi-sensory Gamma Stimulation Ameliorates Alzheimer’s-Associated Pathology and Improves Cognition. Cell. 2019;177:256–271.e22. pmid:30879788
- 45. Meng JH, Riecke H. Synchronization by uncorrelated noise: interacting rhythms in interconnected neuronal networks. BMC Neuroscience. 2018;19 (Suppl 2):116.
- 46. Brunel N, Wang XJ. What Determines the Frequency of Fast Network Oscillations with Irregular Neural Discharges? I. Synaptic Dynamics and Excitation-Inhibition Balance. J Neurophysiol. 2003;90(1):415–430.
- 47.
Izhikevich EM. Dynamical Systems in Neuroscience: the Geometry of Excitability and Bursting. MIT Press; 2005.