Figures
Abstract
The crustacean pyloric Central Pattern Generator (CPG) is a nervous circuit that endogenously provides periodic motor patterns. Even after about 40 years of intensive studies, the rhythm genesis is still not rigorously understood in this CPG, mainly because it is made of neurons with irregular intrinsic activity. Using mathematical models we addressed the question of using a network of irregularly behaving elements to generate periodic oscillations, and we show some advantages of using non-periodic neurons with intrinsic behavior in the transition from bursting to tonic spiking (as found in biological pyloric CPGs) as building components. We studied two- and three-neuron model CPGs built either with Hindmarsh-Rose or with conductance-based Hodgkin-Huxley-like model neurons. By changing a model’s parameter we could span the neuron’s intrinsic dynamical behavior from slow periodic bursting to fast tonic spiking, passing through a transition where irregular bursting was observed. Two-neuron CPG, half center oscillator (HCO), was obtained for each intrinsic behavior of the neurons by coupling them with mutual symmetric synaptic inhibition. Most of these HCOs presented regular antiphasic bursting activity and the changes of the bursting frequencies was studied as a function of the inhibitory synaptic strength. Among all HCOs, those made of intrinsic irregular neurons presented a wider burst frequency range while keeping a reliable regular oscillatory (bursting) behavior. HCOs of periodic neurons tended to be either hard to change their behavior with synaptic strength variations (slow periodic burster neurons) or unable to perform a physiologically meaningful rhythm (fast tonic spiking neurons). Moreover, 3-neuron CPGs with connectivity and output similar to those of the pyloric CPG presented the same results.
Citation: Reyes MB, Carelli PV, Sartorelli JC, Pinto RD (2015) A Modeling Approach on Why Simple Central Pattern Generators Are Built of Irregular Neurons. PLoS ONE 10(3): e0120314. https://doi.org/10.1371/journal.pone.0120314
Academic Editor: Adriano B. L. Tort, Federal University of Rio Grande do Norte, BRAZIL
Received: September 9, 2014; Accepted: December 15, 2014; Published: March 23, 2015
Copyright: © 2015 Reyes et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper.
Funding: The authors received financial support from the Brazilian agencies: Fundação de Amparo à Pesquisa do Estado de São Paulo—FAPESP (grant 98/15902-8), Conselho Nacional de Desenvolvimento Científico e Tecnológico – CNPq (grants 473554/2011-9 and 480053/2013-8) and Fundação de Amparo à Ciência e Tecnologia do Estado de Pernambuco—FACEPE (grant APQ-1415-1.05/10). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Central Pattern Generators (CPGs) are small neural networks specialized in endogenously providing periodic and reliable patterns to generate rhythmic motor activity [1–3] such as chewing, walking, flying, breathing, etc. They work in an almost autonomous fashion in which the supervision of higher centers mostly consists in shaping or fine-tuning the patterns to a specific purpose. Studying simpler CPGs can bring some light on how larger circuits (e.g. in the brain) generate spatio-temporal patterns [4, 5]. Some CPGs produce the very similar activity in the living animal and “in vitro”, thus being especially suitable for studies in neurophysiology. One of these remarkable circuits is the pyloric CPG of the crustacean stomatogastric ganglion (STG) [6–8]. This network has been widely studied for more than 35 years and most of its physiological details are known. Several pattern generation mechanisms have been proposed [9–13] but the genesis of the motor patterns is still not rigorously understood [14].
Crustacean pyloric CPGs are extremely robust, in the sense that they have the property of keeping generating a functional pattern when subject to physiological or environmental changes [15–18]. The pyloric CPG is robust under strong changes in neuromodulation [19, 20], excitability [21], synaptic strengths [22], and temperature [23].
Nevertheless, the pyloric CPG, when submitted to environmental, physiological or modulators changes, also have the property of easily changing its activity, what is usually referred to as flexibility [24–28]. Experimental data from the pyloric circuit shows that these CPGs are highly flexible, being able to present up to 5-fold changes in their bursting frequency “in vitro” [21, 29] and 3-fold changes “in vivo” [30], while keeping their relative bursting phase of the neurons.
Reductionist attempts to understand the genesis of robust and flexible rhythms in apparently simple circuits, such as the pyloric CPG, have failed because of the complex nature of the mechanism [14]. It has been found in experiments that similar network performance is obtained from highly variable sets of network parameters [31, 32], the same results were reported using a database of models based in STG neurons [33]. These findings have been considered as evidences of the role of homeostasis in shaping intrinsic and network parameters to compensate for variability while achieving functional robustness [5]. In spite of all biophysical variability, most of the CPG motor neurons present a similar chaotic-like bursting behavior when isolated from the network [14, 34–36]. This findings suggest a relation between the intrinsic dynamical behavior of neurons and the set of rhythms that emerges as a collective property of the complex CPG. Moreover it raises a question: Why to use irregular neurons to generate rhythmic activity?
Appealing ideas such as the control of chaos [37, 38], in which the stabilization of any periodic orbit out of an infinite number of unstable periodic orbits embedded in a phase space could be reliably achieved either by slightly changing the value of some relevant control parameter or simply by applying a small perturbation, led some researchers to hypothesize that the main role of chaos in the isolated neurons is to provide a neural network with both flexibility and reliability [14, 39, 40].
Here we addressed the hypothesis about the flexibility and robustness of CPG’s built on irregular neurons. We used CPG models with two and three neurons and two types of neural models, one phenomenological Hindmarsh-Rose-like [41–44] and one realistic conductance-based Hodgkin-Huxley-like model [45, 46]. Here we adopted the amplitude of frequency changes as a function of synaptic strength as a measure of flexibility. The robustness was assessed by the standard deviation of the burst duration and the absence of non-oscillatory behavior. These choices are not unique, but they seemed to be good approximations to those complex concepts.
We analyzed how these objective measures were influenced by changes on the intrinsic excitability of neurons. We found that in order to obtain the more flexible and robust CPGs one have to tune the intrinsic parameter of the neurons in a narrow range of values were they present irregular bursting in the transition to tonic behavior and not in any other parameter range.
Materials and Methods
We used two model neurons: a four-dimensional Hindmarsh-Rose-like model (HR4) [41, 42, 44] and a two-compartment model (HH2C) based on a twelve-dimensional Hodgkin-Huxley-like model (HH) [45–47]. Results from an improved HH2C model, inspired in previous works on the role of the hyperpolarization-activated current (IH) [12, 48–50], in which the IH dynamics was changed are also presented.
Synaptic connections were implemented by using a first order kinetic model of neurotransmitter release [51, 52]. The integration was performed using an adaptive-step 6th order Runge-Kutta algorithm. The numerical integration error at each step was kept smaller than 10-6 mV. The first 10 seconds of each simulation were discarded to eliminate the transient behavior and the following 60 seconds of activity were considered for analysis.
At the end of each simulation the last state of the variables were saved and used as initial conditions for the next integration. We also compared the parameter space built by sequentially incrementing the parameters with the one built by randomly choosing both the parameters and the initial conditions of the neurons to ensure no hysteresis is present.
Hindmarsh-Rose-like model (HR)
The HR model was chosen because it is the one of the simplest neuron models that is able to qualitatively mimic both the behavior of STG isolated neurons as well as the behavior of pair of neurons connected by mutual inhibition [44]. Furthermore, experiments have shown that this model successfully replaced a damaged neuron in the pyloric circuit [43].
The HR model we used is given by:
where A = 1, B = 3, C = 1, D = 0.99, E = 1.01, F = 5.0128, G = 0.0278, H = 1.605, K = 0.9573, L = 1.619, μ = 0.0021, ν = 0.0009, R = 3, S = 3.966.
The x variable represents the membrane potential, while I represents a DC current injected in the neuron. The y variable represents a fast component of the total current trough the membrane and z and w are the slow components responsible for the bursts. Isyn is the dynamic postsynaptic current due to the connections. The parameter I was used to adjust the intrinsic behavior of the model from periodic spiking to chaotic bursting and finally tonic spiking.
Hodgkin-Huxley-like model (HH2C)
Our HH2C model was based on a single compartment HH model that was first developed and then updated to better represent the ion channels and their dynamics as observed in voltage-clamp experiments with STG neurons in primary culture [45–47].
We modified this HH model in order to include deeper long lasting spontaneous hyperpolarizations, which are not only a very important characteristic of STG bursting neurons, but they also allow one to design networks using graded synaptic connections, believed to play crucial roles in CPG pattern formation [7, 53–57].
Since most works on modeling STG neurons are based in whole cell voltage clamp experiments of cultured neurons and there are not enough data to decide, without speculative assumptions, neither how many compartments are needed, nor how to segregate or how to split the many different conductances among compartments, we decided to modify the model in the simplest possible way yet capable to perform deeper hyperpolarizing behavior. Our modification consisted in splitting the different ion channel conductances of the HH2C model neuron in two compartments: an axonal compartment where the spike generating fast Na+ and K+ plus a passive leakage currents are located, and a somatic/neuropil compartment that includes all slow conductances of the model as well as the synaptic input current. The two compartments were connected by a passive electrical conductance adjusted in such a way that the bursting behavior of the model is similar to the one found in STG neurons.
The membrane potential dynamics of the two compartments are given by:
where C = 0.628 nF is the capacitance of the soma whose area is 0.628×10-3 cm2, CAx = 0.2 nF is the capacitance of the axon of area AreaAx = 0.2×10-3 cm2, GVV = 200 nS is the conductance coupling the two compartments. These values are based on STG neurons properties.
Besides the separation of the model in two compartments, we kept all the remaining parameters as shown by Prinz et al. [45], with the exception of the Eleak that was slightly decreased to produce the desired deeper hyperpolarizations.
The currents are described by
where gi is the maximal specific conductance: gNa = 120 mS/cm2; gCaT = 1.0 mS/cm2; gCaS = 11.0 mS/cm2; gKCa = 1.22 mS/cm2; gKd = 36 mS/cm2. Ac is the area of the corresponding compartment (soma or axon). The reversal potentials are: +50 mV for Na, -80 mV for the three potassium currents, -20 mV for IH, and -60 mV for Ileak. The calcium reversal potential was calculated by the instantaneous intracellular calcium concentration and an extracellular calcium concentration [Ca]ext of 3 mM, by means of the Nernst equation, at 17°C. The values for the integer exponents γi and δi are given in Table 1. The activation and inactivation variables mi and hi change according to:
where τm, m∞, τh and h∞ are voltage-dependent, as shown in Table 1. The internal calcium concentration dynamics is given by
where τCa = 200 ms is the Ca+2 buffering time constant, f = 14.96 M/nA, and [Ca+2]0 = 0.05 M is the internal calcium concentration for which there is no calcium flux through the membrane.
The dynamical variables related to the soma currents are calculated considering the potential V, and the axon currents considering Vax.
In this model the calcium-dependent potassium conductance gKCa was used to control the level of excitation of the neurons because it regulates the outflow of potassium during the spiking onset, thus it was the intrinsic parameter for the HH-based model CPGs. Varying this conductance the neuron electrical activity could be smoothly changed from rhythmically bursting to tonic spiking (Fig. 1).
(A) HR model neuron: up to I∼3.1 the number of spikes per burst increased with I in a period adding bifurcation; for I>3.15 the neuron was tonic. (B) The HH2C model presented tonic behavior for values of the intrinsic parameter gKCa<1.21, while for gKCa>1.21 a bursting behavior was observed. For gKCa>1.45 an inverse period adding bifurcation took place. (C) HHIH model: as in the HH2C model the transition from bursting to tonic behavior happened when the control parameter was decreased.
Hodgkin-Huxley-like model with increased hyperpolarization-activated current (HHIH)
The HHIH model was obtained from a modification of our previous HH2C model that consisted in changing the dynamics and increasing the value of the hyperpolarization activated current IH. Several facts guided this modification. First, several studies show that this conductance is important in rhythm generation [12, 48, 50]. Also, differenty from all other original HH model conductances [45] that were based on voltage-clamp data from isolated stomatogastric neurons [46, 47], the dynamics of IH conductance, was taken from guinea pig thalamic relay neurons [58]. Finally, we were also inspired in previous experimental results [49] and consisted in the intensification of the IH conductance and also in making it active for more depolarized potentials.
The modification were: the conductance and the reversal potential were increased (gH = 0.5 mS/cm2; Vrev = 20mV) and the activation current function was slightly displaced 5mV towards more depolarized values. The modifications were made to intensify the current and to make it active for more depolarized potentials, inspired in previous experimental results [49].
The parameters for the HHIH model are: EH = 20 mV, gH = 0.5 and
All the remaining equations are the same as in the HH2C model. In the HHIH model the calcium-dependent potassium conductance gKCa was also chosen as the intrinsic parameter for the model CPGs.
Chemical synapses
The model neurons were connected by chemical synapses implemented using a model that mimics the release and the diffusion of the neurotransmitter in the synaptic cleft according to a simple first order kinetic description [51, 52]. The postsynaptic current is given by:
where gsyn is the maximal synaptic conductance, Vrev is the reversal potential for the synapse, and Vpos is the membrane potential of the post-synaptic cell. The dynamical variable S(t) is the voltage-dependent activation that mimics the kinetics release and the binding of the neurotransmitter at the synaptic cleft, and it is given by
where S∞ is given by
Table 2 shows the synaptic parameters used in the simulations for all models.
Results
Intrinsic properties of the model neurons
We characterize the intrinsic behavior of the model neurons by plotting series of interspike intervals (ISIs) as a function of the intrinsic parameter. The bifurcation diagrams show many qualitatively different behaviors the models present as the intrinsic parameter is changed (Fig. 1). In spite of each model’s particularities, all of them showed a similar sequence of dynamical states: they present a region where a period-adding bifurcation is observed and a transition from periodic bursting to tonic spiking. However, in the HR and HHIH models the transition corresponds to a band of chaotic behavior with irregular number of spikes/burst and burst duration, while in the HH2C model the transition from periodic bursting to tonic spiking is a point of accumulation of the period-adding bifurcation in which the number of spikes/burst successively increases toward infinity and the tonic behavior takes place.
Half-center oscillators
The parameter space for the HR model is shown in Fig. 2, where we observe that when the neurons are intrinsic periodic bursters (lower values of I) the frequency of the network is very close to the frequency of the isolated neuron and it is almost insensitive to changes in the synaptic strength.
(A) Parameter space of the bursting frequency for a two-HR model neurons half-center oscillator. The parameter I (horizontal axis) represents the intrinsic behavior of the neurons and the parameter gsyn (vertical axis) represents the maximal synaptic conductance between neurons. (B) Standard deviation of the bursting frequency for the same parameter space. The network is unstable for small values of the synaptic coupling when neurons become intrinsically more excited (tonic).
On the other hand, when the neurons are intrinsically tonic (higher values of I) the rhythm of the network is substantially changed by the synaptic connection. One can observe a 5-fold modification in the rhythm, which goes from 0.5 Hz (when neurons are strongly connected) to 2,5 Hz (for lower synaptic coupling) in agreement with what is experimentally observed [21, 29, 30].
We inferred the network flexibility for a given value of I by computing the difference between the maximal and the minimal bursting frequency the network reached for the whole set of synaptic coupling (Fig. 3A). The robustness of the CPG for a given I was estimated by observing the average standard deviation of the bursting frequency over the synaptic strength (Fig. 3B): if the rhythm becomes irregular and the CPG fails in functionality, the bursting frequency will present large variations that will be revealed by the average of the standard deviations; conversely a robust CPG will generate periodic rhythms over all the values of the synaptic strength and will present only small standard deviations of its bursting frequencies.
(A) The difference between the maximal and the minimal frequencies the GPG reaches for the whole set of synaptic conductances as a function of the intrinsic parameter I. (B) The mean standard deviation of the bursting frequency (averaged over all the values of the synaptic coupling) as a function of the intrinsic parameter I. From (A) we can infer that the flexibility of the CPG increases with I, since the range of frequencies that the same neurons are able to generate is also increasing. However, in (B) we observe that the behavior of the CPGs becomes more irregular as we increase I, as it can be seen by the increase in the average standard deviation of the bursting frequency.
In this context the more tonic were the neurons intrinsically, the more flexible was the network, as shown in Fig. 3A. However, the robustness of the CPG decreases as the neurons go from bursting to tonic, i.e., as we increased I (Fig. 3B). As the neurons became intrinsically more tonic, there was a stronger competition for firing, and the rhythm became unstable in a larger area over the parameter space as it can be seen in Fig. 2B. Moreover, when neurons were intrinsically tonic, for small synaptic strengths the network behavior is non oscillatory (white regions in Fig. 2A).
Based on these observations we argue that the best balance between flexibility and robustness is achieved when the neurons are in the transition from bursting to tonic behavior. This is the range where the model neurons present chaotic behavior when isolated.
In order to verify if these results were model-independent, we repeated the same analysis with CPGs built with HH2C model neurons, which were originated from electrophysiological measurements of STG cultured neurons.
To obtain the parameter space of the HH2C-based CPGs (Fig. 4A), we used the calcium-dependent potassium conductance (gKCa) as the intrinsic parameter while keeping the synaptic strength (gsyn) as the synaptic parameter.
(A) Parameter space for the CPG. For smaller values of the intrinsic parameter the neurons behave tonically and do not provide usable CPGs (white region). (B) The frequency dependence on the synaptic strength for the line showed in (A) (gKCa = 2.5 mS/cm2).
Fig. 4A shows that these CPGs are rather insensitive to changes in the synaptic conductance, no matter what was the intrinsic behavior of the neurons. Moreover, the changes in the frequency as a function of gsyn (shown in Fig. 4B) occurred in the opposite direction than the observed in experiments [12]. Furthermore, the CPG stops the rhythm generation when the neurons intrinsic behavior is tonic (gKCa≤1.25). So, in spite of the stronger biological appeal of the HH2C in comparison to the HR model, it was not able to provide a realistic dynamical repertory of the biological CPGs.
Such discrepancy might be attributed to two factors: the model neuron was extremely sensitive to current injection, easily going to a silent state while inhibited; the model present a weak post inhibitory rebound, meaning that the activity after the release from inhibition is not increased in comparison to the ordinary activity.
One of the reasons for the HH2C model be very sensitive to inhibition is that it presents a small overall conductance during hyperpolarization, so a small current is enough to keep the neuron in the silent state. Based on these observations and in a few previous modeling and experimental works, we propose a way to improve the behavior of the model, as shown in the next section.
Increasing the effect of IH conductance in the HH model
The parameter space for the HHIH-based CPG model is shown in Fig. 5. The alteration in the IH conductance corrected the dependence of the CPG frequency on the synaptic strength gsyn, meaning that the frequency of oscillation now decreased as gsyn was increased, as observed for the HR model and in experiments. Furthermore, the frequency gradient increased, and so the flexibility of the CPG. Finally, the changes in IH also provided the network with more stability, since the network oscillatory behavior is stable for a larger area of the parameter space.
The burst frequency has its greatest gradient in the region of the transition between bursting to tonic intrinsic behavior as pointed by the dashed line.
It is worthy noting that there was a range of values of the intrinsic parameter gKCa close to the transition from bursting to tonic intrinsic behavior in which the CPG had the best flexibility and it was also robust, as pointed out in Fig. 5 (the dashed line).
A three-neurons model CPG
We also simulated some more realistic model CPGs to mimic the pyloric activity of the spiny lobster Panulirus interruptus. The scheme of the network is shown in Fig. 6 and it is based on the fact that food is filtered/pumped in a cycle that always preserve the same firing sequence: a cycle starts with the firing of the group formed by the Lateral Pyloric (LP) and the Inferior Cardiac (IC) neurons, on the sequence the Ventricular Dilator (VD) and the 8 Pyloric (PY) neurons fire, finally the cycle is reset by the firing of the pacemaker group formed by the Anterior Burster (AB) and the two Pyloric Dilator (PD) neurons [7, 33, 59]. Since inside each group the neurons fire with very small phase differences, in our model pyloric CPG we represented each group by a single model neuron. We also considered that all neurons have the same intrinsic properties, however we used different synaptic strengths to include the fact that in the real CPG some connections are stronger than others.
The connections between neurons represent the inhibitory synapses. In each synapse it is shown the value of the relative synaptic strength.
In Fig. 7 we show the typical phase lags observed in our simulated model CPGs, as well as the respective temporal series obtained in a HR-based 3-neuron CPG.
(A) Phase diagram showing the sequence of bursts (grey boxes) and (B) example of time series for the HR-based 3-neuron CPG. LP/IC and PY/VD bursts are superimposed as usually found in experiments. The PY/VD burst is interrupted by AB/PD and the cycle restarts.
The parameter spaces obtained as function of I and gsyn for the HR-based 3-neuron model CPG are shown in Fig. 8. For values of gsyn<3 the results were similar to the ones obtained for the half-center oscillators: a change from 1Hz to 2Hz in the CPG frequency with the increase of gsyn is observed for values of the intrinsic parameter I∼3.1 (Fig. 8A) which is in the transition from bursting to tonic behavior where the model neurons are intrinsically chaotic. Around I∼3.1, and again considering only the region of the parameter space where gsyn<3, are also found the smaller values of the standard deviation of the CPG frequencies computed from the time series of the AB/PD model neuron (Fig. 8B). For smaller values of I, where the neurons are intrinsically periodic bursters, the frequency is less sensitive to changes in gsyn so the CPGs are less flexible; conversely, for bigger values of the parameter I, where the neurons are intrinsically tonic, the CPG lost its robustness as it can be seen by the larger standard deviations of the CPG frequencies (as shown in Fig. 8B). For values of gsyn>3 the results are strongly biased by the limitations of the HR model concerning the strong PIR. In these region we found several non-physiological behaviors: the presence of a series of Arnold tongues that correspond to high bursting frequencies that are very stable as it can be seen in the white regions of Fig. 8B, and a reverse dependence of the CPG frequency on gsyn.
(A) Bursting frequency for the AB/PD model neuron. (A) Standard deviation of the bursting frequency for the same neuron. (C) The grey regions correspond to sets of parameters where the CPG completely loses its robustness: the LP/IC neuron does not fire during the activity of the network.
This discrepancies for higher values of the synaptic conductance can be understood by considering that the bursting genesis in the HR model is provided by a slow adaptation current that depends linearly on the membrane potential, instead of presenting a sigmoidal saturation as observed in biological neurons [42]. With this non-saturation characteristic of the post-inhibitory rebound (PIR) it is difficult to obtain patterns that present duty cycles much smaller than 50%, specially when a strong inhibition enhances the PIR response of the neurons. This can be seen in the region shown in Fig. 8C where the strong PIR presented by the AB/PD and VD/PY neurons prevent the LP/IC neuron of firing, disrupting the three phase rhythm of the CPG.
The parameter space obtained for a HH2C-based 3-neuron model CPG is shown in Fig. 9. In this case we observed that either no rhythm is produced by the CPG (when the neurons are set in a range of the intrinsic parameter gKCa where they are intrinsically tonic), or the CPGs present almost no flexibility to changes in the synaptic conductance (for gKCa in a range that corresponds to intrinsic bursting behavior).
For lower values of gKCa the CPG do not provide a three phase rhythm (blank region).
We also studied the parameter space obtained from model CPGs based on our HHIH model neurons, where we increased the influence of the IH current. The results are shown in Fig. 10. Similarly to what happened with the half-center oscillator the modification brought some flexibility to our three-neurons CPG model, and the area of the parameter space where the network produces a three phase rhythm was also increased.
In comparison to the parameter space of the HH2C-based CPG the region that corresponds to bursting behavior is enlarged and a greater frequency variation is obtained in the region of gKCa close to the transition between bursting to tonic behavior.
Discussion
One of the main questions in neuroscience is to identify to which degree one can infer the behavior of a neural network just by investigating the isolated behavior of its neurons and the sinaptic connectivity. Not only the dynamical properties of the neurons are quite complex but the neuromodulation produces yet another layer of complexity, by changing both the intrinsic parameter of the neurons and their connectivity [60]. We tried to shed some light into this question by simulating the behavior of two- and three-neuron networks, investigating their output as the intrinsic dynamics of the neurons and the synaptic strength are changed. Our investigations reveal the mechanism and the key elements for the proper establishment of the rhythmic oscillations and its modulation by the synaptic strength.
Using reduced neural networks to investigate the dynamical properties neurons has been a successful approach to uncover features that would be hidden if the neural models were not inserted in a network. This is specially useful for understanding small GPG circuits where the number of neurons is reduced and hence the role of each individual cell is important. Connecting a neural model in a, network can be interpreted as a challenge to the model, and might reveal possible weaknesses. We believe that was the case here. A very important model (HH2C) could be improved because of a “dynamical test” under which it was subjected.
For a given value of the models intrinsic parameter we tried to assess how flexible that CPG is by changing the synaptic maximum conductance and measuring the range of bursting frequencies obtained, a common way of investigating the dynamical propperties of the CPGs [21, 29]. We evaluated the stability of a CPG through two main aspects: if a proper bursting rithms was established for all sinaptic strengths and and if the rithm had a low standard deviation of the bursting period. Even though a CPG does not requre a great amount of periodicity as for example can be obtained with computational simulations, a fair degree of periodicity is observed in biological CPGs, even when important parameters are changed [22]. Furthermore, CPGs are attached to muscles whose activation depends on a sustained activity of these neurons, and hence the muscular activity can be affected if a certain level of stability is not achieved.
Half-Center Oscillators
For HCO based on the phenomenological HR neuron model the best relation between flexibility and robustness was obtained when the intrinsic parameter of the neurons was set in a region close to the transition between bursting and tonic spiking behaviors, as it was found in neurons isolated from the biological CPGs [36].
The original HH-like model was not able to produce half-center oscillations when the neurons were set in intrinsically tonic spiking state. Moreover, in their intrinsic bursting region they were not flexible (the frequency was not sensitive to synaptic changes). This failure in providing good models of half-center oscillators clearly shows that sometimes a successful model of an isolated neuron is not able to mimic the collective dynamics, because of the complex nature of the CPG.
We modified the HH model by changing its IH conductance for experimental and theoretical reasons main reasons (see methods session). The CPGs with the resulting (HHIH) model presented three main improvements. A larger area of the parameter space became functionally meaningful, so the robustness was increased; The range of frequencies of the CPG when the synaptic parameter is changed also increased, adding flexibility to the model; It corrected the gradient of the frequency as a function of the synaptic conductance was corrected (it was reversed in the CPGs built with the original HH model).
In the improved HH model, the flexibility was maximum around the transition from bursting to tonic spiking intrinsic behavior. CPGs with tonic spiking intrinsic neurons were also less robust than those with bursting intrinsic neurons.
According to our results, when the model neurons intrinsic behavior is set to regular bursting they are able to establish anti-phase oscillations with minimal synaptic current.
If the neurons do not have a strong PIR, as soon as they achieve the anti-phase oscillatory regime, the bursting frequency is no longer influenced by changes of the synaptic conductance. On the other hand, if the neurons are intrinsically tonic, one neuron will keep firing until the other neuron escapes from the inhibition (due to IH current, for example) and starts to fire. If the neurons have a weak PIR the CPG will become unstable or will not produce any oscillations.
Three-neurons CPGs
We also presented some results obtained from 3-neurons CPG, built either with HR or HHIH models, to provide a three phase rhythm, similar to the one found in the pyloric circuit of crustaceans.
Similarly to the results obtained for HCOs, in 3-neurons model CPGs, the parameter ranges that showed the best balance between flexibility and robustness were those corresponding to intrinsic behavior in the transition from bursting to tonic spiking, the same regions where the chaotic behavior can be found in the isolated neuron models. This is again in agreement with the observation of chaotic-like dynamics in the behavior of isolated biological neurons [14, 34, 35].
Our previous discussion of the role of the PIR should be also valid for CPGs made by three or more neurons, since the competition for firing also holds. Evidently, these networks exhibit much richer behavior, since there is a stronger dependence on the connectivity. However, the general oscillating properties can still be revealed with our analysis.
Presence of chaotic-like behavior in models and biological neurons
When pyloric STG neurons (with the exception of the AB) are isolated from the circuit, they usually behave irregularly, presenting chaotic-like bursting behavior, close to a transition to tonic spiking [14, 34–36]. The hypothesis that the main role of chaos in the isolated neurons is to provide a CPG with both flexibility and reliability is an interesting theoretical framework. Unfortunately, it only applies rigorously to isolated chaotic systems and it is challenging to show that these arguments can be extended to systems made of two or more coupled chaotic oscillators, particularly when they are strongly connected, as it is the case of the neurons of a CPG.
Here we showed that the ranges in the intrinsic parameter of the models that correspond to the best CPGs, regarding our measures of flexibility and robustness, are those where the isolated models are near a transition from bursting to tonic spiking, where a range of complex behaviors can be easily found: windows of periodic behavior, spike adding transitions, and also chaotic behavior.
However, we did not find any direct relation between the presence of chaotic behavior (at a specific values of the intrinsic parameters) and special increases on the flexibility (robustness) of the CPGs. According to our results, as the neuron models were tuned from periodic bursting to tonic spiking, the flexibility increased smoothly.
Instead of being an indicator of the role of chaos in CPGs, the fact that we always find irregular, chaotic-like behavior, in biological isolated neurons, might be rather explained by the natural biological variability and noise [36] that act by mixing different regimes of oscillation.
If the best CPGs are those made of model neurons tuned at the transition from periodic bursting to tonic spiking, where a rich variety of dynamical behaviors are found, variability and noise are able to mix several windows of periodic behavior, spike-adding transitions, and chaotic windows, providing an irregular time-series that is comparable to the ones from biological isolated neurons.
The main question, however, might be the biological meaning underlying these findings, which suggest that neurons are in a very particular dynamical state, i.e., in a narrow range in the transition between two distinct modes of operation (bursting and tonic). Hence, such delicate balance must be sustained by a sort of homeostatic process that keeps these neurons in such state. In one hand, there are experimental evidences that general dynamical properties can be maintained even with disparate individual features [22]. On the other hand, evidences suggest that from different individuals neurons can present very different parameters and yet, keep the same dynamical properties [33, 61]. These evidences, along with our results, suggest that there might be a “target dynamics” instead of a target parameter, in which a particular mode of operation is maintained. The way the phisiological mechanisms act to maintain such balance is still to be uncovered.
Acknowledgments
Authors also acknowledge Ramon Huerta and Pablo Varona for the help in computational matter.
Author Contributions
Conceived and designed the experiments: MBR RDP. Performed the experiments: MBR PVC. Analyzed the data: MBR PVC RDP. Contributed reagents/materials/analysis tools: RDP JCS. Contributed to the writing of the manuscript: MBR PVC JCS RDP.
References
- 1. Marder E. Variability, compensation, and modulation in neurons and circuits. Proceedings of the National Academy of Sciences of the United States of America. 2011 Sep;108 Suppl:15542–8. Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3176600&tool=pmcentrez&rendertype=abstract. pmid:21383190
- 2. Marder E, Calabrese RL. Principles of rhythmic motor pattern generation. Physiological Reviews. 1996 Jul;76(3):687–717. Available from: http://physrev.physiology.org/content/76/3/687.abstract. pmid:8757786
- 3.
Stein P, Grillner S, Selverston A, Stuart D. Neurons, Networks, and Behavior. 1st ed. Cambrige, MA: MIT Press; 1997.
- 4. Destexhe A, Marder E. Plasticity in single neuron and circuit computations. Nature. 2004 Oct;431 (7010):789–795. Available from: http://dx.doi.org/10.1038/nature03011. pmid:15483600
- 5. Marder E, Bucher D. Understanding circuit dynamics using the stomatogastric nervous system of lobsters and crabs. Annual review of physiology. 2007;69:291–316. pmid:17009928
- 6. Mulloney B, Selverston AI. Organization of the stomatogastric ganglion of the spiny lobster—I. Neurons Driving the Lateral Teeth. Journal of Comparative Physiology. 1974;91:1–32. Available from: http://www.springerlink.com/content/j831481w83u7023l/.
- 7. Selverston AI, Russell DF, Miller JP. The stomatogastric nervous system: structure and function of a small neural network. Progress in neurobiology. 1976;7:215–290. pmid:11525
- 8.
Selverston AI, Moulins M. The Crustacean Stomatogastric System. 1st ed. Berlin: Springer-Verlag; 1987. Available from: http://link.springer.com/10.1007/978-3-642-71516-7.
- 9.
Perkel DH, Mulloney B. Motor pattern production in reciprocally inhibitory neurons exhibiting postinhibitory rebound. Science (New York, NY). 1974;185:181–183.
- 10. Wang XJ, Rinzel J. Alternating and Synchronous Rhythms in Reciprocally Inhibitory Model Neurons. Neural Computation. 1992;4:84–97.
- 11. Skinner FK, Kopell N, Marder E. Mechanisms for oscillation and frequency control in reciprocally inhibitory model neural networks. Journal of Computational Neuroscience. 1994;1:69–87. pmid:8792226
- 12. Sharp AA, Skinner FK, Marder E. Mechanisms of oscillation in dynamic clamp constructed two-cell half-center circuits. Journal of Neurophysiology. 1996 Aug;76(2):867–883. Available from: http://jn.physiology.org/content/76/2/867.abstract. pmid:8871205
- 13. Rowat PF, Selverston AI. Oscillatory mechanisms in pairs of neurons connected with fast inhibitory synapses. Journal of Computational Neuroscience. 1997;4:103–127. pmid:9154518
- 14. Selverston aI, Rabinovich MI, Abarbanel HDI, Elson R, Szücs a, Pinto RD, et al. Reliable circuits from irregular neurons: a dynamical approach to unterstanding central pattern generators. J Physiol (Paris), 94: 357–374. 2000;94:357–374.
- 15. Gdovin MJ, Torgerson CS, Remmers JE. The fictively breathing tadpole brainstem preparation as a model for the development of respiratory pattern generation and central chemoreception. Comparative Biochemistry and Physiology Part A: Molecular & Integrative Physiology. 1999 Nov;124(3):275–286. Available from: http://www.sciencedirect.com/science/article/pii/S1095643399001166.
- 16. Kemenes G, Staras K, Benjamin PR. Multiple types of control by identified interneurons in a sensory-activated rhythmic motor pattern. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2001;21(8):2903–2911.
- 17. Brezina V, Horn CC, Weiss KR. Modeling neuromuscular modulation in Aplysia. III. Interaction of central motor commands and peripheral modulatory state for optimal behavior. Journal of neurophysiology. 2005;93:1523–1556. pmid:15469963
- 18. Simoni MF, DeWeerth SP. Two-dimensional variation of bursting properties in a silicon-neuron half-center oscillator. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2006;14:281–289. pmid:17009487
- 19. Nusbaum MP, Beenhakker MP. A small-systems approach to motor pattern generation. Nature. 2002;417:343–350. pmid:12015615
- 20. Marder E, Bucher D. Central pattern generators and the control of rhythmic movements. Current Biology. 2001;11. pmid:11728329
- 21. Weaver AL, Hooper SL. Relating network synaptic connectivity and network activity in the lobster (Panulirus interruptus) pyloric network. Journal of neurophysiology. 2003;90:2378–2386. pmid:12801895
- 22. Reyes MB, Huerta R, Rabinovich MI, Selverston AI. Artificial synaptic modification reveals a dynamical invariant in the pyloric CPG. European journal of applied physiology. 2008 Apr;102(6):667–75. Available from: http://www.ncbi.nlm.nih.gov/pubmed/18075756. pmid:18075756
- 23. Tang LS, Taylor AL, Rinberg A, Marder E. Robustness of a rhythmic circuit to short- and long-term temperature changes. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2012 Jul;32(29):10075–85. Available from: http://www.ncbi.nlm.nih.gov/pubmed/22815521.
- 24. Pearson KG. Neural adaptation in the generation of rhythmic behavior. Annual review of physiology. 2000;62:723–753. pmid:10845109
- 25. Mackay-lyons M. Spinal Cord Injury Special Series Central Pattern Generation of Locomotion: A Review of the evidence. Physical Therapy. 2002;82:69–83. pmid:11784280
- 26. Ohgane K, Ei SI, Kazutoshi K, Ohtsuki T. Emergence of adaptability to time delay in bipedal locomotion. Biological cybernetics. 2004 Feb;90(2):125–32. Available from: http://www.ncbi.nlm.nih.gov/pubmed/14999479. pmid:14999479
- 27. Yakovenko S, McCrea DA, Stecina K, Prochazka A. Control of locomotor cycle durations. Journal of neurophysiology. 2005;94:1057–1065. pmid:15800075
- 28. Dickinson PS. Neuromodulation of central pattern generators in invertebrates and vertebrates. Current Opinion in Neurobiology. 2006 Dec;16(6):604–614. Available from: http://www.ncbi.nlm.nih.gov/pubmed/17085040. pmid:17085040
- 29. Bartos M, Manor Y, Nadim F, Marder E, Nusbaum MP. Coordination of fast and slow rhythmic neuronal circuits. The Journal of neuroscience: the official journal of the Society for Neuroscience. 1999;19(15):6650–6660.
- 30. Böhm H, Dybek E, Heinzel HG. Anatomy and in vivo activity of neurons connecting the crustacean stomatogastric nervous system to the brain. Journal of Comparative Physiology—A Sensory, Neural, and Behavioral Physiology. 2001;187:393–403.
- 31. Roffman RC, Norris BJ, Calabrese RL. Animal-to-animal variability of connection strength in the leech heartbeat central pattern generator. Journal of Neurophysiology. 2012;107:1681–1693. pmid:22190622
- 32. Goaillard JM, Taylor AL, Schulz DJ, Marder E. Functional consequences of animal-to-animal variation in circuit parameters. Nature neuroscience. 2009;12:1424–1430. pmid:19838180
- 33. Prinz AA, Bucher D, Marder E. Similar network activity from disparate circuit parameters. Nature neuroscience. 2004;7:1345–1352. pmid:15558066
- 34. Rabinovich MI, Abarbanel HDI, Huerta R, Elson R, Selverston AI. Self-regularization of chaos in neural systems: experimental and theoretical results. IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications. 1997;44.
- 35. Elson RC, Huerta R, Abarbanel HDI, Rabinovich MI, Selverston AI. Dynamic Control of Irregular Bursting in an Identified Neuron of an Oscillatory Circuit. Journal of Neurophysiology. 1999 Jul;82(1):115–122. Available from: http://jn.physiology.org/content/82/1/115.abstract. pmid:10400940
- 36. Carelli PV, Reyes MB, Sartorelli JC, Pinto RD. Whole cell stochastic model reproduces the irregularities found in the membrane potential of bursting neurons. Journal of neurophysiology. 2005 Aug;94(2):1169–79. Available from: http://www.ncbi.nlm.nih.gov/pubmed/15800078. pmid:15800078
- 37. Ott E, Grebogi C, Yorke JA. Controlling chaos. Physical Review Letters. 1990;64:1196–1199. Available from: http://link.aps.org/doi/10.1103/PhysRevLett.64.1196. pmid:10041332
- 38. Schiff SJ, Jerger K, Duong DH, Chang T, Spano ML, Ditto WL. Controlling chaos in the brain. Nature. 1994;370:615–620. pmid:8065447
- 39.
Holden AV, Tucker JV, Thompson BC, Withington D, Zhang H. Theoretical framework for analysing the behaviour of real and simulated neural networks. In: Taylor JG, Caianiello ER, Cotterill RMJ, Clark JW, editors. Neural Network Dynamics SE—11. Perspectives in Neural Computing. Springer London; 1992. p. 155–169. Available from: http://dx.doi.org/10.1007/978-1-4471-2001-8_11.
- 40. Rabinovich MI, Abarbanel HDI. The role of chaos in neural systems. Neuroscience. 1998;87:5–14. pmid:9722138
- 41. Hindmarsh JL, Rose RM. A model of the nerve impulse using two first-order differential equations. Nature. 1982;296:162–164. pmid:7063018
- 42. Hindmarsh JL, Rose RM. A model of neuronal bursting using three coupled first order differential equations. Proceedings of the Royal Society of London Series B, Containing papers of a Biological character Royal Society (Great Britain). 1984;221:87–102.
- 43. Szucs a, Varona P, Volkovskii aR, Abarbanel HD, Rabinovich MI, Selverston aI. Interacting biological and electronic neurons generate realistic oscillatory rhythms. Neuroreport. 2000;11(3):563–569. pmid:10718315
- 44. Pinto RD, Varona P, Volkovskii AR, Szücs A, Abarbanel HDI, Rabinovich MI. Synchronous behavior of two coupled electronic neurons. Physical Review E. 2000 Aug;62(2):2644–2656. Available from: http://link.aps.org/doi/10.1103/PhysRevE.62.2644.
- 45. Prinz Aa, Thirumalai V, Marder E. The functional consequences of changes in the strength and duration of synaptic inputs to oscillatory neurons. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2003;23(3):943–954.
- 46. Turrigiano G, LeMasson G, Marder E. Selective regulation of current densities underlies spontaneous changes in the activity of cultured neurons. The Journal of Neuroscience. 1995 May;15(5):3640–3652. Available from: http://www.jneurosci.org/content/15/5/3640.abstract. pmid:7538565
- 47. Liu Z, Golowasch J, Marder E, Abbott LF. A model neuron with activity-dependent conductances regulated by multiple calcium sensors. The Journal of neuroscience: the official journal of the Society for Neuroscience. 1998;18(7):2309–2320.
- 48. Kiehn O, Harris-Warrick RM. 5-HT modulation of hyperpolarization-activated inward current and calcium-dependent outward current in a crustacean motor neuron. Journal of Neurophysiology. 1992 Aug;68(2):496–508. Available from: http://jn.physiology.org/content/68/2/496.abstract. pmid:1382120
- 49. Harris-Warrick RM, Coniglio LM, Levini RM, Gueron S, Guckenheimer J. Dopamine modulation of two subthreshold currents produces phase shifts in activity of an identified motoneuron. Journal of Neurophysiology. 1995 Oct;74(4):1404–1420. Available from: http://jn.physiology.org/content/74/4/1404.abstract. pmid:8989381
- 50. Zhang Y, Oliva R, Gisselmann G, Hatt H, Guckenheimer J, Harris-Warrick RM. Overexpression of a hyperpolarization-activated cation current (Ih) channel gene modifies the firing activity of identified motor neurons in a small neural network. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2003;23(27):9059–9067.
- 51. Destexhe A, Mainen ZF, Sejnowski TJ. An Efficient Method for Computing Synaptic Conductances Based on a Kinetic Model of Receptor Binding. Neural Comput. 1994 Jan;6(1):14–18. Available from: http://dx.doi.org/10.1162/neco.1994.6.1.14.
- 52. Pinto RD, Elson RC, Szücs A, Rabinovich MI, Selverston AI, Abarbanel HDI. Extended dynamic clamp: controlling up to four neurons using a single desktop computer and interface. Journal of Neuroscience Methods. 2001;108:39–48. pmid:11459616
- 53. Ivanov AI, Calabrese RL. Graded Inhibitory Synaptic Transmission Between Leech Interneurons: Assessing the Roles of Two Kinetically Distinct Low-Threshold Ca Currents. Journal of Neurophysiology. 2006 Jun;96(1):218–234. Available from: http://jn.physiology.org/content/96/1/218.abstract. pmid:16641379
- 54. Ayali A, Johnson BR, Harris-Warrick RM. Dopamine Modulates Graded and Spike-Evoked Synaptic Inhibition Independently at Single Synapses in Pyloric Network of Lobster. Journal of Neurophysiology. 1998 Apr;79(4):2063–2069. Available from: http://jn.physiology.org/content/79/4/2063.abstract. pmid:9535968
- 55. Graubard K, Raper JA, Hartline DK. Graded synaptic transmission between spiking neurons. Proceedings of the National Academy of Sciences. 1980 Jun;77(6):3733–3735. Available from: http://www.pnas.org/content/77/6/3733.abstract.
- 56. Graubard K, Raper JA, Hartline DK. Graded synaptic transmission between identified spiking neurons. Journal of Neurophysiology. 1983 Aug;50(2):508–521. Available from: http://jn.physiology.org/content/50/2/508.abstract. pmid:6136554
- 57. Maynard DM, Walton KD. Effects of maintained depolarization of presynaptic neurons on inhibitory transmission in lobster neuropil. Journal of Comparative Physiology. 1975;97:215–243.
- 58. Huguenard JR, McCormick DA. Simulation of the currents involved in rhythmic oscillations in thalamic relay neurons. Journal of Neurophysiology. 1992 Oct;68(4):1373–1383. Available from: http://jn.physiology.org/content/68/4/1373.abstract. pmid:1279135
- 59.
Harris-Warrick R, Marder E, Selverston AI, Moulins M. Dynamic Biological Networks. The Stomatogastric Nervous System. Cambridge, MA, USA: MIT Press; 1992.
- 60. Barabási Al. Taming complexity. Nature Physics. 2005;1(November):68–70.
- 61. Grashow R, Brookings T, Marder E. Reliable neuromodulation from circuits with variable underlying structure. Proceedings of the National Academy of Sciences of the United States of America. 2009;106:11742–11746. pmid:19553211