Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Periodic flashing coordinated reset stimulation paradigm reduces sensitivity to ON and OFF period durations

  • Danil Tyulmankov,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Boston Scientific Neuromodulation, Valencia, California, United States of America

  • Peter A. Tass,

    Roles Conceptualization, Methodology, Validation, Writing – review & editing

    Affiliation Department of Neurosurgery, Stanford University School of Medicine, Stanford, California, United States of America

  • Hemant Bokil

    Roles Conceptualization, Investigation, Methodology, Project administration, Supervision, Validation, Writing – review & editing

    hemant.bokil@bsci.com

    Affiliation Boston Scientific Neuromodulation, Valencia, California, United States of America

Abstract

Pathological synchronization in the basal ganglia network has been considered an important component of Parkinson’s disease pathophysiology. An established treatment for some patients with Parkinson’s disease is deep brain stimulation, in which a tonic high-frequency pulse train is delivered to target regions of the brain. In recent years, a novel neuromodulation paradigm called coordinated reset stimulation has been proposed, which aims to reverse the pathological synchrony by sequentially delivering short high-frequency bursts to distinct sub-regions of the pathologically synchronized network, with an average intra-burst interval for each sub-region corresponding to period of the pathological oscillation. It has further been proposed that the resultant desynchronization can be enhanced when stimulation is interrupted periodically, and that it is particularly beneficial to precisely tune the stimulation ON and OFF time-windows to the underlying pathological frequency. Pre-clinical and clinical studies of coordinated reset stimulation have relied on these proposals for their stimulation protocols. In this study, we present a modified ON-OFF coordinated reset stimulation paradigm called periodic flashing and study its behavior through computational modeling using the Kuramoto coupled phase oscillator model. We demonstrate that in contrast to conventional coordinated reset stimulation, the periodic flashing variation does not exhibit a need for precise turning of the ON-OFF periods to the pathological frequency, and demonstrates desynchronization for a wide range of ON and OFF periods. We provide a mechanistic explanation for the previously observed sensitivities and demonstrate that they are an artifact of the specific ON-OFF cycling paradigm used. As a practical consequence, the periodic flashing paradigm simplifies the tuning of optimal stimulation parameters by decreasing the dimension of the search space. It also suggests new, more flexible ways of delivering coordinated reset stimulation.

Introduction

Parkinson’s disease (PD) is a progressive neurodegenerative disease, the prevalence of which is estimated at 0.3% of the overall population in industrialized countries and advances to 1% by the age of 60 and 4% in the highest age groups [1]. The hallmark signs of PD include movement disorders such as bradykinesia, resting tremors and muscle rigidity [2]. The motor symptoms of PD are associated with a dopamine deficiency resulting from the degradation of dopaminergic neurons in the substantia nigra pars compacta. At present there is no cure for PD; treatment is focused on medical management of motor symptoms. Medical therapy has been primarily focused on restoring dopamine levels through the administration of levodopa, dopamine agonists, or monoamine oxidase B inhibitors [3,4]. Current standards for subject care recommend levodopa as first line therapy for the symptomatic control during the early, uncomplicated stages of PD [3,4]. Unfortunately, chronic treatment with levodopa frequently leads to significant side effects, especially dyskinesias and motor fluctuations [5,6].

Previously, for subjects who had reduced response to medical therapy, pallidotomy (destruction of the globus pallidus) and thalamotomy (destruction of the thalamus) were the only available surgical treatment options [7]. In the 1990s, high-frequency deep brain stimulation (DBS) was demonstrated to be effective in reducing the motor complications of subjects with PD [6]. Since that time, numerous case studies and trials, as well as three recent, large, multicenter, randomized trials have demonstrated the efficacy of this therapy [810]. DBS works by chronically delivering a high frequency (120–180 Hz) pulse train (60–200 μs pulse width) through a surgically implanted electrode, most commonly in the subthalamic nucleus (STN) or the globus pallidus internus (GPi). Although the exact mechanisms of action of DBS are still debated, a likely explanation is due to the inhibition of the neuron cell bodies and excitation of axons, which results in modulation of pathological network activity [11]. Further studies have observed that high frequency stimulation suppresses pathological oscillatory behavior in the beta (13–30 Hz) frequency band of the local field potential [12].

Coordinated reset stimulation (CRS) is a brain stimulation technique predicated on the idea that many neurological disorders, including PD, are caused by pathological synchronization of implicated neural elements. Unlike DBS, which delivers a tonic high frequency pulse train, CRS delivers short bursts of high frequency stimulation sequentially across more than one electrode of the implanted lead (Fig 1). This pattern of activation, which may include variation in the electrode order (Fig 2), occurs with a frequency that corresponds approximately to the pathological oscillation frequency. Since its proposal in 2003 [13,14], CRS has been refined over the course of many computational modeling studies [1522], including variations in the electrode order on various time-scales [21], demand-controlled stimulation onset and duration [1317], and fixed periods with (ON) and without (OFF) stimulation [20].

thumbnail
Fig 1. Example coordinated reset stimulation pattern.

Bursts of stimulation pulses are delivered sequentially across Nc different stimulation sites (as shown, Nc = 4) distributed along an electrical stimulation lead. Bursts may be delivered in any order within a CR period (e.g. Fig 2). Periods of stimulation (ON) may be interspersed with periods of silence (OFF), with durations defined as integer or non-integer multiples of the CR period (as shown, m = 2, n = 1). Inset shows an example burst of stimulation, (represented in the main figure as a solid colored block). The number of individual pulses delivered per burst is determined by the intra-burst period and pulse width.

https://doi.org/10.1371/journal.pone.0203782.g001

thumbnail
Fig 2. Variations of the coordinated reset stimulation paradigm.

(A) Periodic flashing, with fixed sequential contact ordering (m = 2.25, n = 1.5). Horizontal bars above the plot indicate the ON-OFF “flashing” pattern given by F(t). Note that the activation sites, when active, correspond to the ones that are active during “chronic” CRS in panel D. (B) Periodic flashing, with randomized contact ordering (m = 2.25, n = 1.5). (C) Stimulation paradigm used by Lysyansky et al. [20] (m = 2.25, n = 1.5). Note that the stimulation pattern re-starts with stimulation site 1 at every ON cycle. (D) “Chronic” CRS, without ON-OFF cycling. (E) Average phase of the oscillator network (modulo 2π), for reference.

https://doi.org/10.1371/journal.pone.0203782.g002

A major challenge of CRS is finding the optimal parameters for stimulation. Along with the parameters that need to be tuned for traditional DBS–frequency (referred to as intra-burst frequency in the context of CRS), intensity, pulse width–it is also necessary to additionally optimize parameters unique to CRS–CR (inter-burst) frequency, ON and OFF periods, and sequence of electrode activation (Fig 1). The large number of parameters had made systematic experimental sensitivity analyses difficult. Instead, the preclinical and clinical studies conducted so far have focused on a limited subset of the parameter values, with the intensity, intra-burst frequency and pulse width chosen to be in the standard DBS range, while parameters unique to CRS chosen, in part, based on practical convenience, or on suggestions from computational work [1322].

First, in epileptic rat hippocampal slice, CRS delivered with 4:2 ON-OFF cycling, at a frequency equal to the mean frequency of the epileptiform discharges, caused long-lasting desynchronization between hippocampal neuronal populations together with a widespread decrease in the amplitude of the epileptiform activity [23]. Next, a study on non-human primates examined the effect of stimulation intensity on the efficacy of CRS. It was observed that CRS delivered for 2 hours/day at the DBS intensity and at one-third of the DBS intensity both provided symptom reduction comparable to that achieved with DBS. In addition, the effect of CRS at one-third of the DBS intensity was long-lasting and persisted for over 1 month after stimulation was turned off. CRS was delivered at a 7 Hz CR frequency with 3:2 ON-OFF cycling [24]. A more recent non-human primate study observed an apparent relationship between the optimal dose and disease severity. A moderate Parkinsonian state required stimulation for 4 hours/day to show symptom reduction comparable to DBS and a mild Parkinsonian state responded more favorably to 2 hours/day than to 4 hours/day. Here again, CRS was delivered at with a 7 Hz CR frequency with 3:2 ON-OFF cycling [25]. Finally, an acute clinical study in 6 patients undergoing DBS treatment for PD demonstrated that CRS delivered for 2 hours, twice a day with 3:2 ON-OFF cycling at the DBS intensity leads to symptom reductions comparable to that seen with traditional DBS [26]. In this study, the intraburst frequency was set to be the peak frequency of the individual patient’s local field potential spectral power.

ON-OFF cycling with periods that are integer multiples of the CRS period has been used in all previous preclinical and clinical studies, raising the question of whether mechanistic reasons exist that make this choice necessary. While using OFF periods to enhance desynchronization was discussed in a number of computational studies [1317], Lysyansky et al. were the first to examine the effect of varying the ON and OFF periods systematically [20]. In a Kuramoto phase oscillator network model, they demonstrated that the efficacy of CRS is critically dependent on the duration of the ON and OFF periods, a dependence that persists across variations of other model and stimulation parameters. Specifically, the authors demonstrated that by varying the spatial spread and intensity of stimulation, two qualitatively distinct states can be created in the oscillator network. In the “cluster state,” the network is partitioned into subsets of oscillators, each subset having a unique phase offset. In the “desynchronized state,” the oscillator phases become uniformly distributed and achieve uniform desynchronization. Both states exhibit dependence on the ON and OFF periods.

In this work, we introduce a modified paradigm, dubbed periodic flashing, in which the timing of the ON-OFF cycles is decoupled from the timing of the stimulation pulse patterns. We study the effect of this paradigm in a phase oscillator network, and demonstrate that this paradigm leads to robust desynchronization for a wide choice of ON and OFF periods. We also show that the dependence seen by Lysyansky et al. is a consequence of the specific CRS paradigm implemented by the authors. In each of the two stimulation regimes discussed above, we establish the mechanism through which the paradigm used by Lysyansky et al. leads to its effects, and detail the reason for failure to achieve desynchronization for certain choices of the ON and OFF period. The periodic flashing paradigm introduced here removes the need to tune two of the CRS parameters–the ON and OFF periods–reducing the search space by two dimensions, potentially simplifying CRS programming and increasing the clinical viability of CRS. It may also open the doors to further enhancement of CRS-like desynchronization approaches.

Materials and methods

Macroscopically, the collective dynamics of a neuronal network have been previously modeled as an all-to-all coupled network of phase oscillators [1315,20] as described by Kuramoto [2729]: #(1) where θi is the phase of the ith oscillator, ωi is the natural frequency of the ith oscillator, and N is the number of oscillators in the network. The natural frequencies are randomly drawn from a distribution g(ω) that is Gaussian with mean Ω and standard deviation σω. Since all pairs of oscillators are coupled together with the same coupling strength K, the spontaneous dynamics of the system (1) are dependent only on the value of K and σω. If K is below the critical coupling strength Kc, the oscillators approach an incoherent state where the phases are uniformly distributed on [0, 2π). If K > Kc, the oscillator phases will spontaneously synchronize. Kc depends only on the distribution of natural frequencies [2729]. Parkinsonian pathological synchrony is modeled by choosing a value of K above the critical coupling strength (Table 1).

thumbnail
Table 1. Definitions and values of model parameters.

https://doi.org/10.1371/journal.pone.0203782.t001

The degree of synchrony is quantified by computing order parameters of various integer orders. The mth order parameter [30,31], where m ≥ 1, is defined as #(2) where 0 ≤ Rm ≤ 1 is the magnitude and ψm is the phase. The first order parameter magnitude R1 corresponds to the coherence of the system, and ψ1 measures the average phase. High values of R1 correspond to a strongly synchronized in-phase system with a single phase cluster. Higher order parameters Rm, m > 1, describe the mth-order clustering behavior of the system. A high value of Rm combined with low values of Rk, 1 ≤ k < m, corresponds to a state with m equally spaced clusters around the unit circle. A fully incoherent state has Rm = 0 for all m.

Following Lysyansky et al. [20], we consider the oscillators arranged on a linear segment [0, L], located at and Nc stimulation sites located at . To model the CRS paradigm, the stimulation term Si(t) is added to the right hand side of (1) #(3) where I is the intensity of the stimulation and the cosθi term [15] accounts for the phase-dependent effect of electrical stimulation of a single neuron [32,33]. P(t) represents a chronic high-frequency stimulation term, here considered as a train of unit amplitude rectangular pulses with inter-pulse interval Tp and pulse width Tp/2. The F(t) and ρj(t) terms control the ON-OFF and spatiotemporal cycling patterns of the stimulation sites, and D(xi, cj) accounts for the spatial profile of the stimulation. We discuss these final three terms in further detail below.

The term ρj(t) is an indicator function that determines whether site j is active at time t. In its most simple “sequential cycling” variation, #(4) where each site is activated one at a time, in sequential order, for a duration of , such that each site is activated exactly once during the CR period (Fig 2A). We also consider a “randomized cycling” variation where the order of the activated sites is randomly permuted every CR period (Fig 2B). As done in previous work [1315,20], the CR period is chosen to be equal to the average natural period of the unstimulated system of oscillators, .

The term F(t) is an indicator function that determines the “flashing” ON-OFF pattern of the entire stimulation; the stimulation is ON for m cycles of length T and OFF for n cycles (Fig 2A and 2B). In contrast to the paradigm used by Lysyansky et al. [20] (Fig 2C), the “flashing” ON-OFF control F(t) is independent of the stimulation site cycling ρj(t). Unlike periodic flashing, the ON-OFF paradigm from Lysyansky et al. enforces the cycling such that site 1 is always the first active site in each ON period.

Finally, D(xi, cj) is the spatial decay function that describes the impact of stimulation of contact cj on location xi. As estimated in brain tissue [34] (however, see [35]), the spatial decay is Lorentzian, #(5) where σ defines the spatial decay rate of the stimulation as a function of distance from the contact (Fig 3). Note that although the coupling between the oscillators (1) is independent of their spatial position, the stimulation strength (2,5) depends on oscillator location. The spatial decay function scales the magnitude of the stimulation applied to a particular oscillator as a function of distance from the stimulation site.

thumbnail
Fig 3. Spatial stimulation decay profile relative to locations of stimulation sites.

Normalized intensity profiles as a function of location for (A) σ = 0.4 and (B) σ = 2. Stimulation sites correspond to the peaks of the spatial profiles. Oscillators are evenly distributed along the length of the horizontal axis.

https://doi.org/10.1371/journal.pone.0203782.g003

See Table 1 for a summary of the definitions and the values used for the parameters in the model.

Finally, to quantify the efficacy of the ON-OFF stimulation, we use the mean maximum of the order parameter [20], defined as #(6) where is the maximum value of Rm(t) during the ith OFF cycle, and NF is the total number of “flashes,” i.e. ON-OFF cycles. To ensure a steady-state result is reached, we ignore the first 10 flashing periods when calculating <r>m.

We numerically integrate the system described by (1) and (3) using the fourth-order explicit Runge-Kutta method with a step size of 0.001. Although less computationally intensive, we have found that adaptive methods did not produce sufficiently reliable results with the necessary degree of temporal precision.

Results

In this work, we introduce a novel CRS paradigm which we call periodic flashing, in which the CR pattern, i.e. the sequence of activation of the stimulation sites, is fixed and operated independently of the ON-OFF “flashing” pattern. We demonstrate that this paradigm is robust to variation of the ON and OFF periods, assuming sufficient stimulation is delivered. Importantly, it is robust for variations of other model and stimulation parameters. Specifically, in the computational work exploring the (I,σ) parameter space through “chronic” CRS (Fig 2D) Lysyansky et al. [20] noted three distinct states achievable through varying the I and σ parameters: a “cluster state,” where R1 is low and R4 is high (Fig 4A and 4B), a “desynchronization state” where both order parameters are low (Fig 4C and 4D), and a state of “oscillation death” where both order parameters are high but the phases are fixed and do not change in time (Fig 4E and 4F). Oscillation death is achieved through large values of I and σ, and is akin to traditional high-frequency DBS which is known to stop oscillation due to high-frequency entrainment [15]. This state is not representative of CRS, and therefore we only focus on two parameter regimes: the “cluster state” regime (I = 10, σ = 0.4) and “desynchronization state” (I = 7, σ = 2) regime.

thumbnail
Fig 4. Three parameter regimes achievable by varying stimulation intensity and spatial spread.

(A) Magnitude and (B) phase modulo 2π, of the first and fourth order parameter in the “cluster state” regime (I = 10, σ = 0.4). (C) and (D) in the “desynchronization state” regime (I = 7, σ = 2). (E) and (F) in the “oscillation death” regime (I = 20, σ = 4). Note that the phase is approximately constant in the “oscillation death” regime, with a high frequency phase jitter. Only the two parameter regimes shown in subplots A-D are considered in this work.

https://doi.org/10.1371/journal.pone.0203782.g004

First-order desynchronization through phase clustering

We first consider the performance of the periodic flashing CRS paradigm in the cluster state regime. Fig 5A shows the degree of first-order desynchronization achieved by the periodic flashing CRS paradigm as a function of the number of ON (m) and OFF (n) cycles. It is quantified by the mean maximum of the first order parameter <r>1 (6). Periodic flashing successfully suppresses first-order synchrony in the oscillator network for all values of m and n, provided that sufficient total stimulation is delivered. In contrast, the CRS paradigm used by Lysyansky et al. [20] only achieves desynchronization for particular choices of m and n (Fig 5C), specifically where the sum (m+n) was an integer, a phenomenon referred to as “anti-resonance”.

thumbnail
Fig 5. Mean maximum of the order parameter as a function of m and n for different stimulation paradigms in the cluster state regime (I = 10, σ = 0.4).

(A) <r>1 and (B) <r>4 using periodic flashing, with sequential activation of stimulation sites. (C) <r>1 and (D) <r>4 using the ON-OFF stimulation paradigm from [20]. (E) <r>1 and (F) <r>4 using periodic flashing, with randomized activation of stimulation sites.

https://doi.org/10.1371/journal.pone.0203782.g005

To understand why an apparently small difference in stimulation pattern causes qualitative differences in the system response, we begin with an explanation of the anti-resonance phenomenon observed by Lysyansky et al. [20]. First, consider the case of chronic CRS with a sequential stimulation site activation order (Fig 2D). Note that in the cluster state regime, the value of σ is low, so the spatial stimulation decay profile is narrow and there is little overlap in stimulation from adjacent stimulation sites (Fig 3A). That is, whenever a particular oscillator is stimulated, it is stimulated by the same site every time. Further, recall that the CR period T is chosen to be equal to the mean natural period of the oscillator network, such that a given stimulation site is always active at the same relative mean phase (modulo 2π). For example, stimulation site 1 is always active when the mean phase (Fig 2E) is . This type of tightly localized in-phase periodic stimulation entrains the sub-group of oscillators to the periodic bursting of its corresponding stimulation site. As a result, we have Nc sub-groups of oscillators, evenly spaced around the unit circle, with subgroup j oscillating at the mean natural frequency Ω and a phase offset of . Since the clusters are evenly spaced, we see a resultant low value of R1 and a high value of R4 (since Nc = 4).

Now additionally consider the ON-OFF CRS pattern used by Lysyansky et al. [20], where the entire stimulation is ON for m periods of length T, and OFF for n periods (Fig 2C). As before, the stimulation sites are activated in sequential order, each for a duration of . At the beginning of each ON period, the order is reset so the sequence re-starts at stimulation site 1. Notice that the regions of optimal first-order desynchronization performance, i.e. low <r>1, occur along the diagonals where (m+n) takes on an integer value (Fig 5C). These regions correspond to high values of <r>4 (Fig 5D), indicative of the clustering behavior described above. The performance is worst and clustering does not occur whenever , where k is an integer.

Taking a closer look at the stimulation paradigm for a non-integer case (m+n = 3.75) (Fig 2C), we see that a given stimulation site no longer activates at the same mean phase (mod 2π) of the oscillator network (Fig 2E), every time. Rather, the activation time relative to the mean phase changes every ON cycle. For example, stimulation site 1 is active when during the odd ON cycles, but when during the even ON cycles. As a result, the sub-group of oscillators cannot become entrained to the periodic bursting of its respective stimulation site, since it does not consistently burst at the same relative phase. Therefore, clustering does not occur and we do not see a suppression of R1.

Whenever (m+n) is an integer, however, the ON-OFF period (m+n)T is an integer multiple of the mean natural oscillator period , so the start of every ON period occurs whenever the mean phase ψ1(t) = Ωt = 0,mod 2π. Therefore, if a stimulation site is active, it is active at the same relative mean phase every time (modulo 2π). As in chronic CRS, four evenly spaced clusters are created, resulting in a high value of <r>4 and low <r>1.

In contrast, during periodic flashing, the ON-OFF pattern is independent of the contact cycling order. As a result, whenever a stimulation site is active, it is guaranteed to be active at the same relative mean phase (modulo 2π) as it would be during chronic CRS. Thus, we see strong suppression of the first order parameter (Fig 5A) and consistent clustering behavior (Fig 5B) regardless of the value of m and n. It is, of course, necessary that enough total stimulation is delivered, as seen in the lower right corner of the figures where the ON periods are very short and OFF periods are long, and suppression of synchrony does not occur. Note that whenever (m+n) is an integer, the periodic flashing paradigm is identical to the ON-OFF paradigm used by Lysyansky et al. [20].

The previous discussion suggests that activation of stimulation sites at the same relative phase in every cycle is essential for clustering which, in turn, causes first-order desynchronization. To verify this idea we consider a third ON-OFF paradigm, where the activation order of stimulation sites is randomly permuted every CR period, while the flashing overlay F(t) remains the same as before (Fig 2B). As expected, we fail to see any clustering behavior and poor suppression of first-order synchrony. <r>1 is high (Fig 5E) and <r>4 is low (Fig 5F) for all values of m and n. Note that in this limit, the paradigm used by Lysyansky et al. and periodic flashing are effectively equivalent.

Uniform desynchronization

We next explore the performance of the periodic flashing paradigm in the “desynchronization state” regime (I = 7, σ = 2). Although we do not see optimal desynchronization performance, periodic flashing does achieve acceptable intermediate results, and successfully removes the dependence on the ON and OFF periods (Fig 6A), with the exception of the apparent thin diagonal stripes which are addressed below. In contrast, when using the paradigm proposed by Lysyansky et al. [20], we see a different structure in the plot of <r>1 as a function of m and n: alternating horizontal regions of good and poor performance (Fig 6C). Note that this structure, although less prominent, is also present during the clustered state regime (Fig 5C).

thumbnail
Fig 6. Mean maximum of the order parameter as a function of m and n for different stimulation paradigms in the desynchronization state regime (I = 7, σ = 2).

Subplots as in Fig 5.

https://doi.org/10.1371/journal.pone.0203782.g006

First, note that the anti-resonance phenomenon is entirely absent in this regime, since the clustering mechanism that causes anti-resonance does not exist. The spatial stimulation spread profile is much wider (Fig 3B), so all the oscillators are significantly stimulated by all four stimulation sites. As a result, lacking tight spatial localization of stimulation, a cluster state cannot be achieved in this regime and we see low values of <r>4, regardless of m and n, or the stimulation paradigm (Fig 6B, 6D and 6F).

To understand the cause of the horizontal stripes, following the analysis of Lysyansky et al. [20], we consider the behavior of the oscillator network immediately after the CR stimulation is turned off, as a function of toff,, the time at which it is turned off (modulo the CR period T). We stimulate the network with chronic CRS until R1(t) reaches a stable periodic state (no more than 5 CR periods when using the parameters in Table 1) and then turn off the stimulation part-way through the next CR period. Recall that since K > Kc, the unstimulated network will spontaneously approach a synchronized state, i.e. R1(t) → 1.

Naturally, if R1 is smaller when the stimulation is turned off, then the transient will be longer. Since we would like to maintain a desynchronized state for as long as possible, the optimal toff is whenever R1 is at the minimum, i.e. . Conversely, the pessimal toff is when R1 is maximal. In the desynchronization state regime, topt ≈ 0.88 (Fig 7A) and in the cluster state regime topt ≈ 0.53. Since chronic CRS is periodic with period T, after reaching steady-state R1(t) is also periodic with the same period. Consequently, topt also corresponds to a particular time point in stimulation site activation pattern. For example, in the desynchronization state regime, topt occurs 0.38 time units after the second stimulation site is activated (Fig 7B).

thumbnail
Fig 7. Optimal time to turn off stimulation depends on the magnitude of the first order parameter at that time.

(A) First order parameter during one CR period (T = 2) in the desynchronization state regime (I = 7, σ = 2), after reaching steady-state. Optimal toff occurs when R1 is minimal, indicated by dotted black vertical line. Converseley, pessimal toff occurs when R1 is maximal, indicated by dashed red line. (B) Periodic CRS pattern that induces the time-varying order parameter shown in A. Optimal toff occurs at a fixed point within the stimulation site activation pattern. In this example, it is always approximately 0.38 time units after the activation of the second stimulation site.

https://doi.org/10.1371/journal.pone.0203782.g007

We now consider the effect of toff during ON-OFF CRS. Recall that in the paradigm used by Lysyansky et al. [20], stimulation site 1 is always the first one to be activated in any given ON period, and thus all the ON periods end at the same time point within the stimulation site activation pattern. Therefore, the length of the ON cycle, mT, is effectively equal to toff. As expected, we see low <r>1 when mTtopt ≈ 0.88 (mod T) and high <r>1 when mT ≈ 1.6 (mod T) (Fig 6C, cf. Fig 7). For very small m, since the network does not fully reach steady state within the ON period, there is an added dependency on n. Note that this structure is less prominent in Fig 5A because the difference between R1 at the optimal and pessimal toff is smaller in the cluster state regime than that in the desynchronization state regime (Fig 7A).

In contrast, with periodic flashing, we see that the dependence on m is almost completely eliminated, with the exception of the diagonals (m+n) = k, where k is an integer (Fig 6A). Also note that the value of <r>1 seen in most of Fig 6A is approximately mid-way between the maximum and minimum values in the figure. This averaging effect occurs because the ON-OFF flashing function F(t) is independent of the stimulation site cycling functions ρj(t) and therefore toff is at a different place within the activation pattern for each new ON period. Over many ON periods, toff ranges between the optimal and the pessimal time and so in (6) also ranges between the lowest and highest it could be. As a result, we see an intermediate value of <r>1 for most values of (n,m).

As noted in the previous section, along the diagonals defined by (m+n) = k, the periodic flashing paradigm is identical to the ON-OFF paradigm used by Lysyansky et al. [20]. Within these diagonals, during any given ON period, toff is at the same place within the stimulation site activation pattern. So, we see low <r>1 only when toff = mT ≈ 0.88 (mod T), since the behavior along the diagonals is governed by a single toff. Similarly, in the cluster state regime, the optimal-toff structure is suppressed, except along the diagonals for which (m+n) is an integer (Fig 5A and 5C).

For completeness, as in the previous section, we further consider an ON-OFF paradigm with a randomized order of stimulation site activation (Fig 2B). We see a washing out of the prominent diagonals seen under sequential-cycling periodic flashing (Fig 6A and 6E), particularly for larger values of m (e.g. m>3). This is to be expected since randomizing the stimulation site activation order breaks the periodicity of the CRS pattern, and therefore also the periodicity of R1(t). As a result, topt is different in every ON period and so we get a similar averaging effect we saw in the (m+n) ≠ k regions of Fig 6A. Note that we do not see a total suppression of the diagonals since there is still a temporal organization to the CRS pattern–the stimulation site switches every time units which induces a weak temporal structure in R1(t). Therefore topt is not uniformly distributed within the ON period and the diagonals, although much less prominent, are still present.

Discussion and conclusions

The initial motivation behind CRS was to drive the leading order parameter R1 to zero by inducing a symmetric clustered state [13,14]. The remaining order parameters are then also driven to zero due to the slaving principle [36]. The resulting uniformly desynchronized state exhibits the greatest possible degree of desynchronization and as a result it has been considered as the goal of neuromodulation. Because the resultant uniformly desynchronized state is unstable, the network eventually resynchronizes if left undisturbed. To maintain the desynchronized state, CRS was either delivered with a demand-controlled timing (i.e. whenever R1 exceeded a pre-defined threshold) or demand-controlled pulse trains (i.e. the length of the tonic stimulation bursts was adapted to R1) [1317]. A single CR stimulus turned out to induce the longest and most pronounced transient uniform desynchronization if the phases of the stimulated subpopulations were symmetrically spaced on the unit circle, e.g. in case of four stimulation sites, if a symmetric 4-cluser state with large R4 and R1 close to zero was achieved [13,14].

Due to technical constraints and, in particular, with a focus on theoretically predicted long-lasting effects [15], the closed-loop, demand-controlled CRS delivery protocols were approximated by periodic protocols, with periodic sequences of either 4:2 [23] or 3:2 [2426] ON-OFF cycles. The intention behind these open-loop protocols is to let the unperturbed network run though a transient uniformly desynchronized state during the OFF cycles. For a pre-defined threshold of R1 optimal relationships between integer m and n were determined for the ON-OFF CRS paradigm used by Lysyansky et al. [20]. If one performs chronic CRS (without OFF cycles) and terminates CRS at different phases of the last CR cycle, the duration and strength of the transient desynchronization may depend on that phase [20]. This motivated Lysyansky et al. to take into account an ON-OFF CRS protocol with non-integer m and n combined with an ON period-triggered restart of the CR stimulus pattern (Fig 2C), demonstrating the sensitivity of the protocol to the duration of the ON and OFF periods.

In this paper, we have introduced a novel CRS paradigm called periodic flashing and explored its effect on desynchronization in the context of two stimulation regimes that achieve qualitatively different synchronization states–high intensity, spatially focused stimulation creating a “cluster state” and low intensity, spatially broad stimulation creating a “desynchronization state.” The previously studied CRS paradigm [20] exhibits sensitivity to the precise choice of ON and OFF periods in either regime through anti-resonance in the “cluster state” regime, or the need for precisely tuned shut-off times in the “desynchronization state” regime. In contrast, the periodic flashing paradigm does not exhibit this sensitivity and leads to desynchronization of the synchronized oscillator network for a wide range of ON and OFF periods in both regimes.

Our results also suggest that, although on average the desynchronization state regime is slightly worse at suppressing R1 than the cluster state regime, the desynchronization state regime is likely more biologically relevant than the cluster state regime for this specific computational model. Previous clinical and preclinical studies have all used ON and OFF periods that are integer multiples of the underlying pathological frequency. However, these studies also used a randomized stimulation site ordering (Fig 2B) [2426] and found, apart from pronounced long-lasting effects achieved only with CR-DBS, an acute reduction of symptoms comparable to those seen with traditional DBS. Assuming that these DBS equivalent outcomes are an indication of significant desynchronization, these experimental observations appear at odds with the effect observed in the cluster state regime, where a sequential ordering (Fig 2A) is far more effective than randomized ordering at suppressing synchrony (Fig 5A and 5E). On the other hand, in the desynchronization state regime we do not see a significant drop in performance when switching from sequential-cycling (Fig 6A) to randomized-cycling (Fig 6E) periodic flashing, suggesting that the desynchronization state regime is a more biologically plausible one, given the model we are using.

The Kuramoto model is very abstract and there are, of course, limitations. These can be addressed by increasing the complexity at the expense of computational time. For instance, this model is noise-free and we may choose to add a noise term ξi(t) to the right hand side of (1) [1315]. Spike-timing dependent plasticity is a factor that may strongly affect the long-term behavior of the model, which can be implemented by replacing the coupling constant K with a time-dependent value for each pair of oscillators as in [15]. Furthermore, in practice, the distribution of natural frequencies, as measured by the local field potential (LFP), is much more broad and multi-modal [26]. This can be addressed by using a more complicated distribution of the frequencies in (1). Finally, we may use a more biologically detailed model such as [37] or [38], although such models may be computationally tractable only for exploring small subsets of the parameter space. We leave these studies for future work.

As an avenue for further exploration, periodic flashing may be generalized to other “flashing” variations. One example is “randomized flashing” where the ON and OFF periods do not have a fixed duration. That is, the number of ON cycles or OFF cycles, or both, may be randomly chosen at the start of each ON-OFF period. Alternatively, with “time-varying flashing” the ON and OFF periods may vary deterministically over time. A further generalization is to perform the “flashing” of each contact independently, either in a fixed, time-varying, or random fashion. Even more broadly, any of these flashing variations can be used in conjunction with other stimulation site activation patterns. The pattern can be any fixed or time-varying pattern, or a randomized one as we have explored in this work. The randomization itself can be varied by using different probability distributions of stimulation site activation. Furthermore, in all of these paradigms, the stimulation site activation is not restricted to binary activation of one site at a time. Two or more sites may be active simultaneously, with varying amounts of power delivered by each one.

Finally, while this paper only discusses open-loop stimulation protocols, increasingly over the past few years, interest has grown in closed-loop DBS. In the context of “flashing” CRS, closed-loop setups might enable novel approaches for the control of abnormal neuronal synchrony. Dynamic characteristics of neuronal activity may vary, e.g., within different phases of motor tasks [39,40] or between different movement and/or freezing states [41]. According to our computational findings, within appropriate CRS parameter ranges, the flashing approach provides flexibility concerning the ON-OFF timing of CRS: the time windows with CRS ON need no longer be linked to the fundamental CRS periodicity. Future studies may be devoted to demand-controlled or, in general, any type of closed-loop flashing. For instance, flashing might enable to perform sensing during appropriate time windows in order to regularly or occasionally recalibrate fundamental CRS parameters. By a similar token, flashing might adjust CRS to relevant physiological processes, e.g., by avoiding stimulation during potentially vulnerable time windows. A variety of candidate biomarkers and control schemes for controlling closed-loop stimulation have been proposed [4246]. However, the viability of these proposed biomarkers remains a topic of debate [47,48]. Exploring these issues remains a topic for future research.

Supporting information

S1 Code. Python 2.7 libraries for simulating coordinated reset stimulation in a Kuramoto oscillator network.

https://doi.org/10.1371/journal.pone.0203782.s001

(ZIP)

References

  1. 1. de Lau LM, Breteler MM. Epidemiology of Parkinson’s disease. Lancet Neurol. 2006;5: 525–535. pmid:16713924
  2. 2. Harrison TR, Hauser SL, Josephson SA. Harrison’s neurology in clinical medicine. New York: McGraw-Hill Medical; 2010.
  3. 3. Pahwa R, Factor SA, Lyons KE, Ondo WG, Gronseth G, Bronte-Stewart H, et al. Practice Parameter: Treatment of Parkinson disease with motor fluctuations and dyskinesia (an evidence-based review) Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology. 2006;66: 983–995. pmid:16606909
  4. 4. Horstink M, Tolosa E, Bonuccelli U, Deuschl G, Friedman A, Kanovsky P, et al. Review of the therapeutic management of Parkinson’s disease. Report of a joint task force of the European Federation of Neurological Societies and the Movement Disorder Society–European Section. Part I: early (uncomplicated) Parkinson’s disease. Eur J Neurol. 2006;13: 1170–1185. pmid:17038031
  5. 5. Ahlskog JE, Muenter MD. Frequency of levodopa-related dyskinesias and motor fluctuations as estimated from the cumulative literature. Mov Disord. 2001;16: 448–458. pmid:11391738
  6. 6. Limousin P, Pollak P, Benazzouz A, Hoffmann D, Le Bas J-F, Perret JE, et al. Effect on parkinsonian signs and symptoms of bilateral subthalamic nucleus stimulation. The Lancet. 1995;345: 91–95.
  7. 7. Obeso JA, Guridi J, Obeso JA, DeLong M. Surgery for Parkinson’s disease. J Neurol Neurosurg Psychiatry. 1997;62: 2–8. pmid:9010390
  8. 8. Deuschl G, Schade-Brittinger C, Krack P, Volkmann J, Schäfer H, Bötzel K, et al. A Randomized Trial of Deep-Brain Stimulation for Parkinson’s Disease. N Engl J Med. 2006;355: 896–908. pmid:16943402
  9. 9. Fraix V, Houeto J-L, Lagrange C, Pen CL, Krystkowiak P, Guehl D, et al. Clinical and economic results of bilateral subthalamic nucleus stimulation in Parkinson’s disease. J Neurol Neurosurg Psychiatry. 2006;77: 443–449. pmid:16543519
  10. 10. Weaver FM, Follett K, Stern M, Hur K, Harris C, Marks WJ, et al. Bilateral Deep Brain Stimulation vs Best Medical Therapy for Patients With Advanced Parkinson Disease: A Randomized Controlled Trial. JAMA. 2009;301: 63–73. pmid:19126811
  11. 11. McIntyre CC, Savasta M, Kerkerian-Le Goff L, Vitek JL. Uncovering the mechanism(s) of action of deep brain stimulation: activation, inhibition, or both. Clin Neurophysiol. 2004;115: 1239–1248. pmid:15134690
  12. 12. Kühn AA, Kempf F, Brücke C, Doyle LG, Martinez-Torres I, Pogosyan A, et al. High-Frequency Stimulation of the Subthalamic Nucleus Suppresses Oscillatory β Activity in Patients with Parkinson9s Disease in Parallel with Improvement in Motor Performance. J Neurosci. 2008;28: 6165–6173. pmid:18550758
  13. 13. Tass PA. Desynchronization by Means of a Coordinated Reset of Neural Sub-Populations: A Novel Technique for Demand-Controlled Deep Brain Stimulation. Prog Theor Phys Suppl. 2003;150: 281–296.
  14. 14. Tass PA. A model of desynchronizing deep brain stimulation with a demand-controlled coordinated reset of neural subpopulations. Biol Cybern. 2003;89: 81–88. pmid:12905037
  15. 15. Tass PA, Majtanik M. Long-term anti-kindling effects of desynchronizing brain stimulation: a theoretical study. Biol Cybern. 2006;94: 58–66. pmid:16284784
  16. 16. Hauptmann C, Tass PA. Therapeutic rewiring by means of desynchronizing brain stimulation. Biosystems. 2007;89: 173–181. pmid:17184901
  17. 17. Tass PA, Hauptmann C. Therapeutic modulation of synaptic connectivity with desynchronizing brain stimulation. Int J Psychophysiol. 2007;64: 53–61. pmid:16997408
  18. 18. Hauptmann C, Tass PA. Cumulative and after-effects of short and weak coordinated reset stimulation: a modeling study. J Neural Eng. 2009;6: 016004. pmid:19141875
  19. 19. Hauptmann C, Tass PA. Restoration of segregated, physiological neuronal connectivity by desynchronizing stimulation. J Neural Eng. 2010;7: 056008. pmid:20811089
  20. 20. Lysyansky B, Popovych OV, Tass PA. Desynchronizing anti-resonance effect of m: n ON–OFF coordinated reset stimulation. J Neural Eng. 2011;8: 036019. pmid:21555848
  21. 21. Zeitler M, Tass PA. Augmented brain function by coordinated reset stimulation with slowly varying sequences. Front Syst Neurosci. 2015;9: 49. pmid:25873867
  22. 22. Popovych OV, Xenakis MN, Tass PA. The Spacing Principle for Unlearning Abnormal Neuronal Synchrony. PLOS ONE. 2015;10: e0117205. pmid:25714553
  23. 23. Tass PA, Silchenko AN, Hauptmann C, Barnikol UB, Speckmann E-J. Long-lasting desynchronization in rat hippocampal slice induced by coordinated reset stimulation. Phys Rev E. 2009;80. pmid:19658724
  24. 24. Tass PA, Qin L, Hauptmann C, Dovero S, Bezard E, Boraud T, et al. Coordinated reset has sustained aftereffects in Parkinsonian monkeys. Ann Neurol. 2012;72: 816–820. pmid:23280797
  25. 25. Wang J, Nebeck S, Muralidharan A, Johnson MD, Vitek JL, Baker KB. Coordinated Reset Deep Brain Stimulation of Subthalamic Nucleus Produces Long-Lasting, Dose-Dependent Motor Improvements in the 1-Methyl-4-phenyl-1,2,3,6-tetrahydropyridine Non-Human Primate Model of Parkinsonism. Brain Stimulat. 2016;9: 609–617. pmid:27151601
  26. 26. Adamchic I, Hauptmann C, Barnikol UB, Pawelczyk N, Popovych O, Barnikol TT, et al. Coordinated reset neuromodulation for Parkinson’s disease: Proof-of-concept study. Mov Disord. 2014;29: 1679–1684. pmid:24976001
  27. 27. Kuramoto Y. Chemical Oscillations, Waves, and Turbulence. Courier Corporation; 2003.
  28. 28. Strogatz SH. From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators. Phys Nonlinear Phenom. 2000;143: 1–20.
  29. 29. Acebrón JA, Bonilla LL, Vicente CJP, Ritort F, Spigler R. The Kuramoto model: A simple paradigm for synchronization phenomena. Rev Mod Phys. 2005;77: 137.
  30. 30. Daido H. Order Function and Macroscopic Mutual Entrainment in Uniformly Coupled Limit-Cycle Oscillators. Prog Theor Phys. 1992;88: 1213–1218.
  31. 31. Tass PA. Phase Resetting in Medicine and Biology: Stochastic Modelling and Data Analysis. Springer Science & Business Media; 2007.
  32. 32. Best EN. Null space in the Hodgkin-Huxley Equations. A critical test. Biophys J. 1979;27: 87–104. pmid:262379
  33. 33. Guttman R, Lewis S, Rinzel J. Control of repetitive firing in squid axon membrane as a model for a neuroneoscillator. J Physiol. 1980;305: 377–395. pmid:7441560
  34. 34. Richardson KA, Gluckman BJ, Weinstein SL, Glosch CE, Moon JB, Gwinn RP, et al. In Vivo Modulation of Hippocampal Epileptiform Activity with Radial Electric Fields. Epilepsia. 2003;44: 768–777. pmid:12790889
  35. 35. Ranck JB. Which elements are excited in electrical stimulation of mammalian central nervous system: A review. Brain Res. 1975;98: 417–440. pmid:1102064
  36. 36. Pliss VA. A reduction principle in the theory of stability of motion. Izv Akad Nauk SSSR Ser Mat. 1964;28: 1297–1324.
  37. 37. Leblois A, Boraud T, Meissner W, Bergman H, Hansel D. Competition between Feedback Loops Underlies Normal and Pathological Dynamics in the Basal Ganglia. J Neurosci. 2006;26: 3567–3583. pmid:16571765
  38. 38. Humphries MD, Stewart RD, Gurney KN. A Physiologically Plausible Model of Action Selection and Oscillatory Activity in the Basal Ganglia. J Neurosci. 2006;26: 12921–12942. pmid:17167083
  39. 39. Quinn EJ, Blumenfeld Z, Velisar A, Koop MM, Shreve LA, Trager MH, et al. Beta oscillations in freely moving Parkinson’s subjects are attenuated during deep brain stimulation. Mov Disord. 2015;30: 1750–1758. pmid:26360123
  40. 40. Pötter-Nerger M, Reese R, Steigerwald F, Heiden JA, Herzog J, Moll CKE, et al. Movement-Related Activity of Human Subthalamic Neurons during a Reach-to-Grasp Task. Front Hum Neurosci. 2017;11. pmid:28936169
  41. 41. Syrkin-Nikolau J, Koop MM, Prieto T, Anidi C, Afzal MF, Velisar A, et al. Subthalamic neural entropy is a feature of freezing of gait in freely moving people with Parkinson’s disease. Neurobiol Dis. 2017;108: 288–297. pmid:28890315
  42. 42. Graupe D, Basu I, Tuninetti D, Vannemreddy P, Slavin KV. Adaptively controlling deep brain stimulation in essential tremor patient via surface electromyography. Neurol Res. 2010;32: 899–904. pmid:20712926
  43. 43. Rosin B, Slovik M, Mitelman R, Rivlin-Etzion M, Haber SN, Israel Z, et al. Closed-Loop Deep Brain Stimulation Is Superior in Ameliorating Parkinsonism. Neuron. 2011;72: 370–384. pmid:22017994
  44. 44. Little S, Pogosyan A, Neal S, Zavala B, Zrinzo L, Hariz M, et al. Adaptive deep brain stimulation in advanced Parkinson disease. Ann Neurol. 2013;74: 449–457. pmid:23852650
  45. 45. Yamamoto T, Katayama Y, Ushiba J, Yoshino H, Obuchi T, Kobayashi K, et al. On-Demand Control System for Deep Brain Stimulation for Treatment of Intention Tremor. Neuromodulation Technol Neural Interface. 2013;16: 230–235. pmid:23094990
  46. 46. Rosa M, Arlotti M, Ardolino G, Cogiamanian F, Marceglia S, Di Fonzo A, et al. Adaptive deep brain stimulation in a freely moving parkinsonian patient. Mov Disord. 2015;30: 1003–1005. pmid:25999288
  47. 47. Beudel M, Brown P. Adaptive deep brain stimulation in Parkinson’s disease. Parkinsonism Relat Disord. 2016;22: S123–S126. pmid:26411502
  48. 48. Kühn AA, Volkmann J. Innovations in deep brain stimulation methodology. Mov Disord. 2017;32: 11–19. pmid:27400763