Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Scale Invariance Properties of Intracerebral EEG Improve Seizure Prediction in Mesial Temporal Lobe Epilepsy

  • Kais Gadhoumi ,

    kais.gadhoumi@mail.mcgill.ca

    Affiliation Montreal Neurological Institute, McGill University, Montréal, Québec, Canada

  • Jean Gotman,

    Affiliation Montreal Neurological Institute, McGill University, Montréal, Québec, Canada

  • Jean Marc Lina

    Affiliations Département de Génie Électrique, École De Technologie Supérieure, Montréal, Québec, Canada, Centre de recherches mathématiques, Université de Montréal, Montréal, Québec, Canada

Scale Invariance Properties of Intracerebral EEG Improve Seizure Prediction in Mesial Temporal Lobe Epilepsy

  • Kais Gadhoumi, 
  • Jean Gotman, 
  • Jean Marc Lina
PLOS
x

Abstract

Although treatment for epilepsy is available and effective for nearly 70 percent of patients, many remain in need of new therapeutic approaches. Predicting the impending seizures in these patients could significantly enhance their quality of life if the prediction performance is clinically practical. In this study, we investigate the improvement of the performance of a seizure prediction algorithm in 17 patients with mesial temporal lobe epilepsy by means of a novel measure. Scale-free dynamics of the intracerebral EEG are quantified through robust estimates of the scaling exponents—the first cumulants—derived from a wavelet leader and bootstrap based multifractal analysis. The cumulants are investigated for the discriminability between preictal and interictal epochs. The performance of our recently published patient-specific seizure prediction algorithm is then out-of-sample tested on long-lasting data using combinations of cumulants and state similarity measures previously introduced. By using the first cumulant in combination with state similarity measures, up to 13 of 17 patients had seizures predicted above chance with clinically practical levels of sensitivity (80.5%) and specificity (25.1% of total time under warning) for prediction horizons above 25 min. These results indicate that the scale-free dynamics of the preictal state are different from those of the interictal state. Quantifiers of these dynamics may carry a predictive power that can be used to improve seizure prediction performance.

Introduction

The existence of a preictal state distinguishable from an interictal state of the epileptic brain is supported by growing evidence of electrophysiological changes preceding the ictal phase [16]. Transitions from interictal to ictal state are likely to be governed by various mechanisms [79] with different electrophysiological manifestations. Revealing changes in dynamical properties of the electroencephalogram (EEG) related to state transition is probably a multifaceted problem and solving it requires a combination of tools each adapted to reveal changes in a distinct aspect of signal properties. For example, preictal changes are probably better detected using a combination of intra- and inter-channel EEG information rather than using either information alone [10].

Many studies in seizure prediction adopted the approach of combining EEG features that capture different properties of the signal [1116]. Whether reported prediction performances are superior to those achieved with single feature algorithms is yet to be verified. It remains intuitive though that an increase in the prediction performance is expected when combining the predictive power of different methods in a complementary manner.

In this study, we examine whether combining measures of two a priori unrelated properties of the EEG, the so-called thermodynamic and scale invariance properties, would result in an improvement of the prediction performance. Descriptors of the thermodynamic property of the intracerebral EEG, namely the wavelet energy and entropy, have been introduced in our previous study [1] and estimated in the high frequency range (50–450 Hz). We demonstrated that measures derived from these descriptors were useful to achieve significant and practical seizure prediction performance results [17]. Scale invariance is a property related to temporal irregularity in signals, first introduced in the study of turbulence [18]. Evidence of scale invariance in the intracranial EEG and its significance to brain electrophysiological function has been demonstrated in [19]. Here, we analyze the scale invariance property of the intracerebral EEG via descriptors extracted through a novel scaling analysis framework: the bootstrap and wavelet leader based multifractal analysis [20,21].

Using scaling analysis based descriptors, we investigate the discriminability of preictal and interictal EEG epochs in a group of patients with intractable mesial temporal lobe epilepsy. We then assess the prediction performance of our previously proposed patient-specific classifier using these descriptors individually and in combination with our previously introduced state similarity measures.

Materials and Methods

Ethics statement

This study was approved by the Montreal Neurological Institute and Hospital Research Ethics Board (REB). The REB acts in conformity with standards set forth by the Tri-Council Policy Statement and Ethical Conduct for Research Involving Humans (Canada), and by the Rules and Regulations of the Department of Health and Human Services and the Food and Drug Administration (US) governing human subjects research and functioning in a manner consistent with internationally accepted principles of good clinical practice. All adult subjects signed an REB-approved written informed consent form.

Materials

To ensure an unbiased comparison between the performance of scaling analysis based features and originally proposed state similarity measures, we use the same dataset as in our previous work [17]. Long-lasting intracerebral EEG (iEEG) recordings, low-pass filtered at 500 Hz and sampled at 2000 Hz, from 17 consecutive patients who attended the Montreal Neurological Institute, Montreal, Canada, between 2004 and 2011 and who underwent depth electrode investigation of refractory epilepsy, were analyzed. The selected patients had a mesial temporal lobe epilepsy (MTLE) diagnosis. They had at least five seizures recorded at 2000 Hz during the investigation.

Depending on the number of implanted electrodes, nine to 18 bipolar iEEG channels from the four deepest contacts of depth electrodes targeting the bilateral mesial temporal structures (amygdala, hippocampus and parahippocampus) were selected. A total of 1565 hours and 175 seizures were analyzed. Electrographic onsets of seizures were determined by an experienced neurologist. Only seizures that are at least two hours apart were considered in the analysis in order to minimize the postictal effect.

The iEEG data was split into training and testing subsets for each patient. The training subset has two or three preictal epochs of uninterrupted iEEG recordings lasting between six and 22 min across patients, and five interictal epochs lasting almost one hour each and separated by at least one hour from each other and by four hours from any seizure. The training data were selected from the beginning of the patient’s iEEG recordings. The remaining iEEG data were used for testing. They are made of continuous multiday iEEG recordings. The number of test seizures per patient ranged between three and 24. In total, 119 hours of iEEG data were used in training and 1446 hours in testing (see S1 Table for a list of training and testing data duration and number of test seizures for each patient). Patient clinical characteristics, surgery outcomes and iEEG data are summarized in Table 1.

Theoretical background of scaling analysis

Scale invariance or “scaling” is defined as the absence of a particular time scale playing a characteristic role in the process [22]. Such a process is called a “scale free” process. For stochastic processes such as in the case of EEG, scale invariance implies that the statistical properties at different time scales (e.g., hours versus minutes versus seconds) effectively remain the same [23]. Implicitly, scaling analysis identifies and characterizes the rules describing the relation between different scales. These rules are principally governed by power laws. Practical scaling analysis aims mostly at estimating the exponents that characterize these power laws: If X designates an EEG signal from one channel and TX(a, t) a multi-resolution measure of the content of X around a time t and a scale a, then the scale invariance property of X is described by the power law behaviors of the time average of the qth power of TX(a, t) with respect to the analysis scale a for a given (large) range of scales a ∈ [am, aM], aM/am >>1. (1) with na the number of samples of X at the scale a. For a range of order q values, the set of estimated exponents ζ(q) fully describes the statistical distribution of the signal and provides a powerful means of characterizing the scale invariance of the signal.

Models of scaling analysis

Various processes exhibiting scale invariance properties are used as models for scaling analysis. The following summarizes some of the most studied models.

- Self-similarity: the framework of “self-similarity” [24] is one of the first models that fulfills the scale invariance property in a mathematically simple and precise way [25]. A random process X(t) is said to be self-similar if: (2) Where designates equality of statistical properties. The parameter H, called Hurst exponent, defines and controls the scale invariance of the process X(t).

- 1/f processes: for many real-data processes, scale invariance may exist only for a range of scales and/or the scaling exponents cannot be described with a single parameter. For such processes, self-similarity is not a suitable model. The so-called 1/f processes are more flexible models of scale invariance that address the limitations of the self-similarity model. These are processes for which the spectral density obeys a power law with a sufficiently large range of frequencies: (3) where α is a scalar referred to as the “index of long-range dependence”. It is related to the Hurst exponent by: (4) Fig 1 illustrates a preictal and an interictal iEEG epochs exhibiting a 1/f process. Two particular 1/f processes define two interesting models, namely long-range dependency [26] and monofractality.

thumbnail
Fig 1. Power spectra of 1-min interictal (left) and preictal (right) epochs from 18 iEEG channels (patient 15).

Power spectrum in red is the average power spectrum of all channels. Both epochs show a power law behavior (P(f) ∼ 1/fα) illustrated with the fitted dotted red line for the range of frequencies delimited with a dashed blue line (corresponding to the range of scales j between 3 and 7). The exponents α obtained by a least-square fit are different in the preictal and interictal epochs.

https://doi.org/10.1371/journal.pone.0121182.g001

- Long-range-dependency (LRD): LRD is a model defined for scaling observed in the limit of small frequencies (equivalently, large scales), fm → 0 in Eq (3). It is usually defined in terms of covariance properties relevant to second-order stationary processes. In long-range dependent processes, the temporal correlation between values decays very slowly, allowing for a dependency between past and future values.

- Fractals and multifractals: fractal processes are models of scale invariance described through the local (Hölder) regularity of the process sample path measured by the Hölder exponents h(t): (5)

The local regularity is the degree of smoothness of the signal in a small time interval. Strong local regularity indicates a smooth signal and weak local regularity indicates less smoothness.

When the Hölder exponents h(t) are a deterministic and stationary function, the process exhibits a slow and smooth regularity fluctuation over time and is called fractal.

When the Hölder exponents h(t) are the same for all t, the process exhibits constant regularity along its sample paths; it is referred to as monofractal process. An example of monofractal process in the fractional Brownian motion (Fig 2.A).

When the fluctuation of h(t) is random and highly undeterministic, the process is said to be multifractal. Instead of Hölder exponents, the irregularity of such processes is described rather through a spectrum D(h) called the singularity (multifractal) spectrum [27,28]. An example of a multifractal process is the multifractal random walk (Fig 2.B).

thumbnail
Fig 2. Estimation of cumulants c1 and c2 using wavelet leader and bootstrap based scaling analysis in signals with different scale invariance properties.

Each signal is 4096 samples. 100 bootstrap wavelet leader resamples were used in cumulant estimation. (a) Realization of a self-similar signal (fractional Brownian motion). ζ(q) is linear in q. c1 ≠ 0 and c2 ≈ 0. (b) Realization of a multifractal random walk. ζ(q) is nonlinear in q. c1, c2 ≠ 0. (c) EEG channel recording showing nonlinear relation of ζ(q) in q. c1, c2 ≠ 0. (Each column, top to bottom: Signal plot, regression plot of ζ(q) exponent estimates and boxplot of cumulant estimates).

https://doi.org/10.1371/journal.pone.0121182.g002

Wavelet leader based scaling analysis

Wendt et al. [21] proposed a scaling analysis framework for a robust estimation of the scaling exponents using cumulants as surrogate measures of the exponents. In the proposed framework, wavelet leaders [29]—quantities derived from the discrete wavelet analysis of the signal—are used as a multi-resolution measure in Eq (1). Using a mathematical formalism (see S1 appendix), it was established that the scaling exponents ζ(q) can be estimated through the cumulants cp of the Taylor series polynomial expansion: (6)

The advantage of using the cumulants as surrogate measures of the scaling exponents lies in the fact that they emphasize the departure from linear behavior of ζ(q) in q: there exists p ≥ 2: cp ≠ 0 [30].

From a single path (single observation) of the signal, the cumulants cp can be estimated through statistical models and bootstrap approaches. At each scale, R bootstrap resamples are generated from the wavelet leader coefficients. R bootstrap cumulant estimates are calculated and then averaged to obtain the final estimates. In practice, the first few cumulants are sufficient to gather most of the scaling property from the signal [21,31]. For c1 ≠ 0, knowing whether c2 ≠ 0 is practically equivalent to choosing between monofractal and multifractal models of scale invariance. In this study, we use the first and second cumulants, c1 and c2.

Fig 2 shows examples of cumulant estimates from realizations of simulated signals with different scale invariance properties and from a bipolar recording of an intracranial EEG channel.

Cumulant estimation

The first two cumulants c1 and c2 are calculated using the Wavelet Leader and Bootstrap based MultiFractal analysis (WLBMF) toolbox (http://www.irit.fr/~Herwig.Wendt/software.html) which implements the empirical multifractal analysis formalism proposed by Wendt et al. [21]. Cumulants were estimated in the training and testing data for scales j between 3 and 7 (corresponding to a frequency range between 11.8 Hz and 187.5 Hz for which the power spectrum exhibits a 1/f-like behavior, see Fig 1) and moments of order q between -5 and 5 in 2s consecutive non overlapping sliding windows using 100 bootstrap resamples of wavelet leaders. A Daubechies wavelet with 3 vanishing moments (Daubechies 3) was used as a mother wavelet. Then the average cumulant was calculated in a 1-min window sliding at a 15s step. The length and overlap of the latter window were selected to match those used in our previous work [17]. This is to warrant an unbiased evaluation of the cumulants when comparing the performance of the seizure prediction method using cumulants to that using state similarity measures.

Statistical comparison of preictal and interictal cumulants

In each patient independently, we compared the values of cumulant observations in 5-min preictal and 5-min interictal epochs of the training dataset. We hypothesized that the median of the cumulant observations does not statistically change when sampled from a 5-min preictal or from a 5-min interictal epoch. To verify this hypothesis, we compared average cumulant observations from the 5-min preictal and the 5-min interictal epochs using an unpaired two-tailed Wilcoxon rank-sum statistical test of the equality of medians. Preictal observations from available 5-min preictal training data were averaged. Similarly, interictal observations from consecutive 5-min epochs of training interictal data were averaged. The statistical comparison was carried in each channel independently and a Bonferroni correction was performed to control for multiple (channels) comparisons.

Cumulant versus spectral power

A change in the state of vigilance (sleep/wakefulness) is generally accompanied by a significant change in the spectral power. This could affect the values of cumulant estimates as they indirectly measure inter-band frequency relations. To control for the state of vigilance as a possible confounder in the preictal and interictal cumulant comparison, we assessed whether any difference between preictal and interictal cumulant observations could only be due to a difference in the state of vigilance. Using the same sliding window we used to compute the average cumulant estimates (i.e. 1-min length, 15s step), we calculated the mean spectral power in the preictal and interictal epochs of the training dataset in the conventional EEG frequency bands: 0.5–3.9 Hz (delta), 4–7.9 Hz (theta), 8–14 Hz (alpha), 15–30 Hz (beta), 30–58 Hz (gamma), 80–250 Hz (ripples) and 250–450 Hz (fast ripples). The average 5-min preictal and interictal spectral power observations were then calculated the same way the average cumulant observations were obtained. By averaging the spectral power across multiple epochs, the confounding effect of the state of vigilance on the comparison between cumulant observations is minimized. The discriminability between preictal and interictal states using cumulants is tested by evaluating the difference between average preictal and interictal cumulant observations and comparing this difference to that observed between average spectral powers.

Seizure prediction using cumulant features

Our original patient-specific seizure prediction method [17] uses a set of three measures, namely the persistence, distance and inclusion, referred to as state similarity measures, which quantify the similarity between the states underlying iEEG epochs and a reference state underlying the immediate preictal (90s) iEEG epoch. The state similarity measures are derived from the two dimensional thermodynamic profiles of the iEEG epochs obtained from time-series of wavelet energy and entropy calculated using the wavelet transform modulus maxima method (WTMM). We adapted our prediction method to use cumulants individually and in combination with state similarity measures as feature sets to predict seizures, with no change to the parameters used in training and testing procedures of the original algorithm. Fig 3 depicts a flow chart of the training and testing steps of the adapted version of the method. The outline of these steps is presented below. A detailed description of the concepts and procedures involved in each step can be found in the aforementioned reference.

thumbnail
Fig 3. Flow chart of the seizure prediction method.

Steps 1 to 3 are training procedures and 4 to 6 are testing procedures. Boxes in orange show procedures used instead when combination of features are used.

https://doi.org/10.1371/journal.pone.0121182.g003

Training procedures

All training procedures for the optimization of the classifier are performed on training data.

  1. Step 1- Feature computation: Cumulant estimates c1 and c2 (and state similarity measures) are calculated for each iEEG channel of the training dataset as previously described.
  2. Step 2- Discriminant analysis: A 10-fold leave-one-out cross validation is performed across preictal and interictal feature observations. A linear discriminant analysis is performed in each iteration. The classifier performance in each channel is iteratively assessed using a score combining the sensitivity and the specificity of the classification.
  3. Step 3- Performance assessment: Final channel scores are ranked and the top three channels with the highest scores are selected for testing procedures. When using state similarity measures, four frequency bands are independently assessed in each channel. In addition to channel selection, the frequency band yielding the best performance is also selected for testing procedures.

Testing procedures

All testing procedures to assess the classifier are performed on test data in a quasi-prospective manner.

  1. Step 4- Feature computation: All features (cumulant estimates c1 and c2 and state similarity measures) are calculated for top ranked EEG channels (and selected frequency bands in the case of state similarity measures) in the sliding window.
  2. Step 5- Classification: Windows are labeled as ‘preictal’ or ‘interictal’ by the classifier in each channel separately. Channel decisions are then aggregated using majority voting rule for an ultimate classification of the window.
  3. Step 6-: Preictal change detection: Preictal changes are signaled through ‘preictal’ classification of five consecutive windows, corresponding to 2 min of iEEG continuously classified as ‘preictal’. Warnings are then raised for a variable period of time (referred to as period of active warning) controlled with the persistence-τ parameter. Raised warnings remain active for as long as a preictal change is detected, according to the persistence of warning lights protocol [32]. The parameter persistence-τ is equivalent to sum of the seizure occurrence period (the period during which the seizure is to be expected) and the seizure prediction horizon (the minimum time between the warning and the beginning of the seizure occurrence period) as defined in [33]. Warnings followed by iEEG interruptions lasting above three minutes are discarded since it is unknown if the patient was in ictal or interictal phase during this time and the classifier outcome could not be assessed.

Statistical validation

The performance of the algorithm is compared to that of a chance predictor to assess the statistical significance of its prediction power. The improvement over chance is evaluated through a statistical comparison between the sensitivity of the algorithm and the sensitivity of the chance predictor which is demonstrated to be equal to the proportion of time spent in warning ρ [32]. More explicitly, we calculate the p-value of the significance of improvement over chance, given analytically in Equation (7), to evaluate the superiority of the prediction performance to chance at the 5% significance level. (7) where n is the number of seizures correctly predicted and N the total number of seizures.

Comparison of prediction performances

Six combinations of cumulant and state similarity measures (feature sets FS1 to FS6) were used in the seizure prediction method: FS1: c1, FS2: c2, FS3: c1 combined with c2; FS4: State similarity measures combined with c1; FS5: State similarity measures combined with c2 and FS6: State similarity measures combined with c1 and c2. Using the testing dataset, the prediction performance of the algorithm was evaluated for each feature set. The sensitivity, the proportion of time spent under warning, and the warning rate were assessed for ten persistence-τ values between five and 60 min. The false positive rate is also assessed for comparability with existing seizure prediction methods which reported the specificity in terms of false positive rate. The improvement over chance is assessed for each persistence-τ value separately. The sensitivity is defined as the proportion of test seizures that occurred within the period of active warning. The proportion of time spent under warning is the total time of active warning periods divided by the total time of test data. The warning rate is the number of all warnings divided by the total time of test data. The false positive rate is defined according to the recommendation of Mormann et al. [34]. It is the number of warnings not followed by a seizure occurrence within the period of active warning, divided by the total time of test data excluding the time of assumed preictal periods. The latter is defined as the sum of the period of time preceding each test seizure for which a false prediction cannot occur by definition. The time of assumed preictal periods can be obtained by multiplying the number of test seizures by the value of persistence-τ.

Correction of multiple comparisons

To correct for multiple comparisons between the sensitivity of the chance predictor and that of the proposed prediction method (in total 1224 comparisons corresponding to 17 patients, 12 values of persistence-τ, and 6 feature sets), we controlled the false discovery rate (the expected proportion of false discoveries amongst the rejected hypotheses) by calculating the q-values (corrected p-values) from the p-values obtained by single comparisons, using the Benjamini-Hochberg procedure [35]. A q-value less 5% indicates that above-chance prediction is possible for the corresponding feature set and value of persistence-τ in the given patient.

Results

Comparison between preictal and interictal cumulant and spectral power observations

To find out whether a difference between average preictal and interictal cumulants is not only due to a difference in spectral power, we evaluated the association between the significance of difference in cumulants and that of the difference in the power of each analyzed EEG spectral band. The comparison between the average 5-min preictal and 5-min interictal cumulant observations was performed for all channels at the 1% significance level (Bonferroni corrected for multiple channel comparisons). For each cumulant and for each patient, channels that showed a statistically significant difference between interictal and preictal epochs were ranked according to the z-score of the comparison test. The most discriminating (highest z-score) channel in each cumulant was then used to compare the spectral power in preictal and interictal epochs in the frequency bands analyzed. Results of the difference in cumulants and in spectral power are detailed in Table 2. For all patients, at least one channel showed a statistically significant difference in c1 and in c2. This difference was highly significant (corrected p-value < 0.001) in 15 of 17 patients (88%) for both cumulants and less significant (corrected p-value < 0.01) in the other 2 patients. The most discriminating channel in c1 was the same as in c2 in 10 of 17 patients (59%). In 11 of 17 patients (65%), the average c1 was higher in the preictal observations than in the interictal observations. For c2, 8 of 17 (47%) patients showed a higher value of the average c2 in the preictal observation compared to the interictal observations.

thumbnail
Table 2. Significance of the difference in the average cumulant and the spectral power observations between preictal and interictal epochs (5-min length) using the most discriminating channel in c1 and the most discriminating channel in c2.

https://doi.org/10.1371/journal.pone.0121182.t002

Using the most discriminating channel in c1 or in c2, none of the spectral bands showed a statistically significant difference in every patient. For example, there were no statistically significant difference in the delta power in 8 patients (resp. 10 patients) when there was a statistically significant difference in c1 (resp. c2) using the most discriminating channel in c1 (resp. c2). Fig 4 illustrates the difference in spectral power as compared to that in cumulants in three representative patients (P2, P10 and P17) with respectively the smallest (zero), the median (4) and the highest number (5) of bands showing a significant difference (corrected p-value < 0.01).

thumbnail
Fig 4. Cumulant vs. spectral power.

Box-and-whisker plot (minimum-maximum range) indicating differences in three patients (P2, P10 and P17) between preictal and interictal average 5-min observations of cumulant c1, cumulant c2 and the spectral power in the conventional EEG bands. Boxes in orange represent observations from the most discriminating channel in cumulant c1. Boxes in blue represent observations from the most discriminating channel in cumulant c2. Significant differences between preictal and interictal observations are denoted by asterisks (* p-value < 0.01, ** p-value < 0.001).

https://doi.org/10.1371/journal.pone.0121182.g004

Seizure prediction performance using cumulants

The performance of the seizure prediction method evaluated on the testing data is shown in Fig 5 for cumulants c1, c2 and their combination (respectively feature sets FS1, FS2 and FS3). When cumulant c1 was used alone, 10 of 17 (59%) patients had their seizures predicted above chance level for persistence-τ values 50, 55 and 60 min. Using these persistence-τ values, the algorithm achieves an average sensitivity of 94.6%, an average percentage warning time between 34.8 and 36.6%, an average false prediction rate between 0.09 and 0.12/h, and an average warning rate of 0.32/h. The number of patients with predictable (above chance) seizures drops gradually to six when the value of persistence-τ is below 15 min. For these persistence-τ values, the average sensitivity is 90.3%, the average percentage warning time is 30.1%, the average false prediction rate is 0.59/h, and the average warning rate is 0.65/h.

thumbnail
Fig 5. Performance of the seizure prediction method using cumulants and their combination.

a-c top: Performance values for the range of persistence-τ values analyzed. Orange circles indicate interpolated values of sensitivity, proportion of time under warning and warning rate corresponding to the critical false prediction rate of 0.15/h. a-c bottom: Number of patients in whom seizures are predicted above chance as a function of the persistence-τ parameter. d. Average prediction time per patient as a function of the persistence-τ parameter.

https://doi.org/10.1371/journal.pone.0121182.g005

When cumulant c2 was used alone, up to eight of 17 (47%) patients had seizures predicted above chance. This is achieved for persistence-τ values 55 and 60 min. At these values, the average sensitivity is 96.3% and the average percentage warning time, the average false prediction rate and the average warning rate are respectively 41.9%, 0.13 and 0.44/h. As in the case of cumulant c1, a gradual decrease in the performance and in the number of patients in whom seizures are predicted above chance is noticed as the value of persistence-τ decreases.

The combination of cumulants c1 and c2 achieves comparable results to those obtained by either cumulants; seizures are predictable in up to nine of 17 patients (53%). For the set of persistence-τ values analyzed, the average sensitivity ranged between 78.3 and 94.1%, the average percentage warning time between 24.4 and 33.1%, the average false prediction rate between 0.07 and 0.69/h, and the average warning rate between 0.29 and 0.75/h.

Prediction time.

The average prediction time per patient (average across seizures predicted above chance of the time of first preictal change) ranged between 37 and 76 min (median = 61.2 min) across the persistence-τ values when cumulant c1 was used, and between 15.5 and 50.1 min (median = 42.6 min) when cumulant c2 is used (Fig 5D). With the combination of cumulants, the average prediction time ranged between 21.4 and 54.1 min (median = 51.1 min).

Seizure prediction performance using combination of cumulants and state similarity measures

Fig 6 shows the performance of the seizure prediction algorithm evaluated on testing data using combinations of cumulants and state similarity measures. The combination of state similarity measures and cumulant c1 (feature set FS4) results in seizures predicted above chance in 13 of 17 patients (76%) for persistence-τ values between 25 and 60 min. The average sensitivity is 81%, the average percentage warning time is 25.2%, the average false prediction rate is 0.12/h, and the average warning rate is 0.28/h. The performance and the number of patients with predictable seizures decreases gradually when persistence-τ values decreases.

thumbnail
Fig 6. Performance of the seizure prediction method using combination of cumulants and state similarity measures.

a-c top: Performance metric values for the range of persistence-τ values analyzed when state similarity measures are combined with respectively cumulant c1 (feature set FS4), cumulant c2 (feature set FS5) and both cumulants (feature set FS6). Orange circles indicate interpolated values of sensitivity, proportion of time under warning and warning rate corresponding to the critical false prediction rate of 0.15/h. a-c bottom: Number of patients in whom seizures are predicted above chance level as function of the persistence-τ parameter, for each of the combination feature sets. d. Average prediction time per patient as a function of the persistence-τ parameter for each combination feature set.

https://doi.org/10.1371/journal.pone.0121182.g006

Ten of 17 (59%) patients had seizures predicted above chance using a combination of state similarity measures and cumulant c2 (feature set FS5) for persistence-τ values between 10 and 60 min. For these patients, the algorithm achieves an average sensitivity of 84.3%, an average percentage warning time of 21.2%, an average warning rate of 0.3/h, an a false prediction rate between of 0.07 and 0.41/h. When combining state similarity features with both cumulants (feature set FS6), seizures were predicted above chance in up to 11 of 17 patients (65%) for the range of persistence-τ values between 25 and 60 min. For this range, the average sensitivity is 82.9%, the average percentage warning time is 24.5%, the average false prediction rate is 0.12/h, and the average warning rate is 0.25/h.

Prediction time.

Fig 6D shows the average prediction time across persistence-τ values for feature sets FS4, FS5 and FS6. For all three feature sets, the average prediction time decreases gradually with the value of persistence-τ. Its median value when using FS4, FS5 and FS6 is respectively 59.3, 48.5 and 52.8 min.

Performance at the critical false positive rate

For a clinically practical seizure prediction method, the false positive rate should be in the order of the patient’s seizure frequency [33,36] which on average is equal to three seizures per day [37]. When medication is discontinued (e.g. during epilepsy monitoring), the average seizure frequency increases to 3.6 seizures per day [38] corresponding to a rate of 0.15 seizures per hour. A false prediction rate above the critical value of 0.15/h in a seizure prediction method is therefore of questionable value. We report in Table 3 the values of the algorithm performance corresponding to the critical false prediction rate. Only performance values corresponding to persistence-τ above the values outlined in Table 3 are to be regarded as clinically significant.

thumbnail
Table 3. Seizure prediction performance at the critical false prediction rate.

https://doi.org/10.1371/journal.pone.0121182.t003

At the critical false positive rate, the best average sensitivity is obtained with feature set FS1 (95.4%) for 10 patients, while the best specificity was obtained with feature set FS5 (% time under warning = 21.3%) for 10 of 17 patients. Feature FS4 achieves the highest number of patients with seizure predicted above chance (13 of 17 patients), with an average sensitivity of 80.5% and an average percentage time under warning of 25.1%. Performance results obtained with feature sets FS1 to FS6 were overall better than those obtained with state similarity feature in the previous study.

Surgery outcome and seizure prediction performance

For all feature sets, there was no consistent difference in seizure above-chance predictability between patients who became seizure-free or had rare disabling seizures after surgery (Engel class I and II) and those who continued to have disabling seizures after surgery (Engel class III and IV), in the group of 12 patients who underwent a resective surgery (Fisher’s exact test, p-value > 0.05).

Discussion

A reliable seizure prediction method with performance levels that would allow for clinical applications remains an unaccomplished task. Ongoing efforts to solve this problem are essentially geared towards finding new descriptors and processing tools of the EEG that would demonstrate a high predictive power. In this context, the current study shows that measures derived from iEEG scaling analysis used together with iEEG state similarity measures can be useful in the prediction of mesial temporal lobe seizures with practical performance levels.

Summary of findings

Novel descriptors of the intracerebral EEG characterizing the property of scale invariance have been investigated in the prediction of mesial temporal lobe seizures in 17 patients. Cumulants derived from the wavelet leader multifractal analysis of intracerebral EEG showed a statistically significant difference between preictal and interictal epochs in one or more channels in all patients. This difference was not likely attributable to differences in the spectral power suggesting that the cumulants carry a predictive power. However, the association between the difference in cumulants and in the power of some frequency bands in some patients can highlight a possible effect of the state of vigilance on the prediction performance. It is expected that cumulants covary with the spectral power of some but not all frequency bands. This is because cumulants are higher order statistics which embed information about the spectral power (a second order statistic) as well as properties of high statistical order such as long-range dependencies. A correlation analysis between cumulants and the spectral power in the EEG spectral bands should help define the contribution of the spectral power to the predictive power of cumulants. When used as features in our previously proposed seizure prediction method, both cumulants showed prediction capability above chance and with noticeably improved sensitivity (an increase of 17.2% with the first cumulant and 18.3% with the second cumulant, at the critical false positive rate of 0.15/h) over originally used state similarity measures. The number of patients in whom seizures are predicable above chance has also increased from seven to ten (using the first cumulant). Specificity levels were relatively worse using cumulants: a relative increase in the proportion of time under warning of 18.4% using the first cumulant and 38.4% using the second cumulant.

The combination of cumulants slightly outperformed state similarity measures in terms of sensitivity and specificity but did not offer a remarkable improvement over either cumulant used individually. This is probably explained by the relatively worse performance of the second cumulant compared to the first cumulant, suggesting that the predictive information carried by the first cumulant is of higher value and that the multifractality of the iEEG, as captured by the second cumulant, does not change between interictal and preictal states offering less predictive power of seizure occurrence than other properties. Indeed, the combination of the first cumulant and state similarity measures achieved markedly improved prediction performance compared to that achieved with state similarity measures. Particularly, the number of patients in whom seizures are predicted above chance increased from seven to 13 (85.7% increase) when the false prediction rate is fixed at the critical value of 0.15/h. The proportion of time under warning decreased slightly from 30.5 to 25.1%. The sensitivity and the warning rate did not significantly differ.

For seizures predicted above-chance, preictal changes were detected between 15.5 and 76 min on average depending on the feature set and the persistence-τ parameter value. Using a combination of state similarity measures and the first cumulant, preictal changes leading to a warning light were detected almost one hour before seizure onset when the false positive rate is fixed at the critical level of 0.15/h. Such a prediction time may not be practical in a seizure advisory system dedicated to warning patients. However, the proposed method should appeal to closed-loop seizure control devices where the intervention time is in the order of the reported prediction time and the levels of required performance are within the range of the achieved performance.

While cumulant c2 did not show a consistent direction in the difference between preictal and interictal epochs, cumulant c1 was on average significantly higher for the 5-min preictal epochs than for the 5-min interictal epochs in 65% of patients. This preictal increase in the first cumulant indicates that one aspect of the regularity of the iEEG increases before the seizure in these patients. In fact for general cases of scale-invariance models (e.g. multifractal processes), c1 partially measures the local regularity of a process. Formally, c1 coincides with the most common value of the local regularity exponent measurable in the process [21]. As c1 alone might not be sufficient to fully describe the regularity of the iEEG, its preictal increase may not have a visible trace in the iEEG. Such a preictal increase in (one aspect of) the regularity may however point to a more organized and less complex neuronal process underlying the preictal state compared to a less regular and more complex interictal state. Furthermore, this process could presumably emanate from a spatially confined area of the brain such that it is only detectable from few electrode contacts, which could explain why generally only few channels exhibit preictal changes.

Unlike with threshold-based prediction algorithms where the sensitivity and the false prediction rate are positively correlated, classification algorithms using non-linear classification and/or rule-based prediction methods do not necessarily satisfy such correlation. This is the case of the proposed algorithm where a decrease of the sensitivity was associated with an increased false prediction rate leading to a deterioration of performance for a range of seizure prediction horizons. Although a linear discriminant analysis has been used in this study, the rules introduced to decide the final classifications (majority voting decision rule and persistent of alarm lights) are not linear and can lead to uncorrelated sensitivity and specificity results.

Combination of features is better

Our findings suggest that the preictal change in mesial temporal lobe epilepsy could be better detected if appropriate measures are combined rather than used individually. A better characterization of the preictal state may require different measures that characterize different aspects of the preictal transition. The dynamics of the preictal transition are likely to be complex and accompanied by changes in different properties of the EEG. Quantifying these properties with measures capable of distinguishing the preictal from the interictal state and joining the information carried by each measure should lead to enhanced seizure prediction. This was demonstrated here by combining measures of state similarity and scale invariance properties of the EEG signal. Each set of measures showed individually a predictive power which increased remarkably when both measures were combined.

The level of prediction performance obtained with cumulants is noteworthy, particularly with the first cumulant. To our knowledge, this is the first study to demonstrate a difference in the scale-free dynamics of the intracerebral EEG, as measured by the cumulants, between preictal and interictal epochs and the relevance of the difference in cumulant profiles to seizure prediction. Few studies applied wavelet based cumulants derived from scaling or multifractal analysis to the investigation of the resting state in EEG [39] and in functional magnetic resonance imaging studies [40,41]. Self-similarity, long range dependence and multifractality have been found in magnetoencephalography (MEG) data of healthy patients during rest or task states by applying the WLBMF analysis [42,43]. One study applied wavelet leader cumulants in the classification of EEG patterns in a brain computer interface application [44].

Scale invariance of the intracerebral EEG

Whether intracerebral EEG reveals scale-free dynamics was not a primary question of this study. We were specifically interested to know if preictal and interictal states manifest different scale-free dynamics as characterized by the cumulants and if any difference could be useful in seizure prediction and its improvement. The profile of the cumulant values obtained for the iEEG data analyzed suggests however that preictal and interictal intracerebral EEG exhibit a scale invariance property. In fact both cumulants c1 and c2 had non-zero estimates across all epochs, which indicates that the EEG data could be described by a multifractal process—a scale-free process [21]. Scale invariance is not a characteristic of the epileptic brain. Scale-free activity of the physiological brain has been observed through different modalities [45]. Several studies have suggested that physiological EEG dynamics reflect perpetual brain state transitions, a property known as self-organized-criticality, manifested at the temporal and the spatial scale and following power law distributions [46]. Other studies have shown power law correlations in the EEG alpha wave [47] and long range correlations in the beta wave [48] and scale invariance properties in the functional magnetic resonance imaging signal during resting state [49] and in the EEG during sleep [50]. The observed difference between preictal and interictal cumulant profiles indicates that the transition to seizure is accompanied by a change in the scale-free dynamics of the underlying neuronal mechanisms. Such a change reflects the emergence of a seizure-facilitating state in which the dynamics are characterized by critical time and probably spatial scales. These dynamics might even be observed at the network level where the interaction between units of neurons would show characteristic preictal scale-free dynamics. A multivariate spatiotemporal investigation of cumulant profiles or a fractal connectivity analysis [5153] would help evaluate this view.

No correlation with surgery outcome

Predictability and intractability of seizures do not seem to be related as we did not find a correlation between surgery outcome and seizure predictability in the group of patients for whom post-surgery outcome was available. This group was relatively small but our findings are consistent with what has been previously reported [36].

Conclusion

In summary, we improved the performance of a previously proposed seizure prediction method by using a combination of features. New descriptors of intracerebral EEG ― the wavelet leader cumulants based on a novel scaling analysis approach ― were efficiently employed to improve seizure prediction performance. The combination of state similarity measures and cumulants led to seizures predicted above chance in an additional six of 17 patients compared to previous study, with enhanced specificity and maintained sensitivity levels. These results suggest that seizures of many patients with mesial temporal lobe epilepsy can be predicted with clinically practical performance and encourage prospective validation on a larger cohort of patients. Given the relatively long prediction horizons evaluated, the improved method can be particularity useful for responsive seizure control devices based on seizure prediction.

Supporting Information

S1 Appendix. Mathematical formalism of the wavelet leader based scaling analysis.

https://doi.org/10.1371/journal.pone.0121182.s001

(DOCX)

S1 Fig. Illustration of the wavelet leader definition.

The wavelet Leader LX (red dot) is the supremum of the discrete wavelet coefficients dX (grey dots) in the time neighborhood 3λj,k over all finer scales 2j’ < 2j (area in grey). (adapted from [30]).

https://doi.org/10.1371/journal.pone.0121182.s002

(EPS)

Acknowledgments

We thank neurologists Dr. Taissa Ferrari, Dr. Birgit Frauscher, and Dr. Piero Perucca for their help on reviewing EEG clinical data, and Ms. Natalja Zazubovits for her technical assistance. We also thank Dr. Herwig Wendt for the Matlab code he provided and for his help on clarifying concepts.

Author Contributions

Conceived and designed the experiments: KG. Performed the experiments: KG. Analyzed the data: KG JML JG. Contributed reagents/materials/analysis tools: KG JML JG. Wrote the paper: KG JML JG.

References

  1. 1. Gadhoumi K, Lina JM, Gotman J (2012) Discriminating preictal and interictal states in patients with temporal lobe epilepsy using wavelet analysis of intracerebral EEG. Clinical neurophysiology 123: 1906–1916. pmid:22480601
  2. 2. Perucca P, Dubeau F, Gotman J (2013) Widespread EEG changes precede focal seizures. PLoS One 8: e80972. pmid:24260523
  3. 3. Huberfeld G, Menendez de la Prida L, Pallud J, Cohen I, Le Van Quyen M, Adam C, et al. (2011) Glutamatergic pre-ictal discharges emerge at the transition to seizure in human epilepsy. Nat Neurosci 14: 627–634. pmid:21460834
  4. 4. Le Van Quyen M, Soss J, Navarro V, Robertson R, Chavez M, Baulac M, et al. (2005) Preictal state identification by synchronization changes in long-term intracranial EEG recordings. Clin Neurophysiol 116: 559–568. pmid:15721070
  5. 5. Badawy R, Macdonell R, Jackson G, Berkovic S (2009) The peri-ictal state: cortical excitability changes within 24 h of a seizure. Brain 132: 1013–1021. pmid:19251759
  6. 6. Jiruska P, Csicsvari J, Powell AD, Fox JE, Chang WC, Vreugdenhil M, et al. (2010) High-frequency network activity, global increase in neuronal activity, and synchrony expansion precede epileptic seizures in vitro. J Neurosci 30: 5690–5701. pmid:20410121
  7. 7. Lopes da Silva F, Blanes W, Kalitzin SN, Parra J, Suffczynski P, Velis DN (2003) Epilepsies as dynamical diseases of brain systems: basic models of the transition between normal and epileptic activity. Epilepsia 44 Suppl 12: 72–83. pmid:14641563
  8. 8. Lopes da Silva FH, Blanes W, Kalitzin SN, Parra J, Suffczynski P, Velis DN (2003) Dynamical diseases of brain systems: different routes to epileptic seizures. IEEE Trans Biomed Eng 50: 540–548. pmid:12769430
  9. 9. Stafstrom CE (2011) Distinct mechanisms mediate interictal and pre-ictal discharges in human temporal lobe epilepsy. Epilepsy Curr 11: 200–202. pmid:22130144
  10. 10. Mormann F, Kreuz T, Rieke C, Andrzejak RG, Kraskov A, David P, et al. (2005) On the predictability of epileptic seizures. Clin Neurophysiol 116: 569–587. pmid:15721071
  11. 11. Mirowski P, Madhavan D, Lecun Y, Kuzniecky R (2009) Classification of patterns of EEG synchronization for seizure prediction. Clin Neurophysiol 120: 1927–1940. pmid:19837629
  12. 12. Valderrama M, Nikolopoulos S, Adam C, Navarro V, Quyen M (2010) Patient-specific seizure prediction using a multi-feature and multi-modal EEG-ECG classification. In: Bamidis P, Pallikarakis N, editors. XII Mediterranean Conference on Medical and Biological Engineering and Computing 2010: Springer Berlin Heidelberg. pp. 77–80.
  13. 13. D'Alessandro M, Vachtsevanos G, Esteller R, Echauz J, Cranstoun S, Worrell G, et al. (2005) A multi-feature and multi-channel univariate selection process for seizure prediction. Clin Neurophysiol 116: 506–516. pmid:15721064
  14. 14. Aarabi A, He B (2011) Seizure prediction in intracranial EEG: a patient-specific rule-based approach. Conf Proc IEEE Eng Med Biol Soc 2011: 2566–2569. pmid:22254865
  15. 15. Feldwisch-Drentrup H, Schelter B, Jachan M, Nawrath J, Timmer J, Schulze-Bonhage A (2010) Joining the benefits: combining epileptic seizure prediction methods. Epilepsia 51: 1598–1606. pmid:20067499
  16. 16. Martis RJ, Acharya UR, Tan JH, Petznick A, Tong L, Chua CK, et al. (2013) Application of intrinsic time-scale decomposition (ITD) to EEG signals for automated seizure prediction. Int J Neural Syst 23: 1350023. pmid:23924414
  17. 17. Gadhoumi K, Lina JM, Gotman J (2013) Seizure prediction in patients with mesial temporal lobe epilepsy using EEG measures of state similarity. Clin Neurophysiol 124: 1745–1754. pmid:23643577
  18. 18. Mandelbrot B (1999) Intermittent turbulence in self-similar cascades: divergence of high moments and dimension of the carrier. Multifractals and 1/ƒ Noise: Springer New York. pp. 317–357. https://doi.org/10.1371/journal.pone.0024791 pmid:23005720
  19. 19. He BJ, Zempel JM, Snyder AZ, Raichle ME (2010) The temporal structures and functional significance of scale-free brain activity. Neuron 66: 353–369. pmid:20471349
  20. 20. Lashermes B, Jaffard S, Abry P. Wavelet leader based multifractal analysis; 2005 18–23 March 2005. pp. iv/161-iv/164 Vol. 164.
  21. 21. Wendt H, Abry P, Jaffard S (2007) Bootstrap for Empirical Multifractal Analysis. Signal Processing Magazine, IEEE 24: 38–48.
  22. 22. Abry P, Flandrin P, Taqqu MS, Veitch D (2000) Wavelets for the analysis, estimation and synthesis of scaling data. In: Park K, Willinger W, editors. Self Similar Network Traffic Analysis and Performance Evaluation: Wiley. pp. 39–88.
  23. 23. Varsavsky A, Mareels I, Cook M (2011) On the predictability of seizures. Epileptic seizures and the EEG: Measurements, Models, Detection and Prediction: CRC Press. pp. 263–303.
  24. 24. Samorodnitsky G, Taqqu MS (1994) Stable non-Gaussian random processes: stochastic models with infinite variance. New York: Chapman & Hall. xvi, 632 p. p.
  25. 25. Abry P, Baraniuk R, Flandrin P, Riedi R, Veitch D (2002) Multiscale nature of network traffic. Signal Processing Magazine, IEEE 19: 28–46.
  26. 26. Beran J (1994) Statistics for Long-Memory Processes: Taylor & Francis.
  27. 27. Falconer K (1990) Fractal Geometry: Mathematical foundations and applications. New York: Wiley.
  28. 28. Riedi R (1995) An Improved Multifractal Formalism and Self-Similar Measures. Journal of Mathematical Analysis and Applications 189: 462–490.
  29. 29. Jaffard S, Lashermes B, Abry P (2006) Wavelet leaders in multifractal analysis. In: Qian T, Vai TP, Yuesheng X, editors. Wavelet Analysis and Applications. Boston: Birkhäuser. pp. 219–264.
  30. 30. Wendt H, Abry P (2007) Multifractality Tests Using Bootstrapped Wavelet Leaders. Trans Sig Proc 55: 4811–4820.
  31. 31. Bacry E, Muzy JF, Arnéodo A (1993) Singularity spectrum of fractal signals from wavelet analysis: Exact results. Journal of Statistical Physics 70: 635–674.
  32. 32. Snyder DE, Echauz J, Grimes DB, Litt B (2008) The statistics of a practical seizure warning system. Journal of neural engineering 5: 392–401. pmid:18827312
  33. 33. Winterhalder M, Maiwald T, Voss HU, Aschenbrenner-Scheibe R, Timmer J, Schulze-Bonhage A (2003) The seizure prediction characteristic: a general framework to assess and compare seizure prediction methods. Epilepsy Behav 4: 318–325. pmid:12791335
  34. 34. Mormann F, Andrzejak RG, Elger CE, Lehnertz K (2007) Seizure prediction: the long and winding road. Brain 130: 314–333. pmid:17008335
  35. 35. Benjamini Y, Hochberg Y (1995) Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. J R Stat Soc 57: 289–300.
  36. 36. Aschenbrenner-Scheibe R, Maiwald T, Winterhalder M, Voss HU, Timmer J, Schulze-Bonhage A (2003) How well can epileptic seizures be predicted? An evaluation of a nonlinear method. Brain 126: 2616–2626. pmid:14506067
  37. 37. Bauer J, Burr W (2001) Course of chronic focal epilepsy resistant to anticonvulsant treatment. Seizure 10: 239–246. pmid:11466018
  38. 38. Haut SR, Swick C, Freeman K, Spencer S (2002) Seizure clustering during epilepsy monitoring. Epilepsia 43: 711–715. pmid:12102673
  39. 39. Van de Ville D, Britz J, Michel CM (2010) EEG microstate sequences in healthy humans at rest reveal scale-free dynamics. Proceedings of the National Academy of Sciences of the United States of America 107: 18179–18184. pmid:20921381
  40. 40. Ciuciu P, Varoquaux G, Abry P, Sadaghiani S, Kleinschmidt A (2012) Scale-Free and Multifractal Time Dynamics of fMRI Signals during Rest and Task. Front Physiol 3: 186. pmid:22715328
  41. 41. Ciuciu P, Abry P, Rabrait C, Wendt H (2008) Log Wavelet Leaders Cumulant Based Multifractal Analysis of EVI fMRI Time Series: Evidence of Scaling in Ongoing and Evoked Brain Activity. Selected Topics in Signal Processing, IEEE Journal of 2: 929–943.
  42. 42. Zilber N, Ciuciu P, Abry P, van Wassenhove V. Modulation of scale-free properties of brain activity in MEG; 2012 2–5 May 2012; Barcelona, Spain. pp. 1531–1534.
  43. 43. Zilber N, Ciuciu P, Abry P, van Wassenhove V. Learning-induced modulation of scale-free properties of brain activity measured with MEG; 2013 7–11 April 2013; San Francisco, CA. pp. 998–1001.
  44. 44. Brodu N, Lotte F, Lécuyer A (2012) Exploring two novel features for EEG-based brain–computer interfaces: Multifractal cumulants and predictive complexity. Neurocomputing 79: 87–94.
  45. 45. He BJ (2014) Scale-free brain activity: past, present, and future. Trends in Cognitive Sciences 18: 480–487. pmid:24788139
  46. 46. Buzsáki G (2006) A system of rhythms: From simple to complex dynamics. Rhythms of the brain. Oxford; New York: Oxford University Press. pp. 111–135.
  47. 47. Linkenkaer-Hansen K, Nikouline VV, Palva JM, Ilmoniemi RJ (2001) Long-Range Temporal Correlations and Scaling Behavior in Human Brain Oscillations. The Journal of Neuroscience 21: 1370–1377. pmid:11160408
  48. 48. Poupard L, Sartène R, Wallet J-C (2001) Scaling behavior in β-wave amplitude modulation and its relationship to alertness. Biological Cybernetics 85: 19–26. pmid:11471837
  49. 49. He BJ (2011) Scale-free properties of the functional magnetic resonance imaging signal during rest and task. J Neurosci 31: 13786–13795. pmid:21957241
  50. 50. Cai S, Jiang Z, Zhou T, Zhou P, Yang H, Wang B (2007) Scale invariance of human electroencephalogram signals in sleep. Physical Review E (Statistical, Nonlinear, and Soft Matter Physics) 76.
  51. 51. Achard S, Bassett DS, Meyer-Lindenberg A, Bullmore E (2008) Fractal connectivity of long-memory networks. Phys Rev E Stat Nonlin Soft Matter Phys 77: 036104. pmid:18517458
  52. 52. Wendt H, Scherrer A, Abry P, Achard S. Testing fractal connectivity in multivariate long memory processes; 2009. pp. 2913–2916.
  53. 53. Ciuciu P, Abry P, He BJ (2014) Interplay between functional connectivity and scale-free dynamics in intrinsic fMRI networks. Neuroimage 95: 248–263. pmid:24675649