Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Altered cerebral blood flow velocity features in fibromyalgia patients in resting-state conditions

Altered cerebral blood flow velocity features in fibromyalgia patients in resting-state conditions

  • Alejandro Rodríguez, 
  • José Tembl, 
  • Patricia Mesa-Gresa, 
  • Miguel Ángel Muñoz, 
  • Pedro Montoya, 
  • Beatriz Rey
PLOS
x

Abstract

The aim of this study is to characterize in resting-state conditions the cerebral blood flow velocity (CBFV) signals of fibromyalgia patients. The anterior and middle cerebral arteries of both hemispheres from 15 women with fibromyalgia and 15 healthy women were monitored using Transcranial Doppler (TCD) during a 5-minute eyes-closed resting period. Several signal processing methods based on time, information theory, frequency and time-frequency analyses were used in order to extract different features to characterize the CBFV signals in the different vessels. Main results indicated that, in comparison with control subjects, fibromyalgia patients showed a higher complexity of the envelope CBFV and a different distribution of the power spectral density. In addition, it has been observed that complexity and spectral features show correlations with clinical pain parameters and emotional factors. The characterization features were used in a lineal model to discriminate between fibromyalgia patients and healthy controls, providing a high accuracy. These findings indicate that CBFV signals, specifically their complexity and spectral characteristics, contain information that may be relevant for the assessment of fibromyalgia patients in resting-state conditions.

Introduction

Fibromyalgia syndrome (FMS) is a chronic disease [1] characterized by widespread musculoskeletal pain, an abnormal pain response from normally non-painful stimuli (allodynia) and an excessive sensitivity to painful stimuli (hyperalgesia) in many tender points. Symptoms derived from FMS include permanent fatigue, insomnia or non-refreshing sleep, stiffness, cognitive and emotional difficulties as depressive symptoms or anxiety response. Although etiology and pathophysiology of FMS is unknown, the central nervous sensitization and the pain-inhibiting mechanisms seem to be affected leading to augmented nociceptive processing [2,3].

There are several brain areas that are activated in response to painful stimuli, including the primary and secondary somatosensory cortices, the insula, the anterior cingulate and the thalamus, as well as prefrontal and parietal regions, which compose the neuromatrix of nociception [46]. In the case of chronic pain patients, a more pronounced activation of this neuromatrix is observed [7,8]. Furthermore, resting-state networks of chronic pain patients are altered in comparison with normal population [912].

One of the techniques that has been recently proposed to evaluate the dynamics of brain activation associated to painful stimuli is Transcranial Doppler (TCD) monitoring [1315]. It is a non-invasive ultrasound diagnosis technique that analyzes the hemodynamical variations in the brain by measuring cerebral blood flow velocities (CBFV) in main cerebral vessels [16,17]. Although the spatial resolution of TCD monitoring is limited to the areas supplied by the vessels under study, its high temporal resolution makes the technique suitable to complement other techniques such as fMRI to evaluate brain function.

The aforementioned TCD studies have found that there are measurable variations in CBFV of anterior cerebral arteries (ACA) and middle cerebral arteries (MCA) in response to different kinds of painful stimuli, being these changes more pronounced in FMS patients than in general population [1315]. Furthermore, there have also been complementary studies to assess the relationship of FMS with cognitive and attentional deficits using TCD [18,19]. However, up to our knowledge, the resting-state features of the CBFV of FMS patients have not been evaluated yet using TCD.

Studies with TCD in the psychophysiological field have commonly based their analysis on the evaluation of the temporal evolution of the mean CBFV (calculated from the so-called envelope velocity) [16,17,20], although there are specific studies that have proposed alternative analyses based on other factors, such as the frequency contents of the envelope signal [21]. Besides, there are recent studies that have evaluated the resting-state CBFV signal from the MCA [22] and the ACA [23,24] in general population, using not only the envelope velocity but also the raw TCD signal. The raw signal is the ultrasound signal that is received by the TCD monitoring system without any processing. It contains information from all the blood cells moving at different velocities [25]. On the other hand, the envelope signal is an already processed signal that represents the instantaneous CBFV of the fastest blood cells, which generate the highest Doppler shift.

The studies about resting-state categorization of CBFV in general population [2224] have also proposed the use of features extracted from both the raw and the envelope signals using not only temporal analyses, but also frequency, time-frequency and information theory analyses. These features can contribute to a better characterization of the CBFV signals in different groups of people or different experimental conditions, complementing typical approaches based on analyzing the temporal evolution of the signals. Sejdić et al. [22] and Huang et al. [24] observed sex-based differences in parameters from the three additional domains both for the envelope signals and the raw CBFV signals from MCA and ACA vessels.

Although previous studies that have applied TCD to evaluate CBFV characteristics of FMS patients have been based on temporal analyses of the signals, the described methodology based on frequency, time-frequency and information theory features is worth to consider in order to assess the resting-state characteristics of CBFV of FMS patients.

As previously described, TCD has started to be applied for evaluating differences in cerebral hemodynamics between patients and controls during pain processing. The current work will advance in this kind of analysis by evaluating other kinds of signal processing and feature extraction methods that can help to differentiate between FMS patients and controls.

Specifically, the main goal of the present work is to characterize the CBFV signals from FMS population in resting-state conditions in comparison with healthy population. Taking into account studies with general population [22], we propose the application of different signal processing methods based on time, information theory, frequency and time-frequency analyses in order to extract different features that enable us to characterize the CBFV from the ACA and MCA, vessels that feed different areas of the pain neuromatrix.

Our first hypothesis is that there will be significant differences between FMS patients and the control group in frequency, time-frequency and information theory parameters obtained from the CBFV signal. This first hypothesis is supported by the evidence from previous studies that have applied this kind of analyses in general population and by the fact that other neuroimaging techniques have observed that resting-state networks of chronic pain patients show alterations in comparison with healthy subjects [1012].

Furthermore, our second hypothesis is that we expect to find an association between these TCD parameters and psychological and clinical measures related to depression, anxiety and pain. Previous studies [26,27] have observed higher levels of depressiveness and anxiety in FMS patients in comparison with healthy controls, Besides, previous studies with other neuroimaging tools have also found correlations between altered physiological parameters and scores obtained from depression and anxiety questionnaires [12]. For these reasons, we expect to find relations between depression and anxiety measures and specific frequency, time-frequency and information theory parameters calculated from the CBFV signal.

Materials and methods

Participants

Fifteen females with FMS aged between 36 and 67 years (mean age 53.08 years; SD 7.64) and fifteen pain-free females aged between 33 and 53 years (mean age 45.60 years; SD 6.17) with comparable sociodemographic data were recruited for the study. Patients were recruited via the Valencian Fibromyalgia Association (AVAFI). Exclusion criteria included neurological disorders, major psychiatric diseases, and migraines during the day of the experimental session, strokes or inflammatory causes of pain. The control group was recruited by means of announcements in notice boards of universities and sport associations. The exclusion criteria for the control group were the same applied to patients, and the presence of any kind of chronic pain disorder. All participants were right-handed based on Edinburgh Handedness Inventory responses (FMS group: mean 19.3, SD 5.16; Control group: mean 18.3, SD 4.87). All the participants gave their informed written consent prior to their inclusion in the study. The study was approved by the ethics committees of the Universitat Politècnica de València and of the Hospital Universitari and Politècnic La Fe.

Clinical assessment

In order to evaluate the mood, manual preference and the impact of pain on participants’ lives, they had to complete several questionnaires before the experimental session: several visual-analog scales for assessing daily and worst pain intensity during the last week, and also the pain laterality (referring to which body side, right versus left was perceived more painful), the State-Trait Anxiety Inventory questionnaire (STAI [28]), the Edinburgh Handedness Inventory test [29,30], the Beck Depression Inventory (BDI-II; Spanish adaptation by [31]) and the West Haven-Yale Multidimensional Pain Inventory (WHYMPI: [32]; Spanish adaptation by [33]).

An additional questionnaire had to be answered at the end of the experimental session: a reduced version of the resting state questionnaire (RQ) [34]. It consisted of 12 yes/no items about the participants’ experience during the resting period, to evaluate if they were able to remain thought-free during this period.

Physiological recordings

In order to measure the cerebral hemodynamic of participants, a commercial transcranial Doppler sonography device (Multi-Dop T; DWL, Germany) was used. Blood flow velocities (in cm/s) in ACA and MCA from both hemispheres were simultaneously monitored using two 2-MHz probes. Each probe was capable of conducting the exploration at two different depths at the same time. The probes were placed in the temporal bone window and fixed using a headset provided with the Doppler Box. The insonation depth of each probe varied between 50 and 55 mm to register MCA blood flow velocity, and between 65 and 70 mm to monitor ACA blood flow velocity.

QL software (provided with the system) was used to register the signals from the Doppler Box and export them to text files for later analyses. The CBFV signals were stored with a sampling rate of 100 Hz while the raw signal was extracted as a binary file sampled at 7042 Hz.

Blood pressure was measured using a wrist blood pressure monitor (R3 Intellisense; Omrom Healthcare Co., Ltd., Kyoto, Japan). Mean arterial pressure was calculated from systolic and diastolic pressures.

Experimental design

Before starting the experiment, participants had to fill out all the questionnaires described above except from the RQ questionnaire. They also received information about the experiment prior to data acquisition.

Thereafter, the Doppler sonography probes with the headset were placed on the participant’s head by an experienced neurologist.

Once the probes were correctly located, participants received instructions to remain awake, in silence and to avoid any thought during a 5-minute resting period. After this period, the participants had to complete the RQ questionnaire. Finally, they had to complete other tasks, which are not considered in this study.

Blood pressure was measured before and after the resting period.

Data analysis

The envelope and raw signals obtained by Transcranial Doppler were analyzed offline using MATLAB R2015b (The Mathworks Inc., Natick, MA, USA) and its toolboxes with custom MATLAB scripts. Only the measurements with a signal quality enough to allow their analyses were considered.

The preprocessing of the envelope and raw signals was applied to the 5-minute data corresponding to the resting period. The first step was a detection and correction of outliers caused by artifacts. In the case of the envelope signals, this was followed by a linear low-pass filter (with a 10 Hz cut-off frequency) that removed the effect of higher frequency artifacts. Finally, in order to avoid the dependence with the incidence angle between the ultrasound probe and the artery, the envelope signal was normalized dividing it by its mean during the resting period and multiplying by 100, in a similar way to other studies [20]. On the other hand, the raw signal was divided by its maximum value during the resting period to restrict its range to normalized values between -1 and 1 for all the subjects.

Several parameters were calculated to characterize the hemodynamic signals from different perspectives: time, frequency, time-frequency and information theory [22,24]. The specific parameters are described below. All the parameters were obtained from the ACA and MCA signals, in both hemispheres and for envelope and raw signals.

Finally, heart rate was calculated from the intervals between the peaks of the normalized envelop signal, also known as inter-systolic intervals [35].

Statistical features.

Five statistical features widely used were calculated to characterize the signals from each vessel. These statistical features included mean, standard deviation (StD), variance, kurtosis and skewness. They were calculated both to the signals before normalizing and after normalizing.

Information-theoretic features.

The goal of information-theoretic analysis is to assess the complexity (or predictability) and the regularity of signals and it is often applied in the analysis of biomedical signals [22,36]. The parameters that have been obtained in the current study to evaluate complexity and regularity of CBFV signals are Lempel-Ziv complexity (LZC) [3739], entropy rate (EntrRate) [40], and multiscale entropy (MSE) [41,42].

The LZC is a non-parametric feature that evaluates the randomness of finite sequences in a one-dimension signal [38]. It is related to the number of distinct substrings and the rate of their recurrence along the signal [39]. High values reflect a more complex signal.

The entropy rate measures the regularity by means of the evaluation of repetitive sequence of patterns in a signal [40]. Entropy rate varies between 0 (maximum randomness) and 1 (maximum regularity) [22].

Finally, the MSE method evaluates the regularity of complex signals by applying a consecutive coarse-graining process to the signal by averaging a successively increasing number of data points (scale or length) in non-overlapping windows [41]. The sample entropy is calculated for each coarse-grained signal [42]. In this case, an entropy of 0 represents maximum regularity.

Frequency features.

The frequency features that were calculated included peak frequency (PeakFreq), centroid frequency (CentFreq), bandwidth (BW) [22,24,43] and spectral power in different frequency bands. Power Spectral Density (PSD) was calculated using the Welch method with a Hamming window of 1024 points and a 50% overlap.

The peak frequency and the centroid frequency are measures that can be used to evaluate spectral changes in the signals, while the BW is used to measure the spectral spread [43]. In addition, the PSD provides information on how power is distributed as a function of frequency.

The peak frequency, the centroid frequency and the BW were calculated from the preprocessed signal and also after applying a more restrictive low-pass filter (cut-off frequency of 0.6 Hz), in order to remove the effect on these parameters of the cardiac cycle.

On the other hand, the spectral power in frequency bands described in previous TCD studies [44] was calculated: low frequency band (LF: 0.04–0.15 Hz), high frequency band (HF: 0.15–0.4 Hz) and the ratio between the LF and HF components (LF/HF ratio).

Finally, an additional band (0.12–0.25 Hz) (B012-015) that has shown accentuated fluctuations in the brain metabolism of chronic pain patients in resting-state was also analyzed [10]. The spectral power in this band was calculated and normalized with respect to the spectral power in the band up to 1 Hz.

Time-frequency features.

A time-frequency analysis based on the wavelet transform was made in order to examine how spectral components change over time. In this analysis, two parameters were calculated: the relative energy from the approximation coefficients (RWEa10) in different time-frequency bands and the wavelet entropy (Wentropy). The discrete Meyer wavelet was used to obtain a 10-level discrete wavelet decomposition [22,45].

Statistical analysis.

In order to explore the differences between the FMS and the control group regarding the questionnaire data and the extracted features from the cerebral hemodynamic responses, several statistical data analyses were applied. All the analyses were conducted using SPSS 16.0 (SPSS Inc., Chicago, USA) with a 0.05 significance level.

An analysis of variance (ANOVA) was applied. The between-subject factor was the experimental group (FMS vs. control). Dependent variables included the extracted features from bilateral ACA and MCA, the data from questionnaires and the heart rate. Prior to applying the ANOVA, Kolmogorov-Smirnov and Levene tests were used to check the different dependent variables for normality and homoscedasticity, respectively. If a specific variable did not follow normality criteria, a non-parametric test was applied instead (Mann-Whitney U).

Spearman correlations were calculated between the variables from questionnaires and the CBFV features to analyze possible relations between pain-related variables (depressiveness, anxiety, pain severity and pain intensity) and cerebral blood flow. Furthermore, Pearson correlations were calculated between the information-theoretic features and the heart rate in order to evaluate the effects of heart rate in the complexity and the regularity parameters.

Finally, a Linear Discriminant Analysis (LDA) [46] was applied to evaluate if the features obtained from TCD CBFV signals are suitable to discriminate between fibromyalgia patients and controls. LDA finds the best linear discriminant function that separates the groups under study. After selecting the features that will be included in the classification model, the LDA model was evaluated by means of a leave-one-out cross-validation method. This feature selection and classification method was applied over three different data sets. The first one was composed by all the calculated features, both from ACA and MCA, the second data set was only composed by the ACA features and the third data set was composed by the MCA features.

Results

Clinical data

The clinical data are summarized in Table 1 (including number of participants taking different kinds of medication).

thumbnail
Table 1. Clinical data from the FMS group and the control group.

Data are presented as mean values ± SD. Bold text indicates the clinical parameters that have shown significant differences between groups (using F or χ2).

https://doi.org/10.1371/journal.pone.0180253.t001

Focusing on clinical questionnaires, the FMS group showed significantly higher levels of pain intensity than the control group in the Pain Intensity/Laterality questionnaire.

Regarding anxiety measures (STAI questionnaire), significant differences were observed for the STAI-state and STAI-trait, with higher levels of anxiety for the FMS group. Regarding depression (BDI questionnaire), significantly higher values were obtained in the FMS group for overall depression scores.

Finally, the results obtained for the different scales and subscales of the WHYMPI questionnaire showed statistically significant differences for sections I and II. Section I is related to “pain experience”, and significant effects were found in the following subscales: negative mood, pain interference, activity interference and pain severity. In Section II (“response by significant others”), significant differences were found in the following subscales: distracting responses, solicitous responses and punishing responses. FMS patients perceived a lower psychological and instrumental support and a higher negative support by significant others than the control group. The subscales from section III (daily activity) did not reveal any significant effect.

No significant differences were found between the mean arterial pressure before and after the resting period, neither for the control group nor for the FMS group.

Finally, the resting questionnaire responses did not show any behavior that was considered sufficient to exclude any participant from the experiment.

Transcranial Doppler signals

Some vessels were discarded because the quality of the signal was not enough to allow their analysis, giving a total number of 25 subjects for L-MCA (12 FMS group), 25 subjects for R-MCA (12 FMS group), 23 subjects for L-ACA (11 FMS group) and 24 subjects for R-ACA (11 FMS group).

For the envelope signals, Tables 25 summarize the obtained results for the different calculated features in the envelope CBFV signals from the four considered arteries. There were significant differences in several information-theoretic, frequency and power spectral density features between the control and FMS groups. However, there were no significant differences in any statistical or time-frequency feature.

thumbnail
Table 2. A summary of statistical parameters (calculated before and after normalization), information-theoretic, frequency and time-frequency features extracted from L-ACA envelope CBFV signals.

All the values with no indicated units are dimensionless. Data are presented as mean values ± standard deviation. Bold text indicates the features that have shown significant differences between groups.

https://doi.org/10.1371/journal.pone.0180253.t002

thumbnail
Table 3. A summary of statistical parameters (calculated before and after normalization), information-theoretic, frequency and time-frequency features extracted from R-ACA envelope CBFV signals.

All the values with no indicated units are dimensionless. Data are presented as mean values ± standard deviation. Bold text indicates the features that have shown significant differences between groups.

https://doi.org/10.1371/journal.pone.0180253.t003

thumbnail
Table 4. A summary of statistical parameters (calculated before and after normalization), information-theoretic, frequency and time-frequency features extracted from L-MCA envelope CBFV signals.

All the values with no indicated units are dimensionless. Data are presented as mean values ± standard deviation. Bold text indicates the features that have shown significant differences between groups.

https://doi.org/10.1371/journal.pone.0180253.t004

thumbnail
Table 5. A summary of statistical parameters (calculated before and after normalization), information-theoretic, frequency and time-frequency features extracted from R-MCA envelope CBFV signals.

All the values with no indicated units are dimensionless. Data are presented as mean values ± standard deviation. Bold text indicates the features that have shown significant differences between groups.

https://doi.org/10.1371/journal.pone.0180253.t005

The envelope signals from the FMS group in the left hemisphere were less predictable than those of the control group as measured by different information-theoric features. Mean MSE values for the different scales, arteries and groups can be observed in Fig 1.

thumbnail
Fig 1.

Multiscale entropy (MSE) analysis of the envelop signal time series in the following arteries: (a) L-ACA (b) R-ACA (c) L-MCA (d) R-MCA. Mean values (dimensionless) for each group (Control and FMS) are shown for scales 1 to 20.

https://doi.org/10.1371/journal.pone.0180253.g001

Regarding the frequency analysis, results show a lower LF/HF ratio in different vessels of the FMS group and a higher spectral power in the frequency band between 0.12 Hz and 0.25 Hz in the L-MCA of this group. Besides, the centroid frequency in the lower frequencies spectrum (0–0.6 Hz) in the L-MCA and L-ACA and the peak frequency in the L-MCA were higher in the FMS group.

The grand average power spectral density for each group in the different arteries can be observed in Fig 2 (including all the frequency range between 0 and 5 Hz–global spectrum) and in Fig 3 (focusing on a lower frequency range not affected by the cardiac cycle–lower frequencies spectrum).

thumbnail
Fig 2.

Grand average power spectral density (PSD) of the envelope cerebral blood flow velocity signal in the following arteries: (a) L-ACA (b) R-ACA (c) L-MCA (d) R-MCA. The frequency range between 0 and 5 Hz is included. Mean values (Hz-1) at each frequency bin for each group (Control and FMS) are shown.

https://doi.org/10.1371/journal.pone.0180253.g002

thumbnail
Fig 3.

Grand average power spectral density (PSD) of the envelope cerebral blood flow velocity signal in the following arteries: (a) L-ACA (b) R-ACA (c) L-MCA (d) R-MCA. The frequency range between 0 and 0.8 Hz is included. Mean values (Hz-1) at each frequency bin for each group (Control and FMS) are shown.

https://doi.org/10.1371/journal.pone.0180253.g003

The heart rate did not show any significant difference between the Control (68.568 ± 8.768) and the FMS (72.224 ± 11.37) groups (F(1,25) = 0.855; p = 0.364; partial η2 = 0.034).

Regarding raw data, no significant differences were found in any calculated parameter between the control group and the FMS group. The analyses described in following sections (correlation and LDA) were applied only to the envelope CBFV features.

Correlation analysis

Correlations were found between BDI questionnaire results, STAI-state, STAI-trait, pain severity factor (WHYMPI) and different envelope CBFV features. Significant correlations are shown in in Table 6. Some of the correlations are graphically represented in Fig 4.

thumbnail
Fig 4.

Significant correlations between the LF/HF ratio from L-ACA and (a) BDI scores, (b) STAI-trait scores and (c) Pain Severity Factor, as well as, between (d) LZC from L-MCA and STAI-state. No correlation was found between heart rate and information-theoretic parameters (p≥0.055).

https://doi.org/10.1371/journal.pone.0180253.g004

thumbnail
Table 6. Correlations between BDI, STAI-state, STAI-trait and Pain Severity Factor (WHYMPI) and different parameters from the envelop BFV signal in the different vessels.

Only the envelop BFV signal parameters that show significant correlations with each of the questionnaire values are included in the table.

https://doi.org/10.1371/journal.pone.0180253.t006

Linear discriminant analysis

In the case of the data set composed by all the features from the four vessels (excluding the statistical features, that had not shown any significant relevance in previous analyses), the selected features by the model were: LZC, LF, MSE factor 1 and the normalized power in the 0.12–0.25 Hz band for L-MCA; MSE factors 3 and 13 for R-ACA and MSE factor 14 for R-MCA. Initially, the classification model used all the features from all the samples as the training set to assess the LDA model. The classification achieved an accuracy of 91.30%. On the other hand, the classification results of the leave-one-out cross-validation (CV) approach achieved an accuracy of 100%.

Regarding the data set composed by ACA vessels features, the selected feature was the centroid frequency in the lower frequency band in the left hemisphere. The classification results using this feature from all the samples as the training set achieved an accuracy of 65.20% and the leave-one-out CV approach achieved an accuracy of 65.20%.

Finally, in the data set composed by MCA vessels features, the selected features were: LF/HF ratio and MSE1 for the left hemisphere and Entropy Rate and LF for the right hemisphere. The classification results using MCA vessels features from all the samples as the training set showed 91.7% of accuracy. The same accuracy was obtained with the leave-one-out CV approach.

The confusion matrices of the different classification models are shown in Table 7.

thumbnail
Table 7. Confusion matrices for LDA using all the features, ACA vessels features and MCA vessels features (except the statistical ones) from all the samples as the training set, using the leave-one-out cross validation approach, to discriminate between FMS group and control group.

https://doi.org/10.1371/journal.pone.0180253.t007

Discussion

This study has characterized the CBFV features obtained by TCD from FMS patients and healthy population. Results have shown that there exist significant differences in CBFV parameters of the TCD envelope signals of these groups in resting-state conditions.

The analyses of clinical pain measures showed results that are in line with previous studies [13]. More specifically, the FMS group had significantly higher levels of depressiveness and anxiety (state and trait) than the healthy population [1,47]. As expected, the FMS patients also showed significantly higher scores of pain intensity. These results are in accordance with those presented in other psychophysiological works where FMS patients participated [26,27].

Regarding the analyses of the registered TCD signals, we analyzed the envelope and raw CBFV signals, both for the FMS patients and the healthy population. Even though the raw CBFV analysis did not show any significant differences between the parameters from both groups, the envelope CBFV analysis showed differences in some of the parameters. The raw CBFV signal had been used previously as a valuable signal that can provide complementary information to the envelop CBFV analysis in resting-state conditions [22] and during the performance of cognitive tasks [48] in healthy population. However, in the present work only the envelope CBFV seems to include relevant information to characterize the groups under study.

Focusing on the envelope signal, the information-theoretic analysis showed significant differences for the LZC features in the two vessels of the left hemisphere. Although previous evidence indicates that several forms of pain are characterized by bilateral cerebral activations [49], there is not an exact correspondence between the activations and responses to pain that are observed in each hemisphere. Craggs et al. [50] used fMRI data from chronic pain and healthy control to estimate models of effective connectivity of pain-related processes. Although the models they obtained were similar between hemispheres, they observed group differences which involved the lack of paths of influence from S1 to S2 and from S1 to posterior insula in the left hemisphere of the FMS group (contralateral to the painful stimulation). Alterations of the connectivity between the default mode network (DMN) and different structures from each hemisphere have also been observed in FMS patients, also denoting a differentiation between hemispheres [51]. Patients have shown greater connectivity between the DMN and brain regions from the left hemisphere such as the left anterior, middle, and posterior insula and the left secondary somatosensory cortex [52]. The CBFV complexity features from the left hemisphere that are altered in the present study may be somehow related to these changes in connectivity that have been observed in previous studies in the same hemisphere.

LZC measures the possibilities of finding new patterns in a temporal series, so a larger LZC implies a more complex dynamical behavior [37]. Our results showed that the envelope signal of the FMS patients has a dynamical behavior with greater complexity and, hence, a lower predictability than the healthy participants. In this line, this analysis also revealed significant differences in the MSE for the scale factor 1 in L-MCA and for the scale factors 9 to 16 in L-ACA, being the envelope CBFV from the FMS patients more irregular and unpredictable than that from the control group.

The correlation results show an association of complexity measures such as LZC and MSE (scale factor 1) of the L-MCA with current anxiety (STAI State) and, in the case of LZC, with current pain level. Besides, the MSE values (scales factors 9 to 16) of the L-ACA are positively correlated with current anxiety (STAI State). The regularity (Entropy rate) of the CBFV signals in the R-MCA is negatively linked with the depression level (BDI measure).

Finally, the correlation analysis also shows the absence of relation between heart rate and information-theoretic parameters. Taking into account that the number of participants in the present study is rather small, this is a result that should be confirmed in future studies, as a larger sample size may be required to detect significant correlations between the studied parameters. However, it should be noted that this result is consistent with previous studies. Aboy et al. [38] had already concluded that the LZC was not influenced by the frequency of the signals being analyzed (in their study, simulated and intracranial pressure signals). Furthermore, previous TCD studies have observed that peripheral physiological mechanisms did not have any effect on slow changes of the cerebral blood flow velocity signal [35].

All these results seem to indicate that the complexity of the CBFV is influenced by different factors such as the depression, pain and anxiety levels of the participants in the study.

Although the bases of the observed differences in CBFV are unknown, there are evidences that have found a link between higher complexity in neuronal electrical activity and depression. Li et al. [53] described a significantly higher complexity in EEG from depression and schizophrenia patients in comparison with healthy participants during a resting task. They hypothesized that the origin of this increase in complexity could be in the activation of more neurons during this resting period in the case of patients. It has also been observed that depression patients had higher complexity in the MEG signal in resting-state conditions before starting a treatment than the healthy group [54]. Indeed, these complexity values decreased after an effective pharmacological treatment. This higher complexity in depression patients could be explained by a higher number of oscillatory systems working simultaneously and by increased frequency variability during the resting period in those patients. The authors of the study based their interpretation on previous works that had found that the EEG of depressed patients showed increased frequency variability caused by a higher disorganized neuronal activity [55] and that had concluded that the basis of the LZC complexity estimate is precisely the variability in the frequency components [38]. There are also studies that have got decreased complexity of these signals in major depressive patients in the context of other medical conditions [56]. Although we cannot assure that there is a direct relationship between the observations from neuronal activity and those from CBFV, it is interesting to consider those previous studies to analyze the origin of the higher CBFV complexity obtained in main cerebral arteries in the current work.

On the other hand, we have also found significant differences between the experimental groups in parameters from the frequency analysis. As can be observed in Fig 2, the CBFV spectrum is highly influenced by the cardiac cycle. A peak is present in all the arteries around 1.3 Hz (global peak frequency). Several harmonic peaks can be observed in higher frequency bands, with some concentrated power also present in lower frequency bands.

The global peak frequency is significantly higher in the FMS patients than in healthy participants (specifically, in L-MCA results). The CBFV component that has the biggest influence on the power spectrum is the cardiac cycle, which determines the position of the global peak frequency. Although the analyses with the current sample have not been able to detect significant differences between groups in the heart rate calculated from the intervals between the peaks of the normalized envelop signal, the higher values in the global peak frequency that have been obtained in the present study are coherent with the already known observation that FMS patients have higher heart rates than healthy population [26,57]. There is probably a different vegetative nervous response in both groups that can lead to these results [19].

When focusing on lower frequency bands, patients seem to have a decreased spectral power in the LF band in comparison with controls, and an increased spectral power in higher frequencies (Fig 3). The LF/HF ratio also presented significant differences for both hemispheres of MCA and for L-ACA, being the values of the healthy participants greater than those of FMS patients. The HF and LF fluctuations of CBFV have been described as secondary to the HF and LF fluctuations of the arterial blood pressure. The HF fluctuations of CBFV are secondary to HF fluctuations of arterial blood pressure (ABP) induced by respiration; LF fluctuations of CBFV are secondary to LF fluctuations of ABP, which originate from peripheral vasomotor activity and are additionally modified by cerebral autoregulation [44]. The LF/HF differences between FMS groups and healthy controls in resting state could reflect differences in peripheral vasomotor activity, vegetative nervous response, interference of drugs as well as subtle differences in cerebral autoregulation.

The correlation analyses show that the lower values the LF/HF ratio observed in the FMS group, for example in the L-MCA, are associated with higher values of both depression and anxiety (STAI trait). On the other hand, the LF spectral power of the L-MCA, which is also lower in the FMS group, is associated with pain indicators (Pain severity factor of the WHYMPI). Finally, the centroid frequency in the lower frequency band is associated with depression and anxiety (STAI state).

Our results also show that the fluctuations in the frequency band between 0.12 and 0.25 Hz are accentuated, in accordance to Malinen et al. [10], who had observed this effect in the BOLD fMRI signal in the insula of patients with chronic pain. This might be associated to an aberrant activity of the autonomic nervous system in the FMS patients. Modified vasomotion in the activated brain regions, typically occurring around 0.1 Hz, could be the origin of the difference between groups [58,59]. A posterior study was unable to find this behavior in the BOLD fMRI signal of FMS patients, but reported having found differences in even lower frequency bands [11]. Although further research will be needed to extract conclusions about these fluctuations in low frequency bands and the influence on them of processes such as cerebral autoregulation, baroreceptor reflex and vasomotion, TCD can be applied as a complementary tool to evaluate this kind of low frequency variations in the brain response.

All the obtained results are in accordance with previous studies that have demonstrated the relationship between negative emotional factors and activation of brain areas that are related to pain [60,61]. Therefore, our results would confirm that the complexity and the frequency features of CBFV are linked with other factors such as the depression levels, the state and trait anxiety, and pain indicators of the participants.

Finally, results from the LDA classification show that features extracted from CBFV could be useful to discriminate between FMS patients and healthy population by means of lineal models. The best accuracy was achieved when using all the calculated parameters from MCA and ACA, confirming the importance of characterizing the four arteries (MCA and ACA) in order to classify between FMS patients and healthy population. In addition, the stepwise features selection showed the high influence of the information-theoretic and frequency features in the LDA models, which would be in line with the previous results.

There are other studies with TCD that are applying classifiers to automatically detect cognitive states, i.e., [6265]. Although their purpose is different from the one of the present study, it is interesting to indicate that their accuracies are in accordance with those obtained in the present work.

The present study has some limitations that should be taken into account. Firstly, the number of participants in this work is reduced. The results should be confirmed with a large population of different age ranges and ethnicities, making possible to analyze the influence on the results of other related factors such as medication. Due to this limitation, the correlation analyses between the TCD parameters and questionnaire scores have been conducted globally with the whole sample, and not separately for each group. This has to be taken into account when interpreting the correlation results. Most of the participants on the FMS group take prescription drugs, mainly analgesics, antidepressant and anxiolytic drugs. Therefore, the influence of drugs in our results cannot be completely discarded. Secondly, other physiological parameters were not continuously monitored during the procedure because the work did not have the goal of studying phenomena such as vasomotor activity or cerebral autoregulation. Consequently, we do not have direct indicators of the influence of those phenomena in the obtained results. Thirdly, the participants in this work were women. The results should be confirmed using also a sample with FMS male patients. Finally, the TCD technique has some limitations. It measures CBFV, which is just an indirect estimation of cerebral blood flow. Besides, its spatial resolution is rather low [17], being restricted to the cerebral areas supplied by the analyzed vessels. Consequently, it would not be possible to detect the activity in smaller foci of cerebral activation.

Conclusion

The main goal of this study was to characterize the resting-state TCD in fibromyalgia patients. Therefore, we acquired raw and envelop CBFV signals in the main cerebral vessels (ACA and MCA). We observed that the fibromyalgia patients were characterized by a higher complexity of the envelope CBFV signal, as well as by a higher peak frequency, a higher 0.12–0.25 Hz band power, a lower LF/HF ratio and a higher centroid frequency in the lower frequency band in resting-state. In addition, these results showed a significant association with clinical pain parameters and emotional factors. Finally, we were able to classify with a high accuracy between FMS patients and healthy participants using the characterization features from the envelope CBFV signal.

Acknowledgments

The authors would like to thank the participants in the study.

Author Contributions

  1. Conceptualization: MAM PM BR.
  2. Data curation: AR BR.
  3. Formal analysis: AR PMG BR.
  4. Funding acquisition: PM BR.
  5. Investigation: AR JT BR.
  6. Methodology: AR JT MAM PM BR.
  7. Project administration: BR.
  8. Resources: AR BR.
  9. Software: AR.
  10. Supervision: MAM PM BR.
  11. Validation: AR JT BR.
  12. Visualization: AR BR.
  13. Writing – original draft: AR BR.
  14. Writing – review & editing: AR JT PMG MAM PM BR.

References

  1. 1. Mayer EA, Bushnell MC. Functional pain syndromes: presentation and pathophysiology. IASP Press (April 28); 2009. 580 p.
  2. 2. Jensen KB, Kosek E, Petzke F, Carville S, Fransson P, Marcus H, et al. Evidence of dysfunctional pain inhibition in Fibromyalgia reflected in rACC during provoked pain. PAIN®. 2009;144[1]:95–100.
  3. 3. Sluka K, Clauw D. Neurobiology of fibromyalgia and chronic widespread pain. Neuroscience. 2016;338:114–29. pmid:27291641
  4. 4. Apkarian AV, Bushnell MC, Treede RD, Zubieta JK. Human brain mechanisms of pain perception and regulation in health and disease. Eur J Pain. Blackwell Publishing Ltd; 2005 Aug;9[4]:463–84. pmid:15979027
  5. 5. Peyron R, Laurent B, García-Larrea L. Functional imaging of brain responses to pain. A review and meta-analysis (2000). Neurophysiol Clin Neurophysiol. 2000;30[5]:263–88.
  6. 6. Morton DL, Sandhu JS, Jones AKP. Brain imaging of pain: State of the art. J Pain Res. 2016;9:613–24. pmid:27660488
  7. 7. Witting N, Kupers RC, Svensson P, Jensen TS. A PET activation study of brush-evoked allodynia in patientswith nerve injury pain. Pain. 2006;120[1]:145–54.
  8. 8. Baliki MN, Geha PY, Apkarian AV, Chialvo DR. Beyond feeling: chronic pain hurts the brain, disrupting the default-mode network dynamics. J Neurosci. 2008 Feb 6;28[6]:1398–403. pmid:18256259
  9. 9. Tagliazucchi E, Balenzuela P, Fraiman D, Chialvo DR. Brain resting state is disrupted in chronic back pain patients. Neurosci Lett. 2010;485[1]:26–31. pmid:20800649
  10. 10. Malinen S, Vartiainen N, Hlushchuk Y, Koskinen M, Ramkumar P, Forss N, et al. Aberrant temporal and spatial brain activity during rest in patients with chronic pain. Proc Natl Acad Sci U S A. National Academy of Sciences; 2010 Apr 6;107[14]:6493–7. pmid:20308545
  11. 11. Kim J-Y, Kim S-H, Seo J, Kim S-H, Han SW, Nam EJ, et al. Increased power spectral density in resting-state pain-related brain networks in fibromyalgia. PAIN®. 2013;154[9]:1792–7.
  12. 12. González-Roldán AM, Cifre I, Sitges C, Montoya P, Clauw D, Williams D, et al. Altered Dynamic of EEG Oscillations in Fibromyalgia Patients at Rest. Pain Med. 2016 Feb 26;17[6]:224–224.
  13. 13. Duschek S, Hellmann N, Merzoug K, Reyes del Paso GA, Werner NS. Cerebral Blood Flow Dynamics During Pain Processing Investigated by Functional Transcranial Doppler Sonography. Pain Med. Blackwell Publishing Inc; 2012 Mar 1;13[3]:419–26. pmid:22299810
  14. 14. Duschek S, Mannhart T, Winkelmann A, Merzoug K, Werner NS, Schuepbach D, et al. Cerebral Blood Flow Dynamics During Pain Processing in Patients With Fibromyalgia Syndrome. Psychosom Med. 2012 Oct;74[8]:802–9. pmid:23006430
  15. 15. Montoro CI, Duschek S, Muñoz Ladrón de Guevara C, Reyes Del Paso GA, Muñoz Ladron de Guevara C, Reyes Del Paso GA. Patterns of Cerebral Blood Flow Modulation During Painful Stimulation in Fibromyalgia: A Transcranial Doppler Sonography Study. Pain Med. 2016;17[12]:2256–67. pmid:28025360
  16. 16. Stroobant N, Vingerhoets G. Transcranial Doppler Ultrasonography Monitoring of Cerebral Hemodynamics During Performance of Cognitive Tasks: A Review. Neuropsychol Rev. Kluwer Academic Publishers-Plenum Publishers; 2000;10[4]:213–31. pmid:11132101
  17. 17. Duschek S, Schandry R. Functional transcranial Doppler sonography as a tool in psychophysiological research. Psychophysiology. Blackwell Publishing; 2003 May;40[3]:436–54. pmid:12946117
  18. 18. Montoro CI, Duschek S, Muñoz Ladrón de Guevara C, Fernández-Serrano MJ, Reyes del Paso GA. Aberrant cerebral blood flow responses during cognition: Implications for the understanding of cognitive deficits in fibromyalgia. Neuropsychology. American Psychological Association; 2015;29[2]:173–82. pmid:25151113
  19. 19. Reyes del Paso GA, Montoro CI, Duschek S. Reaction time, cerebral blood flow, and heart rate responses in fibromyalgia: Evidence of alterations in attentional control. J Clin Exp Neuropsychol. Routledge; 2015 Apr 21;37[4]:414–28. pmid:25825849
  20. 20. Deppe M, Knecht S, Henningsen H, Ringelstein EB. AVERAGE: a Windows program for automated analysis of event related cerebral blood flow. J Neurosci Methods. 1997 Aug 22;75[2]:147–54. pmid:9288646
  21. 21. Rey B, Naranjo V, Parkhutik V, Tembl J, Alcañiz M. A new visually evoked cerebral blood flow response analysis using a low-frequency estimation. Ultrasound Med Biol. 2010 Mar;36[3]:383–91. pmid:20133037
  22. 22. Sejdić E, Kalika D, Czarnek N, Paulson O, Hasselbalch S, Rostrup E, et al. An Analysis of Resting-State Functional Transcranial Doppler Recordings from Middle Cerebral Arteries. Paul F, editor. PLoS One. Public Library of Science; 2013 Feb 6;8[2]:e55405. pmid:23405146
  23. 23. Huang H. Characterization of anterior cerebral artery blood flow in resting state by using transcranial Doppler Recordings in Electrical Engineering, University of Pittsburgh, 2012 Submitted to the Graduate Faculty of the Swanson School o. 2013;
  24. 24. Huang H, Sejdić E. Assessment of Resting-State Blood Flow Through Anterior Cerebral Arteries Using Trans-cranial Doppler Recordings. Ultrasound Med Biol. 2013;39[12]:2285–94. pmid:24120413
  25. 25. Deppe M, Ringelstein EB, Knecht S. The investigation of functional brain lateralization by transcranial Doppler sonography. Neuroimage. 2004;21[3]:1124–46. pmid:15006680
  26. 26. Reyes Del Paso GA, Garrido S, Pulgar A, Martín-Vázquez M, Duschek S. Aberrances in autonomic cardiovascular regulation in fibromyalgia syndrome and their relevance for clinical pain reports. Psychosom Med. 2010 Jun;72[5]:462–70. pmid:20467004
  27. 27. Montoya P, Sitges C, García-Herrera M, Izquierdo R, Truyols M, Blay N, et al. Abnormal Affective Modulation of Somatosensory Brain Processing Among Patients With Fibromyalgia. Psychosom Med. 2005;67[6]:957–63. pmid:16314601
  28. 28. Spielberger, C. D., Gorsuch, R. L., & Lushene RE. Manual for the state-trait inventory. Consulting Psychologists, Palo Alto, California. 1970.
  29. 29. Oldfield RC. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia. 1971;9[1]:97–113. pmid:5146491
  30. 30. Bryden MP. Measuring handedness with questionnaires. Neuropsychologia. 1977;15[4]:617–24.
  31. 31. Sanz J, Vazquez C. Adaptación española del Inventario para la psicométricas en estudiantes universitarios. Análisis y Modif Conduct. 2003;29[124]:239–88.
  32. 32. Kerns RD, Turk DC, Rudy TE. The West Haven-Yale Multidimensional Pain Inventory (WHYMPI). Pain. 1985 Dec;23[4]:345–56. pmid:4088697
  33. 33. Ferrer V, González-Barrón R, Manassero MA. El West Haven Yale Multidimensional Pain Questionnaire: un instrumento para evaluar al paciente con dolor cr’onico. Dolor Investig Clínica y Ter. 1993;8[JANUARY]:153–60.
  34. 34. Delamillieure P, Doucet G, Mazoyer B, Turbelin MR, Delcroix N, Mellet E, et al. The resting state questionnaire: An introspective questionnaire for evaluation of inner experience during the conscious resting state. Brain Res Bull. 2010;81[6]:565–73. pmid:20003916
  35. 35. Duschek S, Schuepbach D, Doll A, Werner NS, Reyes Del Paso GA. Self-regulation of cerebral blood flow by means of transcranial doppler sonography biofeedback. Ann Behav Med. 2011;41[2]:235–42. pmid:21061103
  36. 36. Porta A, Guzzetti S, Montano N, Pagani M, Somers V, Malliani A, et al. Information domain analysis of cardiovascular variability signals: Evaluation of regularity, synchronisation and co-ordination. Med Biol Eng Comput. Springer-Verlag; 2000 Mar;38[2]:180–8. pmid:10829411
  37. 37. Lempel A, Ziv J. On the Complexity of Finite Sequences. IEEE Trans Inf Theory. 1976 Jan;22[1]:75–81.
  38. 38. Aboy M, Hornero R, Abasolo D, Alvarez D. Interpretation of the Lempel-Ziv Complexity Measure in the Context of Biomedical Signal Analysis. IEEE Trans Biomed Eng. 2006 Nov;53[11]:2282–8. pmid:17073334
  39. 39. Abásolo D, Hornero R, Gómez C, García M, López M. Analysis of EEG background activity in Alzheimer’s disease patients with Lempel–Ziv complexity and central tendency measure. Med Eng Phys. 2006;28[4]:315–22. pmid:16122963
  40. 40. Porta A, Guzzetti S, Montano N, Furlan R, Pagani M, Malliani A, et al. Entropy, entropy rate, and pattern classification as tools to typify complexity in short heart period variability series. IEEE Trans Biomed Eng. 2001 Nov;48[11]:1282–91. pmid:11686627
  41. 41. Costa M, Goldberger AL, Peng C- K. Multiscale Entropy Analysis of Complex Physiologic Time Series. Phys Rev Lett. American Physical Society; 2002 Jul 19;89[6]:68102.
  42. 42. Bornas X, Llabrés J, Noguera M, López AM, Gelabert JM, Vila I. Fear induced complexity loss in the electrocardiogram of flight phobics: A multiscale entropy analysis. Biol Psychol. 2006;73[3]:272–9. pmid:16839658
  43. 43. Sejdić E, Steele CM, Chau T, Miller A, Logemann J, Steele C, et al. The effects of head movement on dual-axis cervical accelerometry signals. BMC Res Notes. BioMed Central; 2010;3[1]:269.
  44. 44. Kuo TB, Chern CM, Sheng WY, Wong WJ, Hu HH. Frequency domain analysis of cerebral blood flow velocity and its correlation with arterial blood pressure. J Cereb Blood Flow Metab. 1998 Mar;18[3]:311–8. pmid:9498848
  45. 45. Rosso OA, Blanco S, Yordanova J, Kolev V, Figliola A, Schürmann M, et al. Wavelet entropy: a new tool for analysis of short duration brain electrical signals. J Neurosci Methods. 2001;105[1]:65–75. pmid:11166367
  46. 46. Mclachlan GJ. Discriminant Analysis and Statistical Pattern Recognition. John Wiley & Sons, Inc., Hoboken, New Jersey.; 2004. 56 p.
  47. 47. Uçar M, Sarp Ü, Karaaslan Ö, Gül AI, Tanik N, Arik HO. Health anxiety and depression in patients with fibromyalgia syndrome. J Int Med Res. 2015;43[5]:679–85. pmid:26249741
  48. 48. Li M, Huang H, Boninger ML, Sejdić E. An analysis of cerebral blood flow from middle cerebral arteries during cognitive tasks via functional transcranial Doppler recordings. Neurosci Res. 2014;84:19–26. pmid:24583337
  49. 49. Davis KD. The neural circuitry of pain as explored with functional MRI. Neurol Res. 2000;22[3]:313–7. pmid:10769826
  50. 50. Craggs JG, Staud R, Robinson ME, Perlstein WM, Price DD. Effective connectivity among brain regions associated with slow temporal summation of C-fiber-evoked pain in fibromyalgia patients and healthy controls. J Pain. 2012;13[4]:390–400. pmid:22480771
  51. 51. Fallon N, Chiu Y, Nurmikko T, Stancak A. Functional connectivity with the default mode network is altered in fibromyalgia patients. PLoS One. 2016;11[7]:e0159198. pmid:27442504
  52. 52. Napadow V, LaCount L, Park K, As-Sanie S, Clauw DJ, Harris RE. Intrinsic brain connectivity in fibromyalgia is associated with chronic pain intensity. Arthritis Rheum. 2010;62[8]:2545–55. pmid:20506181
  53. 53. Li Y, Tong S, Liu D, Gai Y, Wang X, Wang J, et al. Abnormal EEG complexity in patients with schizophrenia and depression. Clin Neurophysiol. 2008;119[6]:1232–41. pmid:18396454
  54. 54. Méndez MA, Zuluaga P, Hornero R, Gómez C, Escudero J, Rodríguez-Palancas A, et al. Complexity analysis of spontaneous brain activity: effects of depression and antidepressant treatment. J Psychopharmacol. SAGE Publications; 2012 May;26[5]:636–43. pmid:21708836
  55. 55. Fingelkurts A, Fingelkurts A, Rytsälä H. Composition of brain oscillations in ongoing EEG during major depression disorder. Neuroscience. 2006;56[2]:133–44.
  56. 56. Zhang Y, Wang C, Sun C, Zhang X, Wang Y, Qi H, et al. Neural complexity in patients with poststroke depression: A resting EEG study. J Affect Disord. 2015;188:310–8. pmid:26402253
  57. 57. Reyes del Paso GA, Garrido S, Pulgar Á, Duschek S. Autonomic cardiovascular control and responses to experimental pain stimulation in fibromyalgia syndrome. J Psychosom Res. 2011;70[2]:125–34. pmid:21262414
  58. 58. Auer DP. Spontaneous low-frequency blood oxygenation level-dependent fluctuations and functional connectivity analysis of the “resting” brain. Magn Reson Imaging. 2008;26[7]:1055–64. pmid:18657923
  59. 59. de Boer RW, Karemaker J, Strackee J. Hemodynamic fluctuations and baroreflex sensitivity in humans: a beat-to-beat model. Am J Physiol. 1987;253[3]:H680–9.
  60. 60. Weisenberg M, Raz T, Hener T. The influence of film-induced mood on pain perception. Pain. 1998;76[3]:365–75. pmid:9718255
  61. 61. Meagher MW, Arnau RC, Rhudy JL. Pain and Emotion: Effects of Affective Picture Modulation. Psychosom Med. 2001;63[1]:79–90. pmid:11211069
  62. 62. Myrden AJB. Detecting and Classifying Cognitive Activity Based on Changes in Cerebral Blood Flow Velocity. Doctoral dissertation, University of Toronto; 2011.
  63. 63. Myrden AJB, Kushki A, Sejdić E, Guerguerian A- M, Chau T. A Brain-Computer Interface Based on Bilateral Transcranial Doppler Ultrasound. Cymbalyuk G, editor. PLoS One. Public Library of Science; 2011 Sep 7;6[9]:e24170. pmid:21915292
  64. 64. Aleem IS. Online Environmental Control of Multiple Devices using Transcranial Doppler (TCD) Ultrasonography. University of Toronto; 2012.
  65. 65. Lu J, Mamun KA, Chau T. Online transcranial Doppler ultrasonographic control of an onscreen keyboard. Front Hum Neurosci. Frontiers; 2014 Apr 22;8:199.