Correction
6 Jun 2024: Jiang X, Dahmani S, Bronshteyn M, Yang FN, Ryan JP, et al. (2024) Correction: Cingulate transcranial direct current stimulation in adults with HIV. PLOS ONE 19(6): e0305368. https://doi.org/10.1371/journal.pone.0305368 View correction
Figures
Abstract
Background
Neuronal dysfunction plays an important role in the high prevalence of HIV-associated neurocognitive disorders (HAND) in people with HIV (PWH). Transcranial direct current stimulation (tDCS)—with its capability to improve neuronal function—may have the potential to serve as an alternative therapeutic approach for HAND. Brain imaging and neurobehavioral studies provide converging evidence that injury to the anterior cingulate cortex (ACC) is highly prevalent and contributes to HAND in PWH, suggesting that ACC may serve as a potential neuromodulation target for HAND. Here we conducted a randomized, double-blind, placebo-controlled, partial crossover pilot study to test the safety, tolerability, and potential efficacy of anodal tDCS over cingulate cortex in adults with HIV, with a focus on the dorsal ACC (dACC).
Methods
Eleven PWH (47–69 years old, 2 females, 100% African Americans, disease duration 16–36 years) participated in the study, which had two phases, Phase 1 and Phase 2. During Phase 1, participants were randomized to receive ten sessions of sham (n = 4) or cingulate tDCS (n = 7) over the course of 2–3 weeks. Treatment assignments were unknown to the participants and the technicians. Neuropsychology and MRI data were collected from four additional study visits to assess treatment effects, including one baseline visit (BL, prior to treatment) and three follow-up visits (FU1, FU2, and FU3, approximately 1 week, 3 weeks, and 3 months after treatment, respectively). Treatment assignment was unblinded after FU3. Participants in the sham group repeated the study with open-label cingulate tDCS during Phase 2. Statistical analysis was limited to data from Phase 1.
Results
Compared to sham tDCS, cingulate tDCS led to a decrease in Perseverative Errors in Wisconsin Card Sorting Test (WCST), but not Non-Perseverative Errors, as well as a decrease in the ratio score of Trail Making Test—Part B (TMT-B) to TMT—Part A (TMT-A). Seed-to-voxel analysis with resting state functional MRI data revealed an increase in functional connectivity between the bilateral dACC and a cluster in the right dorsal striatum after cingulate tDCS. There were no differences in self-reported discomfort ratings between sham and cingulate tDCS.
Citation: Jiang X, Dahmani S, Bronshteyn M, Yang FN, Ryan JP, Gallagher RC Jr, et al. (2022) Cingulate transcranial direct current stimulation in adults with HIV. PLoS ONE 17(6): e0269491. https://doi.org/10.1371/journal.pone.0269491
Editor: Peter Schwenkreis, BG-Universitatsklinikum Bergmannsheil, Ruhr-Universitat Bochum, GERMANY
Received: October 24, 2021; Accepted: May 22, 2022; Published: June 3, 2022
Copyright: © 2022 Jiang et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: MRI data has been uploaded to OSF (https://osf.io/6nj3c/), and the neuropsychological data has been uploaded to PLOS ONE as a supporting data file in excel format.
Funding: This research was supported in part by Georgetown University Partners In Research Award, Georgetown University Lisa J. Raines Summer Research Fellowship, NIH 1R01MH108466, and NIH R56NS124422-01. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Despite largely successful peripheral viral suppression with combination antiretroviral treatment (cART), HIV-associated neurocognitive disorders (HAND) remain highly prevalent in people with HIV (PWH). In the cART era, neuronal dysfunction and synaptodendritic damage emerge as key mediators of cognitive decline/impairment in PWH [1–3]. Therefore, in addition to targeting neuroinflammation with enhancing cART, alternative approaches targeting neuronal/synaptodendritic function may have the potential to serve as therapeutic tools for HAND intervention and treatment.
Transcranial direct current stimulation (tDCS), a technique that safely and non-invasively modulates brain activity through a subthreshold shift of resting membrane potentials [4], has been shown to improve neuronal and synaptodendritic function [5, 6], suggesting that tDCS may have the potential to serve as an alternative approach for HAND intervention and treatment in PWH. In tDCS, the modulation effects are proposed to depend on polarity, i.e., an increase in excitability with anodal (positive) stimulation versus a decrease in excitability with cathodal (negative) stimulation [7], although this association is likely oversimplified, especially with regards to neurocognitive function [8]. Over the past two decades, there has been exponentially growing interest in applying tDCS to treat various psychiatric and neurological conditions. A comprehensive review concluded that tDCS is probably effective in treating fibromyalgia, depression, and addiction/craving [9]. The efficacy of tDCS in treating depression has been confirmed in a more recent review [10].
Compared to the large number of tDCS studies on many other neurological disorders, however, few studies have examined the effects of tDCS in HIV brain disease. To the best of our knowledge, there are six published works that investigated the safety and efficacy of tDCS in PWH. One open-label study examined the effects of tDCS in treating depression in PWH [11], and five single-blind studies investigated whether a combination of tDCS and cognitive training could improve cognitive performance in PWH [12–16]. In two studies with PWH participants who were older than 50 and met the Frascati criteria for HAND diagnosis, Ownby and colleagues investigated the effects of anodal tDCS over the left dorsal lateral prefrontal cortex (DLPFC) while participants were receiving a computer-based cognitive training [12, 16]. Subjectively, PWH who received active tDCS tended to rate the intervention trials more positively. However, objective neuropsychological tests did not find any significant difference between active and sham tDCS [12, 16]. In a series of tDCS studies combined with speed of processing training, Cody, Fazeli, Pope, Vance, and colleagues investigated the effects of anodal tDCS over the right DLPFC in older PWH (aged 50 and older) and age-matched HIV-uninfected controls: compared to sham tDCS, active tDCS led to a stronger improvement in psychomotor speed [15], cautious driving behavior [13], and oral reading [14] in both HIV-infected and HIV-uninfected adults. Overall, these findings are encouraging but also suggest a need for additional research, i.e., applying tDCS to different brain regions.
In this study, the anterior cingulate cortex (ACC) and the posterior cingulate cortex (PCC) were selected as the target regions for anodal tDCS neuromodulation, with a focus on the dorsal ACC (dACC). The selection of ACC as the primary target region was motivated by a neural model of HAND we recently proposed [17], which recognizes ACC as one of the most commonly affected brain regions in PWH and proposes an important role of ACC injury in HAND progression—suggesting that the ACC may serve as a potential therapeutic target for HAND intervention and/or treatment. The important role of ACC in HIV brain disease is supported by neurobehavioral and brain imaging studies in HIV: first, ACC injury in PWH has been detected using various brain imaging techniques, including structural MRI [17], task-based functional MRI (fMRI) [18], task-free fMRI [19] and perfusion MRI [20], proton magnetic resonance spectroscopy (MRS) [3, 21–23], and positron emission tomography (PET) [20, 24]; second, the high prevalence of executive deficits [25] and apathy [26]—both are known to involve the ACC [27–29]—provides additional evidence supporting the prevalence and importance of ACC injury in PWH. Furthermore, using invasive and non-invasive brain stimulation techniques (including deep brain stimulation, repetitive transcranial magnetic stimulation (rTMS), and tDCS), previous studies provided evidence suggesting that dACC stimulation might be effective in modulating brain/cognitive function [30–33] and emotional processes [34], as well as in treating disorders like obsessive compulsive disorder [35, 36]. Highly relevant to the present study, two previous studies found that one session of anodal tDCS stimulation (1.5–2 mA, 15–20 minutes) targeting the dACC was sufficient to induce detectable changes at a behavioral (“more efficient adjustments in decision‐making strategies” [33]) or neural level (neuronal signal related to “improved efficiency of neural resources for inhibitory control and error processing” [32]), providing further support for the present study. The posterior cingulate cortex (PCC) was selected as the secondary target region, as the PCC is a central hub of the default mode network (DMN) and both PCC and DMN have been frequently implicated in various neurodegenerative diseases [37, 38], including HAND [19, 39, 40].
Applying anodal tDCS over the ACC and the PCC, here we conducted a randomized, double-blind, partial crossover, and placebo-controlled pilot study to test the hypothesis that the cingulate cortex (especially the dACC) is a potential therapeutic target in adults with HIV. Neuropsychological and MRI data, along with self-reported discomfort ratings, were collected to test three predictions: i) cingulate tDCS is safe and well-tolerated in adults with chronic HIV-disease (primary goal); ii) cingulate tDCS might lead to improvements in cognitive function (secondary goal); and iii) cingulate tDCS might result in a change in brain structure and/or brain function (secondary goal).
Methods
Participants
Fifteen PWH from the greater Washington D.C. metropolitan area were enrolled into the study. Eleven of them finished the study prior to the COVID-19 pandemic (age 47–69 years old, 100% African American, 2 females) (Table 1 and S1 Table). One participant with MRI contraindications was excluded from the MRI portion of the study, but participated in all other aspects of the study (S1 Table). Written informed consent approved by the Institutional Review Board at Georgetown University Medical Center was obtained prior to enrollment. Medical data and other comorbidities such as substance abuse were assessed. Viral load and current CD4 counts were collected using their most recent medical records. CD4 nadir and estimated duration of HIV disease were collected through self-report.
Study design (randomized, double-blind, placebo-controlled, partial crossover)
There were two study phases: Phase 1, and Phase 2 (Fig 1A). During Phase 1, participants were randomized to receive active cingulate tDCS or sham tDCS (see Cingulate tDCS section below). Both involved 10 treatment sessions (one session per weekday) over the course of two to three weeks (11.7±1.7 weekdays). The treatment assignments were unknown to the participants and the technicians who administered tDCS (“double-blind”). Neuropsychological and MRI data were collected at four additional study visits to evaluate treatment effects, including one baseline visit (BL, prior to the first tDCS treatment session), and three follow-up visits (FU1/FU2/FU3, corresponding to ~1-week, ~3-week, and ~3-month after the last tDCS session, respectively).
(a) This partial crossover study had two study phases. During Phase 1, participants were randomly assigned to receive sham or cingulate tDCS based on age and sex at birth. The treatment assignments were unknown to the participants as well as the study team during Phase 1. There were ten tDCS treatment sessions, with one per weekday over the course of 2–3 weeks. Neuropsychology and MRI data were collected from four additional study visits, including one baseline visit prior to the first tDCS treatment session (BL) and three follow-up visits (FU1/FU2/FU3, which were approximately one-week, three-weeks, and three-months after the last tDCS treatment session, respectively). After the FU3 visit, the treatment assignments were unblinded. The study was finished for participants who received active cingulate tDCS during Phase 1. In contrast, participants who received sham tDCS during Phase 1 were invited back to participate in Phase 2 of the study (open-label cingulate tDCS treatment). The study design of Phase 2 was identical to that of Phase 1, except that FU3 from Phase 1 served as BL for Phase 2. (b) Model of the induced electrical field on a typical brain, shown as field intensity (V/m) irrespective of the direction of current flow (the range of field intensity: 0 to 0.43 V/m). (c) The locations of anodal and cathodal electrodes with a 2x2 high-definition tDCS setup, which were based on the simulations in (b). Electrode locations were based on the international 10–10 electroencephalography (EEG) system.
After the FU3 study visit, the treatment assignment of Phase 1 was unblinded. The study was finished for participants who received active cingulate tDCS, whereas participants who received sham tDCS were invited back to participate in Phase 2 of the study, which involved open label cingulate tDCS. The experimental design of Phase 2 was identical to that of Phase 1, except the FU3 study from Phase 1 served as the BL study visit for Phase 2 (Fig 1A).
Cingulate tDCS
Cingulate tDCS and sham tDCS were applied using a custom designed Soterix HD-tDCS- CT unit stimulator (Soterix Medical, Inc.) when participants were at rest. The stimulator consists of a current source powered by 9-Volt batteries, pre-programmed with >200 random treatment codes that can be used for studies with a double-blind stimulation design, such as Phase 1 of this study. Ag/AgCl sintered ring electrodes were used with electroconductive gel to make contact with the scalp. To target the ACC and the PCC regions, Soterix Medical Individualized Modeling Service (https://soterixmedical.com/research/software/modeling-service) was requested to develop an electrode montage to provide anodal stimulation to dACC and PCC, while minimizing possible inhibitory (cathodal) stimulation of potentially important structures in the fronto-parietal brain networks. Electrode locations are based on the international 10–10 electroencephalography (EEG) system. Based on finite element electrical field models (Fig 1B), the two anodal electrodes were placed at AFz and CPz, with two return (cathodal) electrodes at T7 and T8, respectively (Fig 1C). One participant reported a burning sensation at the CPz location after the first active tDCS session. The electrode was moved from CPz to Pz for the rest of nine active tDCS sessions and the participant reported no burning sensation after the switch.
In cingulate tDCS conditions, the current was ramped up to 1.5mA over 30sec, applied for 20 minutes, and then ramped down over 30sec [41, 42]. The dosage was based on the recommendations from an expert panel [43] and the findings from a comprehensive safety review study [44]. The sham tDCS stimulation consisted of an initial 30-second ramp-up to 1.5 mA, followed immediately by a 30-second ramp-down. No current was delivered until 19 minutes later, when another 30-second ramp-up began, followed by a 30-second ramp-down. The ramp up and down after 20 minutes simulates the change in sensation participants sometimes report during active tDCS as the current is ramped down at the end of treatment. All other procedures were identical between the sham and cingulate tDCS conditions. Usually, participants quickly acclimated to the tingling sensations of active tDCS, so sham tDCS was designed to generate these initial tingling sensations, then stop stimulation before delivery of clinically meaningful stimulation. After each sham or cingulate tDCS session, participants reported their discomfort ratings using the Wong-Baker FACES Pain Rating Scale (https://wongbakerfaces.org), then participated in an approximately 20-minute cognitive training session with various designs of cognitive control tasks that are known to engage the dACC region and other executive regions/networks, including go/no-go and task switch [18, 45]. For the purpose of generalizing training effects and stimulating the dACC and associated brain networks/regions, a total of five tasks with different experimental designs were implemented for cognitive training, including two go/no-go tasks (one with letters as the target/distractor; the other with colorful bars as the target/distractor), two tasks with switching-rules (one with line orientation task; the other with animal size task), and one verbal fluency task with alternating rules (i.e., alternating between semantic verbal fluency and letter verbal fluency). However, after each tDCS session, only one of the five tasks was administered. Therefore, with a total of five different tasks and a total of 10 tDCS sessions per study phase, each task was repeated twice during each study phase.
Neuropsychological testing
During the baseline study visit (BL) and the three follow-up study visits (FU1/FU2/FU3) within each study phase, participants underwent a comprehensive neuropsychological assessment comprised of 12 standardized tests that assessed seven neurocognitive domains that are often affected in PWH, including speed of information processing, verbal fluency, learning, delayed recall, executive function, working memory, and motor abilities. This neuropsychology battery was adopted from the CHARTER study [25] and has been used in our previous studies with larger sample sizes [46, 47]. Additionally, participants completed a modified version of the Lawton and Brody Activities of Daily Living questionnaire (1969) in which they self-reported any declines on everyday tasks (e.g., managing finances, managing medications, etc.). The comprehensive neuropsychology battery was administered to all but one participant (S1 and S2 Tables).
Based on the tDCS simulation data (Fig 1B) as well as the cognitive training after each tDCS session (see Cingulate tDCS section above), we limited statistical analyses to four test scores from three neuropsychology tests that have been widely used to assess executive function in PWH, including Wisconsin Card Sorting Test (WCST-64) (Perseverative Errors, and Non-Perseverative Errors), Stroop Color and Word Test (SCWT) (color-word score), and the ratio of Trail Making Test—Part B (TMT-B) to Trail Making Test—Part A (TMT-A) score. WCST is the most commonly used neuropsychological test to examine and assess frontal (including ACC) dysfunction. Compared to other common WCST measures such as Non-Perseverative Errors (or random errors), Perseverative Errors, in which participants continue to use the same old and incorrect strategy even after receiving negative feedback from the previous trial, are probably the best predictor of frontal/ACC dysfunction [48]. The SCWT is another widely used neuropsychological test to assess executive function, and the color-word score—measured as the number of correctly named ink-colors under the incongruent condition (i.e., the word “red” is printed in green)—is used to assess the ability to inhibit cognitive interference [49]. Compared to Trail Making Test–Part A (TMT-A), a set-switching component is added to the TMT-B to assess executive control and cognitive flexibility [50]. The ratio of time, TMT-B / TMT-A, was used in data analysis [51].
MRI data acquisition
Structural MRI and resting-state functional MRI (fMRI) were acquired at the local institute using a 3-Tesla Siemens Magnetom Trio with a 12-channel head coil or Prisma-Fit scanner with a 20-channel head coil with the same scanning parameters. Structural images were acquired with a 3D T1-weighted sequence (MPRAGE, magnetization prepared rapid acquisition gradient echo) with the following parameters: TR/TE = 1900/2.52ms, TI = 900ms, flip angle = 9°, 160 contiguous 1mm sagittal slices, FoV = 256x160x256mm, 1mm3 resolution. One run of resting state fMRI images was acquired with an echo-planar sequence with the following parameters: flip angle = 90°, TR/TE = 2040/29ms, FoV = 205mm (64×64 matrix), 35 interleaved axial slices (4mm thick, no gap; 3.2×3.2mm2 in plane resolution). There were 264 acquisitions, and the first 5 acquisitions were discarded prior to preprocessing. In previous studies [46, 47], we found that the scanner upgrade did not have a strong impact on structural and resting state fMRI data, and whether or not including the scanner type as a covariate did not change the conclusions of these studies. In addition, MRI data analyses were limited to participants who received active cingulate tDCS during Phase 1, and for these participants, the same scanner and head coil was used to acquire data at all four study visits (except two participants, s2 and s3, with whom the same scanner was used at BL, FU1, and FU2, but not at FU3). Therefore, the scanner status was not included as a covariate in data analyses, although we did conduct post-hoc analyses with scanner being included as a covariate, which produced similar results that led to the same conclusion.
MRI data preprocessing and analysis
MRI data preprocessing and analysis was performed using the SPM12 software package (https://www.fil.ion.ucl.ac.uk/spm/software/spm12/) and the CAT12 toolbox release 12.6 (http://dbm.neuro.uni-jena.de/cat/) in MATLAB (release 2018b, The MathWorks, Inc., Natick, Massachusetts, United States). Standard preprocessing procedures were used, including correction for bias-field inhomogeneities, denoising, skull-stripping, segmentation, and corrections for partial volume estimation. Segmentation output comprised GM, WM, and CSF tissue class volumes for each participant. Tissue class volumes were then used to spatially normalize all images to the template in standard Montreal Neurologic Institute (MNI) space. For GM volume-based analyses, normalized GM voxel values were modulated to preserve voxel-wise estimates of the absolute amount of tissue, then smoothed using a Gaussian kernel of 8mm FWHM prior to statistical analysis.
For resting-state fMRI, raw images were first preprocessed in SPM12. The preprocessing consisted of slice-timing correction, realignment, coregistration to structural volume, normalization based on structural normalization parameters obtained from CAT12, outlier identification, smoothing with an 8-mm FWHM. Then, normalized images were processed following the standard CONN pipeline [52], including movement regression, removal of signals from CSF and white matter, band passing [0.009 0.08] Hz, detrend, and a structural aCompCor strategy.
In addition, the software package FreeSurfer v6.0 (https://surfer.nmr.mgh.harvard.edu/) was used to extract cortical thickness estimates using the default longitudinal pipeline [53]. Briefly, an unbiased within-subject template space and image was created using robust, inverse consistent registration. Several processing steps, such as skull stripping, Talairach transforms, atlas registration as well as spherical surface maps and parcellations were then initialized with common information from the within-subject template, significantly increasing reliability and statistical power [53]. Thickness data were then smoothed using a 12mm FWHM kernel prior to statistical analysis.
Statistical analyses
Three comparisons were conducted independently to investigate treatment effects of active cingulate tDCS, including BL vs FU1, BL vs FU2, and BL vs FU3, respectively.
Neurobehavioral data were analyzed using a robust non-parametric equivalent of repeated-measures ANOVA for mixed factorial designs [54] as implemented in the R package “nparLD” [55]. We assessed the impact of tDCS treatment assignment on test scores across study visits for BL vs FU1, BL vs FU2, and BL vs FU3. For each of these 2x2 factorial models, ANOVA-type statistics were generated to test the null hypothesis of no whole-plot treatment effect, no time effect, and no interaction between these factors. Only the data from Phase 1 (“double-blind”) were analyzed (though the treatment assignments were already unblinded prior to data analysis). The data from Phase 2 were presented for illustration purposes only. Based on the tDCS simulation data (Fig 1B) as well as the cognitive training after each tDCS session (see above), we limited statistical analyses to four test scores from three neuropsychology tests that are designed to examine executive function, including Wisconsin Card Sorting Test (WCST) (Perseverative Errors, and Non-Perseverative Errors), Stroop Color and Word Test (SCWT) (color-word score), and the ratio score of TMT-B to TMT-A (ratio of total time). As a pilot study, all P values were reported without correction for multiple comparisons.
MRI data analyses were limited to the participants who received cingulate tDCS during Phase 1, as only two participants who received sham tDCS during Phase 1 had resting state fMRI data eligible for data analysis (S1 Table).
Gray matter volume (GMv) and cortical thickness data analyses were conducted within the CAT or FreeSurfer software package, respectively, using a longitudinal design. A voxel/vertex threshold of p<0.005 (uncorrected) along with a cluster threshold of p<0.05 (FWE corrected) was used in both GMv and cortical thickness data analyses.
For resting state fMRI data, seed-to-voxel functional connectivity (FC) analyses were performed to investigate the treatment effect using the dorsal ACC (bilateral, brainnetome atlas 179+180) and the PCC (bilateral, AAL) as the seed regions, respectively (thresholded at voxel-wise p<0.01 uncorrected, cluster-wise p<0.05 FDR corrected). For clusters that survived the threshold, we extracted the FCs between the clusters and the corresponding seed regions for all participants and all sessions.
Results
Participants
Seven participants received cingulate tDCS during Phase 1, and four participants received sham tDCS during Phase 1 then cingulate tDCS during Phase 2 of the study (Table 1 and S1 Table). Non-parametric t-tests implemented using the R package “nparcomp” [56] revealed no significant difference in demographics between the two participant groups.
In addition, there was no significant difference in self-reported discomfort ratings between sham and active cingulate tDCS during Phase 1, nor between sham tDCS during Phase 1 and active cingulate tDCS during Phase 2 (Table 1).
Neuropsychological data
For WCST Perseverative Errors (Fig 2A), non-parametric mixed-design ANOVAs revealed a significant interaction between treatment assignments and study visits for BL vs FU1 (F(1,8) = 6.842, p = 0.009) and BL vs FU2 (F(1,8) = 5.745, p = 0.017), but not for BL vs FU3 (F(1,8) = 2.955, p = 0.086). There were no significant main effects of study assignments (at least p>0.107) or study visits (at least p>0.379) for any of the three comparisons (BL vs FU1, BL vs FU2, or BL vs FU3). Post-hoc non-parametric pairwise comparisons revealed that both significant interactions were driven by a decrease in Perseverative Errors after active cingulate tDCS (BL vs FU1, p<0.001; BL vs FU2, p<0.001).
(a) Wisconsin Card Sorting Test (WCST) Perseverative Errors. (b) WCST Non-Perseverative Errors. (c) The ratio of Trail Making Test B (TMT-B) to Trail Making Test A (TMT-A). (d) Stroop Color and Word Test (SCWT) color-word. Left: tDCS (1st phase)–participants who received cingulate tDCS treatment during Phase 1; middle: sham (1st phase)–participants who received sham tDCS treatment during Phase 1; right: tDCS (2nd phase)–participants who received cingulate tDCS treatment during Phase 2. BL, baseline visit (prior to the first treatment sessions); FU1/FU2/FU3, follow-up visit 1, 2, 3 after the last treatment session, respectively. For participants who received sham tDCS during Phase 1, data from FU3 of Phase 1 were used as BL for Phase 2. Markers represent individual participants. Bars represent group average at each study phase. Error bars represent standard deviation. See Supplementary Materials for the complete test scores of all neuropsychology tests.
For WCST Non-Perseverative Errors (Fig 2B), there were no significant effects of study assignments (at least p>0.353), study visits (at least p>0.417), or interactions between the two factors (at least p>0.301), for any of the three comparisons (BL vs FU1, BL vs FU2, and BL vs FU3).
For the ratio of TMT-B to TMT-A score (Fig 2C), there was a significant interaction between treatment assignments and study visits for BL vs FU1 (F(1,8) = 5.379, p = 0.020), but not for BL vs FU2 (F(1,8) = 2.606, p = 0.106) or BL vs FU3 (F(1,8) = 3.237, p = 0.072). There was a significant main effect of study assignments for BL vs FU2 (F(1,8) = 6.112, p = 0.013) and BL vs FU3 (F(1,8) = 4.422, p = 0.035), but not for BL vs FU1 (F(1,8) = 1.976, p = 0.160). There were no significant main effects of study visits (at least p>0.841) for any of the three comparisons (BL vs FU1, BL vs FU2, or BL vs FU3).
For SCWT Color-Word score (Fig 2D), there were no significant effects of study assignments (at least p>0.335), study visits (at least p>0.071), or interactions between the two factors (at least p>0.787), for any of the three comparisons (BL vs FU1, BL vs FU2, and BL vs FU3).
In addition, using the output from the nparLD package, we calculated the time (post- vs pre-treatment) x condition (sham vs active tDCS) effect sizes (epsilon-squared [57]) for all three comparisons (BL vs FU1, BL vs FU2, and BL vs FU3) and for all neuropsychological test scores listed above (Fig 3, Phase 1 only). The epsilon-squared effect sizes for WCST Perseverative Errors were greater than 0.14 (which denotes a large effect size) at all three comparisons (BL vs FU1, BL vs FU2, and BL vs FU3). Effect sizes for the ratio of TMT-B to TMT-A score were large (ε2> = 0.14) at the comparison of BL vs FU1 and BL vs FU3, but not BL vs FU2.
Separate mixed-design ANOVAs were performed in order to estimate the effect size for the time x condition interaction term at each level of comparison for each neuropsychology test score of interest.
Structural MRI and resting state Functional Connectivity (FC)
There were no significant changes in gray matter volume or cortical thickness after cingulate tDCS treatment.
Using the bilateral dACC as the seed region, seed-to-voxel analysis on 7 participants who received cingulate tDCS during Phase 1 with the contrast of BL vs FU1 revealed a cluster at the right dorsal striatum (MNI: [18 2 12], 1936 mm3) (Fig 4A). However, there were no significant results for the comparisons of BL vs FU2 or BL vs FU3. In addition, there were no significant results with the bilateral PCC as the seed region for any of the three comparisons.
(a) Seed-to-voxel FC analysis was limited to participants who received active cingulate tDCS treatment during Phase 1. The bilateral dACC as the seed region revealed increased FC between the dACC and a cluster in the right dorsal striatum using the contrast of FU1 versus BL (MNI: [18 2 12], p < .05, FDR cluster-level correction). (b) The FCs between the bilateral dACC and the right dorsal striatum cluster (FCdACC-rStriatum) from all participants (markers represent individual participants in the same order as in Fig 2). Note there were no WCST data from subject s11, no MRI data from s7 due to MRI contraindications, and no FC data from s10 due to excessive head movement (S1 Table). Error bars represent standard deviation. (c) The correlations between changes in FCdACC-rStriatum and changes in WCST Perseverative Errors during Phase 1 of the study. Red, FU1 vs BL; Green, FU2 vs BL; Blue, FU3 vs BL; *, participants who received active cingulate tDCS during Phase 1; o, participants who received sham tDCS during Phase 1.
Next, we extracted the FCs between the dACC and the right dorsal striatum cluster (FCdACC-rStriatum) from all participants and all visits (BL, FU1, FU2, FU3), including Phase 2 (if applicable) (Fig 4B). The potential associations between changes in WCST Perseverative Errors and changes in FCdACC-rStriatum (FU1 vs BL, FU2 vs BL, and FU3 vs BL from Phase 1) were also examined. At all three follow-up visits (FU1, FU2, and FU3), the changes (compared to the baseline visit) in FCdACC-rStriatum tended to correlate with the changes in WCST Perseverative Errors (Fig 4C).
Discussion
In this randomized, “double-blind”, placebo-controlled, partial crossover cingulate tDCS pilot study, we examined the safety and potential efficacy of anodal tDCS neuromodulations over the dorsal ACC (dACC) and the PCC in adults with chronic HIV-disease.
The primary goal of this pilot study was to investigate the safety and tolerability of cingulate tDCS in PWH. Compared to other invasive (i.e., deep brain stimulation) and non-invasive (i.e., rTMS) brain stimulation techniques, tDCS is appreciated for its safety [44, 58, 59] and tolerability [59, 60]. In this pilot study, only one participant reported a burning sensation at one electrode location (CPz) after the first active tDCS session and the burning sensation went away after the anodal electrode was moved from CPz to Pz. In addition, self-reported discomfort ratings using the Wong-Baker FACES Pain Scale were comparable between participants who received sham tDCS and participants who received active cingulate tDCS (both during Phase 1), and between sham tDCS and active cingulate tDCS in participants who received both (sham tDCS during Phase 1 and active tDCS during Phase 2) (Table 1). Taken together, these data suggest that the current cingulate tDCS setup (1.5 mA anodal tDCS over dACC and PCC) is safe and can be well-tolerated by adults with chronic HIV-disease.
The secondary goal of this pilot study was to examine the potential effects of cingulate tDCS on improving cognitive function, with a focus on executive function, which is one of the most commonly affected cognitive domains in PWH in the cART era [25]. Of the four test scores from three standard neuropsychology tests that have been widely used to assess executive function (Fig 2), we found a significant interaction between treatment assignments (sham versus active cingulate tDCS) and study visits (BL vs FU1, and BL vs FU2) on WCST Perseverative Errors performance, suggesting that active cingulate tDCS may have led to a decrease in WCST Perseverative Errors, indicating an improvement in cognitive flexibility, an important component of executive functions. This notion is further supported by a similar but slightly weaker effect with the TMT-B / TMT-A ratio score–another measure of cognitive flexibility and executive control [50, 61]. Brain imaging [62] and brain lesions studies [63, 64] have provided converging evidence supporting an important role of dACC (in addition to DLPFC, especially the right DLPFC) in performing WCST, especially with regards to Perseverative Errors [63, 64], suggesting that the decrease in WCST Perseverative Errors might reflect an improvement in dACC neuronal function after cingulate tDCS. This hypothesis is supported by findings from previous magnetic resonance spectroscopy (MRS) studies. First, NAA is located exclusively in neurons and their processes; a decrease in NAA is believed to reflect either permanent neuronal loss or reversible neuronal/axonal dysfunction [65], suggesting that NAA concentrations might serve as a marker of neuronal/synaptodendritic injury in neurological diseases, including HAND [3]. Second, a previous study found that five consecutive sessions of anodal tDCS (2 mA) over dACC in adults with spinal cord injury led to a significant decrease in neuropathic pain, which negatively correlated with a significant increase in the concentrations of NAA (and glutamate/glutamine (Glx)) in the dACC–suggesting that anodal tDCS over the dACC might be effective in improving dACC neuronal function (i.e., an increase in dACC NAA concentrations) [66]. Third, in another study using high frequency (15 Hz) rTMS in adults with drug-resistant major depressive disorders [31], twenty sessions of rTMS over the left DLPFC led to a decrease in WCST Perseverative Errors and an increase in NAA concentrations in the dACC, and crucially, the changes in the two measures strongly correlated with each other, suggesting that a decrease in WCST Perseverative Errors might be attributed to an increase in dACC NAA, at least partially. Taken together, these findings support the notion that cingulate tDCS with the current setup (Fig 1C) may be effective in improving dACC neuronal function (i.e., an increase in dACC NAA), which in turn may lead to an improvement in cognitive flexibility–as supported by reduced WCST Perseverative Errors and a decrease in the ratio score of TMT-B / TMT-A. This notion can be directly tested in a future MRS study using a similar tDCS design.
In addition to directly modulating neuronal function within the stimulated brain region(s) (i.e., dACC), tDCS may impact/improve the functional brain networks associated with the stimulated brain region(s) [67, 68]. Indeed, a seed-to-voxel analysis revealed an increase in FC between the dACC and the right dorsal striatum (FCdACC-rStriatum) after cingulate tDCS (Fig 4A). This finding—while preliminary due to the small sample size (n = 7)—is interesting. As part of the corticostriatal circuitry, the extensive projections from the dACC to the dorsal striatum are well-established [69] and supported by data from diffusion tensor imaging [70] and resting state functional connectivity studies [71, 72]. Furthermore, a previous study found that the resting state FC between the dACC and the dorsal caudate negatively correlated with WCST Perseverative Errors in healthy adults [73], suggesting that effective communication between the dACC and the dorsal striatum is important to efficiently adjust response strategy (i.e., after receiving a negative feedback), probably by modulating neuronal activity in the dorsal striatum [74]. Therefore, the cingulate tDCS-induced increase in FCdACC-rStriatum in this study might reflect an improved communication between the dACC and the dorsal striatum, which in turn contributed to the reduced WCST Perseverative Errors (Fig 4C), providing further evidence suggesting that, even though the location of stimulation with tDCS cannot be finely controlled and is never focal (Fig 1B), the current tDCS setup was effective in modulating/improving dACC function and may have the potential to improve brain function in PWH.
This study has several limitations. First, as a pilot study with a small sample size, this study lacks the power to determine the efficacy of cingulate tDCS; therefore, the preliminary findings with resting state FC as well as WCST and Trail Making Tests scores—while they are encouraging—should be taken with caution as a less stringent statistical approach was used (i.e., there was no correction for multiple comparisons for neuropsychological data analyses), which could lead to an increase in false positives. Nevertheless, the effect sizes in Fig 3 could be used to design a larger study that is powered to test for efficacy of this treatment approach. Second, other factors might also contribute to the observed improvement in neuropsychological test scores (i.e., reduced WCST Perseverative Errors as well as a decrease in TMT-B / TMT-A ratio), including a practice effect due to repeated administration of these neuropsychological tests, and/or the targeted cognitive training after each tDCS session. Third, due to the budget constraint, we used a partial crossover study design instead of a full crossover design, and the Phase 2 of the study was an open-label study that might have biased the results, though we did not include Phase 2 data in statistical analysis. Fourth, the demographics of the study sample might make it difficult to generalize the findings to the HIV+ community at large, i.e., all participants were African Americans with chronic HIV-disease (disease duration ranging from 16–36 years) and the vast majority of them were males (9 out of 11) and older than 54 (10 out of 11). However, it is of a significant interest to investigate whether the current tDCS setup may benefit HIV-infected youth, who are impaired in executive domains, “particularly in cognitive flexibility and inhibition” [75]. Future studies with a larger and more balanced (i.e., age, race, sex/gender, disease duration, etc.) sample, along with a double-blind and full crossover study design, are necessary to adequately assess the safety and efficacy of anodal tDCS over dACC and PCC on brain structure and function in PWH.
In summary, for adults with chronic HIV disease, anodal tDCS neuromodulation over the dACC and the PCC is safe and can be well-tolerated, and may have the potential to improve brain and cognitive function.
Supporting information
S1 Table. Demographics and treatment assignments of each individual participant.
https://doi.org/10.1371/journal.pone.0269491.s001
(DOCX)
Acknowledgments
We wish to thank all participants for their time and participation, Abhishek Datta from the Soterix Medical Inc for providing the electrical field modeling figure, Maryam Ghaleh for helping with the tDCS experiment, and the assistance for patient care from the Georgetown University Clinical Research Unit (GU-CRU).
References
- 1. Ellis R, Langford D, Masliah E. HIV and antiretroviral therapy in the brain: neuronal injury and repair. Nature reviews Neuroscience. 2007;8: 33–44. pmid:17180161
- 2. Irollo E, Luchetta J, Ho C, Nash B, Meucci O. Mechanisms of neuronal dysfunction in HIV-associated neurocognitive disorders. Cell Mol Life Sci. 2021;78: 4283–4303. pmid:33585975
- 3. Dahmani S, Kaliss N, VanMeter JW, Moore DJ, Ellis RJ, Jiang X. Alterations of Brain Metabolites in Adults With HIV: A Systematic Meta-analysis of Magnetic Resonance Spectroscopy Studies. Neurology. 2021;97: e1085–e1096. pmid:34253633
- 4. Stagg CJ, Nitsche MA. Physiological basis of transcranial direct current stimulation. Neuroscientist. 2011;17: 37–53. pmid:21343407
- 5. Jackson MP, Rahman A, Lafon B, Kronberg G, Ling D, Parra LC, et al. Animal models of transcranial direct current stimulation: Methods and mechanisms. Clin Neurophysiol. 2016;127: 3425–3454. pmid:27693941
- 6. Stagg CJ, Antal A, Nitsche MA. Physiology of Transcranial Direct Current Stimulation. J ECT. 2018;34: 144–152. pmid:29877965
- 7. Nitsche MA, Paulus W. Excitability changes induced in the human motor cortex by weak transcranial direct current stimulation. The Journal of physiology. 2000;527 Pt 3: 633–9.
- 8. Jacobson L, Koslowsky M, Lavidor M. tDCS polarity effects in motor and cognitive domains: a meta-analytical review. Exp Brain Res. 2012;216: 1–10. pmid:21989847
- 9. Lefaucheur J-P, Antal A, Ayache SS, Benninger DH, Brunelin J, Cogiamanian F, et al. Evidence-based guidelines on the therapeutic use of transcranial direct current stimulation (tDCS). Clin Neurophysiol. 2017;128: 56–92. pmid:27866120
- 10. Fregni F, El-Hagrassy MM, Pacheco-Barrios K, Carvalho S, Leite J, Simis M, et al. Evidence-Based Guidelines and Secondary Meta-Analysis for the Use of Transcranial Direct Current Stimulation in Neurological and Psychiatric Disorders. Int J Neuropsychopharmacol. 2021;24: 256–313. pmid:32710772
- 11. Knotkova H, Rosedale M, Strauss SM, Horne J, Soto E, Cruciani RA, et al. Using Transcranial Direct Current Stimulation to Treat Depression in HIV-Infected Persons: The Outcomes of a Feasibility Study. Frontiers in psychiatry. 2012;3: 59. pmid:22719732
- 12. Ownby RL, Acevedo A. A pilot study of cognitive training with and without transcranial direct current stimulation to improve cognition in older persons with HIV-related cognitive impairment. Neuropsychiatric disease and treatment. 2016;12: 2745–2754. pmid:27822047
- 13. Pope CN, Stavrinos D, Vance DE, Woods AJ, Bell TR, Ball KK, et al. A pilot investigation on the effects of combination transcranial direct current stimulation and speed of processing cognitive remediation therapy on simulated driving behavior in older adults with HIV. Transp Res Part F Traffic Psychol Behav. 2018;58: 1061–1073. pmid:31354384
- 14. Fazeli PL, Woods AJ, Pope CN, Vance DE, Ball KK. Effect of transcranial direct current stimulation combined with cognitive training on cognitive functioning in older adults with HIV: A pilot study. Appl Neuropsychol Adult. 2019;26: 36–47. pmid:29020472
- 15. Cody SL, Fazeli PL, Crowe M, Kempf M-C, Moneyham L, Stavrinos D, et al. Effects of speed of processing training and transcranial direct current stimulation on global sleep quality and speed of processing in older adults with and without HIV: A pilot study. Appl Neuropsychol Adult. 2020;27: 267–278. pmid:30652949
- 16. Ownby RL, Kim J. Computer-Delivered Cognitive Training and Transcranial Direct Current Stimulation in Patients With HIV-Associated Neurocognitive Disorder: A Randomized Trial. Front Aging Neurosci. 2021;13: 766311. pmid:34867291
- 17. Israel SM, Hassanzadeh‐Behbahani S, Turkeltaub PE, Moore DJ, Ellis RJ, Jiang X. Different roles of frontal versus striatal atrophy in HIV-associated neurocognitive disorders. Human Brain Mapping. 2019;40: 3010–3026. pmid:30921494
- 18. Jiang X, Barasky R, Olsen H, Riesenhuber M, Magnus M. Behavioral and neuroimaging evidence for impaired executive function in “cognitively normal” older HIV-infected adults. AIDS Care. 2016;28: 436–440. pmid:26573559
- 19. Abidin AZ, DSouza AM, Schifitto G, Wismüller A. Detecting cognitive impairment in HIV-infected individuals using mutual connectivity analysis of resting state functional MRI. J Neurovirol. 2020;26: 188–200. pmid:31912459
- 20. Towgood KJ, Pitkanen M, Kulasegaram R, Fradera A, Soni S, Sibtain N, et al. Regional cerebral blood flow and FDG uptake in asymptomatic HIV-1 men. Hum Brain Mapp. 2013;34: 2484–2493. pmid:22496057
- 21. Taylor MJ, Schweinsburg BC, Alhassoon OM, Gongvatana A, Brown GG, Young-Casey C, et al. Effects of human immunodeficiency virus and methamphetamine on cerebral metabolites measured with magnetic resonance spectroscopy. J Neurovirol. 2007;13: 150–159. pmid:17505983
- 22. Bladowska J, Zimny A, Kołtowska A, Szewczyk P, Knysz B, Gąsiorowski J, et al. Evaluation of metabolic changes within the normal appearing gray and white matters in neurologically asymptomatic HIV-1-positive and HCV-positive patients: magnetic resonance spectroscopy and immunologic correlation. Eur J Radiol. 2013;82: 686–692. pmid:23246331
- 23. Boban J, Thurnher MM, Brkic S, Lendak D, Bugarski Ignjatovic V, Todorovic A, et al. Neurometabolic Remodeling in Chronic Hiv Infection: a Five-Year Follow-up Multi-Voxel Mrs Study. Sci Rep. 2019;9: 19799. pmid:31875001
- 24. Garvey LJ, Pavese N, Politis M, Ramlackhansingh A, Brooks DJ, Taylor-Robinson SD, et al. Increased microglia activation in neurologically asymptomatic HIV-infected patients receiving effective ART. AIDS (London, England). 2014;28: 67–72. pmid:23887068
- 25. Heaton RK, Clifford DB, Franklin DR, Woods SP, Ake C, Vaida F, et al. HIV-associated neurocognitive disorders persist in the era of potent antiretroviral therapy. Neurology. 2010;75: 2087–2096. pmid:21135382
- 26. Walker KA, Brown GG. HIV-associated executive dysfunction in the era of modern antiretroviral therapy: A systematic review and meta-analysis. J Clin Exp Neuropsychol. 2017; 1–20. pmid:28689493
- 27. Shenhav A, Botvinick MM, Cohen JD. The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron. 2013;79: 217–240. pmid:23889930
- 28. Heilbronner SR, Hayden BY. Dorsal Anterior Cingulate Cortex: A Bottom-Up View. Annu Rev Neurosci. 2016;39: 149–170. pmid:27090954
- 29. Le Heron C, Apps M a. J, Husain M. The anatomy of apathy: A neurocognitive framework for amotivated behaviour. Neuropsychologia. 2018;118: 54–67. pmid:28689673
- 30. Hayward G, Goodwin GM, Harmer CJ. The role of the anterior cingulate cortex in the counting Stroop task. Exp Brain Res. 2004;154: 355–358. pmid:14666393
- 31. Zheng H, Jia F, Guo G, Quan D, Li G, Wu H, et al. Abnormal Anterior Cingulate N-Acetylaspartate and Executive Functioning in Treatment-Resistant Depression After rTMS Therapy. Int J Neuropsychopharmacol. 2015;18: pyv059. pmid:26025780
- 32. Verveer I, Hill AT, Franken IHA, Yücel M, van Dongen JDM, Segrave R. Modulation of control: Can HD-tDCS targeting the dACC reduce impulsivity? Brain Res. 2021;1756: 147282. pmid:33515536
- 33. Csifcsák G, Bjørkøy J, Kuyateh S, Reithe H, Mittner M. Transcranial direct current stimulation above the medial prefrontal cortex facilitates decision-making following periods of low outcome controllability. eNeuro. 2021 [cited 26 Aug 2021]. pmid:34433576
- 34. Harmer CJ, Thilo KV, Rothwell JC, Goodwin GM. Transcranial magnetic stimulation of medial-frontal cortex impairs the processing of angry facial expressions. Nat Neurosci. 2001;4: 17–18. pmid:11135640
- 35. De Ridder D, Leong SL, Manning P, Vanneste S, Glue P. Anterior Cingulate Implant for Obsessive-Compulsive Disorder. World Neurosurg. 2017;97: 754.e7–754.e16. pmid:27756670
- 36. Modirrousta M, Shams E, Katz C, Mansouri B, Moussavi Z, Sareen J, et al. The efficacy of deep repetitive transcranial magnetic stimulation over the medial prefrontal cortex in obsessive compulsive disorder: results from an open-label study. Depress Anxiety. 2015;32: 445–450. pmid:25826717
- 37. Leech R, Sharp DJ. The role of the posterior cingulate cortex in cognition and disease. Brain : a journal of neurology. 2014;137: 12–32. pmid:23869106
- 38. Hohenfeld C, Werner CJ, Reetz K. Resting-state connectivity in neurodegenerative disorders: Is there potential for an imaging biomarker? Neuroimage Clin. 2018;18: 849–870. pmid:29876270
- 39. Mohamed M, Barker PB, Skolasky RL, Sacktor N. 7T Brain MRS in HIV Infection: Correlation with Cognitive Impairment and Performance on Neuropsychological Tests. AJNR Am J Neuroradiol. 2018;39: 704–712. pmid:29449278
- 40. Popov M, Molsberry SA, Lecci F, Junker B, Kingsley LA, Levine A, et al. Brain structural correlates of trajectories to cognitive impairment in men with and without HIV disease. Brain Imaging Behav. 2020;14: 821–829. pmid:30623289
- 41. Lacey EH, Jiang X, Friedman RB, Snider SF, Parra LC, Huang Y, et al. Transcranial direct current stimulation for pure alexia: effects on brain and behavior. Brain Stimul. 2015;8: 305–307. pmid:25511797
- 42. DeMarco AT, Dvorak E, Lacey E, Stoodley CJ, Turkeltaub PE. An Exploratory Study of Cerebellar Transcranial Direct Current Stimulation in Individuals With Chronic Stroke Aphasia. Cogn Behav Neurol. 2021;34: 96–106. pmid:34074864
- 43. Fregni F, Nitsche MA, Loo CK, Brunoni AR, Marangolo P, Leite J, et al. Regulatory Considerations for the Clinical and Research Use of Transcranial Direct Current Stimulation (tDCS): review and recommendations from an expert panel. Clin Res Regul Aff. 2015;32: 22–35. pmid:25983531
- 44. Bikson M, Grossman P, Thomas C, Zannou AL, Jiang J, Adnan T, et al. Safety of Transcranial Direct Current Stimulation: Evidence Based Update 2016. Brain Stimulation. 2016;9: 641–661. pmid:27372845
- 45. Casey BJ, Trainor RJ, Orendi JL, Schubert AB, Nystrom LE, Giedd JN, et al. A Developmental Functional MRI Study of Prefrontal Activation during Performance of a Go-No-Go Task. J Cogn Neurosci. 1997;9: 835–847. pmid:23964603
- 46. Yang FN, Bronshteyn M, Flowers SA, Dawson M, Kumar P, Rebeck GW, et al. Low CD4+ cell count nadir exacerbates the impacts of APOE ε4 on functional connectivity and memory in adults with HIV. AIDS. 2021;35: 727–736. pmid:33587445
- 47. Bronshteyn M, Yang FN, Shattuck KF, Dawson M, Kumar P, Moore DJ, et al. Depression is associated with hippocampal volume loss in adults with HIV. Hum Brain Mapp. 2021;42: 3750–3759. pmid:34089276
- 48. Demakis GJ. A meta-analytic review of the sensitivity of the Wisconsin Card Sorting Test to frontal and lateralized frontal brain damage. Neuropsychology. 2003;17: 255–264. pmid:12803431
- 49. Scarpina F, Tagini S. The Stroop Color and Word Test. Front Psychol. 2017;8: 557. pmid:28446889
- 50. Arbuthnott K, Frank J. Trail making test, part B as a measure of executive control: validation using a set-switching paradigm. J Clin Exp Neuropsychol. 2000;22: 518–528. pmid:10923061
- 51. Corrigan JD, Hinkeldey NS. Relationships between parts A and B of the Trail Making Test. J Clin Psychol. 1987;43: 402–409. pmid:3611374
- 52. Whitfield-Gabrieli S, Nieto-Castanon A. Conn: a functional connectivity toolbox for correlated and anticorrelated brain networks. Brain connectivity. 2012;2: 125–41. pmid:22642651
- 53. Reuter M, Schmansky NJ, Rosas HD, Fischl B. Within-subject template estimation for unbiased longitudinal image analysis. Neuroimage. 2012;61: 1402–1418. pmid:22430496
- 54. Brunner E, Puri ML. Nonparametric methods in factorial designs. Statistical Papers. 2001;42: 1–52.
- 55. Noguchi K, Gel YR, Brunner E, Konietschke F. nparLD: An R Software Package for the Nonparametric Analysis of Longitudinal Data in Factorial Experiments. Journal of Statistical Software. 2012;50: 1–23.
- 56. Konietschke F, Placzek M, Schaarschmidt F, Hothorn LA. nparcomp: An R Software Package for Nonparametric Multiple Comparisons and Simultaneous Confidence Intervals. Journal of Statistical Software. 2015;64: 1–17.
- 57.
Sampling Characteristics of Kelley’s ε and Hays’ ω—Robert M. Carroll, Lena A. Nordholm, 1975. [cited 29 Mar 2022]. Available: https://journals.sagepub.com/doi/abs/10.1177/001316447503500304
- 58. Nikolin S, Huggins C, Martin D, Alonzo A, Loo CK. Safety of repeated sessions of transcranial direct current stimulation: A systematic review. Brain Stimul. 2018;11: 278–288. pmid:29169814
- 59. Buchanan DM, Bogdanowicz T, Khanna N, Lockman-Dufour G, Robaey P, D’Angiulli A. Systematic Review on the Safety and Tolerability of Transcranial Direct Current Stimulation in Children and Adolescents. Brain Sci. 2021;11: 212. pmid:33578648
- 60. Chhabra H, Bose A, Shivakumar V, Agarwal SM, Sreeraj VS, Shenoy S, et al. Tolerance of transcranial direct current stimulation in psychiatric disorders: An analysis of 2000+ sessions. Psychiatry Res. 2020;284: 112744. pmid:31955053
- 61. Kortte KB, Horner MD, Windham WK. The trail making test, part B: cognitive flexibility or ability to maintain set? Appl Neuropsychol. 2002;9: 106–109. pmid:12214820
- 62. Buchsbaum BR, Greer S, Chang W-L, Berman KF. Meta-analysis of neuroimaging studies of the Wisconsin card-sorting task and component processes. Hum Brain Mapp. 2005;25: 35–45. pmid:15846821
- 63. Stuss DT, Alexander MP. Executive functions and the frontal lobes: a conceptual view. Psychol Res. 2000;63: 289–298. pmid:11004882
- 64. Gläscher J, Adolphs R, Tranel D. Model-based lesion mapping of cognitive control using the Wisconsin Card Sorting Test. Nat Commun. 2019;10: 20. pmid:30604744
- 65. Moffett JR, Ross B, Arun P, Madhavarao CN, Namboodiri AMA. N-Acetylaspartate in the CNS: from neurodiagnostics to neurobiology. Prog Neurobiol. 2007;81: 89–131. pmid:17275978
- 66. Auvichayapat P, Keeratitanont K, Janyachareon T, Auvichayapat N. The effects of transcranial direct current stimulation on metabolite changes at the anterior cingulate cortex in neuropathic pain: a pilot study. J Pain Res. 2018;11: 2301–2309. pmid:30349356
- 67. Keeser D, Meindl T, Bor J, Palm U, Pogarell O, Mulert C, et al. Prefrontal transcranial direct current stimulation changes connectivity of resting-state networks during fMRI. J Neurosci. 2011;31: 15284–15293. pmid:22031874
- 68. Khan A, Wang X, Ti CHE, Tse C-Y, Tong K-Y. Anodal Transcranial Direct Current Stimulation of Anterior Cingulate Cortex Modulates Subcortical Brain Regions Resulting in Cognitive Enhancement. Front Hum Neurosci. 2020;14: 584136. pmid:33390917
- 69. Haber SN. Corticostriatal circuitry. Dialogues Clin Neurosci. 2016;18: 7–21. pmid:27069376
- 70. Beckmann M, Johansen-Berg H, Rushworth MFS. Connectivity-based parcellation of human cingulate cortex and its relation to functional specialization. J Neurosci. 2009;29: 1175–1190. pmid:19176826
- 71. Hoffstaedter F, Grefkes C, Caspers S, Roski C, Palomero-Gallagher N, Laird AR, et al. The role of anterior midcingulate cortex in cognitive motor control: evidence from functional connectivity analyses. Hum Brain Mapp. 2014;35: 2741–2753. pmid:24115159
- 72. Choi EY, Tanimura Y, Vage PR, Yates EH, Haber SN. Convergence of prefrontal and parietal anatomical projections in a connectional hub in the striatum. Neuroimage. 2017;146: 821–832. pmid:27646127
- 73. Tomiyama H, Nakao T, Murayama K, Nemoto K, Ikari K, Yamada S, et al. Dysfunction between dorsal caudate and salience network associated with impaired cognitive flexibility in obsessive-compulsive disorder: A resting-state fMRI study. Neuroimage Clin. 2019;24: 102004. pmid:31622840
- 74. Brockett AT, Tennyson SS, deBettencourt CA, Gaye F, Roesch MR. Anterior cingulate cortex is necessary for adaptation of action plans. Proc Natl Acad Sci U S A. 2020;117: 6196–6204. pmid:32132213
- 75. Hoare J, Phillips N, Joska JA, Paul R, Donald KA, Stein DJ, et al. Applying the HIV-associated neurocognitive disorder diagnostic criteria to HIV-infected youth. Neurology. 2016;87: 86–93. pmid:27206720