Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

More subjects are required for ventrolateral than dorsolateral prefrontal TMS because of intolerability and potential drop-out

  • Shuyan Han,

    Roles Conceptualization, Formal analysis, Investigation, Writing – original draft

    Affiliation Department of Neurophysiology, Juntendo University School of Medicine, Tokyo, Japan

  • Akitoshi Ogawa,

    Roles Conceptualization, Formal analysis, Investigation, Writing – original draft

    Affiliation Department of Neurophysiology, Juntendo University School of Medicine, Tokyo, Japan

  • Takahiro Osada,

    Roles Writing – original draft

    Affiliation Department of Neurophysiology, Juntendo University School of Medicine, Tokyo, Japan

  • Akimitsu Suda,

    Roles Investigation

    Affiliations Department of Neurophysiology, Juntendo University School of Medicine, Tokyo, Japan, Department of Neurology, Juntendo University School of Medicine, Tokyo, Japan

  • Masaki Tanaka,

    Roles Investigation

    Affiliation Department of Neurophysiology, Juntendo University School of Medicine, Tokyo, Japan

  • Hitoshi Nanjo,

    Roles Investigation

    Affiliation Department of Neurophysiology, Juntendo University School of Medicine, Tokyo, Japan

  • Yasushi Shimo,

    Roles Investigation

    Affiliation Department of Neurology, Juntendo University School of Medicine, Tokyo, Japan

  • Nobutaka Hattori,

    Roles Investigation

    Affiliation Department of Neurology, Juntendo University School of Medicine, Tokyo, Japan

  • Seiki Konishi

    Roles Conceptualization, Formal analysis, Writing – original draft

    skonishi@juntendo.ac.jp

    Affiliations Department of Neurophysiology, Juntendo University School of Medicine, Tokyo, Japan, Research Institute for Diseases of Old Age, Juntendo University School of Medicine, Tokyo, Japan, Sportology Center, Juntendo University School of Medicine, Tokyo, Japan, Advanced Research Institute for Health Science, Juntendo University School of Medicine, Tokyo, Japan

Abstract

Transcranial magnetic stimulation (TMS) of the human lateral prefrontal cortex, particularly the ventral region, often causes considerable discomfort to subjects. To date, in contrast to abundant literature on stimulations to the dorsolateral prefrontal cortex, the ventrolateral prefrontal cortex has been less frequently stimulated, partly because some subjects are intolerable of stimulation to the ventrolateral prefrontal cortex. To predict the additional number of subjects required for the stimulation of the dorsolateral and ventrolateral prefrontal cortices, 20 young healthy subjects reported two evaluation scores: the discomfort caused by TMS and the resulting intolerability to complete the TMS experiments. Single-pulse stimulation (SPS) or theta-burst stimulation (TBS) was administered to the lateral prefrontal cortex. The high-resolution extended 10–20 system was used to provide accurate estimation of the voxelwise scores. The discomfort ratings with the SPS and TBS were relatively higher in the ventrolateral prefrontal cortex than those in the dorsolateral prefrontal cortex. Both the SPS and TBS elicited maximal discomfort at the stimulation position F8. The SPS and TBS to F8 under the standard TMS protocols were intolerable for approximately one half (11 and 10, respectively) of the subjects. The intolerability was further calculated for all voxels in the lateral prefrontal cortex, which enabled us to estimate the additional number of subjects required for specific target areas. These results suggest that prior knowledge of subjects’ discomfort during stimulation of the lateral prefrontal cortex can be of practical use in the experimental planning of the appropriate number of recruited subjects and provide the database for the probability of intolerability that can be used to predict the additional number of subjects.

Introduction

Transcranial magnetic stimulation (TMS) of the lateral prefrontal cortex can be powerful in noninvasive studies of the causal relationship of brain regions with cognitive functions [18]. However, TMS research in the lateral prefrontal cortex is limited. Stimulation to the lateral prefrontal cortex often causes considerable discomfort to subjects [916] due to a greater density of muscles and nerves in the prefrontal regions [1719]. Stimulation of the dorsal region of the lateral prefrontal cortex has frequently been reported [2040], while fewer (approximately one-third, based on our PubMed search) studies have reported stimulation of the ventral region of the lateral prefrontal cortex [4148]. Stimulation of brain regions that tend to elicit discomfort appears nonpreferred, partly because some subjects are intolerant of stimulation to the brain regions. The intolerability of unpreferred brain region stimulation results in data loss of some subjects and, therefore, the loss of study power. However, prior knowledge of intolerability caused by stimulation is helpful in the experimental planning of the appropriate sample size.

Previous studies have performed detailed scalp mapping of discomfort using the standard 10–20 system during single-pulse stimulation (SPS) and have provided evidence that discomfort exerts small but significant delays in the reaction times of cognitive tasks [49, 50]. We extended the prior studies such that estimation of the additional number of subjects to be recruited in stimulating the lateral prefrontal cortex could be provided. Specifically, in the present study, subjects reported discomfort caused by TMS and the resulting intolerability to complete TMS experiments. Discomfort is a subjective feeling that makes an experiment difficult to continue, and intolerability is a result of discomfort that can be binarized regarding whether or not the experiment can be continued. In addition to SPS, which is the most basic stimulation, we also examined continuous theta-burst stimulation (TBS) [2, 51], which seems to be the most useful rTMS in studying cognitive functions because of the prevalence and reasonable duration of effects. Moreover, the high-resolution extended 10–20 system (10–10 system) [52, 53] was applied to the lateral prefrontal cortex, which can be used to estimate the discomfort and intolerability of stimulation of any region in the lateral prefrontal cortex.

Materials and methods

Subjects

Twenty right-handed subjects [10 men and 10 women; age: 26.0 ± 9.0 years (mean ± SD), ranging from 20 to 49] participated in the study. At least 20 samples are known to be required to minimize false positive observations [54]. Written informed consent was obtained from all subjects based on the guidelines of the Declaration of Helsinki. The experimental procedures were approved by the Institutional Review Board of Juntendo University School of Medicine. All raw data are uploaded as supplementary materials (S1 Dataset).

TMS procedures

TMS was administered using a hand-held figure-of-eight coil (7-cm diameter at each wing; The Magstim Company, Whitland, Dyfed, UK). Monophasic SPS and biphasic TBS [2, 51] were administered in the main experiments (Blocks 1 to 5) (Fig 1A). Prior to the main experiments, monophasic SPS was administered to determine the optimal stimulation site by searching likely regions for the optimal site and the resting motor threshold (RMT) for the right first dorsal interosseous (FDI) muscle [5557] for a later main experiment using SPS. The RMT was defined as the lowest intensity that evoked a small response (> 50 μV) in 5 or more (typically 5 or 6) of 10 consecutive trials in the relaxed FDI. Motor evoked potentials were recorded from the right FDI muscle using Ag/AgCl sheet electrodes placed over the muscle belly (active) and the metacarpophalangeal joint of the index finger (reference). The signals were sent to an amplifier (The Nihon Kohden Co., Tokyo, Japan) through filters set at 150 Hz to 3 kHz. Biphasic SPS was also conducted in a similar way to determine the optimal stimulation site and the active motor threshold (AMT) for the right FDI muscle for a later main experiment using TBS. The AMT was defined as the lowest intensity that evoked a small response (> 100 μV) in more than 5 of 10 consecutive trials when subjects maintained a slight contraction of the right FDI (10% of the maximum voluntary contraction determined after several trials). The intensity of TMS was not adjusted [5860] because the aim of the present study is to measure discomfort caused by stimulation of the nerves and muscles outside the brain rather than to investigate the effects of TMS on the brain and behavioral performance.

thumbnail
Fig 1. Experimental protocols of the TMS study.

(A) Four TMS stimulation conditions that were administered to subjects. After the measurement of the RMT and AMT, subjects received four types of stimulations in separate blocks. (B) High-resolution extended 10–20 system (11 stimulation positions) that covered the lateral prefrontal cortex. (C) Evaluation scores of discomfort and intolerability reported after each trial at each stimulation position. Discomfort was rated from 0 to 10, and intolerability was defined as “none,” “moderate” and “severe”.

https://doi.org/10.1371/journal.pone.0217826.g001

We used SPS in Blocks 1, 2 and 3 and TBS in Block 4 (Fig 1A). For TBS, 50 Hz triple-pulses were repeated at 5 Hz only for one second instead of the standard 40 seconds [2, 51] to minimize the total amount of stimulation at 11 stimulation positions. Four of the subjects were first examined for 1 second, 2 seconds and 40 seconds, and it was determined that the scores using 1 second were sufficiently similar to those using 40 seconds. The stimulation intensity in Block 1 was set to 30% of the maximum output of the stimulator (a sufficiently small intensity used in TMS studies), while that in Block 2 was set to 50% [50, 61]. In Blocks 3 and 4, the intensity was set individually at 120% RMT and 80% AMT of each subject. The monophasic RMT was 48.0 ± 6.8% (mean ± SD) of the maximum stimulator output, and the biphasic AMT was 35.8 ± 3.4%. After Block 4, in 10 of the 20 subjects who had sufficient additional time for the retest, one block was additionally administered as a retest of Block 2 using the same intensity (50%) as that in Block 2.

The scalp locations of the stimulation were measured and marked using the extended 10–20 system designed for electroencephalogram examination. Stimulations were administered to 11 electrode locations in the extended 10–20 system covering the prefrontal cortex of the right hemisphere, which implements response inhibition [56, 57, 62, 63] that we investigate using the present results (Fig 1B). In each block of the main experiments, stimulations were administered to each location in the predetermined order (Fp2, AF4, AF8, F8, F6, F4, F2, FC2, FC4, FC6 and FC8) for one-half of the subjects and in the reverse order for the other half of the subjects.

Evaluation scores

After each trial of SPS and TBS, the subjects were instructed to report the extent of discomfort they felt from the stimulation and the extent to which they could tolerate it (Fig 1C). Discomfort was evaluated using a numeric rating scale similar to the visual analogue score with a range from 0 to 10, where 0 represented that there was no discomfort at all, and 10 represented that discomfort was maximally severe to “complete the experiment.” In SPS, to “complete the experiment” meant to receive the stimulation every 30 s for one hour. In TBS, to “complete the experiment” meant to receive the stimulation continuously for 40 seconds, similar to the original protocol [2, 51]. The tolerability was evaluated using a three-level descriptive scale (“none,” “moderate,” and “severe”), in which “none” represented that no feeling of intolerance occurred, “moderate” represented that the stimulation was sensible but tolerable, and “severe” represented that the stimulation was intolerable and should be stopped immediately.

Online navigation

An online navigation system (TMS Navigator-SW, Localite GmbH, Germany) was used to enssure that the stimulation was administered at the accurate locations. The image data used for navigation were acquired using a 3-T MRI scanner and a 64-channel head coil (Siemens Prisma, Erlanger, Germany). T1-weighted structural images were obtained for anatomical reference (resolution = 0.8 × 0.8 × 0.8 mm3). The T1 images were registered to the subject’s head in space using a tracking device and navigation software. The position and orientation of the TMS coil were also registered to the subject’s head in space and were recorded during each time of stimulation.

Data analysis

Discomfort ratings in the dorsolateral vs. ventrolateral prefrontal cortex were tested using a paired t-test at a group level. The test-retest reproducibility of the discomfort ratings was examined using a correlation of the ratings across electrode positions at the test and retest for each subject, and the correlation coefficients were transformed to Fisher’s z and were tested using a paired t-test at a group level. The test-retest reproducibility of the intolerability ratings was examined by calculating the percentage of the test-retest matches for each subject and was evaluated using a nonparametric test (Wilcoxon signed-rank test) at a group level. Logistic regression analyses were performed to investigate the relationship between the discomfort rating (0 to 10) as an independent variable and the proportion of intolerability (“none,” “moderate,” or “severe”) as a dependent variable.

Interpolation to generate 3D probability maps

It would be helpful to predict the level of discomfort and tolerability at MNI coordinates of the voxels of interest in the lateral prefrontal cortex. We interpolated the evaluation scores collected at 11 stimulation positions and calculated the evaluation scores at all coordinates in the lateral prefrontal cortex. For the interpolation processing in a three-dimensional space, a stimulation line was defined. The stimulation line indicates the geometrical vector between the TMS coil and the target brain region, and the same discomfort and intolerability ratings were assigned along the stimulation line for each stimulation position, stimulus condition and subject. The predicted value Vpredict, of the discomfort or the intolerability was calculated for each voxel in the lateral prefrontal cortex by interpolating the values from the three nearest stimulation lines as follows: where V1, V2, and V3 are the original values of the 1st, 2nd, and 3rd nearest stimulation lines, respectively, and d1, d2, and d3 are the distances between the voxel and the 1st, 2nd, and 3rd lines, respectively. The maps of the predicted values calculated for each subject were normalized in the standard MNI space (ICBM152) and were averaged across subjects. Thus, the rating of discomfort could be predicted for each specific voxel, with a range from 0 to 10. Intolerability reports were transformed into binary values in the interpolation processing: “none” (no feeling of intolerance) or “moderate” (the stimulation was sensible but tolerable) as 0 and “severe” (the stimulation was intolerable and should be stopped immediately) as 1. Thus, the probability of a stimulation being intolerable at a voxel (0 to 1) could be predicted.

Results

Discomfort and intolerability

The ratings of discomfort induced by SPS and TBS were averaged across subjects for each stimulation position (Fig 2). In the SPS blocks (Blocks 1, 2 and 3), the overall rating increased with the stimulus intensity. The rating was relatively greater in the ventrolateral prefrontal cortex (Fp2, AF8, F8 and FC8) than that in the dorsolateral prefrontal cortex (F2, F4, FC2 and FC4) [t(19) = 8.6, P < 0.001], which is consistent with the smaller number of the extant TMS studies of the ventrolateral prefrontal cortex (approximately one-third, based on our PubMed search). S1 Fig shows the ratio of the increase in the TMS intensity to the level of discomfort and tolerability based on the results of 30% and 50% maximal output in SPS. In the TBS block (Block 4), the rating of discomfort was similar to Block 2 both in magnitude and spatial pattern [t(19) = 6.8, P < 0.001]. Both SPS and TBS elicited maximal discomfort at the stimulation position F8. Fig 3 shows how the discomfort was intolerable for the subjects. The spatial pattern of intolerability was similar to that of the discomfort rating in each stimulus condition, and SPS and TBS at F8 under the standard TMS protocol (SPS: 120% of RMT; TBS: 80% of AMT) were intolerable for approximately 10 of 20 subjects.

thumbnail
Fig 2. Discomfort rating at 11 stimulation positions.

The stimulation conditions consisted of SPS at 30% of the maximal output (upper left), SPS at 50% of the maximal output (upper right), SPS at 120% of the RMT (bottom left), and TBS at 80% of the AMT (bottom right). The color scale indicates the degree of discomfort averaged for each electrode across subjects (0: minimal and 10: maximal for each subject).

https://doi.org/10.1371/journal.pone.0217826.g002

thumbnail
Fig 3. Percentage intolerability at 11 stimulation positions.

The stimulation conditions consisted of SPS at 30% of the maximal output (upper left), SPS at 50% of the maximal output (upper right), SPS at 120% of the RMT (bottom left), and TBS at 80% of the AMT (bottom right). The color scale indicates the probability of intolerability (0: tolerable and 1: intolerable for each subject).

https://doi.org/10.1371/journal.pone.0217826.g003

Test-retest reliability

To examine the test-retest reliability, we calculated the Pearson’s correlation coefficient of the discomfort ratings for each subject between the test (Block 2) and retest blocks at the 11 stimulation positions. The ratings of discomfort of the test blocks significantly correlated with those of the retest blocks [Fisher’s z: mean = 1.25, SD = 0.30, one-sample t-test, t(9) = 13.0, P < 0.001] (Fig 4A). We also examined the consistency of the tolerability between the test and retest blocks for each subject at the 11 stimulation positions. The subjects consistently reported their intolerability [mean = 71.8%, SD = 15.1%, Wilcoxon signed-rank test, z = 2.8, P = 0.005, chance-level = 33.3%] (Fig 4B). These results indicate that discomfort and tolerability were consistent across the different blocks.

thumbnail
Fig 4. Test-retest reliability.

(A) The correlation (Fisher’s z) between two stimulation blocks under SPS at 50% of the maximal output. The bar graph indicates the standard errors of the means, and one point indicates each subject. (B) The average reproducibility of the three ranks of intolerability (“none,” “moderate,” and “severe”). The dotted line indicates the chance level (33%).

https://doi.org/10.1371/journal.pone.0217826.g004

Relationship between the two evaluation scores

As shown in Figs 2 and 3, the discomfort and intolerability ratings were closely related. We used a logistic regression analysis to quantify the relationship between the discomfort rating (0 to 10) and the proportion of intolerability (“none,” “moderate,” or “severe”). The probability of “severe” for each rating value in the 11 stimulation positions of the subjects was calculated for the SPS at 120% of the RMT, and the 50% point scored 8.55 in the discomfort rating (Fig 5A). The probability of “severe” was also calculated for the TBS at 80% of the AMT, and the 50% point scored 8.16 in the discomfort rating (Fig 5B), consistent with the results of the SPS. Similarly, the probability of “severe” or “moderate,” rather than “severe” only, for each rating value in the 11 stimulation positions of the subjects was subsequently calculated for the SPS at 120% of the RMT, and the 50% point scored 3.84 in the discomfort rating (Fig 5C). The probability of “severe” or “moderate” was also calculated for the TBS at 80% of the AMT, and the 50% point scored 3.36 in the discomfort rating (Fig 5D), consistent with the results of the SPS.

thumbnail
Fig 5. Relationship between discomfort and intolerability.

(A) The relationship between the discomfort rating (0 to 10) as an independent variable and the proportion of intolerability (“none,” “moderate,” or “severe”) as a dependent variable. The solid curve indicates a logistic regression. The probability of “severe” for each rating value in the stimulation positions of the subjects was calculated for the SPS at 120% of the RMT. (B) Similar to (A), with the exception that the probability of “severe” was calculated for the TBS at 80% of the AMT. (C) Similar to (A), with the exception that the probability of “severe” or “moderate” for each rating value in the stimulation positions of the subjects was calculated for the SPS at 120% of the RMT. (D) Similar to (A), with the exception that the probability of “severe” or “moderate” was also calculated for the TBS at 80% of the AMT.

https://doi.org/10.1371/journal.pone.0217826.g005

Estimation of discomfort and intolerability in any lateral prefrontal region

The two evaluation scores were measured only at the 11 stimulation positions. To estimate the value of the two evaluation scores at any target voxel in the lateral prefrontal cortex, the values at the voxel were interpolated from the three nearest stimulation lines (refer to Methods). Table 1 shows the average MNI coordinates of the intersection points where the 11 stimulation lines cross the brain surface. Fig 6A shows one example slice (sagittal slice at X = 21) of such images of the discomfort rating near the electrode F2 for the four stimulation conditions. The slice is also shown for the intolerability probability in Fig 6B. Because the extent of stimulation into the brain tissue is limited, the images were calculated only for 4 cm from the head surface to cover the brain surface region. These interpolation images enable us to estimate the additional number of subjects required in stimulating a target in the lateral prefrontal cortex. The image files for the interpolated values are available as supplementary materials (S1 File).

thumbnail
Fig 6. Brain mapping of discomfort and intolerability.

(A) Sagittal sections of discomfort mapping under the four stimulation conditions. The images were calculated 4 cm from the head surface for convenience. The color scale indicates the level of discomfort. D: dorsal, V: ventral, A: anterior, and P: posterior. (B) Sagittal sections of the intolerability mapping under the four stimulation conditions. The color scale indicates the probability of intolerability.

https://doi.org/10.1371/journal.pone.0217826.g006

thumbnail
Table 1. Coordinates of the brain surface that correspond to the stimulation positions.

https://doi.org/10.1371/journal.pone.0217826.t001

Discussion

The present study investigated discomfort and intolerability for subjects during SPS and TBS administered to the lateral prefrontal stimulation positions of the high-resolution extended 10–20 system. The SPS and TBS of the ventrolateral prefrontal cortex elicited greater discomfort and intolerability than that of the dorsolateral prefrontal cortex. The magnitude of discomfort and intolerability was similar in the SPS and TBS, and the intolerability was maximal (~ 50%) at stimulation position F8, which indicates that the number of subjects to be recruited would have to be double the intended sample size. The image file of the voxelwise probability of intolerability in the lateral prefrontal cortex is provided as supplementary data (S1 File), which would be useful in estimating the additional number of subjects to be recruited.

Discomfort during TMS to the lateral prefrontal cortex consists of pain and twitches caused by nerves and muscles, respectively [916, 49, 50]. The first branch of the trigeminal nerve (ophthalmic nerve) innervates a wide range of the forehead. TMS of the rostral part of the lateral prefrontal cortex often activates the trigeminal nerve; however, the stimulation of the ventrolateral prefrontal cortex may cause greater discomfort due to the activation of a greater number of nerve fibers. Moreover, the temporal muscle is activated by stimulation of the caudal part of the ventrolateral prefrontal cortex. The spatial pattern of discomfort reported in this study, in which greater discomfort was reported in the ventrolateral prefrontal cortex in all four stimulation conditions, 30% Max SPS, 50% Max SPS, 120% RMT SPS and TBS, appears consistent with the sum of the distribution of the involved nerves and muscles.

TBS was administered for only 1 second in the present study to minimize the total amount of stimulation over the 11 stimulation positions instead of the 40 seconds of the standard protocol [2, 51]. It is possible that the stimulation effect accumulates over the 40 seconds, making the intolerability greater than the reported results. On the other hand, subjects tend to become habituated over time [43, 45], and it seems likely that the increase of intolerability would be minimal. It is noted that the present study examined Japanese subjects. The motor threshold is known to be lower in Caucasian than in Han Chinese subjects [64], and intolerability is likely lower in Caucasian subjects because of the lower RMT and AMT. It is also noted that the effect of TMS depends on the distance between TMS coil and the target brain region, and a greater stimulation intensity will be required when deeper brain regions are targeted [5860]. Therefore, the present results of discomfort/intolerability primarily pertain to surface regions.

The required number of subjects for inclusion in TMS studies depends on the significance level, the statistical power, and the magnitude of expected changes in measured behavioral/MEP effects induced by TMS. Intolerability measured in the present study can be used to expect potential drop-outs due to discomfort experienced during TMS and calculate the likely number of subjects to be recruited in the initial phase of the study. This approach can be applied to other forms of brain stimulation techniques, such as transcranial current direction stimulation [6567]. The interpolation images (Fig 6) enable us to estimate the additional number of subjects required in stimulating activated regions in the lateral prefrontal cortex reported in previous fMRI studies. For example, in the study by Osada et al., 2019 [57], for the lateral prefrontal activation located at MNI coordinates (49, 11, 26), the estimated probability of intolerability for the region was 18% and 25% for the SPS and TBS, respectively. The results indicate that when 20 subjects are required for data collection, the actual number of subjects to be recruited would be approximately 25. In addition, in the study by Chikazoe et al., 2009 [68], for the lateral prefrontal activation located at (56, 16, 16), the estimated probability of intolerability was 30% and 32% for the SPS and TBS experiments, respectively, which indicates that when the data are to be collected from 20 subjects, the actual number of subjects to be recruited would be approximately 30 (for example, 30% of 30 subjects, i.e., 9 subjects, will be excluded, resulting in a final size of 21, approximately 20, subjects).

Importantly, even when stimulation of the ventrolateral prefrontal cortex is experimentally executable, the discomfort caused by stimulation confounds the behavioral performance [50]. For the confound to be managed, it is advisable to choose control sites with similar levels of discomfort rather than simply using sham TMS [49, 6972]. Although TMS studies of the ventrolateral prefrontal cortex are relatively rare at this point, the present study may encourage future studies targeting the ventrolateral prefrontal cortex by providing the additional number of subjects required for the study in planning the experimental protocols.

Supporting information

S1 Fig. The ratio of the increase in the TMS intensity to the level of discomfort and tolerability based on the results of 30% and 50% maximal output in SPS.

https://doi.org/10.1371/journal.pone.0217826.s001

(TIFF)

S1 Dataset. The ratings of discomfort and intolerability in each stimulation condition at each electrode position for each subject.

https://doi.org/10.1371/journal.pone.0217826.s002

(XLSX)

S1 File. The image files for the interpolated values of discomfort and intolerability in each stimulation condition.

https://doi.org/10.1371/journal.pone.0217826.s003

(ZIP)

Acknowledgments

We thank Ms. Fukui, Mr. T. Kamiya and Mr. H. Goto for technical assistance. This work was supported by JSPS KAKENHI to A.O. (grant number 16K16076) and a grant from Takeda Science Foundation to S.K. The authors have no conflicts of interest to declare.

References

  1. 1. Pascual-Leone A, Walsh V, Rothwell J. Transcranial magnetic stimulation in cognitive neuroscience—virtual lesion, chronometry, and functional connectivity. Curr Opin Neurobiol. 2000;10(2):232–7. pmid:10753803
  2. 2. Huang YZ, Edwards MJ, Rounis E, Bhatia KP, Rothwell JC. Theta burst stimulation of the human motor cortex. Neuron. 2005;45(2):201–6. pmid:15664172
  3. 3. Paus T. Inferring causality in brain images: a perturbation approach. Philos Trans R Soc Lond B Biol Sci. 2005;360(1457):1109–14. pmid:16087451
  4. 4. Hallett M. Transcranial magnetic stimulation: a primer. Neuron. 2007;55(2):187–99. pmid:17640522
  5. 5. Narayana S, Papanicolaou AC, McGregor A, Boop FA, Wheless JW. Clinical Applications of Transcranial Magnetic Stimulation in Pediatric Neurology. J Child Neurol. 2015;30(9):1111–24. pmid:25342309
  6. 6. Parkin BL, Ekhtiari H, Walsh VF. Non-invasive Human Brain Stimulation in Cognitive Neuroscience: A Primer. Neuron. 2015;87(5):932–45. pmid:26335641
  7. 7. Rossini PM, Burke D, Chen R, Cohen LG, Daskalakis Z, Di Iorio R, et al. Non-invasive electrical and magnetic stimulation of the brain, spinal cord, roots and peripheral nerves: Basic principles and procedures for routine clinical and research application. An updated report from an I.F.C.N. Committee. Clin Neurophysiol. 2015;126(6):1071–107. pmid:25797650
  8. 8. Miyashita Y. The cutting edge in brain science and sportology. Juntendo Medical Journal. 2016;62:6–11.
  9. 9. Wassermann EM. Risk and safety of repetitive transcranial magnetic stimulation: report and suggested guidelines from the International Workshop on the Safety of Repetitive Transcranial Magnetic Stimulation, June 5–7, 1996. Electroencephalogr Clin Neurophysiol. 1998;108(1):1–16. pmid:9474057
  10. 10. Abler B, Walter H, Wunderlich A, Grothe J, Schönfeldt-Lecuona C, Spitzer M, et al. Side effects of transcranial magnetic stimulation biased task performance in a cognitive neuroscience study. Brain Topogr. 2005;17(4):193–6. pmid:16110769
  11. 11. Grossheinrich N, Rau A, Pogarell O, Hennig-Fast K, Reinl M, Karch S, et al. Theta burst stimulation of the prefrontal cortex: safety and impact on cognition, mood, and resting electroencephalogram. Biol Psychiatry. 2009;65(9):778–84. pmid:19070834
  12. 12. Poreisz C, Paulus W, Moser T, Lang N. Does a single session of theta-burst transcranial magnetic stimulation of inferior temporal cortex affect tinnitus perception?. BMC Neurosci. 2009;10:54. pmid:19480651
  13. 13. Rossi S, Hallett M, Rossini PM, Pascual-Leone A. Safety, ethical considerations, and application guidelines for the use of transcranial magnetic stimulation in clinical practice and research. Clin Neurophysiol. 2009;120(12):2008–39. pmid:19833552
  14. 14. Oberman L, Edwards D, Eldaief M, Pascual-Leone A. Safety of theta burst transcranial magnetic stimulation: a systematic review of the literature. J Clin Neurophysiol. 2011;28(1):67–74. pmid:21221011
  15. 15. Tarapore PE, Picht T, Bulubas L, Shin Y, Kulchytska N, Meyer B, et al. Safety and tolerability of navigated TMS for preoperative mapping in neurosurgical patients. Clin Neurophysiol. 2016;127(3):1895–900. pmid:26762952
  16. 16. Peterchev AV, Luber B, Westin GG, Lisanby SH. Pulse Width Affects Scalp Sensation of Transcranial Magnetic Stimulation. Brain Stimul. 2017;10(1):99–105. pmid:28029593
  17. 17. Machii K, Cohen D, Ramos-Estebanez C, Pascual-Leone A. Safety of rTMS to non-motor cortical areas in healthy participants and patients. Clin Neurophysiol. 2006;117(2):455–71. pmid:16387549
  18. 18. Loo CK, McFarquhar TF, Mitchell PB. A review of the safety of repetitive transcranial magnetic stimulation as a clinical treatment for depression. Int J Neuropsychopharmacol. 2008;11(1):131–47. pmid:17880752
  19. 19. Maizey L, Allen CP, Dervinis M, Verbruggen F, Varnava A, Kozlov M, et al. Comparative incidence rates of mild adverse effects to transcranial magnetic stimulation. Clin Neurophysiol. 2013;124(3):536–44. pmid:22986284
  20. 20. Ro T, Henik A, Machado L, Rafal RD. Transcranial magnetic stimulation of the prefrontal cortex delays contralateral endogenous saccades. J Cogn Neurosci. 1997;9(4):433–40. pmid:23968209
  21. 21. Müri RM, Gaymard B, Rivaud S, Vermersch A, Hess CW, Pierrot-Deseilligny C. Hemispheric asymmetry in cortical control of memory-guided saccades. A transcranial magnetic stimulation study. Neuropsychologia. 2000;38(8):1105–11. pmid:10838145
  22. 22. Mull BR, Seyal M. Transcranial magnetic stimulation of left prefrontal cortex impairs working memory. Clin Neurophysiol. 2001;112(9):1672–5. pmid:11514250
  23. 23. Mottaghy FM, Gangitano M, Krause BJ, Pascual-Leone A. Chronometry of parietal and prefrontal activations in verbal working memory revealed by transcranial magnetic stimulation. Neuroimage. 2003;18(3):565–75. pmid:12667834
  24. 24. Nyffeler T, Pierrot-Deseilligny C, Pflugshaupt T, von Wartburg R, Hess CW, Müri RM. Information processing in long delay memory-guided saccades: further insights from TMS. Exp Brain Res. 2004;154(1):109–12. pmid:14578999
  25. 25. Morishima Y, Akaishi R, Yamada Y, Okuda J, Toma K, Sakai K. Task-specific signal transmission from prefrontal cortex in visual selective attention. Nat Neurosci. 2009;12(1):85–91. pmid:19098905
  26. 26. Basso D, Ferrari M, Palladino P. Prospective memory and working memory: asymmetrical effects during frontal lobe TMS stimulation. Neuropsychologia. 2010;48(11):3282–90. pmid:20637788
  27. 27. Ott DVM, Ullsperger M, Jocham G, Neumann J, Klein TA. Continuous theta-burst stimulation (cTBS) over the lateral prefrontal cortex alters reinforcement learning bias. Neuroimage. 2011;57(2):617–23. pmid:21554966
  28. 28. D'Ardenne K, Eshel N, Luka J, Lenartowicz A, Nystrom LE, Cohen JD. Role of prefrontal cortex and the midbrain dopamine system in working memory updating. Proc Natl Acad Sci USA. 2012;109(49):19900–9. pmid:23086162
  29. 29. Duque J, Labruna L, Verset S, Olivier E, Ivry RB. Dissociating the role of prefrontal and premotor cortices in controlling inhibitory mechanisms during motor preparation. J Neurosci. 2012;32(3):806–16. pmid:22262879
  30. 30. Bilek E, Schafer A, Ochs E, Esslinger C, Zangl M, Plichta MM, et al. Application of high-frequency repetitive transcranial magnetic stimulation to the DLPFC alters human prefrontal-hippocampal functional interaction. J Neurosci. 2013;33(16):7050–6. pmid:23595762
  31. 31. Gratton C, Lee TG, Nomura EM, D'Esposito M. The effect of theta-burst TMS on cognitive control networks measured with resting state fMRI. Front Syst Neurosci. 2013;7:124. pmid:24416003
  32. 32. Hartwigsen G, Saur D, Price CJ, Ulmer S, Baumgaertner A, Siebner HR. Perturbation of the left inferior frontal gyrus triggers adaptive plasticity in the right homologous area during speech production. Proc Natl Acad Sci USA. 2013;110(41):16402–7. pmid:24062469
  33. 33. Smittenaar P, FitzGerald TH, Romei V, Wright ND, Dolan RJ. Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans. Neuron. 2013;80(4):914–9. pmid:24206669
  34. 34. Ubaldi S, Barchiesi G, Cattaneo L. Bottom-up and top-down visuomotor responses to action observation. Cereb Cortex. 2015;25(4):1032–41. pmid:24132640
  35. 35. Rahnev D, Nee DE, Riddle J, Larson AS, D'Esposito M. Causal evidence for frontal cortex organization for perceptual decision making. Proc Natl Acad Sci USA. 2016;113(21):6059–64. pmid:27162349
  36. 36. Sagliano L, D'Olimpio F, Panico F, Gagliardi S, Trojano L. The role of the dorsolateral prefrontal cortex in early threat processing: a TMS study. Soc Cogn Affect Neurosci. 2016;11(12):1992–8. pmid:27510494
  37. 37. Gogulski J, Zetter R, Nyrhinen M, Pertovaara A, Carlson S. Neural Substrate for Metacognitive Accuracy of Tactile Working Memory. Cereb Cortex. 2017;27(11):5343–52. pmid:28968804
  38. 38. Smalle E, Panouilleres M, Szmalec A, & Möttönen R. Language learning in the adult brain: disrupting the dorsolateral prefrontal cortex facilitates word-form learning. Scientific reports. 2017;7(1):13966. pmid:29070879
  39. 39. Chung SW, Rogasch NC, Hoy KE, Sullivan CM, Cash RFH., Fitzgerald PB. Impact of different intensities of intermittent theta burst stimulation on the cortical properties during TMS-EEG and working memory performance. Hum Brain Mapp. 2018;39(2):783–802. pmid:29124791
  40. 40. Zhao D, Zhou YD, Bodner M, Ku Y. The Causal Role of the Prefrontal Cortex and Somatosensory Cortex in Tactile Working Memory. Cereb Cortex. 2018;28(10):3468–77. pmid:28968894
  41. 41. Devlin JT, Matthews PM, Rushworth MF. Semantic processing in the left inferior prefrontal cortex: a combined functional magnetic resonance imaging and transcranial magnetic stimulation study. J Cogn Neurosci. 2003;15(1):71–84. pmid:12590844
  42. 42. Kahn I, Pascual-Leone A, Theoret H, Fregni F, Clark D, Wagner AD. Transient disruption of ventrolateral prefrontal cortex during verbal encoding affects subsequent memory performance. J Neurophysiol. 2005;94(1):688–98. pmid:15758048
  43. 43. Anderson BS, Kavanagh K, Borckardt JJ, Nahas ZH, Kose S, Lisanby SH, et al. Decreasing procedural pain over time of left prefrontal rTMS for depression: initial results from the open-label phase of a multi-site trial (OPT-TMS). Brain Stimul. 2009;2(2):88–92. pmid:20161310
  44. 44. Verbruggen F, Aron AR, Stevens MA, Chambers CD. Theta burst stimulation dissociates attention and action updating in human inferior frontal cortex. Proc Natl Acad Sci USA. 2010;107(31):13966–71. pmid:20631303
  45. 45. Borckardt JJ, Nahas ZH, Teal J, Lisanby SH, McDonald WM, Avery D, et al. The painfulness of active, but not sham, transcranial magnetic stimulation decreases rapidly over time: results from the double-blind phase of the OPT-TMS Trial. Brain Stimul. 2013;6(6):925–8. pmid:23769413
  46. 46. De Dreu CK, Kret ME, Sligte IG. Modulating prefrontal control in humans reveals distinct pathways to competitive success and collective waste. Soc Cogn Affect Neurosci. 2016;11(8):1236–44. pmid:27036875
  47. 47. Hartwright CE, Hardwick RM, Apperly IA, Hansen PC. Resting state morphology predicts the effect of theta burst stimulation in false belief reasoning. Hum Brain Mapp. 2016;37(10):3502–14. pmid:27195942
  48. 48. Ueno T, Meteyard L, Hoffman P, & Murayama K. The Ventral Anterior Temporal Lobe has a Necessary Role in Exception Word Reading. Cereb Cortex. 2018;28(8):3035–45. pmid:29878073
  49. 49. Holmes NP & Meteyard L. Subjective Discomfort of TMS Predicts Reaction Times Differences in Published Studies. Front Psychol. 2018;9:1989. pmid:30405482
  50. 50. Meteyard L & Holmes NP. TMS SMART - Scalp mapping of annoyance ratings and twitches caused by Transcranial Magnetic Stimulation. J Neurosci Methods. 2018;299:34–44. pmid:29471064
  51. 51. Suppa A, Huang YZ, Funke K, Ridding MC, Cheeran B, Di Lazzaro V, et al. Ten Years of Theta Burst Stimulation in Humans: Established Knowledge, Unknowns and Prospects. Brain Stimul. 2016;9(3):323–35. pmid:26947241
  52. 52. Chatrian GE, Lettich E, Nelson PL. Modified nomenclature for the "10%" electrode system. J Clin Neurophysiol. 1988;5(2):183–6. pmid:3250964
  53. 53. Jurcak V, Tsuzuki D, Dan I. 10/20, 10/10, and 10/5 systems revisited: their validity as relative head-surface-based positioning systems. Neuroimage. 2007;34(4):1600–11. pmid:17207640
  54. 54. Simmons JP, Nelson LD, Simonsohn U. False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol Sci. 2011;22(11):1359–66. pmid:22006061
  55. 55. Watanabe T, Hanajima R, Shirota Y, Ohminami S, Tsutsumi R, Terao Y, et al. Bidirectional effects on interhemispheric resting-state functional connectivity induced by excitatory and inhibitory repetitive transcranial magnetic stimulation. Hum Brain Mapp. 2014;35:1896–905. pmid:23897535
  56. 56. Watanabe T, Hanajima R, Shirota Y, Tsutsumi R, Shimizu T, Hayashi T, et al. Effects of rTMS of pre-supplementary motor area on fronto basal ganglia network activity during stop-signal task. J Neurosci. 2015;35(12):4813–23. pmid:25810512
  57. 57. Osada T, Ohta S, Ogawa A, Tanaka M, Suda A, Kamagata K, et al. An essential role of the intraparietal sulcus in response inhibition predicted by parcellation-based network. J Neurosci. 2019;39(13):2509–21. pmid:30692225
  58. 58. Stokes MG, Chambers CD, Gould IC, Henderson TR, Janko NE, Allen NB, et al. Simple metric for scaling motor threshold based on scalp-cortex distance: application to studies using transcranial magnetic stimulation. J Neurophysiol. 2005 Dec;94(6):4520–7. pmid:16135552
  59. 59. Stokes MG, Chambers CD, Gould IC, English T, McNaught E, McDonald O, et al. Distance-adjusted motor threshold for transcranial magnetic stimulation. Clin Neurophysiol. 2007;118(7):1617–25. pmid:17524764
  60. 60. Cai W, George JS, Chambers CD, Stokes MG, Verbruggen F, Aron AR. Stimulating deep cortical structures with the batwing coil: how to determine the intensity for transcranial magnetic stimulation using coil-cortex distance. J Neurosci Methods. 2012;204(2):238–41. pmid:22138632
  61. 61. Tamè L & Holmes NP. Involvement of human primary somatosensory cortex in vibrotactile detection depends on task demand. Neuroimage. 2016;138:184–96. pmid:27233148
  62. 62. Jimura K, Hirose S, Kunimatsu A, Ohtomo K, Koike Y, Konishi S. Late enhancement of brain-behavior correlations during response inhibition. Neuroscience. 2014;274:383–92. pmid:24912028
  63. 63. Yamasaki T, Ogawa A, Osada T, Jimura K, Konishi S. Within-subject correlation analysis to detect functional areas associated with response inhibition. Front Hum Neurosci. 2018;12:208. pmid:29872386
  64. 64. Yi X, Fisher KM, Lai M, Mansoor K, Bicker R, Baker SN. Differences between Han Chinese and Caucasians in transcranial magnetic stimulation parameters. Exp Brain Res. 2014;232(2):545–53. pmid:24240390
  65. 65. Schabrun SM, Burns E, Thapa T, Hodges P. The response of the primary motor cortex to neuromodulation is altered in chronic low back pain: a preliminary study. Pain Med. 2018;19(6):1227–36. pmid:29016867
  66. 66. Thapa T, Graven-Nielsen T, Chipchase LS, Schabrun SM. Disruption of cortical synaptic homeostasis in individuals with chronic low back pain. Clin Neurophysiol. 2018;129(5):1090–6. pmid:29472134
  67. 67. Thapa T, Schabrun SM. Test-Retest Reliability of Homeostatic Plasticity in the Human Primary Motor Cortex. Neural Plast. 2018;2018:6207508. pmid:29983706
  68. 68. Chikazoe J, Jimura K, Asari T, Yamashita K, Morimoto H, Hirose S, et al. Functional dissociation in right inferior frontal cortex during performance of go/no-go task. Cereb Cortex. 2009;19(1):146–52. pmid:18445602
  69. 69. Arana AB, Borckardt JJ, Ricci R, Anderson B, Li X, Linder KJ, et al. Focal electrical stimulation as a sham control for repetitive transcranial magnetic stimulation: does it truly mimic the cutaneous sensation and pain of active prefrontal repetitive transcranial magnetic stimulation? Brain Stimul. 2008;1(1):44–51. pmid:19424459
  70. 70. Herwig U, Cardenas-Morales L, Connemann BJ, Kammer T, Schönfeldt-Lecuona C. Sham or real—Post hoc estimation of stimulation condition in a randomized transcranial magnetic stimulation trial. Neurosci Lett. 2010;471(1):30–3. pmid:20064587
  71. 71. Duecker F, de Graaf TA, Jacobs C, Sack AT. Time-and task-dependent non-neural effects of real and sham TMS. PLoS One. 2013;8(9):e73813. pmid:24040080
  72. 72. Duecker F & Sack AT. Rethinking the role of sham TMS. Front Psychol. 2015;6:210. pmid:25767458