Pain often exists in the absence of observable injury; therefore, the gold standard for pain assessment has long been self-report. Because the inability to verbally communicate can prevent effective pain management, research efforts have focused on the development of a tool that accurately assesses pain without depending on self-report. Those previous efforts have not proven successful at substituting self-report with a clinically valid, physiology-based measure of pain. Recent neuroimaging data suggest that functional magnetic resonance imaging (fMRI) and support vector machine (SVM) learning can be jointly used to accurately assess cognitive states. Therefore, we hypothesized that an SVM trained on fMRI data can assess pain in the absence of self-report. In fMRI experiments, 24 individuals were presented painful and nonpainful thermal stimuli. Using eight individuals, we trained a linear SVM to distinguish these stimuli using whole-brain patterns of activity. We assessed the performance of this trained SVM model by testing it on 16 individuals whose data were not used for training. The whole-brain SVM was 81% accurate at distinguishing painful from non-painful stimuli (p<0.0000001). Using distance from the SVM hyperplane as a confidence measure, accuracy was further increased to 84%, albeit at the expense of excluding 15% of the stimuli that were the most difficult to classify. Overall performance of the SVM was primarily affected by activity in pain-processing regions of the brain including the primary somatosensory cortex, secondary somatosensory cortex, insular cortex, primary motor cortex, and cingulate cortex. Region of interest (ROI) analyses revealed that whole-brain patterns of activity led to more accurate classification than localized activity from individual brain regions. Our findings demonstrate that fMRI with SVM learning can assess pain without requiring any communication from the person being tested. We outline tasks that should be completed to advance this approach toward use in clinical settings.
Citation: Brown JE, Chatterjee N, Younger J, Mackey S (2011) Towards a Physiology-Based Measure of Pain: Patterns of Human Brain Activity Distinguish Painful from Non-Painful Thermal Stimulation. PLoS ONE 6(9): e24124. https://doi.org/10.1371/journal.pone.0024124
Editor: Alexander J. Annala, City of Hope, United States of America
Received: January 31, 2011; Accepted: August 4, 2011; Published: September 13, 2011
Copyright: © 2011 Brown et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was funded by the National Institutes of Health (NIH) [1R21DA026092, K24DA029262 and 1F31GM08361] and the Chris Redlich Pain Research Fund. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Pain is commonly accepted to be a subjective experience , for which the gold standard of measurement is self-report. While self-reported pain provides useful clinical information and proves to be an effective assessment approach in most situations, it can fail certain vulnerable populations. Individuals with major cognitive or communicative impairments, such as intensive care unit patients or older adults with dementia, may not be able to provide valid self-reports of pain , . For those individuals, there are few methods for determining the presence or absence of pain. While behavioral tools exist (such as those assessing facial expressions, vocalizations, and body movements) –, they too may fail individuals with paralyses or other disorders affecting motor behavior. There is, therefore, a need to develop a pain assessment tool that is based on physiology, and requires no communication on the part of patients.
Researchers have long sought to develop a physiology-based pain assessment that does not depend on patient volitional behaviors . Those efforts have focused on various biosignals, such as heart rate , , skin conductance , and electroencephalography . While several physiologic variables have shown statistically significant correlations with the presence of pain, or with pain intensity, no measure has provided a sufficiently high relationship with pain to be used as a valid surrogate for self-reports –. Therefore, despite many years of research, there is currently no accepted technique for the physiologic assessment of pain in humans.
Recent advances in neuroimaging have provided possibilities for pain assessment that have not traditionally been available to researchers . By measuring physiologic events that are closely associated with neural activity, noninvasive neuroimaging methods such as functional magnetic resonance imaging (fMRI) gain an advantage over previously employed methods of physiologic pain assessment. The use of fMRI in detecting the presence of pain may be particularly strengthened by incorporating machine learning algorithms. Machine learning algorithms, such as the support vector machine (SVM), can allow predictive models to be trained with a known set of stimuli, and then used to classify novel stimuli. An SVM can be trained on patterns of whole-brain activity, in order to find the linear combinations of regional brain activity that best distinguishes two experiential states. Using this approach, machine learning algorithms have recently been used, in conjunction with fMRI data, to determine what a person is seeing or hearing , . Properly developed, the union of fMRI and SVM may provide a valid, physiology-based proxy for self-reported pain.
Marquand and colleagues (2010) were the first to apply fMRI and machine learning algorithms to the problem of pain measurement . In their study, healthy individuals were exposed to thermal stimuli presented at heat perception threshold, pain perception threshold, and pain tolerance. Machine learning algorithms were trained on fMRI data and used to predict self-reported pain for each participant individually (i.e., one model per participant). Each individual's model was then used to classify subsequent stimuli in that same individual. The SVM model was reported to have a classification accuracy that ranged from 68.34% (distinguishing pain detection from pain tolerance) to 91.67% (distinguishing heat threshold from pain tolerance). This study provided an important advancement in pain measurement, demonstrating that machine learning algorithms could be used to assess an individual's pain, if trained using fMRI data from that same individual.
An important extension of the work of Marquand et al. would be to demonstrate that physiology-based pain assessment, using fMRI data and machine learning algorithms, can classify pain accurately without relying on self-report data from the individual tested. If, for example, an SVM model could be trained on one set of individuals, and used to accurately classify pain in different individuals, then its performance would not depend on the test subjects' self-report.
In this study, we attempted to develop an SVM model that accurately determines the presence or absence of pain, even when tested on individuals whose self-reported data were not included in the model's training. Towards this aim, we investigated the task of distinguishing non-painful heat stimuli from painful heat stimuli. The major goal of the study was to determine whether blood-oxygen-level dependent (BOLD) signal change is sufficiently consistent between individuals to potentially train a physiology-based pain classifier that performs accurately when trained on one group of subjects and tested on another. An SVM model was trained on a group of eight individuals, and used to classify pain in a separate group of eight individuals. When tested on this separate group of eight individual, the SVM was significantly more accurate than chance. In a second study, the same SVM model was further validated through test-retest reliability in an additional group of eight individuals. When tested on this additional group of eight individuals, the SVM was again significantly more accurate than chance.
Study 1: Training and Initial Validation of the SVM Model
Nineteen participants were recruited via advertisements posted on and around the Stanford University campus. All participants were healthy and none reported having a chronic pain condition. Procedures were approved by the Stanford University School of Medicine Institutional Review Board, and all participants provided written informed consent. Due to technical difficulties with the temperature thresholding or scan procedures, complete data were not collected for three participants; therefore, they were excluded from all analyses. The remaining 16 participants were an average age of 22.7 years (SD = 3.6), with 10 men and 6 women.
Before starting the fMRI scanning session, participants were thresholded with a thermal stimulator in order to determine individual temperatures for painful heat. Thermal stimuli were delivered to the left volar forearm via a 3×3 cm Peltier-type thermode (Medoc, North Carolina). A range of temperatures was presented, each for 30 seconds. Following each temperature presentation, the participant provided a self-report of pain on a 0–10 numerical rating scale with the following anchors: 0 (no pain), 3 (minor pain), 5 (moderate pain), 7 (intense pain that you can bear without moving), and 10 (unbearable pain). The thresholding procedures used here have been previously described in greater detail . The temperature that consistently elicited a 7 out of 10 pain score was used as the painful stimulus temperature in the fMRI scanning session. The average temperature selected for painful stimulation was 46.3°C (SD = 1.1).
During the fMRI sessions, heat stimuli were again presented to the left volar forearm in a block design, with 40 seconds of baseline temperature (at 26°C), followed by 30 seconds of heat stimulation. All participants completed four functional runs. In two runs, participants received hot but non-painful heat stimulation (38°C). In the other two runs, participants received painful heat stimulation (individually calibrated to elicit a pain score of seven). Each participant received a total of 14 nonpainful stimuli and 14 painful stimuli. Following each functional run, participants reported whether the stimuli presented were painful or non-painful.
MRI Data Collection and Standard Pre-Processing.
FMRI data were collected on a 3.0 Tesla, whole-body scanner (GE Healthcare Discovery 750), using an 8-channel receive-only phased-array head coil. A T1-weighted fast spoiled gradient-recall scan was acquired for anatomical reference (TE = 2.0 ms, 156 slices at 1.3 mm thickness). High-order shimming  was then performed, followed by the functional runs. Functional imaging used a T2*-sensitive gradient spiral in/out pulse sequence , with a TR of 2000 ms, TE = 20 ms, flip angle = 77°, 64×64 acquisition matrix, and 30, 4 mm interleaved slices parallel to the intercommissural line. Images were corrected for cardiac and respiratory noise using RETROICOR . SPM5 (Wellcome Trust Centre) was used for functional image realignment and motion correction, coregistration to the structural images, and normalization to the Montreal Neurologic Institute (MNI) stereotactic template. As a final processing step, functional images were spatially smoothed with a 3D Gaussian kernel (4 mm full-width half-maximum).
SVM Model Pre-Processing.
SVM model pre-processing was conducted in MATLAB (Mathworks) using SPM5 and custom software. A whole-brain pattern of the activity induced by each heat stimulus was computed as map of percent BOLD signal change. For each heat stimulus, the average percent BOLD change was calculated with the following formula: ((average stimulus signal – average baseline signal)/average baseline signal). The baseline signal consisted of the 20 seconds before each heat stimulus. The stimulus signal consisted of the final 24 seconds of each heat block, excluding the initial 6 seconds to allow for the BOLD signal to reach its peak intensity. Each of the maps of percent BOLD signal change constitutes an example to be used for training and testing the SVM. In this way, by treating each heat stimulus as a single example, the SVM preprocessing resulted in 448 examples: 28 heat stimuli ×16 subjects. Each of these examples was a map of percent BOLD change containing 18,124,575 features (voxels).
Feature reduction (to avoid over-fitting of the model) was achieved by applying a gray matter mask to exclude areas that did not containing neuron cell bodies. Typically, the magnitude of pain-induced BOLD signal change is less than 1% –. Thus, an additional and liberal feature reduction step was achieved by excluding any voxel exhibiting percent signal change greater than 3%, on the grounds that large changes are likely artifactual. The feature reduction steps reduced the number of features in each example from 18,124,575 to 65,839, with each feature corresponding to average percent BOLD change in a single gray-matter voxel.
SVM Model Training.
Eight of the sixteen participants were randomly assigned to the model training group. Randomization was performed using a computer-based list randomizer. As described previously , the SVM model training was performed using a multi-voxel pattern analysis approach, conducted in MATLAB using an SVM toolbox written by Anton Schwaighofer (mail to: firstname.lastname@example.org). Using examples of painful and non-painful heat stimuli from the eight training group participants, a linear SVM was trained to classify heat stimuli as painful or non-painful (the regularization parameter, C, was set at 10 prior to training). Using a linear combination of the features (the magnitude of percent BOLD change in each voxel), the SVM determined a function to best predict whether each example (each heat stimulus) in the training set was painful or non-painful. Numerically, this function is of the form: Y = W1X1+W2X2 …+WNXN+Z, where for each example, N is the number of features (number of voxels), W is the weighting of each feature, X is the value of each feature (the percent BOLD signal change), and Z is a constant. If Y is positive, then the example is classified as painful, and if Y is negative, then the example is classified as nonpainful. The function used for SVM classification is often described visually: each example (each map of BOLD signal) can be thought of as a point in space, and the SVM can be thought of as determining the separating hyperplane which best separates those points in space associated with painful stimulation from those associated with nonpainful stimulation. For a more detailed discussion of the mathematical method, see C. Cortes and V. Vapnik (1995) .
SVM Model Testing.
The trained SVM model was then used to classify pain in the eight individuals who were randomly assigned to the testing group. For each heat stimulus presented to participants in the testing group, the SVM model assigned a classification of painful or non-painful. The SVM also calculated a measure of confidence in the accuracy of each assignment. This measure of confidence was derived from the distance of each example (each map of percent BOLD change) from the separating hyperplane. The percent of accurate classifications was calculated for each participant in the testing group, as well as positive predictive value (PPV) and negative predictive value (NPV). PPV is the percent of stimuli predicted to be painful which were actually painful, while NPV is the percent of stimuli predicted to be non-painful which were actually non-painful.
To identify which brain regions significantly influenced the SVM classifier's accuracy, we conducted a permutation test as previously described . In brief, we tested the null hypothesis that patterns of brain activity did not influence the performance of the SVM classifier. To derive the null distribution by permutation, the class labels (painful or non-painful) were randomized 750 times. With each randomization, a linear SVM was trained to distinguish the examples (the maps of percent BOLD change) that were randomly labeled painful from the examples that were randomly labeled non-painful. To determine statistical significance, the model resulting from accurate class labeling was compared to the empirically derived null distribution. By randomly rearranging the training data, this permutation test reveals which brain regions significantly affected the training of the SVM, and thus contributed to the SVM classifier's performance at distinguishing painful from non-painful stimulation.
Region of Interest Analysis.
To test whether any regions might independently distinguish painful and non-painful stimuli, we conducted individual SVM classifications using small regions of interest (ROIs). Based on a meta-analysis of 68 studies, Apkarian et al. (2005) have proposed that there is a brain network for acute pain which is composed of 6 brain regions: the primary and secondary somatosensory cortices, the insular cortex, the anterior cingulate cortex, the prefrontal cortex, and the thalamus . In separate SVM analyses, we investigated each of those six areas. Each ROI was functionally defined as an 8 mm sphere centered on previously reported coordinates which were identified in a study of pain processing . For each ROI, the average percent BOLD signal change was computed for each heat stimulus. These measurements of percent BOLD signal change constitute the examples used to train and test an SVM for each ROI. As with the whole-brain SVM analysis, each ROI classifier was trained on fMRI data from the training group (N = 8) and tested on fMRI data from the testing group (N = 8).
Study 2: Confirmatory Validation of the SVM Model
In order to provide an additional validation of the SVM model by test-retest reliability, an additional nine participants were recruited and assigned to an independent retesting group. As with the previous groups, participants were recruited from Stanford and from the surrounding area. Due to technical difficulties with the temperature thresholding procedures, complete data were not collected for one participant; therefore, this participant's data were excluded from all analyses. The remaining eight participants were an average age of 25.9 years (SD = 3.3), with 5 men and 3 women. Participants in Study 2 followed the same procedures as those participants in Study 1 (with the exception that no randomization was conducted because all participants were assigned to a single retest group). The average temperature for the painful stimulation was 46.0°C (SD = 1.0). The SVM model trained in Study 1 was used to classify painful and non-painful stimuli in the participants recruited to Study 2.
Study 1: Training and Initial Validation of the SVM Model
As a validity check on the effectiveness of the chosen temperatures to elicit painful and non-painful sensations, we first examined self-reported pain. All included participants reported that the experimental temperature that was thresholded to a 7 out of 10 pain score elicited pain, and that the 38°C temperature did not.
The SVM model, which was trained on data from participants in the training group, performed significantly better than chance when distinguishing painful from non-painful stimuli in participants from the independent testing group (t (7) = 9.9, p = 0.00002). Average accuracy was 86.6%. As seen in Table 1, accuracy ranged from 71.4% to 100% across the eight testing individuals. Average PPV (stimuli classified as painful which were actually painful) was 90.3%, and NPV (stimuli classified as non-painful which were actually non-painful) was 85.4%.
We next examined whether classification accuracy could be improved by incorporating a confidence threshold, measured as distance from the separating hyperplane. BOLD maps not meeting the confidence threshold were excluded on the basis of insufficient evidence to make a confident classification. Overall accuracy of the SVM classifier increased monotonically with the number of stimuli excluded (Figure 1). When excluding the 15% of stimuli that were nearest to the hyperplane, the best balance was achieved between maximizing the accuracy of the SVM classifier and minimizing the number of excluded stimuli. Specifically, when excluding the 15% of stimuli that were nearest to the hyperplane, overall accuracy was increased to 91.8%, PPV was increased to 93.8% and NPV was increased to 92.7% (Figure 1).
The classifier's performance was assessed at increasing distance thresholds. As the distance threshold increased, an increasing number of stimuli were excluded on the grounds that stimuli nearest the separating hyperplane were most likely misclassified. In this figure, performance is plotted as a function of the percentage of stimuli that have been excluded from classification. Dotted lines display the performance computed at each distance threshold. Solid lines display a third degree polynomial fit to those data.
Next, a permutation test was used to determine which brain regions were most involved in driving the whole-brain SVM classifier's performance. The classification of a stimulus as painful was significantly influenced (p<0.01) by greater BOLD signal in the bilateral mid-insular cortices (MNI: −36, 0, 12 and 36, 4, 12), bilateral secondary somatosensory cortices (−34, −18, 16 and 38, −18, 20), contralateral posterior insular cortex (36, −16, 14), contralateral primary somatosensory cortex (22, −26, 54 and 24, −46, 6), and contralateral primary motor cortex (36, −14, 48). The classification of a stimulus as nonpainful was significantly influenced (p<0.01) by greater BOLD signal in the bilateral primary motor cortices (−44, −12, 36 and 52, −14, 48), and ipsilateral pregenual cingulate cortex (−10, 42, 2). Those brain regions, which significantly affected the whole-brain SVM classification, are illustrated in Figure 2.
A permutation test was run to determine which brain regions significantly affected the whole-brain SVM classification. This figure illustrates brain regions that fall within the 90th percentile of the null distribution that was determined by permutation. Regions in the 99th percentile (p<0.01) are noted in the results section. Shades of red indicate regions where greater BOLD signal influenced the SVM to classify a stimulus as painful. Shades of blue indicate regions where greater BOLD signal influenced the SVM to classify a stimulus as non-painful.
Because using information from a single ROI to assess pain would be simpler than employing a whole-brain SVM, we next tested whether BOLD signal from individual ROI's could distinguish painful and non-painful stimuli as accurately as the whole-brain SVM model. Activity in the secondary somatosensory cortex classified painful stimuli significantly better than chance (t (7) = 5.0, p = 0.0016), as did activity in the mid-insular cortex (t (7) = 4.0, p = 0.0052). As seen in Table 2, for the other regions tested, overall accuracy did not reach the p<0.05 level of significance for classifying stimuli as painful or non-painful. Classification based on activity in the secondary somatosensory cortex (71.9%) and mid-insular cortex (64.3%), did not reach the same level of accuracy as classification based on whole-brain patterns of activity (86.6%).
Study 2: Confirmatory Validation of the SVM Model
An additional group of eight participants was investigated to determine test-retest reliability of the SVM model in classifying painful stimuli. As seen in Table 3, accuracy in this second group was 74.6% (t (7) = 5.5, p = 0.0009). Average PPV was 83.6% and average NPV was 74.4%. We again examined whether accuracy could be improved by incorporating a confidence threshold based on distance from the separating hyperplane. In the retest group, as with the initial test group, when excluding the 15% of stimuli that were nearest to the hyperplane, the performance of the SVM classifier improved. The exact value of the confidence threshold differed between test groups, so that in both analyses, 15% of the stimuli were excluded. When excluding 15% of stimuli from the retest group, the overall accuracy was increased to 76.9%, PPV was increased to 85.8%, and NPV was increased to 76.7%.
In this study, we establish the feasibility of physiology-based pain detection using BOLD fMRI data and supervised machine learning algorithms. An SVM model, trained on 8 individuals, was 80.6% accurate at distinguishing painful from non-painful stimuli when tested on 16 individuals whose self-report data were not used in training.
BOLD activity in five brain regions was principally responsible for the SVM classifier's performance at distinguishing painful from non-painful stimulation. Increased activity in the primary somatosensory cortex, secondary somatosensory cortex, insular cortex, and primary motor cortex was predictive of painful stimulation. Increased activity in other areas of the primary motor cortex and in the pregenual anterior cingulate cortex was predicative of nonpainful stimulation. These five areas are consistent with prior literature that identifies critical pain processing regions of the human brain , , . The primary sensory cortex, secondary sensory cortex, and insular cortex have been implicated in sensory aspects of pain perception, the insular cortex has been implicated in emotional aspects of pain perception, and the primary motor cortex may play a role in the inhibition of reflexive withdraw from pain. Increased activity in the pregenual anterior cingulate cortex has been implicated in happiness ; we speculate that pain may have caused a state of unhappiness leading to decreased activity in this region.
Because the SVM model was powered by a relatively small set of brain regions, we were interested to know if activity in any one brain region could classify pain equally as well as the whole-brain approach. When tested, we found that an SVM, using recordings of activity in the secondary somatosensory cortex, performed significantly greater than chance at classifying pain and better than any of the other regions tested. Our findings are consistent with the secondary somatosensory cortex being the region which is most often reported to activate during painful stimulation , , . Our findings are also consistent with the theory that one primary role of the secondary somatosensory cortex in pain perception is to discern whether stimuli are painful or non-painful –. However, accuracy of the SVM which was trained using only data from the secondary somatosensory cortex was below that of the whole-brain approach. Therefore, we find that pain assessment based on whole-brain BOLD patterns of activity performs better than assessment based on the activity in individual brain regions.
We further found that the accuracy of the SVM classifier could be enhanced by employing distance from the separating hyperplane as a measure of the classifier's confidence. Greater distance from the separating hyperplane was indicative of greater confidence in the SVM classification. By taking this information into account, each classification was associated with a probability of its accuracy, and the SVM classifier's overall accuracy was increased, at the cost of excluding some stimuli on the basis of ambiguity.
While this study was designed to probe the use of physiology-based pain detection, the results also more largely suggest that the brain's neural representation of pain is robust and replicable across individuals. We found that the SVM classifier performed more accurately than chance when applied to study participants in both the test group and the retest group. This finding shows that across individuals, pain-induced BOLD signal changes are considerably similar with regard to both spatial location and absolute magnitude, measured in units of percent BOLD signal change. Therefore, while there may be considerable individual differences in the experience of pain and in patterns of brain activity induced by pain, there are nonetheless a core set of pain-induced responses in the brain that may be universal, at least when considering discreet thermal pain stimuli.
We are still very far from a physiology-based pain assessment tool that could be used in clinical, forensic, and other applied settings. However, we see the goal of an accurate, valid surrogate for self-reported pain as both attainable and worthy of effort. There are several areas where the method reported here for detecting pain can be improved. We outline five specific tasks below.
First, supervised machine learning algorithms should be used in conjunction with fMRI to extend the approach reported here by investigating pain intensity, and by distinguishing brain activity related to stimulus intensity from brain activity related to pain intensity. The potential of using fMRI and machine learning algorithms to measure pain intensity has been demonstrated using a within-person analysis , yet it remains unknown whether the approach can provide accurate measurements when data from the test subject are not included in training. At minimum, using an approach similar to the one used here, classifiers should be able to distinguish between low, moderate, and high levels of pain.
Second, using fMRI and machine learning algorithms, future experiments should develop physiology-based pain assessments that perform accurately across sensory modalities. While recent work has demonstrated that a major component of the brain regions activated by pain are also activated by non-painful somatosensory stimuli , we show here that painful stimuli can be distinguished from non-painful stimuli by the magnitude of activation; others have shown that painful stimuli can be distinguished from nonpainful stimuli by the time course of activation , . Taking into account the spatial location of brain activity, its magnitude, and its change over time, future studies should identify patterns of brain activity that distinguish pain regardless of the causal stimulus (for example, thermal, electrical, and mechanical stimuli should be tested). Doing so would further elucidate neural mechanisms that distinguish pain processing from sense modality-specific processing. The stimuli would also need to be tested in various locations on the body, to avoid developing models that are only accurate at assessing pain evoked in a specific body region.
Third, supervised machine learning algorithms should be developed that can distinguish pain from affective conditions that induce patterns of brain activity that are similar to those induced by pain. While previous research suggests that many of the brain regions that were most involved in driving the SVM's performance are associated with the sensory dimensions of pain such as pain intensity and localization , , , it is necessary to ensure that the approach used here is both sensitive and specific to pain. Therefore, a series of experiments should be conducted to determine whether SVM models can accurately distinguish physical pain from related affective experiences such as anticipation of pain , pain empathy , imagined pain , and social exclusion . These experiments would further validate the use of fMRI and machine learning algorithms as an approach which is not only accurate in controlled experimental settings, but in applied settings as well.
Fourth, SVM accuracy at classifying pain should be increased by incorporating various physiological and trait-based measurements. Sources of physiologic information such as skin conductance , heart rate , and pupil dilation  have been shown to correlate with measurements of pain. Similarly, trait differences such as gender , , genotype , fear of pain , and pain catastrophizing  have also been shown to correlate with measurements of pain. SVM and related machine learning algorithms are versatile tools that can learn complex relationships between multiple inputs; therefore, they are well suited for integrating varied measurements to make classifications which are more accurate than would result from the investigation of one data source in isolation. The goal in utilizing diverse data streams would be to yield accuracy levels as close to 100% as possible.
Fifth, future experiments should develop fMRI-based machine learning algorithms that can measure chronic pain. We have shown here that it is feasible to classify transient pain experiences by comparing the period of stimulation to a preceding pain-free rest period. While this is a major development, the method does not easily translate to chronic pain assessment because in patients with chronic pain, it is difficult to obtain a pain-free rest condition. More complex measurements of brain activity, for example, temporal covariance of the activity between regions, have been shown to correlate with pain perception . These methods should be used in conjunction with supervised machine learning algorithms to provide greater information and to generate physiology-based models that perform accurately at detecting chronic pain.
There are many machine learning algorithms and thus, many alternatives to SVM classification when using multi voxel pattern analysis and fMRI data to assess pain. As we have done here, other groups have used linear classifiers, such as SVMs and Fisher's linear discriminant, to distinguish two or more cognitive states using patterns of brain activity , , . In the case of fMRI data, there are typically many more features than examples, and therefore, one advantage of linear classifiers is a reduced risk of over-fitting. Furthermore, the direct comparison of linear and nonlinear classifiers of fMRI data has not demonstrated any advantage in accuracy when using a nonlinear classifier . Thus the greater model simplicity makes linear classifiers an attractive option. One alternative to SVM classification is the use of Gaussian process models, which are well suited for probabilistic classification, in which a machine learning algorithm not only classifies but also provides a measure of probability for each example belonging to a particular class. Marquand et al. have compared this method to SVM classification and find that accuracies are similar . Other approaches such as Gaussian process regression may be useful for measuring continuous variables such as pain intensity .
In conclusion, without relying on self-report from tested subjects, we demonstrate that in a controlled experimental setting, whole-brain patterns of brain activity can be used to assess whether a heat stimulus is painful. The results suggest that to advance the development of a physiology-based pain measure, neuroimaging methods can benefit from incorporating machine learning techniques, and from deeper investigation of the complex interplay of brain regions in mediating the experience of pain.
We thank Hanna Michelsen and Hoameng Ung for technical assistance and Catherine Chang, Ph.D., for discussion. We also thank Ian Carroll, M.D., M.S., Catherine Chang, Ph.D., Andrea Crowell, M.D., Gary Glover, Ph.D., Fumiko Hoeft, M.D., Ph.D., Jiang-Ti Kong, M.D., Honglak Lee, Ph.D., Rebecca McCue, Patricia Rohrs, and Andrew Saxe, for reading the manuscript.
Conceived and designed the experiments: JEB NC SM. Performed the experiments: JEB NC. Analyzed the data: JEB NC JY SM. Wrote the paper: JEB NC JY SM.
- 1. IASP Task Force on Taxonomy (1994) Part III pain terms: a current list with definitions and notes on usage. In: Merskey H, Bogduk N, editors. Classification of chronic pain: descriptions of chronic pain syndromes and definitions of pain terms, second edition. Seattle: IASP Press. pp. 209–13.IASP Task Force on Taxonomy1994Part III pain terms: a current list with definitions and notes on usage.H. MerskeyN. BogdukClassification of chronic pain: descriptions of chronic pain syndromes and definitions of pain terms, second editionSeattleIASP Press20913
- 2. Li D, Puntillo K, Miaskowski C (2008) A review of objective pain measures for use with critical care adult patients unable to self-report. J Pain 9: 2–10.D. LiK. PuntilloC. Miaskowski2008A review of objective pain measures for use with critical care adult patients unable to self-report.J Pain9210DOI:10.1016/j.jpain.2007.08.009. DOI:10.1016/j.jpain.2007.08.009.
- 3. Herr K, Bjoro K, Decker S (2006) Tools for assessment of pain in nonverbal older adults with dementia: a state-of-the-science review. J Pain Symptom Manage 31: 170–92.K. HerrK. BjoroS. Decker2006Tools for assessment of pain in nonverbal older adults with dementia: a state-of-the-science review.J Pain Symptom Manage3117092DOI:10.1016/j.jpainsymman.2005.07.001. DOI:10.1016/j.jpainsymman.2005.07.001.
- 4. Puntillo KA, Morris AB, Thompson CL, Stanik-Hutt J, White CA, et al. (2004) Pain behaviors observed during six common procedures: results from Thunder Project II. Crit. Care Med 32: 421–7.KA PuntilloAB MorrisCL ThompsonJ. Stanik-HuttCA White2004Pain behaviors observed during six common procedures: results from Thunder Project II. Crit.Care Med324217DOI:10.1097/01.CCM.0000108875.35298.D2. DOI:10.1097/01.CCM.0000108875.35298.D2.
- 5. Gélinas C, Fillion L, Puntillo KA, Viens C, Fortier M (2006) Validation of the critical-care pain observation tool in adult patients. Am J Crit Care 15: 420–7.C. GélinasL. FillionKA PuntilloC. ViensM. Fortier2006Validation of the critical-care pain observation tool in adult patients.Am J Crit Care154207
- 6. Young J, Siffleet J, Nikoletti S, Shaw T (2006) Use of a Behavioural Pain Scale to assess pain in ventilated, unconscious and/or sedated patients. Intensive Crit Care Nurs 22: 32–9.J. YoungJ. SiffleetS. NikolettiT. Shaw2006Use of a Behavioural Pain Scale to assess pain in ventilated, unconscious and/or sedated patients.Intensive Crit Care Nurs22329DOI:10.1016/j.iccn.2005.04.004. DOI:10.1016/j.iccn.2005.04.004.
- 7. Shankar K, Bharathi S, Daniel J (2009) An Empirical Approach for Objective Pain Measurement using Dermal and Cardiac Parameters. ICBME Proceedings 23: 678–81.K. ShankarS. BharathiJ. Daniel2009An Empirical Approach for Objective Pain Measurement using Dermal and Cardiac Parameters.ICBME Proceedings2367881DOI:10.1007/978-3-540-92841-6_166. DOI:10.1007/978-3-540-92841-6_166.
- 8. Tousignant-Laflamme Y, Rainville P, Marchand S (2005) Establishing a link between heart rate and pain in healthy subjects: a gender effect. J Pain 6: 341–7.Y. Tousignant-LaflammeP. RainvilleS. Marchand2005Establishing a link between heart rate and pain in healthy subjects: a gender effect.J Pain63417DOI:10.1016/j.jpain.2005.01.351. DOI:10.1016/j.jpain.2005.01.351.
- 9. Faye PM, De Jonckheere J, Logier R, Kuissi E, Jeanne M, et al. (2010) Newborn infant pain assessment using heart rate variability analysis. Clin J Pain 26: 777–82.PM FayeJ. De JonckheereR. LogierE. KuissiM. Jeanne2010Newborn infant pain assessment using heart rate variability analysis.Clin J Pain2677782DOI:10.1097/AJP.0b013e3181ed1058. DOI:10.1097/AJP.0b013e3181ed1058.
- 10. Storm H (2000) Skin conductance and the stress response from heel stick in preterm infants. Arch Dis Child Fetal Neonatal Ed 2000 83: F143–7.H. Storm2000Skin conductance and the stress response from heel stick in preterm infants.Arch Dis Child Fetal Neonatal Ed 200083F1437DOI:10.1136/fn.83.2.F143. DOI:10.1136/fn.83.2.F143.
- 11. Nir RR, Sinai A, Raz E, Sprecher E, Yarnitsky D (2010) Pain assessment by continuous EEG: association between subjective perception of tonic pain and peak frequency of alpha oscillations during stimulation and at rest. Brain Res 1344: 77–86.RR NirA. SinaiE. RazE. SprecherD. Yarnitsky2010Pain assessment by continuous EEG: association between subjective perception of tonic pain and peak frequency of alpha oscillations during stimulation and at rest.Brain Res13447786DOI:10.1016/j.brainres.2010.05.004. DOI:10.1016/j.brainres.2010.05.004.
- 12. Bossart P, Fosnocht D, Swanson E (2007) Changes in heart rate do not correlate with changes in pain intensity in emergency department patients. J Emerg Med 32: 19–22.P. BossartD. FosnochtE. Swanson2007Changes in heart rate do not correlate with changes in pain intensity in emergency department patients.J Emerg Med321922DOI:10.1016/j.jemermed.2006.05.029. DOI:10.1016/j.jemermed.2006.05.029.
- 13. Hellerud BC, Storm H (2002) Skin conductance and behaviour during sensory stimulation of preterm and term infants. Early Hum Dev 70: 35–46.BC HellerudH. Storm2002Skin conductance and behaviour during sensory stimulation of preterm and term infants.Early Hum Dev703546DOI:10.1016/S0378-3782(02)00070-1. DOI:10.1016/S0378-3782(02)00070-1.
- 14. Harrison D, Boyce S, Loughnan P, Dargaville P, Storm H, et al. (2006) Skin conductance as a measure of pain and stress in hospitalised infants. Early Hum Dev 82: 603–8.D. HarrisonS. BoyceP. LoughnanP. DargavilleH. Storm2006Skin conductance as a measure of pain and stress in hospitalised infants.Early Hum Dev826038DOI:10.1016/j.earlhumdev.2005.12.008. DOI:10.1016/j.earlhumdev.2005.12.008.
- 15. Miller G (2009) Neuroscience. Brain scans of pain raise questions for the law. Science 323: 195.G. Miller2009Neuroscience. Brain scans of pain raise questions for the law.Science323195DOI:10.1126/science.323.5911.195. DOI:10.1126/science.323.5911.195.
- 16. Formisano E, De Martino F, Bonte M, Goebel R (2008) “Who” is saying “what”? Brain-based decoding of human voice and speech. Science 322: 970–3.E. FormisanoF. De MartinoM. BonteR. Goebel2008“Who” is saying “what”? Brain-based decoding of human voice and speech.Science3229703DOI:10.1126/science.1164318. DOI:10.1126/science.1164318.
- 17. Miyawaki Y, Uchida H, Yamashita O, Sato MA, Morito Y, et al. (2008) Visual image reconstruction from human brain activity using a combination of multiscale local image decoders. Neuron 60: 915–29.Y. MiyawakiH. UchidaO. YamashitaMA SatoY. Morito2008Visual image reconstruction from human brain activity using a combination of multiscale local image decoders.Neuron6091529DOI:10.1016/j.neuron.2008.11.004. DOI:10.1016/j.neuron.2008.11.004.
- 18. Marquand A, Howard M, Brammer M, Chu C, Coen S, et al. (2010) Quantitative prediction of subjective pain intensity from whole-brain fMRI data using Gaussian processes. NeuroImage 49: 2178–89.A. MarquandM. HowardM. BrammerC. ChuS. Coen2010Quantitative prediction of subjective pain intensity from whole-brain fMRI data using Gaussian processes.NeuroImage49217889DOI:10.1016/j.neuroimage.2009.10.072. DOI:10.1016/j.neuroimage.2009.10.072.
- 19. deCharms RC, Maeda F, Glover GH, Ludlow D, Pauly JM, et al. (2005) Control over brain activation and pain learned by using real-time functional MRI. Proc Natl Acad Sci U S A 102: 18626–31.RC deCharmsF. MaedaGH GloverD. LudlowJM Pauly2005Control over brain activation and pain learned by using real-time functional MRI.Proc Natl Acad Sci U S A1021862631DOI:10.1073/pnas.0505210102. DOI:10.1073/pnas.0505210102.
- 20. Kim DH, Adalsteinsson E, Glover GH, Spielman DM (2002) Regularized higher-order in vivo shimming. Magn Reson Med 48: 715–22.DH KimE. AdalsteinssonGH GloverDM Spielman2002Regularized higher-order in vivo shimming.Magn Reson Med4871522DOI:10.1002/mrm.10267. DOI:10.1002/mrm.10267.
- 21. Glover GH, Law CS (2001) Spiral-in/out BOLD fMRI for increased SNR and reduced susceptibility artifacts. Magn Reson Med 46: 515–22.GH GloverCS Law2001Spiral-in/out BOLD fMRI for increased SNR and reduced susceptibility artifacts.Magn Reson Med4651522DOI:10.1002/mrm.1222. DOI:10.1002/mrm.1222.
- 22. Glover GH, Li TQ, Ress D (2000) Image-based method for retrospective correction of physiological motion effects in fMRI: RETROICOR. Magn Reson Med 44: 162–7.GH GloverTQ LiD. Ress2000Image-based method for retrospective correction of physiological motion effects in fMRI: RETROICOR.Magn Reson Med441627DOI:10.1002/mrm.1522. DOI:10.1002/mrm.1522.
- 23. Taylor KS, Davis KD (2009) Stability of tactile- and pain-related fMRI brain activations: an examination of threshold-dependent and threshold-independent methods. Hum Brain Mapp 30: 1947–62.KS TaylorKD Davis2009Stability of tactile- and pain-related fMRI brain activations: an examination of threshold-dependent and threshold-independent methods.Hum Brain Mapp30194762DOI:10.1002/hbm.20641. DOI:10.1002/hbm.20641.
- 24. Veldhuijzen DS, Nemenov MI, Keaser M, Zhuo J, Gullapalli RP, et al. (2009) Differential brain activation associated with laser-evoked burning and pricking pain: an event-related fMRI study. Pain 141: 104–13.DS VeldhuijzenMI NemenovM. KeaserJ. ZhuoRP Gullapalli2009Differential brain activation associated with laser-evoked burning and pricking pain: an event-related fMRI study.Pain14110413DOI:10.1016/j.pain.2008.10.027. DOI:10.1016/j.pain.2008.10.027.
- 25. Moulton EA, Keaser ML, Gullapalli RP, Greenspan JD (2005) Regional intensive and temporal patterns of functional MRI activation distinguishing noxious and innocuous contact heat. J Neurophysiol 93: 2183–93.EA MoultonML KeaserRP GullapalliJD Greenspan2005Regional intensive and temporal patterns of functional MRI activation distinguishing noxious and innocuous contact heat.J Neurophysiol93218393DOI:10.1152/jn.01025.2004. DOI:10.1152/jn.01025.2004.
- 26. Wager TD, Rilling JK, Smith EE, Sokolik A, Casey KL, et al. (2004) Placebo-induced changes in fMRI in the anticipation and experience of pain. Science 303: 1162–7.TD WagerJK RillingEE SmithA. SokolikKL Casey2004Placebo-induced changes in fMRI in the anticipation and experience of pain.Science30311627DOI:10.1126/science.1093065. DOI:10.1126/science.1093065.
- 27. Becerra L, Breiter HC, Wise R, Gonzalez RG, Borsook D (2001) Reward circuitry activation by noxious thermal stimuli. Neuron 32: 927–46.L. BecerraHC BreiterR. WiseRG GonzalezD. Borsook2001Reward circuitry activation by noxious thermal stimuli.Neuron3292746DOI:10.1016/S0896-6273(01)00533-5. DOI:10.1016/S0896-6273(01)00533-5.
- 28. Mourão-Miranda J, Bokde ALW, Born C, Hampel H, Stetter M (2005) Classifying brain states and determining the discriminating activation patterns: Support Vector Machine on functional MRI data. Neuroimage 28: 980–95.J. Mourão-MirandaALW BokdeC. BornH. HampelM. Stetter2005Classifying brain states and determining the discriminating activation patterns: Support Vector Machine on functional MRI data.Neuroimage2898095DOI:10.1016/j.neuroimage.2005.06.070. DOI:10.1016/j.neuroimage.2005.06.070.
- 29. Cortes C, Vapnik V (1995) Support-vector networks. Machine learning 20: 273–297.C. CortesV. Vapnik1995Support-vector networks.Machine learning20273297DOI:10.1007/BF00994018. DOI:10.1007/BF00994018.
- 30. Apkarian AV, Bushnell MC, Treede RD, Zubieta JK (2005) Human brain mechanisms of pain perception and regulation in health and disease. Eur J Pain 9: 463–84.AV ApkarianMC BushnellRD TreedeJK Zubieta2005Human brain mechanisms of pain perception and regulation in health and disease.Eur J Pain946384DOI:10.1016/j.ejpain.2004.11.001. DOI:10.1016/j.ejpain.2004.11.001.
- 31. Coghill RC, Sang CN, Maisog JM, Iadarola MJ (1999) Pain intensity processing within the human brain: a bilateral, distributed mechanism. J Neurophysiol 82: 1934–43.RC CoghillCN SangJM MaisogMJ Iadarola1999Pain intensity processing within the human brain: a bilateral, distributed mechanism.J Neurophysiol82193443
- 32. Borsook D, Sava S, Becerra L (2010) The pain imaging revolution: advancing pain into the 21st century. Neuroscientist 16: 171–85.D. BorsookS. SavaL. Becerra2010The pain imaging revolution: advancing pain into the 21st century.Neuroscientist1617185DOI:10.1177/1073858409349902. DOI:10.1177/1073858409349902.
- 33. Peyron R, Laurent B, García-Larrea L (2000) Functional imaging of brain responses to pain. A review and meta-analysis (2000). Neurophysiol Clin 30: 263–88.R. PeyronB. LaurentL. García-Larrea2000Functional imaging of brain responses to pain. A review and meta-analysis (2000).Neurophysiol Clin3026388DOI:10.1016/S0987-7053(00)00227-6. DOI:10.1016/S0987-7053(00)00227-6.
- 34. Vogt BA, Berger GR, Derbyshire SWG (2003) Structural and functional dichotomy of human midcingulate cortex. Eur J Neurosci 18: 3134–44.BA VogtGR BergerSWG Derbyshire2003Structural and functional dichotomy of human midcingulate cortex.Eur J Neurosci18313444DOI:10.1111/j.1460-9568.2003.03034.x. DOI:10.1111/j.1460-9568.2003.03034.x.
- 35. Brooks J, Tracey I (2005) From nociception to pain perception: imaging the spinal and supraspinal pathways. J Anat 207: 19–33.J. BrooksI. Tracey2005From nociception to pain perception: imaging the spinal and supraspinal pathways.J Anat2071933DOI:10.1111/j.1469-7580.2005.00428.x. DOI:10.1111/j.1469-7580.2005.00428.x.
- 36. Treede RD, Apkarian AV, Bromm B, Greenspan JD, Lenz FA (2000) Cortical representation of pain: functional characterization of nociceptive areas near the lateral sulcus. Pain 87: 113–9.RD TreedeAV ApkarianB. BrommJD GreenspanFA Lenz2000Cortical representation of pain: functional characterization of nociceptive areas near the lateral sulcus.Pain871139DOI:10.1016/S0304-3959(00)00350-X. DOI:10.1016/S0304-3959(00)00350-X.
- 37. Timmermann L, Ploner M, Haucke K, Schmitz F, Baltissen R, et al. (2001) Differential coding of pain intensity in the human primary and secondary somatosensory cortex. J Neurophysiol 86: 1499–503.L. TimmermannM. PlonerK. HauckeF. SchmitzR. Baltissen2001Differential coding of pain intensity in the human primary and secondary somatosensory cortex.J Neurophysiol861499503
- 38. Frot M, Magnin M, Mauguière F, Garcia-Larrea L (2007) Human SII and posterior insula differently encode thermal laser stimuli. Cereb Cortex 17: 610–20.M. FrotM. MagninF. MauguièreL. Garcia-Larrea2007Human SII and posterior insula differently encode thermal laser stimuli.Cereb Cortex1761020DOI:10.1093/cercor/bhk007. DOI:10.1093/cercor/bhk007.
- 39. Mouraux A, Diukova A, Lee MC, Wise RG, Iannetti GD (2011) A multisensory investigation of the functional significance of the “pain matrix”. Neuroimage 54: 2237–49.A. MourauxA. DiukovaMC LeeRG WiseGD Iannetti2011A multisensory investigation of the functional significance of the “pain matrix”.Neuroimage54223749DOI:10.1016/j.neuroimage.2010.09.084. DOI:10.1016/j.neuroimage.2010.09.084.
- 40. Moulton EA, Keaser ML, Gullapalli RP, Greenspan JD (2005) Regional intensive and temporal patterns of functional MRI activation distinguishing noxious and innocuous contact heat. J Neurophysiol 93: 2183–93.EA MoultonML KeaserRP GullapalliJD Greenspan2005Regional intensive and temporal patterns of functional MRI activation distinguishing noxious and innocuous contact heat.J Neurophysiol93218393DOI:10.1152/jn.01025.2004. DOI:10.1152/jn.01025.2004.
- 41. Lui F, Duzzi D, Corradini M, Serafini M, Baraldi P, et al. (2008) Touch or pain? Spatio-temporal patterns of cortical fMRI activity following brief mechanical stimuli. Pain 138: 362–74.F. LuiD. DuzziM. CorradiniM. SerafiniP. Baraldi2008Touch or pain? Spatio-temporal patterns of cortical fMRI activity following brief mechanical stimuli.Pain13836274DOI:10.1016/j.pain.2008.01.010. DOI:10.1016/j.pain.2008.01.010.
- 42. Ploghaus A, Tracey I, Gati JS, Clare S, Menon RS, et al. (1999) Dissociating pain from its anticipation in the human brain. Science 284: 1979–81.A. PloghausI. TraceyJS GatiS. ClareRS Menon1999Dissociating pain from its anticipation in the human brain.Science284197981DOI:10.1126/science.284.5422.1979. DOI:10.1126/science.284.5422.1979.
- 43. Singer T, Seymour B, O'Doherty J, Kaube H, Dolan RJ, et al. (2004) Empathy for pain involves the affective but not sensory components of pain. Science 303: 1157–62.T. SingerB. SeymourJ. O'DohertyH. KaubeRJ Dolan2004Empathy for pain involves the affective but not sensory components of pain.Science303115762DOI:10.1126/science.1093535. DOI:10.1126/science.1093535.
- 44. Derbyshire SWG, Whalley MG, Stenger VA, Oakly DA (2004) Cerebral activation during hypnotically induced and imagined pain. NeuroImage 23: 392–401.SWG DerbyshireMG WhalleyVA StengerDA Oakly2004Cerebral activation during hypnotically induced and imagined pain.NeuroImage23392401DOI:10.1016/j.neuroimage.2004.04.033. DOI:10.1016/j.neuroimage.2004.04.033.
- 45. Eisenberger NI, Lieberman MD, Williams KD (2003) Does rejection hurt? An fMRI study of social exclusion. Science 302: 290–2.NI EisenbergerMD LiebermanKD Williams2003Does rejection hurt? An fMRI study of social exclusion.Science3022902DOI:10.1126/science.1089134. DOI:10.1126/science.1089134.
- 46. Chapman CR, Oka S, Bradshaw DH, Jacobson RC, Donaldson GW (1999) Phasic pupil dilation response to noxious stimulation in normal volunteers: relationship to brain evoked potentials and pain report. Psychophysiology 36: 44–52.CR ChapmanS. OkaDH BradshawRC JacobsonGW Donaldson1999Phasic pupil dilation response to noxious stimulation in normal volunteers: relationship to brain evoked potentials and pain report.Psychophysiology364452DOI:10.1017/S0048577299970373. DOI:10.1017/S0048577299970373.
- 47. Paulson PE, Minoshima S, Morrow TJ, Casey KL (1998) Gender differences in pain perception and patterns of cerebral activation during noxious heat stimulation in humans. Pain 76: 223–9.PE PaulsonS. MinoshimaTJ MorrowKL Casey1998Gender differences in pain perception and patterns of cerebral activation during noxious heat stimulation in humans.Pain762239DOI:10.1016/S0304-3959(98)00048-7. DOI:10.1016/S0304-3959(98)00048-7.
- 48. Naliboff BD, Berman S, Chang L, Derbyshire SWG, Suyenobu B, et al. (2003) Sex-related differences in IBS patients: central processing of visceral stimuli. Gastroenterology 124: 1738–47.BD NaliboffS. BermanL. ChangSWG DerbyshireB. Suyenobu2003Sex-related differences in IBS patients: central processing of visceral stimuli.Gastroenterology124173847DOI:10.1016/S0016-5085(03)00400-1. DOI:10.1016/S0016-5085(03)00400-1.
- 49. Zubieta JK, Heitzeg MM, Smith YR, Bueller JA, Xu K, et al. (2003) COMT val158met genotype affects mu-opioid neurotransmitter responses to a pain stressor. Science 299: 1240–3.JK ZubietaMM HeitzegYR SmithJA BuellerK. Xu2003COMT val158met genotype affects mu-opioid neurotransmitter responses to a pain stressor.Science29912403DOI:10.1126/science.1078546. DOI:10.1126/science.1078546.
- 50. Ochsner KN, Ludlow DH, Knierim K, Hanelin J, Ramachandran T, et al. (2006) Neural correlates of individual differences in pain-related fear and anxiety. Pain 120: 69–77.KN OchsnerDH LudlowK. KnierimJ. HanelinT. Ramachandran2006Neural correlates of individual differences in pain-related fear and anxiety.Pain1206977DOI:10.1016/j.pain.2005.10.014. DOI:10.1016/j.pain.2005.10.014.
- 51. Seminowicz DA, Davis KD (2006) Cortical responses to pain in healthy individuals depends on pain catastrophizing. Pain 120: 297–306.DA SeminowiczKD Davis2006Cortical responses to pain in healthy individuals depends on pain catastrophizing.Pain120297306DOI:10.1016/j.pain.2005.11.008. DOI:10.1016/j.pain.2005.11.008.
- 52. Ploner M, Lee MC, Wiech K, Bingel U, Tracey I (2010) Prestimulus functional connectivity determines pain perception in humans. Proc Natl Acad Sci U S A 107: 355–60.M. PlonerMC LeeK. WiechU. BingelI. Tracey2010Prestimulus functional connectivity determines pain perception in humans.Proc Natl Acad Sci U S A10735560DOI:10.1073/pnas.0906186106. DOI:10.1073/pnas.0906186106.
- 53. Cox DD, Savoy RL (2003) Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 19: 261–70.DD CoxRL Savoy2003Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex.Neuroimage1926170DOI:10.1016/S1053-8119(03)00049-1. DOI:10.1016/S1053-8119(03)00049-1.