Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A comparison of the effectiveness of functional MRI analysis methods for pain research: The new normal

  • Patrick W. Stroman ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    stromanp@queensu.ca

    Affiliations Centre for Neuroscience Studies, Queen’s University, Kingston, Ontario, Canada, Department of Biomedical and Molecular Sciences, Queen’s University, Kingston, Ontario, Canada, Department of Physics, Queen’s University, Kingston, Ontario, Canada

  • Howard J. M. Warren ,

    Contributed equally to this work with: Howard J. M. Warren, Gabriela Ioachim, Jocelyn M. Powers, Kaitlin McNeil

    Roles Data curation, Writing – original draft, Writing – review & editing

    Affiliation Centre for Neuroscience Studies, Queen’s University, Kingston, Ontario, Canada

  • Gabriela Ioachim ,

    Contributed equally to this work with: Howard J. M. Warren, Gabriela Ioachim, Jocelyn M. Powers, Kaitlin McNeil

    Roles Data curation, Writing – review & editing

    Affiliation Centre for Neuroscience Studies, Queen’s University, Kingston, Ontario, Canada

  • Jocelyn M. Powers ,

    Contributed equally to this work with: Howard J. M. Warren, Gabriela Ioachim, Jocelyn M. Powers, Kaitlin McNeil

    Roles Data curation, Writing – review & editing

    Affiliation Centre for Neuroscience Studies, Queen’s University, Kingston, Ontario, Canada

  • Kaitlin McNeil

    Contributed equally to this work with: Howard J. M. Warren, Gabriela Ioachim, Jocelyn M. Powers, Kaitlin McNeil

    Roles Data curation, Writing – review & editing

    Affiliations Centre for Neuroscience Studies, Queen’s University, Kingston, Ontario, Canada, Royal Military College of Canada, Kingston, Ontario, Canada

Abstract

Studies of the neural basis of human pain processing present many challenges because of the subjective and variable nature of pain, and the inaccessibility of the central nervous system. Neuroimaging methods, such as functional magnetic resonance imaging (fMRI), have provided the ability to investigate these neural processes, and yet commonly used analysis methods may not be optimally adapted for studies of pain. Here we present a comparison of model-driven and data-driven analysis methods, specifically for the study of human pain processing. Methods are tested using data from healthy control participants in two previous studies, with separate data sets spanning the brain, and the brainstem and spinal cord. Data are analyzed by fitting time-series responses to predicted BOLD responses in order to identify significantly responding regions (model-driven), as well as with connectivity analyses (data-driven) based on temporal correlations between responses in spatially separated regions, and with connectivity analyses based on structural equation modeling, allowing for multiple source regions to explain the signal variations in each target region. The results are assessed in terms of the amount of signal variance that can be explained in each region, and in terms of the regions and connections that are identified as having BOLD responses of interest. The characteristics of BOLD responses in identified regions are also investigated. The results demonstrate that data-driven approaches are more effective than model-driven approaches for fMRI studies of pain.

Introduction

Pain is complex and highly subjective, being an emotional and cognitive response to nociceptive signaling, and varying with a person’s environment and mental state [1, 2]. Pain serves an important purpose of motivating us to protect ourselves from injury, and to protect an injury while it heals. However, it can have devastating effects when it is maladaptive and occurs in the absence of noxious input, or is disproportionate to noxious or sensory stimuli. As a result, pain presents challenges for clinical and basic research. In spite of its impact, our understanding of the neural processes underlying pain is still quite limited [3].

In the 1960s major advances were realized as a result of electrophysiological studies in the brainstem (BS) and spinal cord (SC) [1, 4, 5]. These studies identified the importance of descending regulation of nociceptive responses in the SC, and their influence on the pain a person experiences. Pain research has been further advanced by the development of functional neuroimaging, such as functional magnetic resonance imaging (fMRI), but the focus of pain research with fMRI shifted to the cortex due to the technical challenges of imaging the BS and SC. While these studies have added substantially to our understanding of pain (for example [69]), it has become clear that cortical areas identified as being involved with pain processing are involved with many functions, such as salience, and are not specific to pain [8, 10]. Functional MRI methods have been adapted for the BS and SC and the studies to date have identified regions that are involved with pain processes. These studies have added to our understanding of descending regulation of the SC, and have shown that it is a dynamic process that is influenced by cognitive and emotional factors (placebo, nocebo, mood, music), and that blood oxygenation-level dependent (BOLD) signal variations can be detected in a resting-state, and in advance of noxious stimuli [1133]. The latter were observed to be correlated with individual pain ratings to the stimuli which followed, and suggest the influence of pain anticipation in these regions [30, 31, 33, 34].

These studies also demonstrate the challenge for functional MRI analysis; how can we identify regions with BOLD responses to noxious stimuli, when we cannot predict the resulting BOLD responses in each person, and each situation? It is the differences in BOLD responses between individuals, or study groups, that are of interest for pain research, and these differences are not limited to the magnitude of the BOLD response with a fixed temporal pattern. The differences can include dynamic variations related to the myriad effects described above. It is possible that the limitations of using conventional model-based fMRI analysis methods (i.e. fitting time-series data to a predicted response) has resulted in important aspects of human pain responses going undetected. We therefore proposed to adapt data-driven fMRI analysis methods for pain studies, in order to detect the temporal patterns of BOLD responses. The objective of this study was to compare model-driven and data-driven fMRI analysis methods, using fMRI data from healthy participants in order to investigate the use of such methods, and identify their strengths and limitations. The data sets used span both the brain, and the BS and SC, in separate data sets, acquired with methods that were optimized for each region, and duplicate data sets are used in order to verify the performance of the methods that are compared.

Materials and methods

Functional MRI analysis approaches

Although the fMRI analysis methods to be compared are well-established and have been described in detail previously, we briefly describe the methods here in order to provide background for non-experts in fMRI theory, and to explain the approach and rationale for the present study.

Model-driven analysis (fit to a predicted model).

One of the first fMRI analysis methods [35, 36], and still likely the most widely-used for task-based fMRI studies, consists of predicting BOLD response patterns of interest, and identifying which voxels have time-series responses that sufficiently match this predicted pattern. The concept is that we impose a model of the BOLD pattern we are looking for, and determine the anatomical locations where it occurs. In the simplest model, a single predicted BOLD response, PBOLD (which is a function of time), can be modelled as the expected variation in signal over time, with an average value of zero, and a peak-to-peak amplitude of 1 (for simplicity). The measured time-series MRI signal from a voxel, S, (also a function of time) can then be modelled as S = β1 PBOLD+β0+err. Expressed in this form, β1 represents the magnitude of the fit BOLD response, and β0 is the average value of S. The “err” term is the residual signal variation that is not accounted for by the model. Calculating the fit of the measured data to the model determines the values of β1 and β0, and the standard errors of these values. The larger the values in the “err” term, the greater the standard errors of the β values (i.e. the worse the fit). The “null hypothesis” is that β1 = 0, and if the probability of this being true is low enough, then the alternative hypothesis is inferred to be true, and S is concluded to have a significant component that corresponds with the predicted BOLD response. That is, the voxel response is significant, and β1 is the magnitude of the predicted BOLD response. It is not necessary for the measured data to describe every detail of the predicted BOLD response pattern, but it is necessary to measure data at times with different predicted values (such as high and low values).

Data-driven analysis (connectivity analysis).

The alternative to modeling the BOLD response and identifying regions where it occurs, is to identify MRI signal variations in time which are related across spatially separated anatomical regions, and are therefore inferred to be physiologically relevant. In the context of fMRI data, these signal variations are assumed to be BOLD if they occur consistently, and in relevant anatomical regions. Even though the BOLD pattern(s) may be unknown or unpredictable, they can be identified based on the relationships between regions and anatomical information. While these methods are most often used to analyze resting-state fMRI data, they can also be applied to task-based data. Relationships between pain processing and BOLD responses or dynamic variations in connectivity can be identified with retrospective analysis of how they relate to the timing of noxious stimuli in a task-based study. While there are a number of data-driven analysis methods available [37], for the present comparison we focus on functional connectivity analyses. Connectivity analyses are based on the concept that BOLD signal variations are related to changes in metabolic demand, which is driven by pre-synaptic input signaling to a region [38]. If two regions have temporally related input signaling, then their BOLD responses are similarly related.

The simplest form of connectivity analysis is to calculate the temporal correlation between all pairs of voxels in an fMRI data set [39, 40]. This produces a large number of results, which must be assessed in relation to the anatomical locations of significantly connected voxels. This approach can be simplified by first identifying clusters of voxels which are spatially contiguous and have similar MRI time-series responses (and therefore similar function). Correlations can then be computed between all pairs of clusters. Similarly, the analysis can be limited to anatomical regions of interest, and can be applied on a voxel-by-voxel or cluster-by-cluster level.

However, this method imposes the assumption that a significant portion of the variance in a voxel/cluster time-series response can be explained by the time-series response in a single other region. In order to allow more flexibility, the time-series response in a region may be explained by the responses in two, or more, other regions. For example, if region A has a time-series response, SA, and we want to test if this response can be explained by two other regions, B and C, then we can use the model SA = βBASBCASC+err. This method is a form of Structural Equation Modeling (SEM) [41, 42] and requires some a priori knowledge (described below) of the anatomical regions that we want to model as the “target” regions and the “source” regions. The resulting fit provides the values of βBA and βCA, which reflect the connectivity to A, from B and C, respectively. Fitting BOLD responses in a target region to BOLD responses in multiple sources, guided by the known neuroanatomy, enables the direction of the connectivity to be inferred. For example, the value of βBA with A as the target and B as one of the sources, is generally expected to be different than the value of βAB, with B as the target and A as one of the sources. However, the calculated connection strengths are estimates, as they are influenced by whether or not the time-series responses SB and SC are independent, or are themselves correlated. The added flexibility of the method also adds to the possible complexity of the results, with the potential for more information being obtained.

Comparisons of analysis approaches

In the present study, model-driven and data-driven analysis methods were compared for the purpose of detecting pain processing in fMRI data from healthy human participants, in data sets from two prior studies which each spanned the brain and the BS/SC. However, the comparisons were limited to a selected set of analysis parameters for practical purposes. It is not possible to test every permutation of all methods. Functional MRI data from healthy participants were pre-processed to remove noise and confounds as much as possible. Clusters of voxels were identified within selected regions of interest based on the entire data set. Once the clusters were defined, cluster data were extracted for each participant/condition. The fMRI data acquisition, pre-processing, and clustering methods, are detailed below. All of the analysis methods being compared were applied to the same cluster data. The methods include 1) Model-driven fit to a predicted BOLD response, 2) Data-driven correlation between clusters, 3) Data-driven SEM with one source region, and 4) Data-driven SEM with two source regions. The significance of results was assessed in terms of the whether or not group-level fit parameters were significantly different than zero, whether connectivity accounted for a significant amount of variance in each region, and whether fit parameters were significantly correlated with pain ratings. The methods were compared using the amount of signal variance that could be explained in each region, and the numbers of regions that were identified as having BOLD responses.

Data sets from prior studies

Data for this comparison of analysis methods were anonymized data obtained from the healthy control groups in two previous fMRI studies by our lab. These studies were reviewed and approved by the Health Sciences Research Ethics board at Queen's University. All participants provided informed written consent, prior to participating.

The data from each participant, in both studies, were obtained spanning the entire brain in one imaging session, and spanning the BS and cervical SC in another session. Some participants either did not return for two sessions or technical difficulties resulted in data being collected from only one region (brain or BS/SC). Although these studies shared common features with respect to their aims and study designs, there are some differences as detailed below. The datasets were not combined, but rather were used as duplicate independent analyses to confirm our findings. In order to differentiate the two datasets, the first study, which was conducted between 2013–2014, will be referred to as ‘Study 1’, and the second study, conducted between 2018–2019, will be referred to as ‘Study 2’. Full details of the methods used for Study 1 have been previously published [11].

Participant recruitment

Study 1.

Healthy women were recruited from the local community and completed the study as a control group. All participants were free of previous neurological injury or disease, and were free of any contraindications for MRI. The study group consisted of 15 women (age range = 21–55, average 39.1 ± 10.2 years (mean ± std)).

Study 2.

Healthy women were again recruited from the local community, and completed the study as a control group, and were again free of any previous neurological injury or disease, or any contraindications for MRI. This group consists of 18 women (age range = 21–59, average 36 ± 11.3 years).

Participant characteristics and study preparation

Participants in both studies were characterized by completing questionnaires to assess anxiety, depression, pain catastrophizing, social desirability, and health-related factors, but these data are not used for the present analysis. Prior to fMRI data collection, each participant underwent a 1-hour training session, during which they were introduced to the experimental pain stimulus and study design, and were trained how to rate their pain using a standardized numerical pain intensity scale (NPS). The scale ranges from 0 to 100 in increments of 5, with verbal descriptors at increments of 10 [11, 43]. In both studies, the stimulus consisted of heat applied briefly to the skin overlying the thenar eminence (base of the thumb) on the right hand. The stimulus devices, temperatures, and timings, were different for the two studies, as detailed below. A series of calibration tests with varying stimulus temperatures (between 40°C and 52°C) were conducted so that participants could become accustomed to the thermal stimulation, and study procedures. The stimulus temperature was calibrated in order to elicit a rating of 50 ± 10 NPS units for the participant. The goal was to have every participant subjectively feel a similar intensity of pain. Participants also underwent a practice fMRI run in a mockup of our MRI system in order to add to their familiarity with the procedures and environment, and reduce potential anxiety. The pain ratings reported by participants consistently varied between the training and imaging portions of the study, and varied across fMRI acquisitions, resulting in a range of pain ratings in spite of the training and calibration efforts.

FMRI paradigm

Study 1.

Heat stimuli were applied to the hand by means of an MRI-compatible Peltier thermode (Medoc®, Ramat Yishai, Israel), which was attached to the participant’s right hand, overlying the thenar eminence. During heat stimulation, the temperature was rapidly increased and decreased under computer control. Imaging runs were separated into two study conditions: temporal summation of second pain (TSSP) and TSSP-Control (TSSP-C). Only the data from the TSSP condition are used for the present comparison of methods. Repeated imaging runs for each condition were implemented in a randomized order, and a minimum of 2 minutes of rest was given between each run. For the TSSP condition, 11 heat spikes with the previously calibrated temperature to elicit a rating of 50 ± 10 NPS units were applied every 3 seconds. The TSSP condition’s stimulation period was preceded by a 52 second rest period and followed by a 65 second rest period (Fig 1). Similar to the training session, participants viewed instructions on a rear-projection screen which notified them when a new scan was about to begin, when the application of the heat stimulus would begin, and when to report their ratings for the first and last heat contacts (Fig 1).

thumbnail
Fig 1. FMRI paradigms for Study 1 and Study 2.

Functional imaging runs in Study 1 were 150 seconds long, and the heat pain was administered as 11 consecutive heat spikes over a span of 33 seconds. Functional imaging runs in Study 2 were 270 seconds long, and the heat pain was administered as 10 brief heat contacts over a span of 30 seconds. Letters indicate different prompts being delivered to participants over the rear-projection screen. A = “you will feel heat.” B = “the pain stimulus will begin in 3…2…1…” C = “please provide your first and last pain ratings.” The predicted BOLD response based on the stimulation paradigm is also shown. However, the data sets from each participant consist of between 4 and 6 repeated runs with this stimulation paradigm.

https://doi.org/10.1371/journal.pone.0243723.g001

Study 2.

Heat stimuli were applied to the participant’s right hand overlying the thenar eminence, by means of an MRI-compatible Robotic Contact-Heat Thermal Heat Stimulator (RTS-2; SpinalMap Inc., Kingston, Ontario). This device pneumatically raises and lowers a heated aluminum thermode to make contact with the participants’ skin, and is precisely controlled using software written in MATLAB (Mathworks Inc., Natick, MA). A ‘threat/safety’ paradigm was employed, in which participants were unaware at the beginning of each run whether or not a painful stimulus would be applied. The imaging runs were separated into two study conditions: ‘Stimulation’ and ‘No-Stimulation’. Repeated imaging runs for each condition were obtained in a randomized order, and a minimum of 2 minutes was given between stimulation periods in successive runs. A rear-projection screen was used to inform the participants when the next imaging run would begin (Fig 1). After 60 seconds of baseline scanning, participants were informed whether that run would involve the thermal heat stimulation (Stimulation) or not (No-Stimulation). If it was a Stimulation run, the participants were informed when the stimulation was to begin at the 120 second mark, and then 10 heat contacts at the calibrated temperature were administered over 30 seconds. This 30 second stimulation period was followed by a 120 second rest period, for a total time of 4 minutes and 30 seconds (Fig 1). At the end of the Stimulation runs, the participants were prompted to provide their pain ratings for the first and last heat contacts, via an intercom. Only the data from the Stimulation condition was used for the analyses in the present study.

FMRI data acquisition

All image data were acquired using a 3 tesla whole-body MRI system (Siemens Magnetom Trio; Siemens, Erlangen, Germany). For all studies, participants were positioned supine and were supported by foam padding as needed to ensure comfort and minimize bulk body movement. Imaging methods were optimized for each region (brain, or BS/SC), due to the different imaging challenges, and were acquired with T2*-weighted imaging in the brain, and T2-weighted imaging in the BS and SC, in order to provide an optimal balance of image quality and BOLD sensitivity in both regions [31, 44, 45]. Although T2-weighted imaging for BOLD sensitivity was demonstrated in some of the earliest fMRI studies [46, 47] it is rarely used for brain fMRI, but it is well-established for BS/SC fMRI [44]. Initial localizer images were acquired in three planes as a reference for slice positioning for subsequent fMRI studies.

Study 1 brain fMRI.

Functional images were acquired in 49 contiguous axial slices oriented parallel to the anterior commissure-posterior commissure (AC-PC) line using a T2*-weighted gradient-echo echo-planar imaging (GE-EPI) sequence (TR = 3 s, TE = 30 ms, Flip Angle = 90°, FOV = 192 mm x 192 mm, Matrix = 64 x 64, Resolution = 3 x 3 x 3 mm3). A 12-channel head coil was used for detection of the MRI signal, with a body coil for transmission of RF pulses. A total of 50 volumes were acquired for each imaging run. Five runs of the same type were combined for each fMRI data set.

Study 2 brain fMRI.

Functional images were acquired in 66 contiguous axial slices using a T2*-weighted GE-EPI sequence (TR = 2 s, TE = 30 ms, Flip Angle = 84°, Multiband = 3, 7/8 Partial Fourier, FOV = 180 mm x 180 mm, Matrix = 90 x 90, Resolution = 2 x 2 x 2 mm3). A 32-channel head coil was used for detection of the MR signal, with a body coil for transmission of RF pulses. A total of 135 volumes were acquired for each imaging run. Three to five runs of the same type were combined for each fMRI data set.

Study 1 and Study 2, brainstem and spinal cord fMRI.

Functional MRI data were acquired with a T2-weighted half-fourier single-shot fast spin-echo (HASTE) sequence. Data were acquired in 9 contiguous sagittal slices with a repetition time (TR) of 0.75 sec/slice, an echo time of 76 msec to optimize the T2-weighted BOLD sensitivity, and a 28 × 21 cm field-of-view with 1.5 × 1.5 × 2 mm3 resolution [45]. The imaging volume spanned from the T1 vertebra to above the thalamus, and spanned the entire cervical SC and BS left-to-right. Data were acquired using the upper elements of a spine receiver-array coil, a posterior neck coil, and the posterior half of a 12-channel head coil. The receiver elements were adjusted based on the participant’s size, as needed. A body coil was used for transmitting radio-frequency (RF) excitation pulses. In Study 1, a total of 138 volumes were acquired for each condition (over 6 repeated runs). In Study 2, a total of 200 volumes were acquired for each condition (over 5 repeated runs). The image quality was enhanced by means of spatial suppression pulses anterior to the spine to reduce motion artefacts caused by breathing, swallowing, etc, and motion compensating gradients in the head-foot direction.

FMRI data preprocessing

Brain fMRI data.

Data from both studies were preprocessed using SPM12 software (Wellcome Institute of Cognitive Neurology, London, UK). Data from both studies were preprocessed using SPM12 software (Wellcome Institute of Cognitive Neurology, London, UK). The data were converted from DICOM to NIfTI format, and were then co-registered to the third volume in the time-series to correct for motion, and motion parameters were retained for later noise modeling. We considered motion exceeding one voxel width or 5 degrees of rotation to be excessive, and no data sets were discarded because of excess motion. Slice-timing correction was applied by interpolating to the middle of each volume acquisition period. Spatial normalization was then applied to the data from each participant by first normalizing the fMRI data to the anatomical images from the same participant, to make use of the better data quality of the anatomical images, and then normalizing the anatomical images to the MNI template. The complete transformation needed to map the fMRI data to the MNI template (Montreal Neurological Institute, Montreal, Quebec) was thus determined. The first two volumes of each run were discarded to avoid periods without consistent T1-weighting, and the remaining time-series responses for each voxel were converted to a percent signal change from the time-series average.

BS/SC fMRI data.

Functional images were preprocessed using our freely-shared software “SpinalFMRI9”, written in MATLAB (The Mathworks Inc., Natick, MA) that has been used extensively in prior SC and BS fMRI studies [11, 4850]. Pre-processing steps included conversion to NIfTI format, co-registration using the Medical Image Registration Toolbox (MIRT) [51], interpolation to 1 mm3 resolution, and spatial normalization to a pre-defined anatomical template based on 300 healthy participants, as described below, using normalization methods described previously [30, 33, 34, 44, 52]. Physiological noise was modeled, and then removed from the data, based on peripheral pulse recordings, bulk motion, and global signal variations in white matter. Our methods of removing physiological noise are highly effective and have been validated by quantifying the contribution from each source of noise, and making comparisons with data from cadavers [31, 45]. Finally, the first two volumes of each run were discarded to avoid periods without consistent T1-weighting, and the remaining time-series responses for each voxel were converted to a percent signal change from the time-series average.

Anatomical templates and region maps

We have combined region maps and anatomical reference images (templates) across the brain and SC regions (the entire CNS) as described by De Leener et al. [53]. An anatomical reference template was thus created by combining the PAM50 template [53] of the SC, and the MNI152 template of the BS/brain. The resulting map was interpolated to 0.5 mm cubic voxels, and can be scaled to lower resolution as needed. For our purposes, an anatomical reference image of the cervical SC and BS region (spanning where the two existing templates join) was also created. This was done by spatially normalizing fMRI data from 1440 fMRI data sets in 300 healthy participants to the combined template, and averaging the normalized images to create a single template.

Corresponding anatomical region-of-interest maps (0.5 mm isotropic resolution) were also defined across the entire CNS by combining probabilistic regions maps from multiple sources, and region maps based on anatomical atlases and published descriptions. Brain regions were identified primarily with the region maps provided in the CONN15e software package [1, 54, 55]. SC gray matter and white matter maps were obtained from PAM50 template in “The Spinal Cord Toolbox” [56]. In addition, the SC was divided into segments, with positions based on the anatomical study done by Lang and Bartram [57], and segments were divided into right/left and anterior/posterior quadrants. BS regions not included in the CONN15e region map were added based on examples and anatomical descriptions [1, 5862], freely shared atlases as described by Pauli et al. [63] (https://identifiers.org/neurovault.collection:3145), Keren et al. [64], and Harvard atlases [65]. The resulting region maps are thus probabilistic, and indicate the likely location of anatomical regions of interest within each data set, after it has been spatially normalized.

Definition of clusters

The anatomical regions to be used for the SEM analysis were identified in spatially normalized data using the pre-defined anatomical reference described above. As it is not expected that entire anatomical regions are uniformly involved in pain responses, regions were first divided into 7 clusters based on the fMRI data. That is, the clustering was based on BOLD responses as opposed to assumed anatomical sub-divisions. Voxels within each region were first identified, and clustering was carried out using a k-means method. This was applied to data from each study separately, which was concatenated across all runs in all participants. The cluster definitions are thus based on similarity of the measured time-series responses across the entire study group. This procedure was repeated for each region of interest, and the same cluster definitions were used for analyzing data from Study 1 and Study 2, but different clusters were used for brain data, and BS/SC data, because of the different imaging parameters and anatomical regions. The choice of 7 clusters for each region was based on previous studies which showed that this number provided a suitable balance of resulting cluster sizes and flexibility in the separation of anatomical sub-regions. The regions used are displayed in Fig 2 by generating a 3D plot in MATLAB, rendering the region surfaces using the MATLAB functions “isosurface”, “patch”, and “isonormals”, and assigning each region a different colour. The 2D figures were then captured in PDF format from the 3D plots and paste into Adobe Illustrator for adding text annotations and colour bars. For brain fMRI data the regions include the anterior cingulate (AC), amygdala, frontal orbital region (FOrb), heschel’s gyrus (HG), the hippocampus (Hipp), hypothalamus (Hyp), insular cortex (IC), periaqueductal gray region (PAG), posterior cingulate (PC), thalamus, and nucleus accumbens (Accumb.). For BS/SC fMRI data the regions include the right dorsal region of the 6th cervical SC segment (C6RD), the dorsal reticular nucleus of the medulla (DRt), the hypothalamus, locus coeruleus (LC), nucleus gigantocellularis (NGc), nucleus raphe magnus (NRM), nucleus tractus solitarius (NTS), the PAG, parabrachial nuclei (PBN, medial and lateral divisions), thalamus, and ventral tegmental area (VTA).

thumbnail
Fig 2.

Anatomical regions included in brain (left), and BS and SC (right), data analysis.

https://doi.org/10.1371/journal.pone.0243723.g002

Application of the data analysis methods and comparison of results

Following pre-processing steps described above, clusters were defined for selected regions of interest which are known/suspected of being involved with aspects of pain. Voxel data were then extracted and average time-series responses were computed for each cluster, in each run, from each participant. The following analyses were then applied:

  1. Data were fit to predicted BOLD response (Fig 1) using a general linear model (GLM), and the significance of β-values were determined (i.e. must be significantly different than zero, which requires that the fit accounts for a significant amount of variance). The predicted response was determined by convolving the canonical hemodynamic response function with the timing of the stimulation paradigm [66]. Analyses were applied to data from each participant concatenated into one large data set, to data from all participants averaged, and also to data from each participant individually, with repeated runs concatenated. The number of time points used for each calculation are listed in Table 1.
  2. Connectivity was computed based on the correlation between all possible pairs of clusters from different regions, and significance was based on Z-values (the correlation must account for a significant amount of the variance). Data from all participants were concatenated for selected time periods, and were also analyzed for each participant individually, with repeated runs concatenated. Dynamic connectivity was calculated using a sliding window spanning 30 second epochs for brain data (10 or 15 volumes, Study1 and Study 2 respectively), and 45 second epochs for BS/SC data, or 7 volumes. The number of time points used for each calculation are listed in Table 1.
  3. Connectivity was computed using SEM with 1 or 2 source regions in separate analyses, with significance based on the amount of variance explained in the target region (expressed as Z values), and on the significance of β-values. Data from all participants were concatenated for selected time periods, and were also analyzed for each participant individually, with repeated runs concatenated. Significance was inferred if the fit explained a significant amount of variance in the target region, and all connectivity weighting factors (β-values) were significantly different than zero, and also the F-test for each connection was significant (all connections contributed significantly to the fit). Again, the number of time points used for each calculation, for each target or source region, are listed in Table 1. The SEM models that were used, are shown in S1 Fig.
  4. β-values determined from GLM fits, and SEM fits, were tested for correlation with pain ratings in each participant (connectivity correlation, R, values were not included because these values are not linearly related to strength of the connection).
  5. The performance of analysis methods was compared based on the average amount of variance explained in each cluster.
  6. Results were assessed by investigating the characteristics of the BOLD responses in regions identified by the previous analyses, and comparing the temporal pattern of BOLD responses across regions, data sets, and to the stimulation paradigms.
thumbnail
Table 1. The number of imaging volumes (i.e. time points) used for each calculation with each analysis method, at the group and individual levels.

https://doi.org/10.1371/journal.pone.0243723.t001

Statistical thresholds

Statistical thresholds used to infer significance were corrected for multiple comparisons, in every case. In order to confirm that suitable thresholds were used, all analysis methods were applied to replicated data sets consisting of random values, to create “null” data sets in which no significant values should be detected. Statistical distributions were thus determined, and statistical thresholds were identified to ensure that there was less than a 5% chance of a single false-positive (Type I) result occurring in any analysis (i.e. family-wise-error corrected p < 0.05).

Results

Each analysis method identified significant BOLD responses in regions, or as connectivity between regions, across the two sets of study data, in both brain and BS/SC regions. The results of the analyses are summarized in Figs 3 and 4. These figures were generated using the methods described above for Fig 2, with the addition of significant connections between regions indicated with lines plotted in MATLAB. A larger number of regions/clusters were identified in all data sets by means of data-driven approaches, including correlations between time-series responses, and structural equation modeling (SEM), than with the model-driven GLM fit to a predicted response. A number of regions were also observed to have connectivity weighting values, measured with SEM, that are significantly correlated with individual pain ratings, also as shown in Figs 3 and 4. The regions identified with each method are summarized in Table 2, for brevity. Details of the regions and connections identified with each analysis method are listed in S1 through S10 Tables. The average amount of variance explained per cluster, with each analysis method, is plotted in Fig 5.

thumbnail
Fig 3. Anatomical regions identified with the analysis methods tested in brain regions.

Regions are shown for the GLM fit, connections are shown for correlation results, and both regions and connections are shown for SEM results.

https://doi.org/10.1371/journal.pone.0243723.g003

thumbnail
Fig 4. Anatomical regions identified with the analysis methods tested in BS and SC regions.

Regions are shown for the GLM fit, connections are shown for correlation results, and both regions and connections are shown for SEM results. “GLM fit to Model” refers to the model-driven analysis, “Correlation” indicates connectivity analysis based on temporal correlation, SEM 1 and SEM 2 refer to structural equation modeling with 1 and 2 source regions, respectively, and “Corr. with Pain” indicates SEM results (β-values) which are significantly correlated with pain ratings from each participant.

https://doi.org/10.1371/journal.pone.0243723.g004

thumbnail
Fig 5. Plots of the average amount of variance explained in each region included in the analysis, for each of the analysis methods being compared.

Abbreviations: GLM; general linear model fit of the data to a predicted BOLD response, Corr.; connectivity calculated by means of temporal correlation, SEM1 and SEM2; structural equation modeling with 1 or 2 source regions, respectively. Variations are indicated as follows: “cat”; concatenated data across the group, “avg”; data averaged across the group, “ind.”; analysis applied to data from each individual participant.

https://doi.org/10.1371/journal.pone.0243723.g005

thumbnail
Table 2. Summary of the regions identified with each of the analysis methods.

https://doi.org/10.1371/journal.pone.0243723.t002

Time-series responses were extracted from selected regions, based on the analysis results, in order to examine their physiological relevance and relationships with the stimulation paradigms. Examples of responses across brain and BS regions in Study 1 are shown in Fig 6, for the anterior cingulate (AC), insula (IC), and nucleus raphe magnus (NRM). A larger set of time-series responses are shown in S2 Fig, from all 4 data sets, for selected regions including the AC, IC, hypothalamus, thalamus, PAG, NGc, and NRM. Examples of dynamic variations in connectivity detected with SEM are shown in Fig 7, for the selected connection of PAG→Hypothalamus. This connection was chosen because it occurs in all of the data sets that were analyzed. Clusters shown were selected from BS/SC data, and similar source and target clusters were selected for comparison with brain fMRI data. Because the cluster definitions are different for the two data sets, and the different acquisition parameters such as spatial resolution, the exact same clusters are not shown, but have centers that are within 11.2 mm for the sources, and within 8.7 mm for the targets.

thumbnail
Fig 6. Details of BOLD responses in selected regions from Study 1.

The three plots are offset vertically for clarity. The vertical axis indicates the relative scale for each of the 3 plots. The horizontal axis indicates time, with the origin at onset of stimulation. The vertical line indicates when participants were informed of which type of stimulation to expect in Study 2. Lines plotted in red are from brain fMRI data, and the line plotted in orange is from BS/SC data. The fit model paradigm to each time-series response is also shown in black on each plot.

https://doi.org/10.1371/journal.pone.0243723.g006

thumbnail
Fig 7. Examples of dynamic variations in the PAG→Hypothalamus connection, as identified with SEM analysis with 2 sources.

Results are shown for data obtained in the brain, and in the BS/SC for Study 1 (red) and Study 2 (blue). The yellow band indicates the stimulation period. The error bars indicate the standard error of the β-values. Similar source and target clusters were selected for the two regions spanned by the data, and the results were within 11.2 mm for the sources, and with 8.7 mm for the targets.

https://doi.org/10.1371/journal.pone.0243723.g007

Discussion

BOLD responses were identified in regions across the brain, BS and SC, with each of the analysis methods. The regions identified by fitting the data to a predicted response (model-driven) were consistently also identified by the data-driven approaches, which showed additional regions as well. The conclusion that the regions identified have signal variations that are BOLD and are physiologically relevant, as opposed to being the result of bulk motion or physiological noise, is supported by the fact that the responses are consistent across repeated fMRI acquisitions in each participant, within each group of 15–18 participants, and either match predicted responses or are significantly coordinated across spatially distinct regions. This conclusion is further supported by the consistency of results across independent data sets, and across different acquisition methods in regions of overlap between the brain and BS/SC studies (illustrated in Figs 3, 4 and 6). Dynamic variations in connectivity between regions were also observed to be relatively consistent across studies, such as the PAG→Hypothalamus connection in Fig 7. Although some degree of variation is to be expected with the different methods and study conditions that were employed, the conclusions that can be drawn from these results are quite robust, in terms of the regions involved, and how signaling is coordinated between regions.

The amount of signal variance that could be explained in each region varied across the analysis methods used for this comparison, but showed a consistent trend across the 4 sets of data (Fig 5). The amount of explained variance was consistently higher with data-driven methods, than with the model-driven fit to a predicted BOLD response. The greatest amount of variance was explained, in most cases, with connectivity based on correlation between regions. The exception was the SEM method with 2 source regions, which explained the most variance in brain regions. The ability to explain the signal variance, and thus identify BOLD time-series responses, demonstrates the effectiveness of each analysis approach for the selected fMRI data sets which involved noxious stimulation. The results consistently indicate that data-driven approaches are more effective than model-driven approaches, and further indicate that detecting connectivity based on temporal correlations may be more effective than SEM. However, the incorporation of anatomical information into the SEM method of connectivity analysis provides the advantage of greater detail in the results that can be obtained. By modeling the possible sources of input to each region, the directionality of connectivity can be inferred. Whereas correlation does not show any information about the direction of influence, the linear fit between a source and a target will typically result in different weighting factors (i.e. connectivity strengths) if the assignment of source and target are reversed. Including more than two source regions could potentially explain even more of the variance in each target region. Conversely, the need to assume an anatomical model for SEM may be a disadvantage for studies with the aim of identifying regions involved, as opposed to investigating the characteristics of BOLD responses in predetermined regions-of-interest.

An important aspect of the data-driven methods for studies of pain responses is that they can demonstrate dynamic variations in coordinated signaling between regions. This allows more degrees of freedom, which contributed to the greater amount of variance that could be explained. Similarly, including multiple source regions to explain the signal variance in a target region, allows more degrees of freedom with the SEM method. This flexibility is important in the context of pain research, given that neural signaling between regions is expected to vary between periods of anticipating pain, experiencing pain, knowing the pain has passed, etc [32, 33]. Moreover, the known neuroanatomy of regions involved with pain processing is a complex network, and each region receives input from multiple sources (1). The flexibility of the data-driven approach thus enables more accurate modeling of the expected neurophysiology, and neuroanatomy, of pain networks.

Investigations of the BOLD response characteristics (Fig 6 for a summary, S2 Fig for more details) demonstrate why the predicted BOLD response, based on the peripheral stimulation paradigm, is not an accurate model. The typical modeled BOLD response would be expected to have increased signal during stimulation periods, and “baseline” signal otherwise (Fig 1). While consistent BOLD responses were observed across runs/participants/groups, some regions such as the insula, had increased signal during the stimulation period, whereas other regions had strong peaks at the onset and offset of stimulation, such as the anterior cingulate cortex. Regions of the BS receive input signaling from number of sources, both ascending and descending, and form a complex feed-back network to regulate pain responses depending on a person’s situation [1]. This results in complicated BOLD response patterns as the total input signaling (and thus metabolic demand) in each region varies throughout the stimulation paradigm. Nonetheless, regions such as the SC dorsal horn, NRM, NGc, etc. were identified by connectivity analyses. Although the BOLD responses in these regions are complex, the relationships between signal variations and periods of the stimulation paradigm can be seen in retrospect.

Consistent with prior studies [12, 32, 33], this comparison of methods also demonstrated important contributions from individual differences in pain responses. SEM connectivity weighting factors between a number of regions were observed to be significantly correlated with pain ratings (Figs 3 and 4). This demonstrates that results from individual participants are sufficiently accurate for this correlation to be detected. Given that pain responses can vary with emotional and cognitive factors, the ability to identify changes in neural signaling in relation to differences between participants, and even between repeated fMRI acquisitions in the same participant, is important for pain research. The BOLD time-series responses shown in S2 Fig further demonstrate this point, with examples of differences in BOLD responses between participants with higher-, or lower-than-average, pain ratings. The ability to detect variations in BOLD responses which are related to behavioral measures further demonstrates the sensitivity of the data-driven analysis methods that were used for this comparison. This comparison of methods included data from females only, with average ages of 39 years and 36 years for the two study groups, and we did not investigate the effects of sex-differences on pain, or the effects of age, which could introduce even greater variability across participants.

Lastly, an important feature demonstrated by the results of this study is the consistency of responses in regions common to data sets spanning the brain and BS/SC. Results in the thalamus, hypothalamus, and PAG, were obtained from all of the data sets, and are shown in the middle row of S2 Fig. Although the study conditions are not identical, similarities can be observed between the BOLD responses detected with T2*-weighted GE-EPI in brain fMRI studies, and with T2-weighted HASTE in BS/SC fMRI studies, and in the connectivity values listed in S2S5 and S7S9 Tables. Moreover, similar dynamic variations in PAG→Hypothalamus connectivity values are demonstrated in Fig 7. The results obtained with the two acquisition methods are thus equivalent in terms of the conclusions that can be drawn about the regions involved, characteristics of the BOLD responses, and the coordination of signaling between regions.

The results of this comparison show that the model-driven fMRI analysis approach of predicting a BOLD response, and detecting the voxels/clusters with a significant component matching this prediction, has limited effectiveness for pain research studies. Data-driven methods based on connectivity analyses are shown to explain more of the observed signal variations in pain-related regions. These methods are also shown to be better suited to pain research because they allow for dynamic analyses, and accommodate unanticipated variations in responses across conditions or participants. This conclusion is supported by consistent findings across duplicate studies, and across different data acquisition methods. FMRI data acquired with methods optimized for the brain (T2*-weighted GE-EPI) and for the BS/SC (T2-weighted HASTE) are shown to provide equivalent results. The conclusions that can be drawn from these data sets in terms of the regions involved, the neural signaling between regions, and how signaling varies over the course of the stimulation paradigm, are shown to be consistent. The results indicate that the most sensitive method of fMRI data analysis for pain research may be connectivity based on temporal correlation between time-series responses. However, SEM analysis results provide more information about networks of coordinated regions. Correlation-based and SEM-based connectivity analysis methods are suited to testing different hypotheses, with the former demonstrating which anatomical regions are likely to be involved, and the latter demonstrating the nature of coordinated signaling within a network of predetermined anatomical regions.

The temporal patterns of BOLD responses that were observed with this analysis demonstrate why model responses based on the stimulation paradigm are ineffective for pain research. The observed BOLD responses demonstrate a number of consistent features that are not modeled, including transient responses at the onset and offset of stimulation, which may reflect salience or novelty, and variations leading up to the stimulation period, which may reflect anticipation. Data-driven approaches were able to identify coordinated regions, and the BOLD responses within these regions could then be investigated to show these different aspects of pain responses, and the results also demonstrated individual differences and how responses varied in relation to pain ratings. Data-driven analysis methods are thus better adapted to the variability of neural responses involved with pain processing, and are thus more effective.

Supporting information

S1 Fig. Anatomical networks used for structural equation modeling (SEM) in the brain (left) and brainstem and spinal cord (right).

Abbreviations: AC: anterior cingulate cortex; Accum: nucleus accumbens; Amyg: amygdala; C6RD: right dorsal region of the 6th cervical spinal cord segment; DRt: dorsal reticular nucleus of the medulla; Forb: frontal orbital region; HG: heschel’s gyrus; Hipp: hippocampus; Hyp: hypothalamus; IC: insular cortex; LC: locus coeruleus; NGc: nucleus gigantocellularis; NRM: nucleus raphe magnus; NTS: nucleus tractus solitarius; PAG: periaqueductal gray region; PBN: parabrachial nucleus; PC: posterior cingulate cortex; Thal: thalamus.

https://doi.org/10.1371/journal.pone.0243723.s001

(TIF)

S2 Fig. Details of BOLD responses in regions identified by means of the analysis methods, compared across the two sets of study data, for brain and brainstem regions.

BOLD responses shown are averaged across all runs/participants in each study group, except where shown for pain ratings separated between above and below average values. The plots in each frame are offset vertically for clarity. The vertical axis indicates the relative scale for each frame. The horizontal axis indicates time, and plots are shown with the onset of stimulation aligned for each study. The vertical line indicates when participants were informed of which type of stimulation to expect in Study 2. The fit model paradigm to each time-series response is also shown in black on each plot.

https://doi.org/10.1371/journal.pone.0243723.s002

(TIF)

S1 Table. Significant BOLD responses detected by fitting a predicted response to data from brain regions in Studies 1 and 2, by means of a general linear model.

Abbreviations are listed in the caption for S1 Fig.

https://doi.org/10.1371/journal.pone.0243723.s003

(DOCX)

S2 Table. Significant connectivity between regions, based on temporal correlations between BOLD responses, for data from brain regions in Studies 1 and 2.

The values shown are for the epoch spanning the stimulation period. Abbreviations are listed in the caption for S1 Fig.

https://doi.org/10.1371/journal.pone.0243723.s004

(DOCX)

S3 Table. Significant connectivity between regions, based on structural equation modeling, with 1 source for each target (i.e. linear fit between regions), for data from brain regions in Studies 1 and 2.

The values shown are for the epoch spanning the stimulation period. Abbreviations are listed in the caption for S1 Fig.

https://doi.org/10.1371/journal.pone.0243723.s005

(DOCX)

S4 Table. Significant connectivity between regions, based on structural equation modeling, with 2 source regions for each target, for data from brain regions in Studies 1 and 2.

The values shown are for the epoch spanning the stimulation period. Abbreviations are listed in the caption for S1 Fig.

https://doi.org/10.1371/journal.pone.0243723.s006

(DOCX)

S5 Table. Significant connectivity between regions, based on structural equation modeling, with 2 source regions for each target, where at least one connection has connectivity weighting factors that are significantly correlated with pain ratings across participants.

Data are from brain regions in Study 1. Values are listed for the epoch spanning the stimulation period. Abbreviations are listed in the caption for S1 Fig.

https://doi.org/10.1371/journal.pone.0243723.s007

(DOCX)

S6 Table. Significant BOLD responses detected by fitting a predicted response to data from brainstem and spinal cord regions in Studies 1 and 2, by means of a general linear model.

Abbreviations are listed in the caption for S1 Fig.

https://doi.org/10.1371/journal.pone.0243723.s008

(DOCX)

S7 Table. Significant connectivity between regions, based on temporal correlations between BOLD responses, for data from brainstem and spinal cord regions in Studies 1 and 2.

Values are listed for the epoch spanning the stimulation period. Abbreviations are listed in the caption for S1 Fig.

https://doi.org/10.1371/journal.pone.0243723.s009

(DOCX)

S8 Table. Significant connectivity between regions, based on structural equation modeling, with 1 source for each target (i.e. linear fit between regions), for data from brainstem and spinal cord regions in Studies 1 and 2.

Values are listed for the epoch spanning the stimulation period. Abbreviations are listed in the caption for S1 Fig.

https://doi.org/10.1371/journal.pone.0243723.s010

(DOCX)

S9 Table. Significant connectivity between regions, based on structural equation modeling, with 2 source regions for each target, for data from brainstem and spinal cord regions in Studies 1 and 2.

Abbreviations are listed in the caption for S1 Fig.

https://doi.org/10.1371/journal.pone.0243723.s011

(DOCX)

S10 Table. Significant connectivity between regions, based on structural equation modeling, with 2 source regions for each target, where at least one connection has connectivity weighting factors that are significantly correlated with pain ratings across participants.

Data are from brainstem and spinal cord regions in Studies 1 and 2. The Z-score is computed from the correlation, R, value, and reflects the significance of the correlation. Only significant values are shown (corrected for multiple comparisons, etc, etc). Values are listed for the epoch spanning the stimulation period. Abbreviations are listed in the caption for S1 Fig.

https://doi.org/10.1371/journal.pone.0243723.s012

(DOCX)

Acknowledgments

We are grateful to Don Brien and Janet Mirtle-Stroman for help with fMRI data collection. All authors confirm that they have no conflicts of interest to disclose with regards to the work presented.

References

  1. 1. Millan MJ. Descending control of pain. Progress in neurobiology. 2002;66(6):355–474. pmid:12034378
  2. 2. Pain terms: a list with definitions and notes on usage. Recommended by the IASP Subcommittee on Taxonomy. Pain. 1979;6(3):249. pmid:460932
  3. 3. The Canadian Pain Coalition. The Status of Pain in Canada–moving toward a Canadian Pain Strategy. Brief for the Parliamentary Committee on Palliative and Compassionate Care. Ottawa2010.
  4. 4. Ossipov MH, Morimura K, Porreca F. Descending pain modulation and chronification of pain. Current opinion in supportive and palliative care. 2014;8(2):143–51. pmid:24752199
  5. 5. Kwon M, Altin M, Duenas H, Alev L. The role of descending inhibitory pathways on chronic pain modulation and clinical implications. Pain practice: the official journal of World Institute of Pain. 2014;14(7):656–67. pmid:24256177
  6. 6. Tracey I, Bushnell MC. How neuroimaging studies have challenged us to rethink: is chronic pain a disease? The journal of pain: official journal of the American Pain Society. 2009;10(11):1113–20. pmid:19878862
  7. 7. Apkarian AV, Bushnell MC, Treede RD, Zubieta JK. Human brain mechanisms of pain perception and regulation in health and disease. Eur J Pain. 2005;9(4):463–84. pmid:15979027
  8. 8. Wager TD, Atlas LY, Lindquist MA, Roy M, Woo CW, Kross E. An fMRI-based neurologic signature of physical pain. N Engl J Med. 2013;368(15):1388–97. pmid:23574118
  9. 9. Ploghaus A, Tracey I, Gati JS, Clare S, Menon RS, Matthews PM, et al. Dissociating pain from its anticipation in the human brain. Science. 1999;284(5422):1979–81. pmid:10373114
  10. 10. Legrain V, Iannetti GD, Plaghki L, Mouraux A. The pain matrix reloaded: a salience detection system for the body. Progress in neurobiology. 2011;93(1):111–24. pmid:21040755
  11. 11. Bosma RL, Mojarad EA, Leung L, Pukall C, Staud R, Stroman PW. FMRI of spinal and supra-spinal correlates of temporal pain summation in fibromyalgia patients. Hum Brain Mapp. 2016;37(4):1349–60. pmid:26749315
  12. 12. Khan HS, Stroman PW. Inter-individual differences in pain processing investigated by functional magnetic resonance imaging of the brainstem and spinal cord. Neuroscience. 2015;307:231–41. pmid:26335379
  13. 13. Bosma RL, Stroman PW. Spinal cord response to stepwise and block presentation of thermal stimuli: a functional MRI study. J Magn Reson Imaging. 2015;41(5):1318–25. pmid:24807470
  14. 14. Dobek CE, Beynon ME, Bosma RL, Stroman PW. Music modulation of pain perception and pain-related activity in the brain, brain stem, and spinal cord: a functional magnetic resonance imaging study. The journal of pain: official journal of the American Pain Society. 2014;15(10):1057–68.
  15. 15. Rempe T, Wolff S, Riedel C, Baron R, Stroman PW, Jansen O, et al. Spinal fMRI reveals decreased descending inhibition during secondary mechanical hyperalgesia. PLoS One. 2014;9(11):e112325. pmid:25372292
  16. 16. Cadotte DW, Bosma R, Mikulis D, Nugaeva N, Smith K, Pokrupa R, et al. Plasticity of the injured human spinal cord: insights revealed by spinal cord functional MRI. PLoS One. 2012;7(9):e45560. pmid:23029097
  17. 17. Stroman PW, Khan HS, Bosma RL, Cotoi AI, Leung R, Cadotte DW, et al. Changes in Pain Processing in the Spinal Cord and Brainstem after Spinal Cord Injury Characterized by Functional Magnetic Resonance Imaging. J Neurotrauma. 2016. pmid:26801315
  18. 18. McIver TA, Kornelsen J, Stroman PW. Diversity in the emotional modulation of pain perception: An account of individual variability. Eur J Pain. 2017. pmid:28940720
  19. 19. Leung RH, Stroman PW. Functional Magnetic Resonance Imaging of the Human Brainstem and Cervical Spinal Cord during Cognitive Modulation of Pain. Crit Rev Biomed Eng. 2016;44(1–2):47–71. pmid:27652451
  20. 20. Bosma RL, Ameli Mojarad E, Leung L, Pukall C, Staud R, Stroman PW. Neural correlates of temporal summation of second pain in the human brainstem and spinal cord. Hum Brain Mapp. 2015;36(12):5038–50. pmid:26366748
  21. 21. Sprenger C, Eippert F, Finsterbusch J, Bingel U, Rose M, Buchel C. Attention modulates spinal cord responses to pain. Curr Biol. 2012;22(11):1019–22. pmid:22608507
  22. 22. Eippert F, Finsterbusch J, Bingel U, Buchel C. Direct evidence for spinal cord involvement in placebo analgesia. Science. 2009;326(5951):404. pmid:19833962
  23. 23. Tinnermann A, Geuter S, Sprenger C, Finsterbusch J, Buchel C. Interactions between brain and spinal cord mediate value effects in nocebo hyperalgesia. Science. 2017;358(6359):105–8. pmid:28983051
  24. 24. Geuter S, Buchel C. Facilitation of pain in the human spinal cord by nocebo treatment. J Neurosci. 2013;33(34):13784–90. pmid:23966699
  25. 25. Barry RL, Rogers BP, Conrad BN, Smith SA, Gore JC. Reproducibility of resting state spinal cord networks in healthy volunteers at 7 Tesla. Neuroimage. 2016;133:31–40. pmid:26924285
  26. 26. Barry RL, Smith SA, Dula AN, Gore JC. Resting state functional connectivity in the human spinal cord. eLife. 2014;3:e02812. pmid:25097248
  27. 27. Kong Y, Eippert F, Beckmann CF, Andersson J, Finsterbusch J, Buchel C, et al. Intrinsically organized resting state networks in the human spinal cord. Proceedings of the National Academy of Sciences of the United States of America. 2014;111(50):18067–72. pmid:25472845
  28. 28. Wei P, Li J, Gao F, Ye D, Zhong Q, Liu S. Resting state networks in human cervical spinal cord observed with fMRI. European journal of applied physiology. 2010;108(2):265–71. pmid:19777254
  29. 29. Harita S, Ioachim G, Powers J, Stroman PW. Investigation of Resting-State BOLD Networks in the Human Brainstem and Spinal Cord. Neuroscience. 2019;404:71–81. pmid:30776404
  30. 30. Ioachim G, Powers JM, Stroman PW. Comparing Coordinated Networks Across the Brainstem and Spinal Cord in the Resting State and Altered Cognitive State. Brain connectivity. 2019;9(5):415–24. pmid:30909725
  31. 31. Harita S, Stroman PW. Confirmation of resting-state BOLD fluctuations in the human brainstem and spinal cord after identification and removal of physiological noise. Magn Reson Med. 2017;78(6):2149–56. pmid:28074492
  32. 32. Stroman PW, Ioachim G, Powers JM, Staud R, Pukall C. Pain processing in the human brainstem and spinal cord before, during, and after the application of noxious heat stimuli. Pain. 2018.
  33. 33. Stroman PW, Bosma RL, Cotoi AI, Leung RH, Kornelsen J, Lawrence-Dewar JM, et al. Continuous Descending Modulation of the Spinal Cord Revealed by Functional MRI. PLoS One. 2016;11(12):e0167317. pmid:27907094
  34. 34. Stroman PW, Ioachim G, Powers JM, Staud R, Pukall C. Pain Processing in the Human Brainstem and Spinal Cord Before, During and After Expected Noxious Heat Stimuli. Pain. 2018;submitted. pmid:29905656
  35. 35. Bandettini PA, Wong EC, Hinks RS, Tikofsky RS, Hyde JS. Time course EPI of human brain function during task activation. Magn ResonMed. 1992;25(2):390–7. pmid:1614324
  36. 36. Friston KJ, Jezzard P, Turner R. Analysis of functional MRI time-series. HumBrain Mapp. 1994;1:153–71.
  37. 37. Iraji A, Calhoun VD, Wiseman NM, Davoodi-Bojd E, Avanaki MR, Haacke EM, et al. The connectivity domain: Analyzing resting state fMRI data using feature-based data-driven and model-based methods. Neuroimage. 2016;134:494–507. pmid:27079528
  38. 38. Logothetis NK, Pauls J, Augath M, Trinath T, Oeltermann A. Neurophysiological investigation of the basis of the fMRI signal. Nature. 2001;412(6843):150–7. pmid:11449264
  39. 39. Friston KJ. Functional and effective connectivity: a review. Brain connectivity. 2011;1(1):13–36. pmid:22432952
  40. 40. Biswal B, Yetkin FZ, Haughton VM, Hyde JS. Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magn ResonMed. 1995;34(4):537–41. pmid:8524021
  41. 41. Stroman PW. Validation of Structural Equation Modeling Methods for Functional MRI Data Acquired in the Human Brainstem and Spinal Cord. Crit Rev Biomed Eng. 2016;44(4):227–41. pmid:29199575
  42. 42. McArdle JJ, McDonald RP. Some algebraic properties of the Reticular Action Model for moment structures. The British journal of mathematical and statistical psychology. 1984;37 (Pt 2):234–51. pmid:6509005
  43. 43. Vierck CJ Jr., Cannon RL, Fry G, Maixner W, Whitsel BL. Characteristics of temporal summation of second pain sensations elicited by brief contact of glabrous skin by a preheated thermode. Journal of neurophysiology. 1997;78(2):992–1002. pmid:9307129
  44. 44. Powers JM, Ioachim G, Stroman PW. Ten Key Insights into the Use of Spinal Cord fMRI. Brain sciences. 2018;8(173):1–23. pmid:30201938
  45. 45. Bosma RL, Stroman PW. Assessment of data acquisition parameters, and analysis techniques for noise reduction in spinal cord fMRI data. Magn Reson Imaging. 2014;32(5):473–81. pmid:24602827
  46. 46. Bandettini PA, Wong EC, Jesmanowicz A, Hinks RS, Hyde JS. Spin-echo and gradient-echo EPI of human brain activation using BOLD contrast: a comparative study at 1.5 T. NMR Biomed. 1994;7(1–2):12–20. pmid:8068520
  47. 47. Norris DG, Zysset S, Mildner T, Wiggins CJ. An Investigation of the Value of Spin-Echo-Based fMRI Using a Stroop Color—Word Matching Task and EPI at 3 T. Neuroimage. 2002;15(3):719–26. pmid:11848715
  48. 48. Stroman PW, Khan HS, Bosma RL, Cotoi AI, Leung R, Cadotte DW, et al. Changes in Pain Processing in the Spinal Cord and Brainstem after Spinal Cord Injury Characterized by Functional Magnetic Resonance Imaging. Journal of Neurotrauma. 2016;33(15):1450–60. pmid:26801315
  49. 49. Rempe T, Wolff S, Riedel C, Baron R, Stroman PW, Jansen O, et al. Spinal fMRI Reveals Decreased Descending Inhibition during Secondary Mechanical Hyperalgesia. PLoS ONE. 2014;9(11). pmid:25372292
  50. 50. Cadotte DW, Stroman PW, Mikulis D, Fehlings MG. A systematic review of spinal fMRI research: outlining the elements of experimental design. J Neurosurg Spine. 2012;17(1):102–18. pmid:22985377
  51. 51. Myronenko A, Song X. Intensity-based image registration by minimizing residual complexity. IEEE Trans Med Imaging. 2010;29(11):1882–91. pmid:20562036
  52. 52. Stroman PW. Validation of structural equation modeling (SEM) methods for functional MRI data acquired in the human brainstem and spinal cord. Critical Reviews in Biomedical Engineering. 2017;in press.
  53. 53. De Leener B, Fonov VS, Collins DL, Callot V, Stikov N, Cohen-Adad J. PAM50: Unbiased multimodal template of the brainstem and spinal cord aligned with the ICBM152 space. Neuroimage. 2018;165:170–9. pmid:29061527
  54. 54. Naidich TP DH, Delman BN, Sorensen AG, Kollias SS, Haacke EM. INTERNAL ARCHITECTURE OF THE BRAIN STEM WITH KEY AXIAL SECTIONS. Duvernoy's Atlas of the Human Brain Stem and Cerebellum. New York: Springer-Verlag/Wien; 2009. p. p 79–82.
  55. 55. Whitfield-Gabrieli S, Nieto-Castanon A. Conn: a functional connectivity toolbox for correlated and anticorrelated brain networks. Brain connectivity. 2012;2(3):125–41. pmid:22642651
  56. 56. De Leener B, Levy S, Dupont SM, Fonov VS, Stikov N, Louis Collins D, et al. SCT: Spinal Cord Toolbox, an open-source software for processing spinal cord MRI data. Neuroimage. 2017;145(Pt A):24–43. pmid:27720818
  57. 57. Lang J, Bartram CT. [Fila radicularia of the ventral and dorsal radices of the human spinal cord]. Gegenbaurs Morphol Jahrb. 1982;128(4):417–62. pmid:7152217
  58. 58. Liebe T, Kaufmann J, Li M, Skalej M, Wagner G, Walter M. In vivo anatomical mapping of human locus coeruleus functional connectivity at 3 T MRI. Hum Brain Mapp. 2020;41(8):2136–51. pmid:31994319
  59. 59. Chiang MC, Bowen A, Schier LA, Tupone D, Uddin O, Heinricher MM. Parabrachial Complex: A Hub for Pain and Aversion. J Neurosci. 2019;39(42):8225–30. pmid:31619491
  60. 60. Naidich TP, Duvernoy HM, Delman BN, Sorensen AG, Kollias SS, Haacke EM. INTERNAL ARCHITECTURE OF THE BRAIN STEM WITH KEY AXIAL SECTIONS. Duvernoy's Atlas of the Human Brain Stem and Cerebellum. New York: Springer-Verlag/Wien; 2009. p. 79–82.
  61. 61. Talairach J, Tournoux P. Co-planar stereotaxic atlas of the human brain. New York: Thieme Medical Publishers, Inc.; 1988. https://doi.org/10.1016/0028-3932(88)90040-1 pmid:3129671
  62. 62. Leijnse JN D'Herde K. Revisiting the segmental organization of the human spinal cord. J Anat. 2016;229(3):384–93. pmid:27173936
  63. 63. Pauli WM, Nili AN, Tyszka JM. A high-resolution probabilistic in vivo atlas of human subcortical brain nuclei. Scientific data. 2018;5:180063. pmid:29664465
  64. 64. Keren NI, Lozar CT, Harris KC, Morgan PS, Eckert MA. In vivo mapping of the human locus coeruleus. Neuroimage. 2009;47(4):1261–7. pmid:19524044
  65. 65. Edlow BL, Takahashi E, Wu O, Benner T, Dai G, Bu L, et al. Neuroanatomic connectivity of the human ascending arousal system critical to consciousness and its disorders. Journal of neuropathology and experimental neurology. 2012;71(6):531–46. pmid:22592840
  66. 66. Worsley KJ, Friston KJ. Analysis of fMRI time-series revisited—again. NeuroImage. 1995;2(3):173–81. pmid:9343600