Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Brain activations associated with anticipation and delivery of monetary reward: A systematic review and meta-analysis of fMRI studies

  • S. Jauhar,

    Roles Conceptualization, Data curation, Investigation, Methodology, Writing – review & editing

    Affiliation Department of Psychosis Studies, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, United Kingdom

  • L. Fortea,

    Roles Data curation, Formal analysis, Investigation, Validation, Writing – review & editing

    Affiliation Imaging of Mood- and Anxiety-Related Disorders (IMARD) group, Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain

  • A. Solanes,

    Roles Data curation, Formal analysis, Investigation

    Affiliations Imaging of Mood- and Anxiety-Related Disorders (IMARD) group, Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain, FIDMAG, Germanes Hospitalàries Research foundation, Barcelona, Spain, Antonomous University of Barcelona, Barcelona, Spain

  • A. Albajes-Eizagirre,

    Roles Data curation, Formal analysis, Investigation, Resources, Software

    Affiliations Imaging of Mood- and Anxiety-Related Disorders (IMARD) group, Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain, FIDMAG, Germanes Hospitalàries Research foundation, Barcelona, Spain, Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Madrid, Spain

  • P. J. McKenna ,

    Roles Conceptualization, Data curation, Methodology, Supervision, Writing – original draft, Writing – review & editing

    mckennapeter1@gmail.com

    Affiliations Imaging of Mood- and Anxiety-Related Disorders (IMARD) group, Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain, Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Madrid, Spain

  • J. Radua

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Project administration, Supervision, Writing – original draft

    Affiliations Department of Psychosis Studies, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, United Kingdom, Imaging of Mood- and Anxiety-Related Disorders (IMARD) group, Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain, FIDMAG, Germanes Hospitalàries Research foundation, Barcelona, Spain, Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Madrid, Spain, Center for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institute, Stockholm, Sweden

Abstract

Background

While multiple studies have examined the brain functional correlates of reward, meta-analyses have either focused on studies using the monetary incentive delay (MID) task, or have adopted a broad strategy, combining data from studies using both monetary and non-monetary reward, as probed using a wide range of tasks.

Objective

To meta-analyze fMRI studies that used monetary reward and in which there was a definable cue-reward contingency. Studies were limited to those using monetary reward in order to avoid potential heterogeneity from use of other rewards, especially social rewards. Studies using gambling or delay discounting tasks were excluded on the grounds that reward anticipation is not easily quantifiable.

Study eligibility

English-language fMRI studies (i) that reported fMRI findings on healthy adults; (ii) that used monetary reward; and (iii) in which a cue that was predictive of reward was compared to a no win (or lesser win) condition. Only voxel-based studies were included; those where brain coverage was incomplete were excluded.

Data sources

Ovid, Medline and PsycInfo, from 2000 to 2020, plus checking of review articles and meta-analyses.

Data synthesis

Data were pooled using Seed-based d Mapping with Permutation of Subject Images (SDM-PSI). Heterogeneity among studies was examined using the I2 statistic. Publication bias was examined using funnel plots and statistical examination of asymmetries. Moderator variables including whether the task was pre-learnt, sex distribution, amount of money won and width of smoothing kernel were examined.

Results

Pooled data from 45 studies of reward anticipation revealed activations in the ventral striatum, the middle cingulate cortex/supplementary motor area and the insula. Pooled data from 28 studies of reward delivery again revealed ventral striatal activation, plus cortical activations in the anterior and posterior cingulate cortex. There was relatively little evidence of publication bias. Among moderating variables, only whether the task was pre-learnt exerted an influence.

Conclusions

According to this meta-analysis monetary reward anticipation and delivery both activate the ventral but not the dorsal striatum, and are associated with different patterns of cortical activation.

Introduction

Recognition of the existence of a ‘reward circuit’ in the brain, ie a system that mediates the effects of positive reinforcement on behaviour, dates back to Olds and Milner’s [1] discovery of the rewarding properties of electrical brain stimulation. Subsequently it was shown that catecholamines were involved in the effect [2], and then that dopamine rather than noradrenalin was the important transmitter (see [3]). A recent important development has been Schultz’s [4] demonstration that around 75% of midbrain dopamine neurons–those that give rise to the ascending ‘mesotelencephalic’ projections [5]–show a switch from tonic activity to phasic bursts consistent with their coding a reward prediction error signal [6].

These findings do not in themselves permit the reward system to be anatomically defined, not least because the mesotelencephalic dopamine system projects widely and in man innervates the entire cerebral cortex [5]. Some further evidence on this question comes from animal studies, where single cell recording studies have established two main areas where firing patterns change during reward processing. One of these is the striatum, including the caudate nucleus and putamen, particularly their ventral sectors [7, 8]. The other is the orbitofrontal cortex, where neurons that respond to various aspects of reward have been found [7, 9]. Neurons showing reward responsiveness have, however, also been documented in a number of other brain regions, including the amygdala [10], the dorsolateral prefrontal cortex [11, 12], the anterior cingulate cortex [13], the subthalamic nucleus, the substantia nigra pars reticulata, the pallidum, the lateral hypothalamus, the nucleus basalis of Meynert, the parietal cortex and the premotor cortex [11, 13, 14].

The other main source of evidence on the anatomical localization of the reward system comes from human functional imaging studies. Early studies using PET and fMRI found activations in a number of brain regions in response to stimuli ranging from seeing attractive faces, to viewing erotic videos, and to being administered doses of cocaine [15] (note: throughout this article we use the term ‘activations’ for convenience, although strictly speaking what is being described are increases in blood flow/metabolism in PET and increases in BOLD signal in fMRI). While PET findings have been heterogeneous [1622], from the outset studies employing fMRI found a more consistent pattern involving particularly the nucleus accumbens (part of the ventral striatum), the amygdala and the orbitofrontal cortex [15].

Further work in this area has depended heavily on the development of the monetary incentive delay (MID) fMRI paradigm by Knutson and co-workers [2325]. In this, subjects are trained on a reaction time task (eg pressing a button when they see a white square), whose difficulty is individually adjusted during a training phase so that they are successful approximately two-thirds of the time. The subjects then perform the same task in the scanner, with the reaction time stimulus (the white square) being preceded by a cue, (eg a circle) which signals that performing the task successfully will lead to a certain amount of money being won, or by a different cue (eg a triangle), which indicates that successful performance will not be followed by reward. Feedback about whether money has been won is given visually immediately after the response is made. Event-related fMRI is used to measure activations at the time of perceiving the reward predictive cue (reward anticipation or expectation) and at the moment of receiving feedback that reward has been received (reward delivery, also referred to as outcome or receipt). In some versions of the task additional information (eg horizontal lines superimposed on the cues) indicates that different amounts of money will be won on different trials. Another common variant uses a second cue which indicates that subjects will lose money if they do not successfully perform the reaction time task.

In an initial meta-analysis of studies using the MID, Knutson and Greer [26] pooled data from 21 voxel-based fMRI studies and found evidence for activation associated with reward anticipation in the medial frontal gyrus, the nucleus accumbens, the anterior insula, the putamen and the thalamus. In this meta-analysis, it should be noted, reward anticipation was not compared against a no win baseline, but instead against anticipation of loss. More recently, Oldham et al [27] meta-analyzed 49 voxel-based MID studies and found that reward anticipation was associated with activation in a large cluster encompassing both ventral and dorsal sectors of the striatum, the thalamus and amygdala, all bilaterally, and the midbrain. Cortical regions activated included the insula, the premotor cortex and supplementary motor area, the occipital cortex and the cuneus; differently to in Knutson and Greer’s [26] meta-analysis, clusters in the medial frontal cortex were not seen. Reward delivery was associated with activation in the ventral striatum and the amygdala in 27 studies, with clusters of cortical activation in the medial frontal and orbitofrontal cortex and in the posterior cingulate cortex. Wilson et al [28] had broadly similar findings for reward anticipation in a meta-analysis of 15 MID studies that utilized information from group maps provided by authors rather than peak co-ordinates; in this meta-analysis the cortical regions activated were more extensive than in Oldham et al’s [27] meta-analysis.

Other meta-analyses have opted for a broader strategy, pooling data from studies using a wide range of paradigms involving anticipation and/or delivery of monetary as well as other kinds of reward, such as juice, water, others, a smiling face, or simply knowledge of having performed the task correctly [2931]. Clearly, broadening the range of different rewards beyond just money means that if these produce different patterns of activation, the results will be conflated. This is arguably of relatively little concern when the other rewards have innate reinforcing qualities, such as food and drink, but it is not clear that this assumption holds true when the reward is social in nature. These meta-analyses all also included studies where there was no cue-reward contingency–ie there was no explicit contrast between a cue that predicts reward and one that predicts no reward (or less reward)–for example, gambling and so-called delay discounting tasks, where subjects have to choose between a small certain or a larger uncertain reward. Such studies do not include one condition where a cue signals that money can be won and another where no money (or a smaller amount of money) will follow, meaning that extraction of findings for reward anticipation is either not possible or has to be inferred indirectly.

A further consideration when pooling data from voxel-based reward studies is whether the whole brain is covered in the examination. Studies not covering a region will fail to find and report potential activations in that region, biasing the effect size for partially-covered brain regions towards zero. This problem applies to some, though not all studies carried out up to around 2012, after which time whole brain coverage appears to have become standard. The issue has not been addressed in existing meta-analyses.

The present meta-analysis attempted to steer a middle course between the narrow and broad meta-analytic approaches taken so far in the literature. Specifically, we restricted the analysis to studies using monetary reward in order to avoid the potential confounding factor that non-monetary (especially social) rewards might activate different brain areas than monetary reward. We also only included studies in which there was an overt monetary cue-reward contingency, ie where one cue signalled that money could be won and another that indicated that no or a lesser amount of money could be won. Finally, we excluded studies that did not employ whole brain coverage. We carried out separate meta-analyses of studies examining activations at the time of reward anticipation, ie at the time of presentation of a cue that predicted monetary reward, and of reward delivery, ie at the time of subsequent receipt of the reward.

Data were pooled using Seed-Based d Mapping (SDM) [32, 33] with permutation of subject images (SDM-PSI) [3436] which has a number of advantages over other voxel-based meta-analytic methods [32]. Specifically, previous methods have relied on an unorthodox statistical test: they aim to find those voxels whether the convergence of findings is statistically significantly higher than in other voxels. Conversely, the statistical tests in SDM-PSI aim to find those voxels whether the BOLD response is statistically significant, ie as in the standard statistical tests applied to original imaging data within SPM or FSL. The use of standard statistics has multiple additional benefits, such as taking the effect size into account (other methods do not), reporting standard estimates of between-study heterogeneity (e.g., the I2 statistic, interpreted as the percentage of variation unrelated to sampling error), and allowing standard tests for the detection of potential publication bias based on funnel plot asymmetry (for more details see [32]).

Method

Papers were searched in Ovid, Medline and PsycInfo, from 2000, the year the first paper using the MID was published, to April 17th 2020. Search terms were ((“fMRI” AND (“reward” OR “prediction error” OR “reinforcement learning” OR “monetary incentive delay task”)). Limits included abstracts and humans and yr = "2000-Current"). We also checked the reference lists of all papers obtained plus review articles and meta-analyses. When studies reported on overlapping samples of participants, the larger sample was used if it provided usable data. There was no protocol for the meta-analysis. For a PRISMA checklist see S1 Checklist.

Only published studies reported in English were included. We included voxel-based fMRI studies that (i) reported fMRI findings on healthy adults (including the healthy control groups of clinical studies and the placebo groups of drug studies); (ii) used monetary reward; and (iii) in which there was an overt cue-reward contingency and a comparison no win (or lesser win) condition. With respect to (i), studies were excluded if the samples consisted entirely of elderly (age>65) or adolescent samples (age<18), although studies where only some of the participants were over 65 or under 18 were included. With respect to (ii), we excluded studies where the participants did not actually receive money at the end of the study, although we accepted studies where they were only given a proportion of their winnings, or they received a fixed amount of money. With respect to (iii), we did not include studies where the participants simply had to choose among different strategies for winning money (ie gambling and delay discounting studies, see above). Otherwise, we defined the concept of cue broadly: it could include an arbitrary stimulus, such as a shape, a complex design or an indoor or outdoor scene. Studies were also included where the cue had an innate, non-arbitrary relationship to the reward, eg a pie chart indicating the probability of winning, or the paradigm featured of one of a number of visually distinct ‘slot machines’, or simply a visual representation of the amount that could be won on the trial; this was on the basis that in these cases a valid cue-reward predictive relationship existed even though it was obvious rather than had to be deduced by trial and error.

Studies could report fMRI findings at any level of statistical significance (SDM only uses the information about peak activations to recreate a map of effect size); however, studies using small volume correction were excluded. Studies reporting findings from multiple ROIs were also excluded. As noted above, we required that the whole brain be covered in the scan; this was operationally defined as axial slices encompassing least 9.6 cm or coronal slices encompassing a minimum of 14.5cm, or alternatively an explicit statement that there was whole brain coverage.

For the meta-analysis of reward anticipation, we considered analyses where reward predictive cue activation was measured compared to a neutral, non-reward-predicting cue, or the comparison was between a high value and a low value cue, or where activation was measured as a linear correlation with cues signalling different amounts of monetary reward. However, we did not include analyses where the comparison was between a reward-predicting cue and a loss-predicting cue or where the linear correlation included monetary loss; this was because of uncertainty about whether the response to loss predicting cues would engage only the reward system and not, say, a punishment-related system. Studies where the comparison was not between monetary predictive and non-predictive cues were also excluded, eg where the comparison was between monetary reward and verbal reward.

For the meta-analysis of reward delivery, studies were included which compared activations at the time feedback was given and indicated that the subject had won or not won money. In terms of the no-win baseline condition we counted failure to receive reward both because of failure to perform the interpolated task sufficiently well, or because the preceding cue indicated no reward would be won. As in the reward anticipation meta-analysis, studies that compared reward delivery against loss delivery were not considered.

Data extraction was independently conducted by two members of the team (PJM and SJ), with fMRI methodological issues and discrepancies being discussed with a third (JR). In cases where a relevant analysis was carried out, but the peak activation co-ordinates in MNI or Talairach space were not given (eg because not all the co-ordinates were reported or the results were only shown in a figure), authors were contacted.

For data pooling using Seed-Based d Mapping (SDM) [32, 33] with permutation of subject images (SDM-PSI) [3436], coordinates were first converted to a common MNI space using the Lancaster method (taking into account the small changes in MNI space between SPM and FSL, and undoing the MNI conversions conducted with the old Brett method) [37]. Second, the map of the potential lower and upper bounds of possible effect sizes (Hedges’ g) was created for each study based on the level of statistical significance, the coordinates and effect size of the reported peaks, and the anisotropic covariance between adjacent voxels [33]. Third, multiple effect size maps (and the corresponding variance maps) were imputed voxelwise for each study, adding normal spatially correlated noise to the maximum likely effect sizes [35]. Fourth, images of each dataset of imputed effect size maps were combined using a standard random-effects meta-analysis, and the meta-analytic maps resulting from the different imputations were combined using Rubin’s rules in a single Hedges’ g map and a single variance map. Finally, subject images were imputed for each study and statistical significance was assessed via permutation test of the subject images [35]. In the text, we consider the most robust results (FWER < 0.01 in clusters of at least 100 voxels); for completeness, we also report results at a more liberal threshold (FWER < 0.05) with clusters of at least 10 voxels in the (see S1 File). All results are reported in MNI space and with brain regions labelled according to the AAL atlas.

We conducted tests to evaluate the robustness of the main findings. For each cluster that emerged we examined heterogeneity in the peak using the I2 statistic. While the use of I2 as an indicator of heterogeneity is not without problems [38], researchers usually consider I2 > 50% as an indicator of significant heterogeneity. Potential publication bias was examined for the peak of each emergent cluster using funnel plots. These were visually inspected to find asymmetries in which small studies reported larger effect sizes than large studies, which could indicate that some small studies with weak of null effect sizes had not been published. We also formally tested these asymmetries conducting meta-regressions by standard error, conceptually similar to the Egger test [36].

A number of potential moderator variables were examined using meta-regression. These were: whether or not the task was pre-learnt outside the scanner, percentage of males in the sample, the amount of money won on successful trials, and the full width at half maximum (FWHM) of the smoothing kernel used. This last variable was included because Sacchet and Knutson [39] found that peak activation co-ordinates in studies that used smaller spatial smoothing kernels (i.e. <6 mm FWHM) were more anterior than those identified for studies that used larger kernels (i.e. >7 mm FWHM). For reward anticipation, the probability of reward–ie the probabilistic frequency with which reward would later be delivered on viewing the anticipation cue–was also examined.

Results

A flow diagram of the study selection process is shown in Fig 1. Forty-nine studies were included. Forty-seven studies provided peak activation co-ordinates for reward anticipation, of which two [40, 41] could not be included because accompanying t- or z-score information was not available. Twenty-nine studies of reward delivery were found, with one [41] again not being included due to non-availability of t- or z-scores.

thumbnail
Fig 1. Flow chart of studies considered for the meta-analysis.

https://doi.org/10.1371/journal.pone.0255292.g001

Details of the studies included in the two meta-analyses are shown in Table 1. More details are available from the authors on request. Excluded studies, with reasons, are listed in the (see S1 File).

Reward anticipation

The findings are shown in Fig 2 and Table 2. The analysis revealed nine clusters of statistically significant voxels. The largest (5644 voxels, peak at MNI 16,6,-12 with Hedges’ g = 0.42) covered areas of the basal ganglia, particularly the ventral striatum extending bilaterally into the insula. It also reached small areas of the superior temporal cortex, the inferior frontal cortex bilaterally, the olfactory cortex, and the gyrus rectus, all bilaterally, and to a very small extent the amygdala. This peak did not show important between-study heterogeneity (I2 = 32%), but there was funnel plot asymmetry (meta-regression of Hedges’ g by standard error p < 0.001) (for this and other funnel plots see S1 File).

thumbnail
Fig 2. Activations associated with monetary reward anticipation in 45 studies.

Depth of colour is proportional to the Z-value.

https://doi.org/10.1371/journal.pone.0255292.g002

thumbnail
Table 2. Results of the reward anticipation and delivery meta-analyses.

https://doi.org/10.1371/journal.pone.0255292.t002

Another large cluster (3961 voxels, peak at MNI 0,6,34 with Hedges’ g = 0.39) was located medially and involved predominantly the bilateral supplementary motor area and the middle cingulate cortex. It also extended to reach the superior frontal gyrus bilaterally. This peak did not show between-study heterogeneity (I2 = 5%), and in this case there were no indications of publication bias (p = 0.18).

Among the smaller clusters, one (667 voxels, peak at MNI 44,-20,48 with Hedges’ g = 0.29) was located in the right precentral cortex. This peak did not show between-study heterogeneity (I2 = 5%) or indications of publication bias (p = 0.44). Another (633 voxels, peak at MNI -20,-96,-16 with Hedges’ g = 0.28) was located in left inferior occipital cortex. Again, this peak did not show between-study heterogeneity (I2 = 15%) or indications of publication bias (p = 0.26). Another (315 voxels, peak at MNI 38,-86,-8 with Hedges’ g = 0.33) was located in right inferior occipital cortex. Between-study heterogeneity was low (I2 = 24%) but there was funnel plot asymmetry (p = 0.04). A further cluster (289 voxels, peak at MNI -34,-6,56 with Hedges’ g = 0.28) was located in the left precentral cortex. Again, the peak did not show between-study heterogeneity (I2 = 17%) but there was funnel plot asymmetry (p = 0.04).

Three clusters were seen in the cerebellum. One (623 voxels, peak at MNI 8,-62,-14 with Hedges’ g = 0.3) was located mostly on the right in lobules IV/V and VI. Between-study heterogeneity was low (I2 = 29%) but there was significant funnel plot asymmetry (p = 0.03). Another (142 voxels, peak at MNI -28,-68,-32 with Hedges’ g = 0.25) was located on the left (crus I and lobule IV). This peak did not show between-study heterogeneity (I2 = 7%) or indications of funnel plot asymmetry (p = 0.58). The third (196 voxels, peak at MNI -24,-46,-30 with Hedges’ g = 0.26) was located in right cerebellum (lobule VI). Again, the peak did not show between-study heterogeneity (I2 = 1%) or indications of funnel plot asymmetry (p = 0.49).

Repeating the analysis at a lower threshold (FWER < 0.05) with clusters of at least 10 voxels led to a broadly similar pattern (see S1 File). The main difference was the appearance of additional small clusters (10–57 voxels) in the left superior temporal cortex, the left middle frontal cortex, the left insula and parts of the parietal and occipital cortex.

Reward delivery

The analysis here resulted in three clusters of statistically significant voxels. The findings are shown in Fig 3 and Table 2. The largest (2830 voxels, peak at 0,46,6 with Hedges’ g = 0.44) was in the anterior cingulate/medial frontal cortex bilaterally, extending to the gyrus rectus. Its peak did not show relevant between-study heterogeneity (I2 = 11%), and only a trend towards funnel plot asymmetry (p = 0.05) (see Fig 3).

thumbnail
Fig 3. Activations associated with monetary reward delivery in 28 studies.

Depth of colour is proportional to Z-value.

https://doi.org/10.1371/journal.pone.0255292.g003

A second, smaller cluster (1140 voxels, peak at 0,-26,34 with Hedges’ g = 0.37) involved the bilateral posterior cingulate cortex. Its peak did not show significant between-study heterogeneity (I2 = 14%) and only a trend towards funnel plot asymmetry (p = 0.06) (for funnel plots see S1 File).

The third cluster (225 voxels) was located in the right ventral striatum. This showed neither heterogeneity (I2 = 6%) nor indications of publication bias (p = 0.25) (see Fig 2B).

Repeating the analysis at a lower threshold (FWER < 0.05) with clusters of at least 10 led to the appearance of a further small cluster (14 voxels) in the right angular gyrus (see S1 File).

Analysis of moderator variables

Reward anticipation.

Using a threshold of p = 0.01, and considering clusters with extension of 100 voxels or more, no clusters of correlation emerged with money per trial, percent trials rewarded, percent male or smoothing. A cluster of 133 voxels in the left lateral middle frontal gyrus (133 voxels, BA 46, peak activation at -28,44,26, Z = 2.44, p = 0.0001) showed a positive correlation with the use of a pre-learnt task (i.e. stronger activation when the task was pre-learnt); this region was not present in the main analysis.

Reward delivery.

No clusters of correlation were seen with money per trial or percent male. As in the meta-analysis of reward anticipation, a cluster of significant positive association emerged for whether the task was pre-learnt (i.e. stronger activation when the task was pre-learnt). The cluster was in the medial prefrontal cortex (383 voxels, peak at -6,36,-14, BA 11, Z = 1.86, p = 0.001); this cluster overlapped with the medial frontal cortex cluster in the main analysis. A cluster of 183 voxels in the left lateral precentral gyrus (183 voxels, BA 6, peak activation at, peak at -48,2,34, Z = 2.5, p = 0.001) showed a positive correlation with smoothing (i.e. images with higher smoothing showed stronger activation); this region was not present in the main analysis.

Discussion

This meta-analysis pooled data from fMRI studies using monetary reward in which there was an explicit cue:reward contingency. It found clear evidence of striatal activation, which was largely localized to the ventral striatal sector and was unilateral in the case of reward delivery. Other subcortical activations were minimal, but cortical activations were prominent–in the mid-cingulate gyrus/supplementary motor area in the case of anticipation, and in the anterior and posterior cingulate cortex the case of delivery. Only reward anticipation was associated with activations outside the medial cortical surface, which were located in the bilateral insula bilaterally and and the precentral cortex.

Striatal activations in our meta-analysis were strikingly restricted to the ventral striatal sector both for reward anticipation and reward delivery (in the case of anticipation, inspection of the peaks contributing to an apparent dorsal extension of the cluster revealed that the majority were actually in the thalamus or the insula). This finding stands in contrast to the findings of previous meta-analyses where a broader pattern of activation involving both the dorsal and ventral striatum has typically been found [2731]. This was also the case in the two meta-analyses that were most similar to ours, in that they pooled data from tasks using monetary reward, specifically the MID task. Thus, Oldham et al [27] found relatively large bilateral clusters of activation involving both the ventral and dorsal striatum during reward anticipation although the localization was more exclusively ventral during delivery. Wilson et al [28] also found both dorsal and ventral striatal activation during anticipation (these authors did not examine delivery). Why our findings and those of previous meta-analyses differ in this respect is uncertain, though it does not seem to be a reflection of the numbers of studies included, since Oldham et al [27] included a similar number of studies to our meta-analysis and the number of studies in Wilson et al [28] was smaller at 15.

Our finding of activation in predominantly ventral striatal regions is consistent with the widely held belief that the ventral striatum, as opposed to the dorsal striatum, has a particular role in reward processing. This view rests partly on anatomical considerations–the ventral striatum forms part of a ‘limbic’ cortico-basal ganglia-cortical circuit which receives its cortical input from the prefrontal cortex, hippocampus and amygdala [14], and partly on findings from single cell recording studies in animals, which have found that reward sensitive neurons are twice as frequent in the ventral than in the dorsal striatum during reward delivery [83]. Also relevant is Schultz et al’s [4] study of midbrain dopamine neurons that signal reward prediction error; this found a greater proportion of such neurons (‘which occasionally reach statistical significance’) in the ventral tegmental area and medial substantia nigra; these neurons project to the ventral striatum, albeit among other regions [5].

Areas in the medial cerebral cortex were prominent among cortical regions where we found reward-associated activations. It is also noteworthy that the areas here were different for anticipation and delivery–anticipation was associated with activation in a single bilateral cluster involving the mid-cingulate cortex and the supplementary motor area, whereas delivery activated two clusters, one in the ventromedial frontal cortex and another in the posterior cingulate cortex. These findings are similar to those of other meta-analyses. Thus, Diekhof et al [31], Oldham et al, [27] and Wilson et al [28] all found a cluster (or in one case two clusters) of anticipation-associated activation in the mid-cingulate cortex/ supplementary motor area. Diekhof et al [31] and Oldham et al [27] found ventromedial frontal activation in association with reward delivery, with Oldham et al [27] additionally finding a cluster in the posterior cingulate cortex. Finally, Bartra et al [30] found two not-dissimilarly placed clusters to ours associated with delivery in their large meta-analysis using different kinds of reward tasks.

Why the mid-cingulate cortex and supplementary motor area might be involved in reward processing, specifically reward anticipation, is unclear. Animal studies have reported reward sensitive neurons in the the anterior cingulate cortex in rats [84], and the dorsal anterior cingulate cortex in monkeys [85], though in both cases this was at the time of delivery rather than during anticipation. In man, the mid-cingulate cortex and part of the pre-supplementary motor area are implicated in executive function or cognitive control. In particular, this region is activated by tasks requiring inhibition of prepotent responses [86], and has been argued to undertake specifically the ‘evaluative’ as opposed to ‘regulative’ cognitive control functions, monitoring the execution of plans generated to achieve task goals and signaling when adjustments are necessary [8789]. These findings do not establish a link with reward processing, but it is interesting to note that in a review of the evidence for the function of different regions of the medial frontal cortex, Amodio and Frith [90] argued that its posterior and rostral zone (ie much the same area) acts to guide behaviour in terms of monitoring of the value of possible future actions. Clearly, such a function could easily encompass reward prediction.

In contrast, the ventromedial frontal cortex, one of the two medial cortex clusters activated by reward delivery in our and other meta-analyses, has a long tradition of being involved in reward processing. In particular, animal studies have identified the orbitofrontal cortex as an important region for multiple aspects of reward processing [7, 9]; this lies adjacent to the ventromedial frontal cortex and the two regions are often considered to form a single entity on anatomical grounds [91]. It is not clear why activation was restricted to the ventromedial frontal cortex in our meta-analysis, whereas others have found activation in both regions [27, 29, 31], but it could be related to the fact that the two regions have different patterns of anatomical connections [91], or alternatively to signal dropout in the orbitofrontal cortex.

In our meta-anlaysis, as in two others [27, 30], reward deliverly also activated the posterior cingulate cortex. The functions of this region have been reviewed by Leech and Sharp [92] and include attention, autobiographical memory and conscious awareness, but not, it should be noted, reward. The other notable feature of this region is that it, along with the medial frontal cortex, forms one of the two midline ‘hubs’ of the default mode network [93], a set of brain regions that de-activate during performance of a wide range of attention demanding tasks. The default mode network is also known to activate in response to some tasks, whose common feature appears to be the involvement of internally oriented, non-stimulus directed thought–examples include recall of autobiographical memories, imagining the future and theory of mind processes [93, 94]. An attempt has recently been made to integrate the role of the default mode network with reward processing on theoretical grounds [95]. However, it seems unlikely that reward is simply a further mental process that activates the default mode network: Wilson et al [28] argued for a pattern of both default mode activations and de-activations in their meta-analyis of reward anticipation, and Martins et al [96] found de-activations in the posterior cingulate cortex, angular gyrus, inferior parietal lobe and medial prefrontal cortex in a meta-analysis of studies of social rewards.

The main non-medial cortical region where we found activations was the insula, which was bilaterally activated by reward anticipation, but not by delivery. Diekhof et al [31] and Oldham et al [27] likewise found bilateral anterior insula activation in association with anticipation but not during delivery. Liu et al [29] found insula activation in their combined analysis of anticipation and delivery, and Bartra et al [30] found it during their meta-analysis of reward delivery.

Although a brain region homologous with the insula exists in primates, the wide range of functions that it has been identified with do not include reward processing [97, 98]. Nevertheless, independent support for an role of the insula in reward comes from human studies. Seeley et al [99] applied independent component analyses (ICA) to resting-state fMRI data in 14 healthy subjects and found evidence not only for two previously well-characterized brain networks, the executive or cognitive control network and the default mode network, but also for a network involving the anterior insula, the dorsal anterior cingulate cortex, and the amygdala, substantia nigra/ventral tegmental area and thalamus. They [99] and subsequently Menon and Uddin [100] used the term ‘salience network’ to describe this set of brain regions, and hypothesized that it functioned to identify the most relevant among competing internal and extrapersonal stimuli for current behaviour. While they considered that these functions explicitly included reward, their conception of salience was broader than this, as ‘a higher-order system for competitive, context-specific, stimulus selection and for focusing the ‘spotlight of attention’ and enhancing access to resources needed for goal-directed behavior’.

Two other cortical regions we found to be activated by reward anticipation have also been found in other meta-analyses. One was the precentral cortex, also found by Oldham et al [27], and the occipital cortex, found by Diekhof et al [31]. As noted in the Introduction, the former of these regions, though not the latter, has been found to be sensitive to reward processing in animal studies, but beyond this, the significance of these findings has to be regarded as obscure. Also unclear is the interpretation of our finding of activations in various subregions of the cerebellum. This finding is conspicuous by its absence in most of the meta-analyses cited above; only Wilson et al [28] found it in their meta-analysis of 15 MID studies which utilized information from individual group maps rather than peak co-ordinate. Recently, however, a direct cerebellar projection to the ventral tegmental area in mice has been discovered [101], which the authors also implicated in reward processing at the behavioural level.

There was no clear evidence of between-study heterogeneity in any of our findings (I2 <50% for all clusters). This suggests that combining studies using the MID task with those using other monetary tasks, as we did, is a viable meta-analytic strategy. It might also imply that the methodological differences among studies (e.g., in the acquisition and processing of data) did not have important effects. On the other hand, there was evidence of publication bias affecting around half of the peaks of the clusters that emerged in our two meta-analyses. It is possible that this reflects the existence of significant numbers of studies that have gone unpublished because they found no activations associated with reward processing or in which the pattern was out of step with the existing literature. Possibly relevant to this explanation is that that the highest level of heterogeneity (p<0.001) found was in the large cluster centred on the ventral striatum in the anticipation meta-analysis, arguably the paradigmatic finding in the field.

Analysis of moderator variables was unrevealing, though in studies where the task was pre-learnt before scanning, activations tended to be stronger in both reward anticipation and delivery. This seems an intuitive result, at least for reward anticipation, given that having to establish a cue: reward contingency while being scanned will inevitably delay and/or reduce the opportunities for a reward predictive cue to produce activations. Against such an interpretation, these associations were only seen in regions that did not emerge in the main meta-analyses. We found only minimal support for Sacchet and Knutson’s [39] suggestion that use of smaller spatial smoothing kernels could exert an influence on the pattern of activations.

In conclusion, this meta-analysis finds that monetary reward anticipation and delivery are associated with partially dissociated pattern of brain activations. Anticipation activates a network of regions whose core could be considered to consist of the ventral striatum, the mid-cingulate gyrus/supplementary motor area and the bilateral insula. Reward delivery also activates the ventral striatum, though to a smaller extent, and is otherwise associated with activations that are restricted to the anterior and posterior cingulate cortex. Our findings are the first to relate human reward processing specifically to the ventral striatum, something that is widely accepted from the animal literature. On the other hand, two of the cortical regions we found to be activated, the mid-cingulate cortex/supplementary motor area by anticipation and the posterior cingulate cortex by delivery, do not as yet have clearly defined reward-related roles.

Supporting information

S1 File. List of excluded studies, funnel plots, meta-analysis results at a lower threshold of (FWER < 0.05).

https://doi.org/10.1371/journal.pone.0255292.s002

(DOCX)

References

  1. 1. Olds J, Milner P. Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. Journal of Comparative and Physiological Psychology. 1954;47(6):419–27. pmid:13233369
  2. 2. Wise RA. Catecholamine theories of reward: a critical review. Brain Research. 1978;152(2):215–47. pmid:354753
  3. 3. Mason ST. Catecholamines and behaviour. Cambridge: Cambridge University Press; 1984.
  4. 4. Schultz W. Predictive reward signal of dopamine neurons. Journal of Neurophysiology. 1998;80(1):1–27. pmid:9658025
  5. 5. Bjorklund A, Dunnett SB. Dopamine neuron systems in the brain: an update. Trends in Neurosciences. 2007;30(5):194–202. pmid:17408759
  6. 6. Glimcher PW. Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proceedings of the National Academy of Sciences USA. 2011;108 Suppl 3:15647–54. pmid:21389268
  7. 7. Hollerman JR, Tremblay L, Schultz W. Involvement of basal ganglia and orbitofrontal cortex in goal-directed behavior. Progress in Brain Research. 2000;126:193–215. pmid:11105648
  8. 8. Schultz W, Tremblay L, Hollerman JR. Reward processing in primate orbitofrontal cortex and basal ganglia. Cerebral Cortex. 2000;10(3):272–84. pmid:10731222
  9. 9. Rolls ET. The orbitofrontal cortex and reward. Cerebral Cortex. 2000;10(3):284–94. pmid:10731223
  10. 10. Murray EA. The amygdala, reward and emotion. Trends in Cognitive Sciences. 2007;11(11):489–97. pmid:17988930
  11. 11. Schultz W, Dickinson A. Neuronal coding of prediction errors. Annual Review of Neuroscience. 2000;23:473–500. pmid:10845072
  12. 12. Lee D, Seo H. Mechanisms of reinforcement learning and decision making in the primate dorsolateral prefrontal cortex. Annals of the New York Academy of Sciences. 2007;1104:108–22. pmid:17347332
  13. 13. Bissonette GB, Roesch MR. Neurophysiology of reward-guided behavior: correlates related to predictions, value, motivation, errors, attention, and action. Current Topics in Behavioral Neurosciences. 2016;27:199–230. pmid:26276036
  14. 14. Haber SN, Knutson B. The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology. 2010;35(1):4–26. pmid:19812543
  15. 15. McClure SM, York MK, Montague PR. The neural substrates of reward processing in humans: the modern role of FMRI. The Neuroscientist. 2004;10(3):260–8. pmid:15155064
  16. 16. Thut G, Schultz W, Roelcke U, Nienhusmeier M, Missimer J, Maguire RP, et al. Activation of the human brain by monetary reward. Neuroreport. 1997;8(5):1225–8. pmid:9175118
  17. 17. Martin-Solch C, Magyar S, Kunig G, Missimer J, Schultz W, Leenders KL. Changes in brain activation associated with reward processing in smokers and nonsmokers. A positron emission tomography study. Experimental Brain Research. 2001;139(3):278–86. pmid:11545466
  18. 18. Hollander E, Pallanti S, Baldini Rossi N, Sood E, Baker BR, Buchsbaum MS. Imaging monetary reward in pathological gamblers. World Journal of Biological Psychiatry. 2005;6(2):113–20. pmid:16156484
  19. 19. Rauch SL, Shin LM, Dougherty DD, Alpert NM, Orr SP, Lasko M, et al. Neural activation during sexual and competitive arousal in healthy men. Psychiatry Research. 1999;91(1):1–10. pmid:10496688
  20. 20. Redoute J, Stoleru S, Gregoire MC, Costes N, Cinotti L, Lavenne F, et al. Brain processing of visual sexual stimuli in human males. Human Brain Mapping. 2000;11(3):162–77. pmid:11098795
  21. 21. Miyagawa Y, Tsujimura A, Fujita K, Matsuoka Y, Takahashi T, Takao T, et al. Differential brain processing of audiovisual sexual stimuli in men: comparative positron emission tomography study of the initiation and maintenance of penile erection during sexual arousal. NeuroImage. 2007;36(3):830–42. pmid:17493836
  22. 22. Tsujimura A, Miyagawa Y, Fujita K, Matsuoka Y, Takahashi T, Takao T, et al. Brain processing of audiovisual sexual stimuli inducing penile erection: a positron emission tomography study. Journal of Urology. 2006;176(2):679–83. pmid:16813919
  23. 23. Knutson B, Westdorp A, Kaiser E, Hommer D. FMRI visualization of brain activity during a monetary incentive delay task. NeuroImage. 2000;12(1):20–7. pmid:10875899
  24. 24. Knutson B, Adams CM, Fong GW, Hommer D. Anticipation of increasing monetary reward selectively recruits nucleus accumbens. Journal of Neuroscience. 2001;21(16):RC159. pmid:11459880
  25. 25. Knutson B, Fong GW, Adams CM, Varner JL, Hommer D. Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport. 2001;12(17):3683–7. pmid:11726774
  26. 26. Knutson B, Greer SM. Anticipatory affect: neural correlates and consequences for choice. Philosophical transactions of the Royal Society of London Series B, Biological sciences. 2008;363(1511):3771–86. pmid:18829428
  27. 27. Oldham S, Murawski C, Fornito A, Youssef G, Yucel M, Lorenzetti V. The anticipation and outcome phases of reward and loss processing: A neuroimaging meta-analysis of the monetary incentive delay task. Human Brain Mapping. 2018;39(8):3398–418. pmid:29696725
  28. 28. Wilson RP, Colizzi M, Bossong MG, Allen P, Kempton M, Bhattacharyya S. The Neural Substrate of Reward Anticipation in Health: A meta-analysis of fMRI findings in the monetary incentive delay task. Neuropsychology Review. 2018;28(4):496–506. pmid:30255220
  29. 29. Liu X, Hairston J, Schrier M, Fan J. Common and distinct networks underlying reward valence and processing stages: a meta-analysis of functional neuroimaging studies. Neuroscience and Biobehavioral Reviews. 2011;35(5):1219–36. pmid:21185861
  30. 30. Bartra O, McGuire JT, Kable JW. The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. NeuroImage. 2013;76:412–27. pmid:23507394
  31. 31. Diekhof EK, Kaps L, Falkai P, Gruber O. The role of the human ventral striatum and the medial orbitofrontal cortex in the representation of reward magnitude—an activation likelihood estimation meta-analysis of neuroimaging studies of passive reward expectancy and outcome processing. Neuropsychologia. 2012;50(7):1252–66. pmid:22366111
  32. 32. Radua J, Mataix-Cols D, Phillips ML, El-Hage W, Kronhaus DM, Cardoner N, et al. A new meta-analytic method for neuroimaging studies that combines reported peak coordinates and statistical parametric maps. European Psychiatry. 2012;27(8):605–11. pmid:21658917
  33. 33. Radua J, Rubia K, Canales-Rodriguez EJ, Pomarol-Clotet E, Fusar-Poli P, Mataix-Cols D. Anisotropic kernels for coordinate-based meta-analyses of neuroimaging studies. Frontiers in Rsychiatry. 2014;5:13. pmid:24575054
  34. 34. Albajes-Eizagirre A, Radua J. What do results from coordinate-based meta-analyses tell us? NeuroImage. 2018;176:550–3. pmid:29729389
  35. 35. Albajes-Eizagirre A, Solanes A, Vieta E, Radua J. Voxel-based meta-analysis via permutation of subject images (PSI): Theory and implementation for SDM. NeuroImage. 2019;186:174–84. pmid:30389629
  36. 36. Albajes-Eizagirre A, Solanes A, Fullana MA, Ioannidis JPA, Fusar-Poli P, Torrent C, et al. Meta-analysis of voxel-based neuroimaging studies using seed-based d mapping with permutation of subject images (SDM-PSI). Journal of Visualized Experiments. 2019;27:153.
  37. 37. Lancaster JL, Tordesillas-Gutierrez D, Martinez M, Salinas F, Evans A, Zilles K, et al. Bias between MNI and Talairach coordinates analyzed using the ICBM-152 brain template. Human Brain Mapping. 2007;28(11):1194–205. pmid:17266101
  38. 38. Rucker G, Schwarzer G, Carpenter JR, Schumacher M. Undue reliance on I2 in assessing heterogeneity may mislead. BMC Medical Research Methodology 2008;8:79. pmid:19036172
  39. 39. Sacchet MD, Knutson B. Spatial smoothing systematically biases the localization of reward-related brain activity. NeuroImage. 2013;66:270–7. pmid:23110886
  40. 40. Galvan A, Hare TA, Davidson M, Spicer J, Glover G, Casey BJ. The role of ventral frontostriatal circuitry in reward-based learning in humans. Journal of Neuroscience. 2005;25(38):8650–6. pmid:16177032
  41. 41. Dillon DG, Holmes AJ, Jahn AL, Bogdan R, Wald LL, Pizzagalli DA. Dissociation of neural regions associated with anticipatory versus consummatory phases of incentive processing. Psychophysiology. 2008;45(1):36–49. pmid:17850241
  42. 42. Kirsch P, Schienle A, Stark R, Sammer G, Blecker C, Walter B, et al. Anticipation of reward in a nonaversive differential conditioning paradigm and the brain reward system: an event-related fMRI study. NeuroImage. 2003;20(2):1086–95. pmid:14568478
  43. 43. Ramnani N, Miall RC. Instructed delay activity in the human prefrontal cortex is modulated by monetary reward expectation. Cerebral Cortex. 2003;13(3):318–27. pmid:12571121
  44. 44. Ernst M, Nelson EE, McClure EB, Monk CS, Munson S, Eshel N, et al. Choice selection and reward anticipation: an fMRI study. Neuropsychologia. 2004;42(12):1585–97. pmid:15327927
  45. 45. Wittmann BC, Schott BH, Guderian S, Frey JU, Heinze HJ, Duzel E. Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron. 2005;45(3):459–67. pmid:15694331
  46. 46. Ernst M, Nelson EE, Jazbec S, McClure EB, Monk CS, Leibenluft E, et al. Amygdala and nucleus accumbens in responses to receipt and omission of gains in adults and adolescents. NeuroImage. 2005;25(4):1279–91. pmid:15850746
  47. 47. Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature. 2006;442(7106):1042–5. pmid:16929307
  48. 48. Samanez-Larkin GR, Gibbs SE, Khanna K, Nielsen L, Carstensen LL, Knutson B. Anticipation of monetary gain but not loss in healthy older adults. Nature Neuroscience. 2007;10(6):787–91. pmid:17468751
  49. 49. Bjork JM, Hommer DW. Anticipating instrumentally obtained and passively-received rewards: a factorial fMRI investigation. Behavioural Brain Research. 2007;177(1):165–70. pmid:17140674
  50. 50. Koch K, Schachtzabel C, Wagner G, Reichenbach JR, Sauer H, Schlosser R. The neural correlates of reward-related trial-and-error learning: an fMRI study with a probabilistic learning task. Learning & Memory. 2008;15(10):728–32. pmid:18832559
  51. 51. Dreher JC, Meyer-Lindenberg A, Kohn P, Berman KF. Age-related changes in midbrain dopaminergic regulation of the human reward system. Proceedings of the National Academy of Sciences USA. 2008;105(39):15106–11. pmid:18794529
  52. 52. Schott BH, Minuzzi L, Krebs RM, Elmenhorst D, Lang M, Winz OH, et al. Mesolimbic functional magnetic resonance imaging activations during reward anticipation correlate with reward-related ventral striatal dopamine release. Journal of Neuroscience. 2008;28(52):14311–9. pmid:19109512
  53. 53. Cooper JC, Hollon NG, Wimmer GE, Knutson B. Available alternative incentives modulate anticipatory nucleus accumbens activation. Social Cognitive and Affective Neuroscience. 2009;4(4):409–16. pmid:19843618
  54. 54. Croxson PL, Walton ME, O’Reilly JX, Behrens TE, Rushworth MF. Effort-based cost-benefit valuation and the human brain. Journal of Neuroscience. 2009;29(14):4531–41. pmid:19357278
  55. 55. Roiser JP, Stephan KE, den Ouden HE, Friston KJ, Joyce EM. Adaptive and aberrant reward prediction signals in the human brain. NeuroImage. 2010;50(2):657–64. pmid:19969090
  56. 56. Simon JJ, Biller A, Walther S, Roesch-Ely D, Stippich C, Weisbrod M, et al. Neural correlates of reward processing in schizophrenia—relationship to apathy and depression. Schizophrenia Research. 2010;118(1–3):154–61. pmid:20005675
  57. 57. Koch K, Schachtzabel C, Wagner G, Schikora J, Schultz C, Reichenbach JR, et al. Altered activation in association with reward-related trial-and-error learning in patients with schizophrenia. NeuroImage. 2010;50(1):223–32. pmid:20006717
  58. 58. Jung WH, Kang DH, Han JY, Jang JH, Gu BM, Choi JS, et al. Aberrant ventral striatal responses during incentive processing in unmedicated patients with obsessive-compulsive disorder. Acta Psychiatrica Scandinavica. 2011;123(5):376–86. pmid:21175552
  59. 59. Kim H, Shimojo S, O’Doherty JP. Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex. Cerebral Cortex. 2011;21(4):769–76. pmid:20732900
  60. 60. Ivanov I, Liu X, Clerkin S, Schulz K, Friston K, Newcorn JH, et al. Effects of motivation on reward and attentional networks: an fMRI study. Brain and Behavior. 2012;2(6):741–53. pmid:23170237
  61. 61. Balodis IM, Kober H, Worhunsky PD, Stevens MC, Pearlson GD, Potenza MN. Diminished frontostriatal activity during processing of monetary rewards and losses in pathological gambling. Biological Psychiatry. 2012;71(8):749–57. pmid:22336565
  62. 62. Yau WY, Zubieta JK, Weiland BJ, Samudra PG, Zucker RA, Heitzeg MM. Nucleus accumbens response to incentive stimuli anticipation in children of alcoholics: relationships with precursive behavioral risk and lifetime alcohol use. Journal of Neuroscience. 2012;32(7):2544–51. pmid:22396427
  63. 63. Filbey FM, Dunlop J, Myers US. Neural effects of positive and negative incentives during marijuana withdrawal. PloS One. 2013;8(5):e61470. pmid:23690923
  64. 64. Rose EJ, Ross TJ, Salmeron BJ, Lee M, Shakleya DM, Huestis MA, et al. Acute nicotine differentially impacts anticipatory valence- and magnitude-related striatal activity. Biological Psychiatry. 2013;73(3):280–8. pmid:22939991
  65. 65. Saji K, Ikeda Y, Kim W, Shingai Y, Tateno A, Takahashi H, et al. Acute NK(1) receptor antagonist administration affects reward incentive anticipation processing in healthy volunteers. International Journal of Neuropsychopharmacology. 2013;16(7):1461–71. pmid:23406545
  66. 66. Kaufmann C, Beucke JC, Preusse F, Endrass T, Schlagenhauf F, Heinz A, et al. Medial prefrontal brain activation to anticipated reward and loss in obsessive-compulsive disorder. NeuroImage Clinical. 2013;2:212–20. pmid:24179774
  67. 67. Costumero V, Barros-Loscertales A, Bustamante JC, Ventura-Campos N, Fuentes P, Avila C. Reward sensitivity modulates connectivity among reward brain areas during processing of anticipatory reward cues. European Journal of Neuroscience. 2013;38(3):2399–407. pmid:23617942
  68. 68. Eppinger B, Schuck NW, Nystrom LE, Cohen JD. Reduced striatal responses to reward prediction errors in older compared with younger adults. Journal of Neuroscience. 2013;33(24):9905–12. pmid:23761885
  69. 69. Bustamante JC, Barros-Loscertales A, Costumero V, Fuentes-Claramonte P, Rosell-Negre P, Ventura-Campos N, et al. Abstinence duration modulates striatal functioning during monetary reward processing in cocaine patients. Addiction Biology. 2014;19(5):885–94. pmid:23445167
  70. 70. Damiano CR, Aloi J, Dunlap K, Burrus CJ, Mosner MG, Kozink RV, et al. Association between the oxytocin receptor (OXTR) gene and mesolimbic responses to rewards. Molecular Autism. 2014;5(1):7. pmid:24485285
  71. 71. Funayama T, Ikeda Y, Tateno A, Takahashi H, Okubo Y, Fukayama H, et al. Modafinil augments brain activation associated with reward anticipation in the nucleus accumbens. Psychopharmacology. 2014;231(16):3217–28. pmid:24682502
  72. 72. Maresh EL, Allen JP, Coan JA. Increased default mode network activity in socially anxious individuals during reward processing. Biology of Mood & Anxiety Disorders. 2014;4:7.
  73. 73. Weiland BJ, Heitzeg MM, Zald D, Cummiford C, Love T, Zucker RA, et al. Relationship between impulsivity, prefrontal anticipatory activation, and striatal dopamine release during rewarded task performance. Psychiatry Research. 2014;223(3):244–52. pmid:24969539
  74. 74. Wu CC, Samanez-Larkin GR, Katovich K, Knutson B. Affective traits link to reliable neural markers of incentive anticipation. NeuroImage. 2014;84:279–89. pmid:24001457
  75. 75. Behan B, Stone A, Garavan H. Right prefrontal and ventral striatum interactions underlying impulsive choice and impulsive responding. Human Brain Mapping. 2015;36(1):187–98. pmid:25158155
  76. 76. Smieskova R, Roiser JP, Chaddock CA, Schmidt A, Harrisberger F, Bendfeldt K, et al. Modulation of motivational salience processing during the early stages of psychosis. Schizophrenia Research. 2015;166(1–3):17–23. pmid:25999039
  77. 77. Mucci A, Dima D, Soricelli A, Volpe U, Bucci P, Frangou S, et al. Is avolition in schizophrenia associated with a deficit of dorsal caudate activity? A functional magnetic resonance imaging study during reward anticipation and feedback. Psychological Medicine. 2015;45(8):1765–78. pmid:25577954
  78. 78. Romanczuk-Seiferth N, Koehler S, Dreesen C, Wustenberg T, Heinz A. Pathological gambling and alcohol dependence: neural disturbances in reward and loss avoidance processing. Addiction Biology. 2015;20(3):557–69. pmid:24754423
  79. 79. Ubl B, Kuehner C, Kirsch P, Ruttorf M, Diener C, Flor H. Altered neural reward and loss processing and prediction error signalling in depression. Social Cognitive and Affective Neuroscience. 2015;10(8):1102–12. pmid:25567763
  80. 80. Carl H, Walsh E, Eisenlohr-Moul T, Minkel J, Crowther A, Moore T, et al. Sustained anterior cingulate cortex activation during reward processing predicts response to psychotherapy in major depressive disorder. Journal of Affective Disorders. 2016;203:204–12. pmid:27295377
  81. 81. Yan C, Wang Y, Su L, Xu T, Yin DZ, Fan MX, et al. Differential mesolimbic and prefrontal alterations during reward anticipation and consummation in positive and negative schizotypy. Psychiatry Research: Neuroimaging. 2016;254:127–36. pmid:27419380
  82. 82. Herbort MC, Soch J, Wustenberg T, Krauel K, Pujara M, Koenigs M, et al. A negative relationship between ventral striatal loss anticipation response and impulsivity in borderline personality disorder. NeuroImage Clinical. 2016;12:724–36. pmid:27766203
  83. 83. Apicella P, Ljungberg T, Scarnati E, Schultz W. Responses to reward in monkey dorsal and ventral striatum. Experimental Brain Research. 1991;85(3):491–500. pmid:1915708
  84. 84. Bryden DW, Johnson EE, Tobia SC, Kashtelyan V, Roesch MR. Attention for learning signals in anterior cingulate cortex. Journal of Neuroscience. 2011;31(50):18266–74. pmid:22171031
  85. 85. Hayden BY, Heilbronner SR, Pearson JM, Platt ML. Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. Journal of Neuroscience. 2011;31(11):4178–87. pmid:21411658
  86. 86. Xu M, Xu G, Yang Y. Neural systems underlying emotional and non-emotional interference processing: an ALE meta-analysis of functional neuroimaging studies. Frontiers in Behavioral Neuroscience. 2016;10:220. pmid:27895564
  87. 87. Ridderinkhof KR, Ullsperger M, Crone EA, Nieuwenhuis S. The role of the medial frontal cortex in cognitive control. Science. 2004;306(5695):443–7. pmid:15486290
  88. 88. Ridderinkhof KR, van den Wildenberg WP, Segalowitz SJ, Carter CS. Neurocognitive mechanisms of cognitive control: the role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning. Brain and Cognition. 2004;56(2):129–40. pmid:15518930
  89. 89. Gratton G, Cooper P, Fabiani M, Carter CS, Karayanidis F. Dynamics of cognitive control: Theoretical bases, paradigms, and a view for the future. Psychophysiology. 2018;55(3).
  90. 90. Amodio DM, Frith CD. Meeting of minds: the medial frontal cortex and social cognition. Nature reviews Neuroscience. 2006;7(4):268–77. pmid:16552413
  91. 91. Carmichael ST, Price JL. Connectional networks within the orbital and medial prefrontal cortex of macaque monkeys. Journal of Comparative Neurology. 1996;371(2):179–207. pmid:8835726
  92. 92. Leech R, Sharp DJ. The role of the posterior cingulate cortex in cognition and disease. Brain: a journal of neurology. 2014;137(Pt 1):12–32. pmid:23869106
  93. 93. Buckner RL, DiNicola LM. The brain’s default network: updated anatomy, physiology and evolving insights. Nature reviews Neuroscience. 2019;20(10):593–608. pmid:31492945
  94. 94. Spreng RN, Mar RA, Kim AS. The common neural basis of autobiographical memory, prospection, navigation, theory of mind, and the default mode: a quantitative meta-analysis. Journal of Cognitive Neuroscience. 2009;21(3):489–510. pmid:18510452
  95. 95. Dohmatob E, Dumas G, Bzdok D. Dark control: The default mode network as a reinforcement learning agent. Human Brain Mapping. 2020;41(12):3318–41. pmid:32500968
  96. 96. Martins D, Rademacher L, Gabay AS, Taylor R, Richey JA, Smith DV, et al. Mapping social reward and punishment processing in the human brain: A voxel-based meta-analysis of neuroimaging findings using the social incentive delay task. Neuroscience and Biobehavioral Reviews. 2021;122:1–17. pmid:33421544
  97. 97. Augustine JR. The insular lobe in primates including humans. Neurological Research. 1985;7(1):2–10. pmid:2860583
  98. 98. Nieuwenhuys R. The insular cortex: a review. Progress in Brain Research. 2012;195:123–63. pmid:22230626
  99. 99. Seeley WW, Menon V, Schatzberg AF, Keller J, Glover GH, Kenna H, et al. Dissociable intrinsic connectivity networks for salience processing and executive control. Journal of Neuroscience. 2007;27(9):2349–56. pmid:17329432
  100. 100. Menon V, Uddin LQ. Saliency, switching, attention and control: a network model of insula function. Brain Structure & Function. 2010;214(5–6):655–67. pmid:20512370
  101. 101. Carta I, Chen CH, Schott AL, Dorizan S, Khodakhah K. Cerebellar modulation of the reward circuitry and social behavior. Science. 2019;363(6424). pmid:30655412