When deciding whether to bet in situations that involve potential monetary loss or gain (mixed gambles), a subjective sense of pressure can influence the evaluation of the expected utility associated with each choice option. Here, we explored how gambling decisions, their psychophysiological and neural counterparts are modulated by an induced sense of urgency to respond. Urgency influenced decision times and evoked heart rate responses, interacting with the expected value of each gamble. Using functional MRI, we observed that this interaction was associated with changes in the activity of the striatum, a critical region for both reward and choice selection, and within the insula, a region implicated as the substrate of affective feelings arising from interoceptive signals which influence motivational behavior. Our findings bridge current psychophysiological and neurobiological models of value representation and action-programming, identifying the striatum and insular cortex as the key substrates of decision-making under risk and urgency.
Citation: Jones CL, Minati L, Harrison NA, Ward J, Critchley HD (2011) Under Pressure: Response Urgency Modulates Striatal and Insula Activity during Decision-Making under Risk. PLoS ONE 6(6): e20942. https://doi.org/10.1371/journal.pone.0020942
Editor: Jan Lauwereyns, Kyushu University, Graduate School of Systems Life Sciences, Japan
Received: November 24, 2010; Accepted: May 16, 2011; Published: June 6, 2011
Copyright: © 2011 Jones et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: CLJ received doctoral funding from Medical Research Council UK (RD13). LM, NAH and HDC were supported by a programme grant awarded by the Wellcome Trust to HDC (074333). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Making risky decisions under time pressure can lead to unfavorable consequences: “Act in haste, repent at leisure”. This effect is so well known that many countries even protect consumers against it with specific ‘cooling off period’ legislation. How does the brain choose under pressure? To date, little is known about the neural substrates which determine the effects of response pressure (or urgency) on decision-making behavior.
In financial decision-making paradigms, multiple components of each gamble are integrated in order to arrive at an optimal decision. The expected value (EV) of a choice option is defined as the sum of the value of each possible outcome weighted by each associated probability of occurrence. Rationally, options with a higher EV are favored, when all else is equal. However, EV maximization is not sufficient to account for all behavioural phenomena which are observed, such as risk aversion (where a sure payment is preferred to a risky option having equal or higher EV) and time discounting (where the subjective value of a payment decreases non-linearly with the associated delay). Influential models in behavioural economics including expected utility theory  and prospect theory  account for neuropsychological evidence , highlighting the integration of cognitive appraisal with emotional responses when making decisions under uncertainty.
Emotional reactions are typically faster than cognitive evaluations  and may constitute “affect heuristics” which reflect a speed-accuracy tradeoff during action-selection. Specific behavioural effects are observed when urgency is modulated by means of response time limitations. Information processing speed is increased , risky options are avoided if EV is positive and more frequently accepted if EV is negative , , and greater weight is placed on the negative domain, e.g. on potential loss . On the basis of these studies, one can hypothesize that response urgency modulates more than one aspect of choice option evaluation, leading to heterogeneous effects on overall performance, depending on the specific paradigm.
Converging neuroimaging evidence indicates that EV and risk are computed in a distributed circuit, involving regions also supporting emotional processes. These include the striatum, the ventrolateral prefrontal cortex (vlPFC), the parietal cortices, the anterior cingulate and the amygdala  and more recently the insula . Striatal activity is hypothesized to encode EV determined from the integration of multiple gamble parameters ; further, the striatum is the main candidate region implementing the speed-accuracy tradeoff and putatively acts as an “urgency switch”  to maintain a balance between decisional speed and accuracy , . To date, it remains unclear to what extent these two aspects of striatal involvement in decision-making are anatomically overlapping and functionally integrated.
The striatum receives cortical projections from the insular cortex, which is emerging as a central hub in models of decision-making. Here, information concerning potential risk and reward is integrated with interoceptive (bodily) signals and the representation of time to give rise to momentary conscious experiences and “gut feelings” that strongly influence option selection , . Clinical reports show that when the insula is damaged, addictive behavior is attenuated . Patients with insula lesions also display relative insensitivity to EV , and impaired adjustment of subjective beliefs about risk through experience . We therefore hypothesized that physiological and affective signals related to urgency may be represented in the insula, and functionally integrated with information concerning EV and/or uncertainty to modulate decision-making behavior.
In this study, we investigated the behavioral consequences of subjective urgency on decision-making under risk. We used concurrent heart rate monitoring and functional magnetic resonance imaging (fMRI) to elucidate the psychophysiological correlates and neurobiological bases of this behavioral bias. In our task, participants were presented with mixed-gambles (see Fig. 1, below) involving an explicit probability of winning, a potential loss and a potential win, and chose whether to accept each gamble or avoid the risk. As cognitive processing is influenced by outcome feedback –, we did not provide outcome feedback on a trial by trial basis, aiming to study the separate evaluation of each gamble, to probe the neural correlates of choice option evaluation and of the resulting internal competitive processes in the absence of learning and feedback-related emotional states.
kwin represents potential gain, pwin the probability of winning, kloss potential loss. Participants were instructed to consider these elements together and equally weight them when deciding whether to bet or leave each gamble. A third of the gambles had positive EV (risk-advantageous), a third negative EV (risk-disadvantageous) and the remaining EV≈0 (risk-indifferent). The clock spun at two different rates: slow or fast. Participants were explicitly instructed that they always had 5 s to respond. Trials were interspersed with null events (fixation cross).
Across trials, we varied EV and, in an orthogonal manner, the uncertainty associated with each gamble, through the probability of winning (pwin), the amount of money to be won (kwin) and the potential loss (kloss). This resulted in three levels of EV (defined as pwin × kwin - (1-pwin) × kloss): negative EV (risk-disadvantageous), neutral EV (risk-neutral) and positive EV (risk-advantageous gambles). We also defined two levels of uncertainty: probability class 20%/80% (low outcome uncertainty) and probability class 40%/60% (high outcome uncertainty). We characterized outcome uncertainty as being largest near pwin = 50% , where the probability of receiving a reward or a loss are similar. EV and uncertainty were orthogonalized to test for distinct substrates involved in processing these parameters, and explore how urgency may differentially modulate their activity.
Our third factor, urgency, comprised two levels: high and low. On each trial, a fast or slow spinning clock was displayed along with the gamble to manipulate the subjective sense of urgency to make a response. Participants nevertheless always had a time limit of five seconds to respond on every trial (see Methods section), and were aware that this was identical irrespective of the clock speed.
We predicted that participants would predominantly accept gambles with a positive EV, reject those with negative EV and exhibit risk-aversion on gambles where EV≈0. We also predicted that a higher level of urgency would reduce decision time  and, through interaction with EV, would reduce performance accuracy. Specifically we anticipated that under high urgency participants would place fewer bets on positive EV gambles and bet more on negative EV gambles. Emotions consist of both subjective and physiological elements, and therefore, physiological responses during task performance provide insight into emotional processes , . We predicted that manipulations of EV, uncertainty and urgency would modulate the participant's affective state in a manner that could be indexed by stimulus-evoked heart rate changes. At a neural level, we expected activation related to EV and/or uncertainty to be modulated by urgency state in regions implicated in action-selection, particularly the striatum and the insula.
Effects of EV (positive, neutral, negative).
As anticipated, EV significantly influenced the percentage of trials on which participants gambled (main effect of EV F(2,26) = 115.8, p<0.001, η2 = 0.90), with significant differences between all EV levels (mean±SEM, positive EV: 72%±2%, neutral EV: 38%±2%, negative EV: 15%±3%, all post-hoc contrasts p<0.001) (Fig. 2a). There was also a main effect of EV on response time (F(2,26) = 4.8, p = 0.02, η2 = 0.27) which was driven by significantly faster responses on negative EV trials (2290±30 ms) compared to neutral EV (2370±30 ms) and positive EV (2450±30 ms) trials (Fig. 2b). Performance level, defined as the ratio of rejected negative EV and taken positive EV gambles over the total number of negative EV and positive EV gambles, was 78±1% (range 60% to 91%) across participants. Risk propensity, defined as the proportion of neutral-EV gambles taken, was 38±1% across participants. A one sample t-test revealed that the group was significantly risk averse on neutral EV trials (i.e., participants tended to reject risk-indifferent gambles, t(13) = 2.9, p<0.01).
Main effects and interactions of EV, uncertainty and urgency on percent bets (a) and reaction time (b). c) Average heart rate change (bpm) over single trials, dashed lines represent standard error of the mean. Main effects and interactions of EV, uncertainty and urgency on heart rate (HR) deceleration(d) and later rise (e).
Effects of urgency (low, high) and its interaction with EV.
There was a main effect of urgency on response times (F(1,13) = 14.7 p<0.01, η2 = 0.53), with quicker responses for high-urgency trials (2310±30 ms vs. 2430±30 ms). There was also a significant interaction between urgency and EV (F(2,26) = 3.7, p<0.05, η2 = 0.22) . Post-hoc contrasts showed that the effect of urgency was significantly more pronounced for neutral EV trials (2300±30 ms for high urgency vs. 2450±40 ms for low urgency) compared to negative EV trials (2260±30 ms for high urgency vs. 2320±30 ms for low urgency), (F(2,26) = 9.9, p<0.01, η2 = 0.43) (Fig. 2b). There was also a statistical trend between urgency and EV on percentage bets (F(2,26) = 3.0, p = 0.05). Post-hoc contrasts revealed that urgency differentially modulated the percent of bets on negative and positive gambles (F(2,26) = 13.7, p<0.01): high urgency increased the proportion of negative EV gambles accepted (17±1% for high urgency vs.13±1% for low urgency) and decreased the proportion of positive EV accepted (68±1% for high urgency vs. 76±1% for low urgency) (Fig. 2a). Participants were not significantly more risk averse under high compared to low urgency (37% vs. 39% on neutral gambles).
Effects of uncertainty.
There were no main effects of uncertainty on percent bets or response time and no interactions with EV or urgency.
To explore whether the rate of the spinning clock influenced the subjective perception of time, participants were asked to estimate short intervals under high (rapidly spinning clock) and low (slowly spinning clock) urgency conditions. This test was performed in the scanner immediately after completion of the gambling task. Participants overestimated the time elapsed under high urgency and underestimated it under low urgency (10±2% vs. −5±2%, F(1,13) = 20.5, p<0.001, ηp2 = 0.59).
Gamble presentation elicited a biphasic orienting response in heart rate, consisting of an initial slowing followed by acceleration. Averaging over all participants, the initial bradycardic response peaked at −1.4±2.5 bpm, 1.8 s post-stimulus, with the subsequent acceleration peaking at 0.9±2.1 bpm, 5.4 s post-stimulus (Fig. 2c).
For the initial slowing (1.5–2.1 s post-stimulus), there was a main effect of urgency (F(1,13) = 10.9 p = 0.006, ηp2 = 0.46), with greater deceleration under high urgency (−1.8±0.4 bpm vs. −1.1±0.3 bpm). Further, urgency interacted with EV (F(2,26) = 8.8, p<0.001, ηp2 = 0.40), modulating heart rate deceleration for negative compared to neutral EV trials (p<0.001) and for positive compared to neutral EV trials (p<0.05). Under low urgency, neutral-EV gambles were associated with the greatest slowing, conversely under high urgency, negative-EV and positive-EV gambles evoked the greatest slowing compared to neutral-EV gambles (Fig. 2d)
For the later heart rate acceleration (5.1–5.7 s post-stimulus), there were no main effects of urgency, EV or uncertainty, however there was an interaction between EV and urgency (F(2,26) = 6.1, p<0.01, ηp2 = 0.32). Contrasts showed that urgency significantly modulated the difference in heart rate rise for negative compared to neutral EV trials (p<0.05) and for positive compared to neutral EV trials (p<0.05) (but not for negative versus positive, p = 0.3). Under low urgency, the greatest increase in heart rate was with negative EV gambles compared to high urgency where neutral EV gambles were associated with the greatest increase in heart rate (Fig. 2e).
To summarize behavioural and physiological results, urgency had a main effect on reaction times (high urgency elicited faster response times) and heart rate (high urgency elicited initial greater slowing) and significantly interacted with EV to modulate both measures. EV had a main effect on the number of bets taken and the response time. Uncertainty had no significant effects suggesting that the probability of gain/loss has little effect on behavior per-se, beyond its contribution in the definition of EV.
Throughout this section, only significant findings are explicitly reported. Those interactions that did not reach statistical significance threshold have not been reported.
Effects of EV (positive, neutral, negative).
As predicted, positive-EV gambles (compared to negative EV) elicited greater activation within the striatum (head of the caudate bordering on the ventral striatum) reflecting greater reward expectation in this condition. Neutral-EV gambles elicited greater activation than both negative-EV and positive EV gambles bilaterally in the medial prefrontal and anterior cingulate cortex; the contrast with negative EV was associated with widespread differences, including in the dorsal- and ventrolateral prefrontal cortex and cingulate gyrus. Negative EV gambles did not elicit greater activation than positive- or neutral-EV gambles in any region (Fig. 3 and Table 1).
Activations shown at the cluster-forming threshold p<0.001. See Table 1 for full list of activation clusters and corresponding extents.
Effects of urgency (high, low) and interaction of urgency and EV.
Critical to the main question of this study was the observation that urgency interacted with EV in many regions (Fig. 4 and Table 2). In particular, significant effects were observed for three contrasts. First, the difference between negative and neutral EV gambles was modulated by urgency for clusters in the ventrolateral and dorsolateral prefrontal cortex, striatum and insula: under low urgency, the response was greater for negative than neutral EV gambles, whereas under high urgency the effect was reversed. Second, the difference between positive and neutral EV gambles was modulated by urgency in the orbitofrontal cortex, anterior insula, cingulate gyrus, dorsolateral prefrontal cortex and caudate nucleus: under low urgency, the response was greater for positive than neutral EV gambles, whereas the converse was observed under high urgency. Third, the difference between negative and positive EV gambles in the middle temporal gyrus was modulated by urgency, i.e. the response was larger for negative than positive EV gambles under low urgency, and the effect was reversed under high urgency.
Activations shown at the cluster-forming threshold p<0.001. See Table 2 for full list of activation clusters and corresponding extents.
To corroborate the above findings, region-of-interest (ROI) analyses were conducted on average activity in the caudate, ventral striatum, putamen and anterior insula (Fig. 5). For the caudate, there was a main effect of EV (F(2,26) = 4.8, p<0.05, ηp2 = 0.27) with stronger activation (BOLD signal percent change) for positive than negative EV (0.29±0.04% vs. 0.14±0.05%, p<0.05); neutral EV elicited activation of intermediate intensity (0.20±0.05%), without significant differences. Further, EV interacted with urgency (F(2,26) = 4.6, p<0.05, ηp2 = 0.26): post-hoc ANOVAs revealed that the effect of EV was stronger under high (F(2,26) = 7.8, p<0.01, ηp2 = 0.36) than under low urgency (F(2,26) = 3.6, p<0.05, ηp2 = 0.20). In particular, the response to negative EV gambles was significantly attenuated under high urgency (0.15±0.01% vs. 0.05±0.01%, p<0.02). There was no significant lateralization of any effect.
See text for statistical results.
Within the putamen there were no interactions between EV and urgency, and no interactions of EV or urgency with side.
Within ventral striatum, there was a statistical trend towards a main effect of EV (F(2,26) = 3.2, p = 0.05, ηp2 = 0.19) which interacted with side (F(2,26) = 4.7, p<0.05, ηp2 = 0.25). Post-hoc ANOVAs revealed that the effect of EV was significant for the left (F(2,26) = 6.4, p<0.01, ηp2 = 0.31) but not for the right hemisphere (p = 0.2). There was no interaction between EV and urgency.
There was a main effect of EV in the anterior insula (F(2,26) = 4.7, p<0.05, ηp2 = 0.27), with neutral EV gambles eliciting the greatest activation. However, there were no interactions of EV, urgency or side.
Effects of uncertainty [low (20/80), high (40/60)].
At the whole-brain level, low-uncertainty gambles elicited diffusely stronger activation than high-uncertainty gambles bilaterally across regions including the insular cortex, the inferior and middle frontal gyri, anterior and posterior cingulate cortices, fusiform gyrus, angular gyrus, cuneus / precuneus and within the rostral brainstem and midbrain. The converse pattern was not observed in any region.
At the ROI level within the caudate, there was also a significant main effect of uncertainty (F(1,13) = 7.2, p<0.05, ηp2 = 0.4), with stronger activation for low uncertainty (0.21±0.05% vs. 0.13±0.04%). In the anterior insula there was a main effect of uncertainty (F(1,13) = 15.8, p = 0.001, ηp2 = 0.53), with stronger activation for low uncertainty (0.38±0.05% vs. 0.31±0.04%), and an interaction with side (F(1,13) = 8.6, p<0.05, ηp2 = 0.38). Post-hoc ANOVAs revealed that the effect of uncertainty was greater within the left (F(1,13) = 23.3, p<0.001, ηp2 = 0.62) than right hemisphere (F(1,13) = 5.8, p<0.05, ηp2 = 0.29). We did not observe any significant interactions between uncertainty and urgency and between uncertainty and EV in either the whole brain or ROI analysis.
Our results characterize how response urgency influences gambling behavior, and which brain regions subserve the observed behavioural effect. We successfully manipulated participants' urgency to make a decision to bet or not bet on mixed gambles, reflected in a significant reduction in response times on high urgency trials and corresponding changes in heart-rate. Corroborating data demonstrated that participants' subjective perception of time was altered when responding, in a time estimation task, where participants significantly underestimated the elapsed time in the high urgency condition and overestimated the elapsed time in the low urgency condition. Therefore an altered perception of the amount of time available to make a decision contributed to the reduced decision time under high urgency.
Participants predictably avoided loss by gambling less frequently on risk-disadvantageous trials (negative EV) and anticipated gain by gambling more frequently on risk advantageous trials (positive EV). EV also influenced response times, with participants making quicker decisions on gambles with greater potential loss (negative EV). These observations support the findings of Tom and colleagues (2007) who report faster response times to negative EV gambles, indicating a preference to attend to negative stimuli and a greater sensitivity to losses than gains , .
Critically, urgency interacted with the EV of a gamble to modulate behavior, heart rate and neural activity. At the behavioural level, high urgency was detrimental to performance, reducing the number of bets placed on risk advantageous (positive-EV) gambles and increasing the number of bets made on risk disadvantageous (negative-EV) gambles. It is suggested that the striatum may mediate this behavioural effect by releasing motor circuit inhibition to facilitate fast but possibly premature responses . We provide empirical validation for this proposal by observing that increased urgency modulates activity within regions of the striatum that encode EV. Our results endorse a model of brain mechanisms for action-selection proposed by Redgrave and colleagues (1999) which suggests that, in order to be considered as a candidate substrate for action-selection, a neural system should exhibit certain properties, namely: 1) it should receive information about internal states and external cues relevant to decision-making, 2) it should support a mechanism to compute the level of urgency to be assigned to each available action, 3) it should have the capacity to resolve conflicts between competing actions based on their relative salience and 4) its outputs should be modifiable allowing the expression of winning actions while suppressing losing actions (importantly, this does not necessarily embed the requirement of a ‘linear’ relationship between activation level and EV, and indeed the relationship was more complex in our results). In this context, the striatum represents the putative core of a decision-making / action-selection circuit . As discussed below, this circuit becomes engaged in a manner that depends on value not only in a ‘direct’ way, but also in terms of deviation from a situation of ‘risk-indifference’: In other words, engagement of action-selection circuitry is augmented under situations of high response conflict, as occurs in neutral-EV gambles.
The insula receives convergent information associated with salient environmental stimuli across sensory modalities, and direct modulation from the striatum , providing crucial capacity for incentive and hedonic signaling. We showed that urgency interacted with EV to modulate activity within insula (according to the whole-brain analysis) as well as modulating physiological arousal. While we are unable to demonstrate a direct relationship between physiological responses and behavioural choice, evidence from previous studies shows that somatic changes contribute to decision-making behavior – and can relate to how well an individual performs on a decision-making task . Existing research on heart rate responses to emotional stimuli identifies two main markers: An initial bradycardia, thought to express attentional orienting to motivationally-salient events through parasympathetic activity  and a later rise in heart rate, signifying emotional arousal through sympathetic activation . Greater initial decelerations are associated with more aversive stimuli , i.e. reflecting a “freeze” response. In the present study, higher urgency trials were associated with a more pronounced cardiac deceleration, 0–2 s following gamble presentation (prior to a response), signaling a more aversive emotional state (compared to low urgency trials). Since feedback and learning were absent in this task, we suggest that such physiological changes reflect affective components of the evaluation process itself, rather than anticipatory changes or reactions to reward or punishment. Urgency interacted with expected value to modulate both the initial heart rate deceleration and the later acceleration. The relationship between the orienting response (heart rate deceleration), neural activation and behavioural choice in decision-making is unlikely to be straightforward. The pattern of EV x urgency interaction observed on heart rate deceleration was not observed in the neuroimaging data, which indicate that, here, the regional neural activity observed as BOLD effects does not directly mediate the orienting response. The pattern of EV x urgency interaction observed on heart rate acceleration resembled more closely the interaction observed in the insula, i.e. greater heart rate increase for negative EV gambles under low urgency compared to high urgency trials, for which neutral EV gambles were associated with the largest heart rate increase. This suggests that insula activity is coupled to the sympathetic arousal generated by gamble evaluation.
Previous studies illustrate direct associations between physiological fluctuations (e.g. heart rate or skin conductance response) and activity changes within the insula –. Our study therefore highlights the contribution to emotional decision-making of brain regions known to represent these homeostatic states and, by implication, of those states themselves. Recent work relates the degree to which the insula is engaged during risky decisions that follow decisions involving no risk, to individual differences in urgency / impulsivity traits . However, in this study the notion of ‘urgency’ differs categorically from that of the present study (e.g., as a state varying within individuals depending on external pressures versus a trait varying between individuals) as do other aspects of the experimental design (e.g. presence of outcome feedback). Current models of insula function also highlight the anterior insula as a key region involved in time perception . How this information is integrated in emotional decision-making is becoming clearer, for example the insula and striatum are conjointly active in immediate versus delayed rewards  further supporting their role integrating temporal information with other parameters during decision-making under risk. In addition to insula and striatum involvement, dlPFC and vlPFC activation was observed in relation to the interaction between EV and urgency. The vlPFC processes motivational and emotional signals from subcortical areas and computes the behavioural salience of external events ; it is also involved in response inhibition . In our data, the dlPFC and vlPFC responded to the contrast between neutral and negative EV, with enhanced activation for neural EV gambles. This effect was, in turn, modulated by the level of urgency in clusters in these regions. We hypothesize that the dlPFC and vlPFC, insula and striatum operate together as substrates for integrating affective information (e.g. related to urgency) into goal-directed behavior. A more general question for future research concerns how cortical and sub-cortical regions may differ in their facilitation of action programming.
Interestingly, in this study the insula and cingulate gyrus were most sensitive to gambles with a neutral value (EV≈0) and within the insula this effect was amplified under high urgency. An influential model of anterior cingulate function concerns its engagement in conflict monitoring, or “in situations requiring selection among a set of equally permissible responses”, a process particularly pertinent to the representation of neutral EV gambles. In particular, one can view decision-making as a competition between processes promoting and inhibiting the performance of a given action; in situations of high-conflict, internal competition leads to enhanced activity with respect to situations where one action rapidly wins over the other , . One alternative account is that the conjoint activation of the insula and anterior cingulate to neutral EV gambles mediates risk aversion, as a subjective, emotionally driven phenomenon . More specifically, we suggest that, depending on the level of urgency, the dominant neural representation shifts from an EV-centered one, where most regions respond linearly to EV, to a response conflict-centered one, whereby under high urgency the striatum, insula and cingulum are engaged proportionate to the level of deviation from a situation of risk-indifference (neutral vs. positive or negative EV).
Uncertainty was negatively correlated with activation in the insula cortex, the inferior frontal gyrus, the middle frontal gyrus, anterior and posterior cingulate cortices, fusiform gyrus, angular gyrus, cuneus/precuneus and within the rostral brainstem and midbrain. That is, we observed greater activation in these regions to gambles with probability class 20%/80% compared with 40%/60%. Neuroimaging studies have demonstrated that the probability with which a stimulus or response occurs modulates activity in the anterior insula, anterior and posterior cingulate cortex, middle frontal gyrus, ventromedial and dorsolateral prefrontal cortex , , . Typically, these regions become engaged as the uncertainty associated with two possible outcomes increases. However, these studies do not dissociate the neural signals reflecting simple uncertainty of reward/loss from other decisional variables e.g. EV or reward/loss prediction errors following outcome presentation. Our findings therefore do not contradict these observations, because there are fundamental differences in task design and implementation across studies which are likely to account for distinct differences in patterns of activation, highlighting the complexity of uncertainty representation in the brain. In particular, one cannot exclude the existence of multiple neural representations underlying what appears to be a unitary definition of uncertainty, and these would be plausibly engaged in a highly task-dependent manner. Further, there may be effects related to shifts in cognitive strategy: When the probability of winning was close to 50%, especially under high urgency, participants might have approximated EV computation with a basic comparison between potential loss and gain, whereas when the probability of winning was distant from 50% deeper processing would be required to support choice option evaluation.
This study lays the foundations for further experiments detailing the effects of urgency on performance and associated physiological and neural substrates. This work could be extended to determine the relationship of physiological effects and/or neural activations with behavioural choice under different levels of urgency. This would involve considering how participants' choices (e.g. bet versus no bet) predicted their regional neural activation and/or heart rate change. The current experimental design did not permit us to assess this directly but illustrates the differential and integrative mechanisms associated with expected value, uncertainty and urgency on brain and body during the evaluation of the value of the options and associated risk. Furthermore, our experimental design did not enable dissection of sub-components of the urgency-inducing manipulation, for example effects of the spinning clock on emotional arousal and visual attention. Future work is necessary to qualify better effects of emotional versus attentional modulations on decision-making and the underlying neural activity. Beyond the mixed gamble design featured here, there is a potential need to examine effects of urgency separately within the loss and gain domains. The present paradigm is, however, well-suited for further exploration and future use in clinical and occupational populations, for example to study patients with gambling addiction or investment bankers, who likely exhibit different patterns of behavioural and physiological activity under heightened levels of urgency .
In conclusion, we provide evidence that signals related to response urgency are integrated with choice value information to modulate neural activity in the striatum and the insula, with concurrent changes in heart rate and gambling performance. This work informs current models of choice-selection, in which the striatum mediates fast but potentially inaccurate responses and supports the integration of basic decision-making parameters.
Materials and Methods
Fifteen right-handed, healthy participants (5 male, 10 female), mean age 25±10 yrs, were enrolled after written informed consent. The study was approved by the Brighton & Sussex University Hospitals NHS Trust ethics committee (Royal Sussex County Hospital, Eastern Road, Brighton, BN2 5BE, UK). All participants were free from neurological and psychiatric disorders.
Design: gambling task
Sets of gambles were constructed based on three factors: EV, uncertainty (probability class) and urgency (Figure 1). For each gamble, EV and uncertainty were determined by independently manipulating the probability of winning (pwin), the amount of money to be won (kwin) and the amount of money that would be lost (kloss). This resulted in three levels of EV: negative, neutral and positive and two levels of uncertainty: high uncertainty (probability 40%/60%) and low uncertainty (probability 20%/80%). Urgency was defined as a two-level factor, and determined by the spinning rate of a clock presented alongside the gamble parameters. Participants chose whether to bet (i.e., to accept a risk related to the variable EV) or leave each gamble (thereby opting for a certain EV = 0 outcome). Participants were told that the outcome of each gamble was not pre-set, but would be determined at the time of response, and that the computer would track all earnings and losses in the form of a ‘virtual bank account’. Participants were instructed to respond within a maximum of 5 s, and that if they did not respond they would lose the fixed amount of £20.
A fast event-related fMRI design was employed, with an average inter-stimulus interval of 6 s and 9 presentations for each cell of the 2×2×3 experimental design, yielding a total of 108 experimental trials; 62 null-events of variable duration were also inserted. The total duration of the task was about 16 min. Stimuli were generated and presented using code developed in-house, based on the ‘Cogent’ toolbox (www.fil.ion.ucl.ac.uk/Cogent/). Stimulus timing and order were optimised by means of optseq2 (www.surfer.nmr.mgh.harvard.edu/optseq).
Participants were informed they would receive feedback on their performance at the end of the experiment. All participants were rewarded with £15 for their participation. Stimuli were presented on a projection screen, viewed through a mirror attached to the head coil. Prior to scanning, participants were shown some sample gambles to familiarize themselves with the stimuli and were encouraged to consider all three elements of each gamble, weighting them equally. Participants were naïve to the concept of EV, and were told not to attempt to perform any explicit calculation. Following completion of the gambling task, they performed a time estimation test to examine whether this was affected by the clock spinning rate. For this part, the same clock was displayed, without a gamble. Participants pressed a button when they thought that the given time interval had elapsed. The time interval to estimate, i.e. 1, 2 or 3 s, was indicated before each trial.
Functional imaging was performed on a clinical 1.5 T scanner (Magnetom Avanto, Siemens AG, Erlangen, Germany) equipped with a standard 4-channel head coil. Sequential T2*-weighted echo-planar images were acquired with bi-commissural orientation for 21 slices, 5 mm thickness, no gap, TR = 2000 ms, TE = 50 ms, in-slice resolution 2×2 mm, matrix 80×128. Structural images were acquired with a magnetization-prepared rapid gradient-echo sequence, having 0.9 mm isotropic voxels and TR = 1160 ms, TE = 4.44 ms, FoV 230×230 mm, matrix size 256x256, 50 slices.
Behavioral Data Analysis
For the gambling task a 3 (EV: positive, neutral, negative) by 2 (Urgency: high, low) by 2 (uncertainty: high, low) ANOVA was performed with percent bets and response time as dependent variables. For each participant, performance was calculated as the ratio of rejected negative EV and taken positive EV gambles to the total number of negative EV and positive EV gambles. We set a minimum accuracy threshold of 60%, leading to the rejection of one participant. Risk propensity was indexed by the average number of bets on neutral EV trials. A standard threshold of p<0.05 was assumed for significance of behavioural and psychophysiological data.
Heart rate changes were assessed through an MRI-compatible pulse oximeter (Nonin 5400, Nonin Inc., Plymouth MN, USA). The plethysmographic signal was low-pass filtered at 1 Hz and processed with a peak-picking algorithm yielding beat-by-beat heart rate measurements. The resulting signal was epoched in the [−0.5,5] s peristimulus range and averaged across trials. On the basis of the grand average (see Fig. 2c), two measurement windows were defined: [1.5,2.1] s and [5.1,5.7] s. Resulting values were processed with a within-subject ANOVA as described above.
Imaging data preprocessing and analysis
Functional imaging data were analyzed using SPM8 (Wellcome Centre for Neuroimaging, London UK). Functional scans were realigned and unwarped, slice-timing corrected, and co-registered with individual anatomy. Subsequently, all scans were transformed into standard Montreal Neurological Institute (MNI) stereotactic space and smoothed using an 8 mm FWHM Gaussian filter.
At the individual level, design matrices were set up using 12 separate regressors, accounting for each combination of EV (3 levels), urgency (2 levels), uncertainty (2 levels). Each event was modeled as having a duration equal to the measured response time. Movement parameters were also inserted as nuisance covariates. Statistical maps were generated for each of the 12 design conditions, contrasting activation for that condition with respect to null events. At the second level, these maps were entered as a 3×2×2 flexible factorial analysis, which enabled us to determine the main effects of EV, urgency and uncertainty, as well as their interactions. We set a voxel-level threshold of p<0.001, uncorrected, to form clusters. Subsequently we employed a Monte Carlo method, involving a full model of the acquisition, normalization and smoothing steps, to calculate the cluster extent threshold yielding an effective cluster-level α of 0.05, which was 35 voxels; this approach has specific advantages as it is parsimonious in terms of statistical assumptions and explicitly captures the effects of the data preprocessing steps .
Planned regions-of-interest (ROI) for the caudate nucleus, putamen, ventral striatum and anterior insula were adapted from the AAL atlas , by an experienced operator who separated the anterior/posterior insula and dorsal/ventral striatum drawing on the three planes on a canonical brain in normalized space. Average BOLD signal percent change was extracted, averaged for each ROI and analyzed by means of a 3 (EV) x 2 (Uncertainty) x 2 (Urgency) x 2 (side) repeated measures ANOVA. Bonferroni's correction for multiple comparisons was applied, accounting for multiple comparisons within each ROI.
The authors are grateful to four anonymous reviewers for the insightful feedback they have offered on an earlier draft.
Conceived and designed the experiments: CLJ LM NAH JW HDC. Performed the experiments: CLJ LM. Analyzed the data: CLJ LM NAH HDC. Contributed reagents/materials/analysis tools: CLJ LM. Wrote the paper: CLJ LM NAH JW HDC.
- 1. Bernoulli D (1954) Exposition of a New Theory on the Measurement of Risk. Econometrica 22: 23–36.
- 2. Kahneman D, Slovic P, Tversky A (1982) Judgement Under Uncertainty: Heuristics and Biases. Cambridge: Cambridge University Press.
- 3. Damasio AR (1994) Descartes' Error: Emotion, reason and the human brain. New York: Putnam Publishing.
- 4. LeDoux J (1999) Cognition and Emotion: Listen to the brain:. In: Lane R, editor. Emotion and Cognitive Neuroscience. Oxford: Oxford University Press.
- 5. Ben Zur H, Breznitz S (1981) The effect of time pressure of risky choice behaviour. Acta Psychologica 47: 89–104.
- 6. Busemeyer JR (1985) Decision making under uncertainty: a comparison of simple scalability, fixed-sample, and sequential-sampling models. J Exp Psychol Learn Mem Cogn 11: 538–64.
- 7. Wright P (1974) The harassed decision maker: time pressures, distractions and the use of evidence. J App Psych 59: 555–561.
- 8. Trepel C, Fox CR, Poldrack RA (2005) Prospect theory on the brain? Toward a cognitive neuroscience of decision under risk. Brain Res Cogn Brain Res 23: 34–50.
- 9. Preuschoff K, Quartz SR, Bossaerts P (2008) Human insula activation reflects risk prediction errors as well as risk. J Neurosci 28: 2745–52.
- 10. Knutson B, Taylor J, Kaufman M, Peterson R, Glover G (2005) Distributed neural representation of expected value. J Neurosci 25: 4806–12.
- 11. Bogacz R, Gurney K (2007) The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput 19: 442–77.
- 12. Forstmann BU, Dutilh G, Brown S, Neumann J, von Cramon DY, et al. (2008) Striatum and pre-SMA facilitate decision-making under time pressure. Proc Natl Acad Sci USA 105: 17538–42.
- 13. Forstmann BU, Anwander A, Schäfer A, Neumann J, Brown S, et al. (2010) Cortico-striatal connections predict control over speed and accuracy in perceptual decision making. Proc Natl Acad Sci USA 107: 15916–20.
- 14. Craig AD (2009) How do you feel--now? The anterior insula and human awareness. Nat Rev Neurosci 10: 59–70.
- 15. Singer T, Critchley HD, Preuschoff K (2009) A common role of insula in feelings, empathy and uncertainty. Trends Cogn Sci 13: 334–40.
- 16. Naqvi NH, Bechara A (2009) The hidden island of addiction: the insula. Trends Neurosci 32: 56–67.
- 17. Weller JA, Levin IP, Shiv B, Bechara A (2009) The effects of insula damage on decision-making for risky gains and losses. Soc Neurosci 4: 347–58.
- 18. Clark L, Bechara A, Damasio H, Aitken MR, Sahakian BJ, et al. (2008) Differential effects of insular and ventromedial prefrontal cortex lesions on risky decision-making. Brain 131: 1311–22.
- 19. Tom SM, Fox CR, Trepel C, Poldrack RA (2007) The neural basis of loss aversion in decision-making under risk. Science 315: 515–8.
- 20. Huettel SA, Song AW, McCarthy G (2005) Decisions under uncertainty: probabilistic context influences activation of prefrontal and parietal cortices. J Neurosci 25: 3304–11.
- 21. Coricelli G, Critchley HD, Joffily M, O'Doherty JP, Sirigu A, et al. (2005) Regret and its avoidance: a neuroimaging study of choice behavior. Nat Neurosci 8: 1255–62.
- 22. Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898–902.
- 23. Reddi BA, Carpenter RH (2000) The influence of urgency on decision time. Nat Neurosci 3: 827–30.
- 24. Critchley HD (2009) Psychophysiology of neural, cognitive and affective integration: fMRI and autonomic indicants. Int J Psychophysiol 73: 88–94.
- 25. Dolan RJ (2002) Emotion, cognition, and behavior. Science 298: 1191–4.
- 26. Tversky A, Kahneman D (1992) Advances in prospect theory: Cumulative representation of uncertainty. J Risk Uncertainty 5: 297–323.
- 27. Redgrave P, Prescott TJ, Gurney K (1999) The basal ganglia: a vertebrate solution to the selection problem? Neuroscience 89: 1009–23.
- 28. Menon V, Levitin DJ (2005) The rewards of music listening: response and physiological connectivity of the mesolimbic system. Neuroimage 28: 175–84.
- 29. Carter S, Pasqualini MS (2004) Stronger autonomic response accompanies better learning: A test of Damasio's somatic marker hypothesis. Cogn Emot 18: 901–911.
- 30. Bechara A, Damasio H, Damasio AR (2000) Emotion, decision making and the orbitofrontal cortex. Cereb Cortex 10: 295–307.
- 31. Damasio H, Bechara A, Damasio AR (2002) Reply to "Do somatic markers mediate decisions on the gambling task? " Nat Neurosci 5: 1104–1104.
- 32. Crone EA, Somsen RJ, Van Beek B, Van Der Molen MW (2004) Heart rate and skin conductance analysis of antecendents and consequences of decision making. Psychophysiol 41: 531–40.
- 33. Bradley MM (2009) Natural selective attention: orienting and emotion. Psychophysiol 46: 1–11.
- 34. Bradley MM, Lang PJ (2007) Emotion and motivation. In: Cacioppo JT, Tassinary LG, Berntson GG, editors. andbook of psychophysiology. Cambidge: Cambridge University Press.
- 35. Libby WL, Lacey BC, Lacey JI (1973) Pupillary and cardiac activity during visual attention. Psychophysiol 10: 270–94.
- 36. Critchley HD, Elliott R, Mathias CJ, Dolan RJ (2000) Neural activity relating to generation and representation of galvanic skin conductance responses: a functional magnetic resonance imaging study. J Neurosci 20: 3033–40.
- 37. Critchley HD, Mathias CJ, Dolan RJ (2001) Neural activity in the human brain relating to uncertainty and arousal during anticipation. Neuron 29: 537–45.
- 38. Harrison NA, Gray MA, Gianaros PJ, Critchley HD (2010) The embodiment of emotional feelings in the brain. J Neurosci 30: 12878–84.
- 39. Xue G, Lu Z, Levin IP, Bechara A (2010) The impact of prior risk experiences on subsequent risky decision-making: the role of the insula. Neuroimage 50: 709–16.
- 40. Livesey AC, Wall MB, Smith AT (2007) Time perception: manipulation of task difficulty dissociates clock functions from other cognitive demands. Neuropsychologia 45: 321–31.
- 41. Wittmann M, Lovero KL, Lane SD, Paulus MP (2010) Now or later? Striatum and insula activation to immediate versus delayed rewards. J Neurosci Psychol Econ. 3: 15–26.
- 42. Sakagami M, Watanabe M (2007) Integration of cognitive and motivational information in the primate lateral prefrontal cortex. Ann N Y Acad Sci 1104: 89–107.
- 43. Botvinick MM (2007) Conflict monitoring and decision making: reconciling two perspectives on anterior cingulate function. Cogn Affect Behav Neurosci 7: 356–66.
- 44. Braver TS, Barch DM, Gray JR, Molfese DL, Snyder A (2001) Anterior cingulate cortex and response conflict: effects of frequency, inhibition and errors. Cereb Cortex 11: 825–36.
- 45. Kuhnen CM, Knutson B (2005) The neural basis of financial risk taking. Neuron 47: 763–70.
- 46. Volz KG, Schubotz RI, von Cramon DY (2003) Predicting events of varying probability: uncertainty investigated by fMRI. Neuroimage 19: 271–80.
- 47. Fenton-O'Creevy M, Soane E, Nicholson N, Willman P (2010) Thinking, feeling and deciding: The influence of emotions on the decision making and performance of traders. J Org Behav, in press.
- 48. Slotnick SD, Moo LR, Segal JB, Hart J (2003) Distinct prefrontal cortex activity associated with item memory and source memory for visual shapes. Cogn Brain Res 17: 75–82.
- 49. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, et al. (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15: 273–89.