Both affective states and personality traits shape how we perceive the social world and interpret emotions. The literature on affective priming has mostly focused on brief influences of emotional stimuli and emotional states on perceptual and cognitive processes. Yet this approach does not fully capture more dynamic processes at the root of emotional states, with such states lingering beyond the duration of the inducing external stimuli. Our goal was to put in perspective three different types of affective states (induced affective states, more sustained mood states and affective traits such as depression and anxiety) and investigate how they may interact and influence emotion perception. Here, we hypothesized that absorption into positive and negative emotional episodes generate sustained affective states that outlast the episode period and bias the interpretation of facial expressions in a perceptual decision-making task. We also investigated how such effects are influenced by more sustained mood states and by individual affect traits (depression and anxiety) and whether they interact. Transient emotional states were induced using movie-clips, after which participants performed a forced-choice emotion classification task with morphed facial expressions ranging from fear to happiness. Using a psychometric approach, we show that negative (vs. neutral) clips increased participants’ propensity to classify ambiguous faces as fearful during several minutes. In contrast, positive movies biased classification toward happiness only for those clips perceived as most absorbing. Negative mood, anxiety and depression had a stronger effect than transient states and increased the propensity to classify ambiguous faces as fearful. These results provide the first evidence that absorption and different temporal dimensions of emotions have a significant effect on how we perceive facial expressions.
Citation: Qiao-Tasserit E, Garcia Quesada M, Antico L, Bavelier D, Vuilleumier P, Pichon S (2017) Transient emotional events and individual affective traits affect emotion recognition in a perceptual decision-making task. PLoS ONE 12(2): e0171375. https://doi.org/10.1371/journal.pone.0171375
Editor: Alessio Avenanti, University of Bologna, ITALY
Received: August 19, 2016; Accepted: January 18, 2017; Published: February 2, 2017
Copyright: © 2017 Qiao-Tasserit et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data cannot be made publicly available due to ethical restrictions. Data can be made available upon request to Pr Bernard Hirschel at Geneva CCER (commission cantonale d’éthique de la recherche; email@example.com; ref: 09-316). For additional information about the underlying data, please contact the corresponding authors.
Funding: This work was supported by the National Center of Competence in Research (NCCR) for Affective Sciences financed by the Swiss National Science Foundation (grant N° 51NF40_104897, http://www.snf.ch/en/Pages/default.aspx) and hosted by the University of Geneva, as well as by the Academic Society of Geneva (Fund Foremane, http://www.sacad.ch/). We thank Ms. Nada Knezevic for helping during pilot experiments. EQT is currently supported by a MD-PhD fellowship from the Swiss National Science Foundation (grant N° 323530_145252). SP is currently supported by the Swiss National Science Foundation (Ambizione grant N° PZ00P1_148035).
Competing interests: The authors have declared that no competing interests exist.
Emotions and mood provide powerful prisms which shape the way individuals interpret social information and their environment. Depending on their affective state, people may see the glass as either half full or half empty when evaluating the same situation. But although these statements seem well known and almost trivial, little research has been conducted to characterize the impact and temporal aspects of such phenomena and to systematically compare the influence of negative and positive affective states on perception. Moreover, most priming studies assume that these biases are short-lived and do not persist more than a fraction of second. Here we addressed this issue by using a simple forced-choice categorization task where subjects evaluated facial expressions morphed between fear and happiness after being exposed for several minutes to negative, positive, or neutral movie clips. Our aim was to measure bias in expression categorization induced by transient affective states and estimate whether such bias persists during the entire duration of the categorization task. We also tested whether such biases depend on more persistent affective states related to individual personality characteristics such as positive and negative mood as well as sub-clinical levels of anxiety and depression.
Unlike persistent affective states such as mood, emotions are generally conceived as short-lived events of physiological, motivational, and psychological changes that have a definite cause, a distinctive cognitive and experiential content, and a rapid decay after elicitation [1,2]. Some studies using EEG have characterized the temporal unfolding of brain responses to emotional events (pictures) and pointed to differential dynamics at the timescale of the second for different emotions [3,4]. However, little is known about changes in behavior and brain activity occurring over several seconds or minutes after emotional events . Likewise, the literature on affective priming has mostly focused on very brief influences of emotional stimuli on perceptual and cognitive processes by employing cue-target paradigms similar to the ones used in the spatial or psycholinguistic domains. In this framework, affective priming typically designates the effect produced by a brief emotional stimulus (the prime) on the evaluation of subsequent information (the target) [6,7]. Affective priming has also been investigated using subliminal masked priming [8,9]. Such affective priming effects are inherently short-lived and dissipate after a fraction of a second [10–12].
However, little has been documented on situations where emotional information is presented for longer periods of time, such as when subjects watch a movie, listen to music, or imagine an emotional event before evaluating a target. Such situations may ‘infuse’ affective states and impact cognitive states over longer periods of time, as proposed in the affect infusion model . The affect infusion model has specifically considered that such extended affective states can modulate the encoding, retrieval, and selective use of information. Such extended states can influence the interpretation of subsequent events even after transient emotions have ‘faded away’ and their experiential content has vanished [14–16]. For instance, watching a movie depicting either a funeral or a child playing, will imbue a subsequent neutral scene with either negative or positive meaning [17,18]. This phenomenon, referred to as the Kuleshov effect used in film editing, can also operate on the perception of neutral faces, and it implies some transfer of emotional or mental content between one movie scene and the perceived facial expression of a character in the next scene . However, few empirical studies have directly investigated the influence of affective states on face perception [5,17–19]. To our knowledge, no study has investigated whether a transient emotion induction procedure can induce interpretation biases for facial expressions, whether the induced biases quickly vanish after induction or persist over several minutes, and whether such interpretation biases vary according to the valence of emotional state. These questions constituted the first objective of the current study.
In a related but different literature, persistent negative emotional states associated with low mood, depression, or anxiety, have frequently been shown to yield a negative interpretation bias. These traits tend to favor negative over positive interpretations [20–22] of ambiguous positive-negative faces [23–26] or ambiguous semantic information . A negative interpretation bias is a type of cognitive bias where there is a tendency to interpret ambiguous stimuli in a negative manner when others would favor positive interpretations [20,21]. According to cognitive theories of depression and anxiety, negative cognitive biases have a major, perhaps causal role in the development and maintenance of depressive and anxious states .
Therefore, the second objective of our study was to measure subject-wise interpretation biases for facial expressions induced by emotional states in relation to individual differences in mood, anxiety, and depression indices. Indeed, persistent negative states, such as depression, are associated with anhedonia and various emotional biases in perception and attention [29,30]. Given that emotional blunting is frequent in depressed patients, whereas heighted emotional reactivity is commonly associated with anxiety , we expected a decreased or exaggerated emotion induction effect in subjects with higher depression or higher anxiety scores, respectively.
Finally, another important factor likely to influence the impact of emotional signals on cognition and perception is the degree of absorption while individuals process emotional information. Yet, to our knowledge, the effect of absorption has been little characterized experimentally. With respect to affects, absorption refers to the extent to which individuals allow themselves to be drawn into an emotional experience. Tellegen and Atkinson (1974) defined absorption as a state of “total attention, involving a full commitment of available perceptual, motoric, imaginative and ideational resources” . Recent evidence indicates that trait absorption is related to enhanced emotional picture processing . Thus, a high absorption state during the processing of emotional information may potentiate more vigorously subsequent interpretation biases than a low absorption state.
Accordingly, several recent studies using neuroimaging techniques have shown that exposure to emotional stimuli using movies [5,34,35] or other emotion-inducing procedures  can produce lasting changes in patterns of brain activity, both during resting state  and during unrelated perceptual or semantic tasks [19,35,36]. In one study using faces , amygdala response to fearful facial expressions (compared to neutral) was enhanced for several minutes following exposure to fear-inducing movies, but attenuated following joyful movies. Furthermore, this study found that such effects were stronger for highly absorbing emotional movies . It remains unknown, however, whether these neural changes are mirrored by measurable behavioural changes in facial expression recognition.
Hence, the goal of the present work was to investigate how transient positive and negative emotions induced by movie-clips influence emotion discrimination for negative and positive facial expressions, using morphed stimuli ranging from pure fear to pure happiness. We also tested how individual characteristics related to persistent mood, personality traits, and experiential absorption would modulate such influences. We predicted that negative and positive emotional states, both transient and persistent, should result in state-congruent interpretation biases for ambiguous facial expressions along the negative-positive continuum.
45 healthy right-handed volunteers participated in this study (22 females, mean age±std 24.1±3.5, range = 18–32). One participant gave random responses was excluded for failing to comply with the instructions. All participants gave their informed written consent before participating in the study, which was carried out in accordance with The Code of Ethics of the World Medical Association (Declaration of Helsinki) for experiments involving humans. The study protocol, inclusion criteria, and consent procedure were reviewed and approved by the ethical committee of the University of Geneva. Participants were compensated for their participation in this study. None had a history of psychiatric or neurological disease, and none took drugs or medication at the time of testing.
During the experiment, participants performed two intermixed tasks arranged in 18 short sessions, all given in a single day and separated by brief rest breaks. At the beginning of each session, subjects watched a positive, negative, or neutral movie clip (~ 50sec–1 min) that was immediately followed by a decision-making task on a series of 15 faces (~2mn). Each face was presented during 500ms and preceded by a fixation cross (500ms). They had to indicate if the face expressed fear or happiness (2 alternatives forced-choice task, Fig 1) without imposed response time limit. Facial expressions were morphed from fear to happiness (see below). To keep the goal of the experiment implicit, participants were told that they would participate in two different studies performed in alternating sessions, to make the experiment less repetitive. The objective of the first study would be to measure their emotional reaction to short negative/threatening, positive/joyful, or neutral film excerpts via their skin conductance response. Participants were instructed to get immersed in the movies as much as possible without being critical. They were told that the objective of the second study would be to measure their ability to recognize fear and happiness in ambiguous morphed faces.
A) Example of a fear-happy morph continuum in facial expression, ranging from pure fear to pure happiness. B) During the task, participants watched negative, neutral or positive movie clips, and subsequently performed a decision-making task where they categorized morphed faces as fearful or happy. Note that these face images are examples similar but not identical to the faces presented in the actual tasks which used KDEF faces, and are therefore for illustrative purposes only. We have received informed consent according to Plos guidelines from the individual portrayed here.
We used 6 movie clips per emotion conditions (negative, positive, and neutral). Movies were selected from a standard database of emotional movies . Each session comprised one movie excerpt followed by 45 facial morphs. Previous studies using the same movies confirmed reliable difference in their valence , and showed sustained changes in brain activity and peripheral autonomic state (skin conductance and pupil size) induced by both negative and positive emotional movies (relative to neutral ones), extending for several minutes after the movies . Examples of movies included The Shining (negative), When Harry met Sally (positive), or documentaries such as Cosmos Mysteries (neutral); see full list in . We equated luminance across movies. Mood's median tests confirmed that audiovisual features were matched across contexts [luminance (p = .13), motion (p = .69), spatial frequency (p = 1), acoustic intensity and power (p>.51)]. To potentiate mood induction, movies from the same valence were grouped in successive sessions intermixed with the decision-making task, but the order of movies within emotional contexts was randomized between subjects. Half of the participants saw negative movies first, followed by neutral and positive movies. Another half of participants performed the task in the reverse order. Neutral movies were kept in the middle to facilitate the transition between negative and positive states.
We generated happy and fearful composite images from 18 faces (9 females) showing a fearful facial expression and the same 18 individuals showing a happy expression (see Fig 1). We computed continua of interpolated (morphed) faces using the Fantamorph software (Abrosoft Co.). Prototypical black and white pictures were taken from the Karolinska Directed Emotional Faces (KDEF) dataset . These prototypical images were used as endpoints to generate a linear morph sequence with 15 steps, with intermediate images changing incrementally from unambiguously fearful to unambiguously happy, with emotionally ambiguous images in the middle. These 15 steps of morph were selected based on a pilot study (n = 19) to ensure that canonical expressions were recognized well above 75% and that ambiguous morph levels fell in the middle of the morph levels continuum. A grey mask surrounded each face. Luminance and contrast were equated for all faces. Each of the 18 actors * 15 morphs was repeated 3 times across the experiment to appear once in each emotional context, leading to a total of 810 trials. After each movie, we presented 45 semi-randomized trials of the decision-making task so that two consecutive morph degrees of the same actor were never presented in a row.
Each trial began with a fixation cross (500ms), followed by a morphed face (500ms) with the words “FEAR” and “HAPPY” presented below (order changed across subjects), all displayed on a grey background. Participants were forced to classify the faces as either fearful or happy, as accurately and as fast as possible. Inter-trial interval ranged between 500 and 1000ms. Faces were centered on the screen and subtended 8.6° of visual angle vertically and 6.7° horizontally.
Analysis of responses
Within participants, the binary categorization of morph stimuli tends to increase monotonically from one response to the other across the morph continuum. The probability of answering “HAPPY” therefore takes the form of a standard sigmoid curve. We estimated the point of subjective equality (PSE) at which each participant was equally likely to classify faces as fearful or happy, by retrieving the morph degree corresponding to a probability of 50% of responding happy. We also estimated the slope of the curve at the PSE, which represents how sharp the distinction between fear and anger is. Data was fitted using a 4-parameter Weibull function. The lower and upper limits of the function were bounded to the interval [0, 1]. The shape parameter, which determines the steepness of the curve, was bounded to be greater than 1 to avoid non-sigmoidal shapes of the function. The slope and the PSE were computed using the drm package  implemented in R, specifying that the data was binomial (R Development Core Team, 2014). These parameters were estimated for each individual and for each emotional context, from the responses across the 15 morph degrees. Fits were obtained for all subjects except for one, for whom the fitting procedure could not converge in the fear and neutral contexts due to highly variable responses. This subject was thus excluded from all analyses.
Once PSEs and slopes for each emotional context and each subject were retrieved, we subtracted the value from each emotional context from that of the neutral context to obtain an estimate of PSE shift and slope change. Given our expression axis from fear to happy and our response axis in terms of probability of responding happy, a rightward (positive) shift in PSE indicated a bias toward classifying ambiguous faces as fearful, whereas a leftward (negative) shift indicated a higher propensity to classify ambiguous faces as happy. Note that because faces were the same across the 3 emotional contexts, PSE shifts cannot be attributed to differences in stimulus content or expression strength. For slope measurements, a positive (respectively negative) change indicated that sensitivity to discriminate between expressions increased (respectively decreased) between a given emotional context and the neutral context. PSE, slope, and reaction times were analyzed through repeated measure ANOVA and t-tests. Effect sizes were reported as Cohen’s d.
Absorption ratings for movie stimuli
After the experiment, participants indicated how much they felt absorbed during each movie on a 10-point Likert scale (i.e. how much they felt emotionally immersed while watching each movie).
After the experiment, participants filled out questionnaires to rate their level of positive and negative mood in the last weeks (PANAS ), as well as current state anxiety (STAIS ), and depression . In addition, trait anxiety (STAIT) was collected at least one day later. Because of technical reasons, questionnaire data was missing for one subject. Participants’ state anxiety scores ranged from 20 to 65 (mean±std 32.3±9.8) and trait anxiety scores ranged from 23 to 69 (40.9±9.3), which fall within the published norms for this age group . Participants’ depression scores ranged from 0 to 16 (2.7±3.6), which is also below clinical levels for all subjects. As expected, scores for depression, state anxiety (STAIS), trait anxiety (STAIT), and negative mood (PANAS negative) were positively correlated between each other (all r>.63, all p < .001), and negatively correlated with scores for positive mood (PANAS positive) (all r<-.44 and all p < .002), except for the PANAS negative (r = -.25, p = .1). Influence of these variables on interpretation bias was examined using ANOVA and 1-tailed Spearman correlations were used in figures for illustrative purpose. In accordance with the literature on depression and anxiety [20–22], we expected that negative mood, depression and anxiety would be positively correlated with negative interpretation bias for facial expressions.
Effects of transient emotions
We first tested for any significant shift in PSEs following emotional movies, relative to the neutral control condition. Planned t-tests on PSE shift across participants showed that ambiguous faces were more likely to be classified as fearful in the post-negative compared to the post-neutral movie context (t(42) = 2.21, p = .016, d = .19, 1-sided 1-sample t-test, Fig 2A and 2B). In contrast, positive context relative to neutral induced no PSE shift (p = .6).
A) Sigmoid curves illustrating the probability of categorizing morphed faces as expressing happiness across morph levels and emotional contexts. Curve fitting resulted in two parameters for each subjects and each emotional context: the point of subjective equality (PSE), which characterizes the morph level at which the subject is at chance for discriminating happy vs. fearful expressions (also termed interpretation bias), and the slope of the curve at the PSE, which characterizes the sharpness of the decision boundary between happy and fearful faces. B) Top plot: zoom on the group average PSE for each emotional context. Middle plot: After viewing negative movies relative to neutral clips (red), participants increased their propensity to classify ambiguous expressions as fearful. No significant average shift (relative to neutral) was observed after watching positive movies (green). Bottom plot: There was an increase in slope after negative compared to neutral movies. C) Evolution of the bias over time in the negative context revealed that it persisted during the entire decision-making task (~2 minutes). Error represent ±1SEM. D) Correlations between absorption ratings and PSE shifts (for emotional compared to neutral movies) showed that for the positive context, more absorbing movies led to increased propensity to classify ambiguous faces as happy. Note that all statistical tests remained significant after removing two potential outliers with the most positive and the most negative PSE shifts.
Similar planned t-tests performed on slope changes showed no significant difference in either context relative to the neutral control condition (p’s > .13, 1-sample t-test). However, a pair-wise comparison between slope change in the negative versus positive contexts was significant (t(42) = 2.28, df(42), p = .02, paired t-test). Average change values revealed that the slope (i.e. sensitivity) of the discrimination performance was increased after exposure to negative compared to neutral movies (mean = .07±.28, d = .19), whereas this change was negligible after exposure to positive movies (mean = -.03±.29, d = .11) (see Fig 2B).
Next, we further characterized how the PSE bias observed in the negative context varied as the experiment unfolded. We divided each face perception blocks into first and second halves with respectively 22 and 23 stimuli each (Fig 2C). We re-computed PSE values for every subject for the negative and neutral contexts. We dropped the positive context from this analysis given the absence of results reported above. Because each fit was estimated on half the data, the fit procedure failed in two subjects who were excluded from this analysis. We entered the new PSE values in a repeated-measure ANOVA crossing the factors time and emotion context. The results confirmed a main effect of emotional context (F(1,40) = 5.67, p = .022). However, neither time (F(1,40) = .1, p = .74) nor the time-by-context interaction were significant (p = .72), indicating that the negative bias remained comparable during the entire face perception blocks and thus sustained over time.
In addition, we investigated whether absorption during movie watching influenced the PSE shift between emotional and neutral contexts. For negative movies, there was no correlation between the PSE shift magnitude and the difference in absorption between negative and neutral movies (r = -.17, df = 41, p = .28). However, in the positive context, the PSE shift was found to become significantly more positive as absorption in movies increased (r = -.39, df = 41, p = .01, Fig 2D). This suggests that subjects who felt more absorbed in positive movies favored more happy interpretation of ambiguous faces than subjects who were less absorbed. Note that positive and negative movies were rated as more absorbing than neutral movies (respectively t(42) = 5.1, p < .001 and t(42) = 11.8, p < .001), and negative movies more absorbing than positive movies (t(42) = 6.1, p < .001). Note also that the variance of absorption ratings for positive movies (sd = 1.87) tended to be higher than for negative movies (sd = 1.22) even though this difference was not significant (p = .77). This may suggest that interest in positive movies in our sample was more nuanced and variable than for negative movies.
Effects of individual differences in mood, anxiety, and depression
To examine the effect of more persistent affective states and mood on facial expression perception, we ran four separate ANOVAs on the emotion-induced shift that tested respectively for modulations by positive mood, negative mood, depression, and anxiety, using the latter individual scores as a between-subject variable. These ANOVAs were run on PSE as the dependent variable and with emotional context as a within-subject factor.
These ANOVAs revealed no effect of positive mood (PANAS positive, p = .4). In contrast, there was a significant main effect of negative mood (PANAS negative, F(1,41) = 5.95, p = .02) but it did not interact with contextual factor (p = .92). Likewise, the third ANOVA with depression scores (Beck scale) indicated an effect of depression (F(1,41) = 4.2, p = .04) with no interaction with emotional context (p = .96). Finally, concerning anxiety scores (STAI-T and STAI-T), we found significant effects of both state anxiety (F(1,41) = 12.7, p < .001) and trait anxiety (F(1,41) = 8.7, p = .005), but again no interaction with emotional context (ps >.2). These data suggest that, in our subclinical population sample, the effect of emotion induction was independent of persistent affective background even though the latter did modulate emotion perception. Note that due to the high comorbidity between anxiety and depression, a multiple regression was not adapted to reliably disentangle the respective contribution of depression or anxiety, and it would be unlikely to reveal other results given the lack of significant effects in separate regression analyses. To illustrate the impact of negative PANAS on emotion perception, we divided participants in three equal groups (tertiles) according to the negative PANAS scores and we plotted the psychometric function of the groups with the lowest and highest negative mood scores in Fig 3A).
A) Subjects with a more negative mood showed a higher propensity to classify ambiguous faces as fearful than subjects with less negative mood (1st and 3rd tertiles of the PANAS negative scale). B-D) Correlations showing that the more individuals’ interpretation bias (i.e. PSE) was negative, the higher the state anxiety (B), depression (C), and trait anxiety (D).
Finally, we performed a repeated-measure ANOVA on reaction times (RT) during the decision-making task, with emotional context and morph levels as independent factors. Results indicated that RT evolved quadratically with morph levels (F(1,14) = 261, p < .001, quadratic contrast). This is reflecting more difficult judgments and longer latencies for more ambiguous faces close to the PSE (S1 Fig). The influence of emotional context was marginal (F(2,84) = 3.06, p = .052). There was no interaction between morph and context (p = .52) even though RT for rating emotional faces looked slower in the negative context (mean±SD: 962ms±283) than in the positive (890ms±204) or neutral contexts (921ms±237). Posthoc tests contrasting both emotional contexts confirmed that RT were slower in the positive than in the negative context (t(42) = 2.12, p = .04, d = .18). There was no significant difference between the neutral context and the negative (p = 08) and positive context (p = .4).
In this manuscript, we tested the hypothesis that several minutes of immersion into positive and/or negative emotional movies, may generate sustained affective states that outlast by ~2 minutes the exposure period and subsequently bias the interpretation of face expressions in a perceptual decision making task. In this sense, our work goes beyond recent priming studies by establishing a longer lasting impact of mood induction. We also investigated whether such effects are influenced by individual affect (depression and anxiety) traits. Finally, a key aspect of our study is the use of a psychometric approach to evaluate the processing of emotional faces allowing us to distinguish the source of the effect as a bias versus a change in sensitivity.
Our results demonstrate that transient emotional states modulate the interpretation of ambiguous emotional faces, with a stronger effect after watching negative movies than after positive movies. Induced negative states increased participants’ propensity to interpret ambiguous facial expressions in a more negative way relative to induced neutral or positive states. Interestingly, while positive movies did not modulate the interpretation of ambiguous expressions overall, participant’s propensity to rate faces as happy increased as their absorption during happy movies increased. In addition, we found that more persistent negative states related to individual traits, such as negative mood, anxiety, and depression, predicted the magnitude of the negative interpretation bias when judging ambiguous expressions, but did not influence the impact of the transient emotions induced by movies. This confirms that persistent negative affect leads to a tendency to over-interpret ambiguous information as negative [20–22]. The findings reported here therefore support the idea that transient and persistent emotional states ‘infuse’ cognitive states and influence evaluation in a state-congruent fashion . They further extend previous work demonstrating that high trait absorption is related to enhanced emotional picture processing , by showing that state absorption can influence, at least for positive movies, the induction of a subsequent interpretation bias. They also show that such interpretation bias may remain present over several minutes, well beyond the short durations previously reported in the priming literature (where cue-target intervals of the order of hundreds of milliseconds are typically used).
Thus, these results add to previous evidence that information available during or shortly before perception of a target stimulus can bias its emotional evaluation [17,43,44]. According to affect priming models, emotional states can prime the encoding, retrieval, and selective use of information. They can also influence the evaluation of emotional stimuli and influence social judgments [13,15,16]. For instance, judgments related to quality-of-life, responsibility, future expectations, or political judgments are more optimistic after seeing a comedy, than after seeing a sad or a violent movie . Certain priming procedures have used movies, music, or scripts to elicit emotional experiences. For instance, a previous experiment showed that the categorization of neutral, mildly happy, or mildly fearful faces was slightly influenced by the valence of a just preceding positive or negative IAPS picture . Other experiments using the auditory modality showed that sad emotional states, induced by sad music, increase the propensity to rate ambiguous faces expressing various negative emotions as more negative [46,47], whereas joyful music induces the opposite effect [47,48]. Another experiment suggested that long lasting emotion effects could operate unconsciously by showing that subliminal happy face primes (compared to angry faces) may promote drinking of a pleasurable beverage during a subsequent unrelated task .
Our findings counter the idea that affective priming effects dissipate shortly after priming, as in paradigms where emotional primes (e.g. words) are presented for durations shorter than a few hundreds of milliseconds . In such paradigms, it was argued that priming ceased to be detectable when the prime is presented beyond certain durations (typically 300ms). Moreover, these paradigms usually employ reaction time measurements, which may lack the sensitivity necessary to detect changes in affective processing. Note that we observed a global trend towards slower reaction times in the negative context relative to the positive context. A generic slowdown of reaction times in threatening contexts has often been interpreted as reflecting a freezing response or a suspension of ongoing task activity due to increased attentional vigilance towards the potential threat . The reaction times changes were however noisy; an advantage of measuring shifts in interpretation bias, as we do here, is that they offer a very sensitive procedure to detect emotional priming effects. However, because this technique requires collecting decisions on several tens of trials, it can only detect biases that last for at least a few minutes. Our results establish that transient affective biases are not limited, nor stronger, during the immediate period following emotional events, and they may extend over a few minutes, at least when the emotional priming context has been presented for a sufficiently long time (e.g., in short movies here). Further work is needed to understand the relationship between the emotion induction duration, absorption during inducing events, and duration of the subsequently induced interpretative bias.
At the neural level, interpretation biases might result from an interaction between changes in the limbic system and interconnected regions in perceptual pathways and the prefrontal cortex. Notably, activity of the amygdala, a key center for emotion perception and fear processing, is modulated by the emotional information associated with or preceding the presentation of neutral faces . Likewise, watching negative movies enhance subsequent amygdala reactivity to fearful faces, whereas positive movies attenuate it [5,35]. Similarly, when cued by a sentence with a negative context (e.g. he/she lost 500$), faces with a surprised expression produce greater activity in the ventral amygdala and the ventrolateral prefrontal cortex than when cued with positive sentences (e.g. he/she won 500$), while the latter produce stronger activity in the ventromedial prefrontal cortex . Interestingly, Eryilmaz et al. (2011) observed that transient emotions can produce lasting changes in brain connectivity patterns, reflecting a reconfiguration of large-scale network states (, see also ). In particular, functional coupling between the amygdala and the ventromedial prefrontal cortex at rest is selectively reduced after watching negative emotional movies, similar to those used here . Also, Pichon et al. (2012) showed that functional connectivity between the amygdala and the orbitofrontal cortex is reduced after priming with negative emotional words . Hence, a modulation of amygdala functioning, together with its connectivity with other prefrontal and temporal regions, may provide a plausible neural substrate for explaining how emotional events influence subsequent affective processing and produce interpretation biases.
Similar to our findings, previous emotion induction procedures have shown that a negative context seems more efficient at priming a negative bias than a positive context is at inducing a positive bias [52–54]. In our study, the higher induction efficiency of negative over positive movies might be related to the fact that negative movies tend to depict universal representations (e.g., violence, death…), while positive movies and humor often rely on cultural norms which may vary between social groups and genders. This interpretation also accords with the fact that absorption ratings were generally lower and more variable for positive than negative movies. This suggests that tailoring the positive context to the targeted social groups or individuals, and carefully selecting or creating positive contexts that allow greater absorption, may be an important factor for regulating emotional responses towards more positive outcomes.
Persistent affective states such as mood, anxiety, and depression also impacted interpretation bias for facial expressions, even to a greater extent than transient emotional states (at least 5 times stronger in terms of effect size). Participants with high anxiety or subclinical depression displayed a higher propensity to interpret ambiguous faces as fearful. This is consistent with previous studies showing that depressed subjects display increased attention and memory toward negative stimuli [24,55]. Dysphoric individuals are more likely to classify morphed faces ranging from pure sadness to pure happiness as sad , and the magnitude of this bias correlates with their levels of depression, anxiety, and negative mood . Also, anxious patients have a greater attentional vigilance to threatening stimuli and are more willing to interpret ambiguous situations as negative . At the brain level, it is interesting to note that depressed patients show increased metabolic activity and altered grey matter volumes in amygdala-medial prefrontal networks , similar to those affected by transient negative priming effects as described above . Hence, chronic dysfunction in this limbic-prefrontal network could lead to the maintenance of negative interpretation biases. Yet, direct evidence linking behaviour to brain function in this domain is still lacking.
However, despite these individual differences, we found no significant correlation between the persistent affective states and the impact of transient emotions on expression interpretation bias in our participants. Given that emotional blunting is frequent in depressed patients , whereas heighted emotional reactivity is commonly associated with anxiety , we expected a decreased or exaggerated emotion induction effect in subjects with higher depression or higher anxiety scores, respectively. This was not the case. It is worth noting that none of our subjects were highly depressed or clinically anxious. Sampling over a wider spectrum of depression or anxiety levels might be necessary for testing this hypothesis.
In conclusion, the present work shows that both transient and persistent affective states influence the way we perceive emotionally ambiguous information. The decision-making task we introduce here shows enough sensitivity to repeatedly detect shifts in emotion expression as a function of different emotional contexts. In addition, given that this perceptual measure correlates well with anxiety and depression scores, it could be used to provide a quantitative and implicit evaluation for the outcomes of an intervention. For example, such a test could be used to assess the transfer of learning after cognitive therapy, which aims to train patients to favor positive interpretations of situations over negative ones . An interesting extension of the present work would be to better characterize how the duration of priming events and the absorption experienced during them may determine the strength, persistence, and volatility of the subsequently induced biases. It would also be interesting to assess whether repeated exposures to specific priming contexts (such as emotionally charged videogames) could lead to more persistent interpretation biases.
S1 Fig. Mean reaction times across morph levels revealed longer latencies for more ambiguous expressions around the PSE.
Reaction times in the negative context were slower than in the positive context (negative: red dotted line, neutral: blue plain line, positive: green dotted line).
This work was supported by the National Center of Competence in Research (NCCR) for Affective Sciences financed by the Swiss National Science Foundation (grant N° 51NF40_104897) and hosted by the University of Geneva, as well as by the Academic Society of Geneva (Fund Foremane). We thank Ms. Nada Knezevic for helping during pilot experiments. EQT is currently supported by a MD-PhD fellowship from the Swiss National Science Foundation (grant N° 323530_145252). SP is currently supported by the Swiss National Science Foundation (Ambizione grant N° PZ00P1_148035).
- Conceptualization: EQT DB PV SP.
- Data curation: EQT DB PV SP.
- Formal analysis: EQT DB PV SP.
- Funding acquisition: PV SP EQT.
- Investigation: EQT MGQ LA SP.
- Methodology: EQT DB PV SP.
- Project administration: EQT DB PV SP.
- Resources: EQT DB PV SP.
- Software: EQT SP.
- Supervision: EQT DB PV SP.
- Validation: EQT DB PV SP.
- Visualization: EQT DB PV SP.
- Writing – original draft: EQT DB PV SP.
- Writing – review & editing: EQT DB PV SP.
- 1. Ekman P. An argument for basic emotions. Cogn Emot. Taylor & Francis Group; 2008; http://www.tandfonline.com/doi/abs/10.1080/02699939208411068
- 2. Scherer KR. What are emotions? And how can they be measured? Soc Sci Inf. 2005;44: 695–729.
- 3. Costa T, Cauda F, Crini M, Tatu MK, Celeghin A, de Gelder B, et al. Temporal and spatial neural dynamics in the perception of basic emotions from complex scenes. Soc Cogn Affect Neurosci. 2014;9: 1690–1703. pmid:24214921
- 4. Esslen M, Pascual-Marqui RD, Hell D, Kochi K, Lehmann D. Brain areas and time course of emotional processing. Neuroimage. 2004;21: 1189–1203. Available: http://www.sciencedirect.com/science/article/B6WNP-4BHJWJP-1/2/b942d71c37b5b55869d28d93434ea750 pmid:15050547
- 5. Pichon S, Miendlarzewska EA, Eryilmaz H, Vuilleumier P. Cumulative activation during positive and negative events and state anxiety predicts subsequent inertia of amygdala reactivity. Soc Cogn Affect Neurosci. 2015;10: 180–90. pmid:24603023
- 6. Bocanegra BR, Zeelenberg RR. Emotion improves and impairs early vision. Psychol Sci A J Am Psychol Soc / APS. 2009;20: 707–713.
- 7. Phelps EA, Ling S, Carrasco M. Emotion facilitates perception and potentiates the perceptual benefits of attention. Psychol Sci. 2006;17: 292–299. pmid:16623685
- 8. Vuilleumier P. How brains beware: neural mechanisms of emotional attention. Trends Cogn Sci. 2005;9: 585–594. pmid:16289871
- 9. Whalen PJ, Rauch SL, Etcoff NL, McInerney SC, Lee MB, Jenike MA. Masked presentations of emotional facial expressions modulate amygdala activity without explicit knowledge. J Neurosci. 1998;18: 411–418. Available: http://www.ncbi.nlm.nih.gov/pubmed/9412517 pmid:9412517
- 10. Hermans D, Houwer D J, Eelen P. A time course analysis of the affective priming effect. Cogn Emot. 2001;15: 143–165. Available: http://philpapers.org/rec/HERATC
- 11. Klauer KC, Rossnagel C, Musch J. List-context effects in evaluative priming. J Exp Psychol Learn Mem Cogn. 1997;23: 246–55. Available: http://www.ncbi.nlm.nih.gov/pubmed/9028030 pmid:9028030
- 12. Murphy ST, Zajonc RB. Affect, cognition, and awareness: affective priming with optimal and suboptimal stimulus exposures. J Pers Soc Psychol. 1993;64: 723–39. Available: http://www.ncbi.nlm.nih.gov/pubmed/8505704 pmid:8505704
- 13. Forgas JP. Mood and judgment: the affect infusion model (AIM). Psychol Bull. 1995;117: 39–66. pmid:7870863
- 14. Forgas JP, Bower GH. Mood effects on person-perception judgments. J Pers Soc Psychol. 1987;53: 53–60. pmid:3612493
- 15. Greifeneder R, Bless H, Pham MT. When do people rely on affective and cognitive feelings in judgment? A review. Pers Soc Psychol Rev. 2011;15: 107–41. pmid:20495111
- 16. Isen AM, Shalker TE. The effect of feeling state on evaluation of positive, neutral, and negative stimuli: When you “accentuate the positive,” do you “eliminate the negative”? Soc Psychol Q. 1982;45: 58–63.
- 17. Mobbs D, Weiskopf N, Lau HC, Featherstone E, Dolan RJ, Frith CD. The Kuleshov Effect: the influence of contextual framing on emotional attributions. Soc Cogn Affect Neurosci. 2006;1: 95–106. pmid:17339967
- 18. Wallbott HG. In and out of context: Influences of facial expression and context information on emotion attributions. Br J Soc Psychol. 1988;27: 357–369.
- 19. Pichon S, Rieger SW, Vuilleumier P. Persistent affective biases in human amygdala response following implicit priming with negative emotion concepts. Neuroimage. 2012;62: 1610–1621. pmid:22691615
- 20. Mathews A, Mackintosh B. Induced emotional interpretation bias and anxiety. J Abnorm Psychol. 2000;109: 602–615. pmid:11195984
- 21. Mogg K, Bradbury KE, Bradley BP. Interpretation of ambiguous information in clinical depression. Behav Res Ther. 2006;44: 1411–1419. pmid:16487479
- 22. Watters AJ, Williams LM. Negative biases and risk for depression; integrating self-report and emotion task markers. Depress Anxiety. 2011;28: 703–718. pmid:21796742
- 23. Beevers CG, Wells TT, Ellis AJ, Fischer K. Identification of emotionally ambiguous interpersonal stimuli among dysphoric and nondysphoric individuals. Cognit Ther Res. 2009;33: 283–290. pmid:20046979
- 24. Joormann J, Gotlib IH. Is this happiness I see? Biases in the identification of emotional facial expressions in depression and social phobia. J Abnorm Psychol. 2006;115: 705–14. pmid:17100528
- 25. Liu W hua, Huang J, Wang L zhi, Gong Q yong, Chan RCK. Facial perception bias in patients with major depression. Psychiatry Res. Elsevier Ltd; 2012;197: 217–220.
- 26. Surguladze SA, Young AW, Senior C, Brebion G, Travis MJ, Phillips ML. Recognition Accuracy and Response Bias to Happy and Sad Facial Expressions in Patients With Major Depression. Neuropsychology. 2004;l: 212–218.
- 27. Mathews A, Macleod C. Selective processing of threat cues in anxiety states. Behav Res Ther. 1985;23: 563–569. Available: http://www.ncbi.nlm.nih.gov/pubmed/4051929 pmid:4051929
- 28. Beck AT. Cognitive therapy and the emotional disorders [Internet]. Cognitive therapy and the emotional disorders. International Universities Press; 1976.
- 29. Dalili MNN, Penton-Voak ISS, Harmer CJJ, Munafo MR, Munafò MR. Meta-analysis of emotion recognition deficits in major depressive disorder. Psychol Med. Cambridge University Press; 2014;45: 1135–1144.
- 30. Hasler G, Drevets WC, Manji HK, Charney DS. Discovering endophenotypes for major depression. Neuropsychopharmacology. 2004;29: 1765–81. pmid:15213704
- 31. Lang PJ, McTeague LM, Bradley MM. Pathological anxiety and function/dysfunction in the brain’s fear/defense circuitry. Restor Neurol Neurosci. 2014;32: 63–77. pmid:23777635
- 32. Tellegen A, Atkinson G. Openness to absorbing and self-altering experiences (“absorption”), a trait related to hypnotic susceptibility. J Abnorm Psychol. 1974;83: 268–277. pmid:4844914
- 33. Benning SD, Rozalski V, Klingspon KL. Trait absorption is related to enhanced emotional picture processing and reduced processing of secondary acoustic probes. Psychophysiology. 2015;52: 1409–15. pmid:26174767
- 34. Eryilmaz H, Van De Ville D, Schwartz S, Vuilleumier P. Impact of transient emotions on functional connectivity during subsequent resting state: A wavelet correlation approach. Neuroimage. 2011;54: 2481–2491. pmid:20955802
- 35. van Marle HJF, Hermans EJ, Qin S, Fernandez G. From specificity to sensitivity: how acute stress affects amygdala processing of biologically salient stimuli. Biol Psychiatry. 2009;66: 649–655. pmid:19596123
- 36. Eryilmaz H, Van De Ville D, Schwartz S, Vuilleumier P. Lasting impact of regret and gratification on resting brain activity and its relation to depressive traits. J Neurosci. 2014;34: 7825–35. pmid:24899706
- 37. Philippot P. Inducing and Assessing Differentiated Emotion-Feeling States in the Laboratory. CognEmot. 1993;7: 171–193. Available: files/12/full_record.html
- 38. Lundqvist D, Litton JE. The averaged Karolinska directed emotional faces. Dep Clin Neurosci Psychol Sect Karolinska InstitutetStockholm, Sweden. 1998;
- 39. Jokinen J, McDonald JW, Smith PWF. Meaningful Regression and Association Models for Clustered Ordinal Data. Sociol Methodol. 2006;36: 173–199.
- 40. Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol. 1988;54: 1063–1070. pmid:3397865
- 41. Spielberger CD. State-Trait Anxiety Inventory [Internet]. Anxiety. Palo Alto, CA: Consulting Psychologists Press, Inc; 1987.
- 42. Beck A, Ward CH, Mendelson M, Mock J, Erbau J. An inventory for measuring depression. Arch Gen Psychiatry. 1961;4: 561–571. pmid:13688369
- 43. Barrett LFLF, Mesquita B, Gendron M. Context in Emotion Perception. Curr Dir Psychol Sci. 2011;20: 286–290.
- 44. Wieser MJ, Brosch T. Faces in context: a review and systematization of contextual influences on affective face processing. Front Psychol. 2012;3: 471. pmid:23130011
- 45. Forgas JP, Moylan S. After the Movies: Transient Mood and Social Judgments. Personality and Social Psychology Bulletin. 1987. pp. 467–477.
- 46. Bouhuys AL, Bloem GM, Groothuis TG. Induction of depressed and elated mood by music influences the perception of facial emotional expressions in healthy subjects. J Affect Disord. 1995;33: 215–26. Available: http://www.ncbi.nlm.nih.gov/pubmed/7790675 pmid:7790675
- 47. Jeong J-W, Diwadkar VA, Chugani CD, Sinsoongsud P, Muzik O, Behen ME, et al. Congruence of happy and sad emotion in music and faces modifies cortical audiovisual activation. Neuroimage. 2011;54: 2973–82. pmid:21073970
- 48. Van den Stock J, Peretz I, Grèzes J, de Gelder B. Instrumental music influences recognition of emotional body language. Brain Topogr. 2009;21: 216–20. pmid:19588251
- 49. Winkielman P. Unconscious Affective Reactions to Masked Happy Versus Angry Faces Influence Consumption Behavior and Judgments of Value. Personal Soc Psychol Bull. 2005;31: 121–135.
- 50. Ohman A, Flykt A, Esteves F. Emotion drives attention_Snakes in the grass.pdf. J Experiemntal Psychol Gen. 2001;130: 466–478.
- 51. Kim H, Somerville LH, Johnstone T, Polis S, Alexander AL, Shin LM, et al. Contextual Modulation of Amygdala Responsivity to Surprised Faces. J Cogn Neurosci. 2004;16: 1730–1745. pmid:15701225
- 52. Goldberg HD. The Role of “Cutting” in the Perception of the Motion Picture. J Appl Psychol. 1951;35: 70. Available: http://connection.ebscohost.com/c/articles/24701443/role-of-cutting-perception-motion-picture pmid:14814082
- 53. Lee T-H, Choi J-S, Cho YS. Context modulation of facial emotion perception differed by individual difference. PLoS One. 2012;7: e32987. pmid:22431992
- 54. Suess F, Rabovsky M, Abdel Rahman R. Perceiving emotions in neutral faces: expression processing is biased by affective person knowledge. Soc Cogn Affect Neurosci. 2014;
- 55. Dalgleish T, Watts FN. Biases of attention and memory in disorders of anxiety and depression. Clin Psychol Rev. 1990;10: 589–604.
- 56. Mathews A, MacLeod C. Cognitive vulnerability to emotional disorders. Annu Rev Clin Psychol. 2005;1: 167–195. pmid:17716086
- 57. Mathews A, Mackintosh B, Fulcher EPEP. Cognitive biases in anxiety and attention to threat. Trends Cogn Sci. 1997;1: 340–345. pmid:21223944
- 58. Price JL, Drevets WC. Neural circuits underlying the pathophysiology of mood disorders. Trends Cogn Sci. 2011;16: 61–71. pmid:22197477
- 59. Hasler G, Northoff G. Discovering imaging endophenotypes for major depression. Mol Psychiatry. 2011;16: 604–619. pmid:21602829
- 60. Menne-Lothmann C, Viechtbauer W, Höhn P, Kasanova Z, Haller SP, Drukker M, et al. How to boost positive interpretations? A meta-analysis of the effectiveness of cognitive bias modification for interpretation. PLoS One. 2014;9.