Figures
Abstract
Ambivalence and uncertainty, though related, are distinct constructs. While research has explored the link between certainty judgements and ambivalence in the context of attitudes and beliefs, little is known about individual differences in how certain people feel about identifying their own ambivalent, or mixed, emotions in the moment. In two samples, we investigated the relationship between the intensity of mixed emotions and self-reported certainty of one’s own current affective experience on a trial-to-trial basis. We additionally tested whether this relationship was moderated by personality and emotional traits. First, in a sample of 140 participants, we found a significant negative relationship between the intensity of mixed feelings and affective certainty, and this relationship was weaker in those with higher emotional intelligence. We next conducted a pre-registered online study with 311 participants in a sample more demographically representative of the United States. We replicated our finding that uncertainty was predicted by higher intensity of co-occurring positive and negative affect, but did not replicate the moderating effect of emotional intelligence. Trait meta-mood, however, did moderate this relationship. Our results show that despite the abstract nature of asking people to report how certain they are of how they feel, and potentially differing interpretations of the question, meaningful variation is found in responses. Future work can refine methods of gauging affective uncertainty, and the implication of affective certainty for mixed emotions on well-being.
Citation: Vaccaro AG, Shakthivel S, Wu H, Iyer R, Kaplan J (2025) Individual differences in feelings of certainty surrounding mixed emotions. PLoS One 20(11): e0332417. https://doi.org/10.1371/journal.pone.0332417
Editor: Bruno Alejandro Mesz, Universidad Nacional de Tres de Febrero, ARGENTINA
Received: August 14, 2024; Accepted: August 29, 2025; Published: November 14, 2025
Copyright: © 2025 Vaccaro et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data that support the findings of this study are publicly available at https://osf.io/2t43c
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests.
Introduction
If you have ever had the sense that you “are not sure” how you feel, you have experienced affective uncertainty. We use the term affective uncertainty to refer to an individual’s state-level metacognitive assessment of the identifiability of their own current affective experience. It captures the degree to which someone feels confident that they can recognize and describe what they are feeling in a given moment. This introspective murkiness becomes especially relevant in emotionally complex situations – those that evoke bittersweetness, ambivalence, or internal conflict. Affective certainty represents an intersection between metacognition and emotion. Just as people may be more or less confident in a perceptual or memory judgment, they may also be more or less confident that they can label, articulate, and interpret what they are currently feeling. Though limited, there is some preliminary work on how individuals assign confidence or metacognitive judgements to the identification of their own affective states [1–4]. A recent study showed test-retest reliability within individuals making metacognition judgements on their degree of felt positivity, suggesting promise in using this concept to understand differences between individuals [2].
Ambivalence and judgements of certainty
A well-established body of research has explored the relationship between ambivalence and certainty, particularly in the domain of attitudes. Previous work has shown that even when subjects report that they hold both positive and negative evaluations of an object (referred to as “objective ambivalence”), this does not necessarily result in a subjective sense of conflict or confusion (“subjective ambivalence”) [5]. The relationship between objective and subjective ambivalence has been shown to vary considerably across individuals and contexts [6–8]. Recent work has extended these findings by showing that the relationship between conflicting emotions or beliefs and subjective ambivalence is moderated by individual differences in tendencies to rely on affective versus cognitive information when forming attitudes [9]. Subjective ambivalence is often measured by directly asking participants how conflicted or ambivalent they feel – probes that often conflate ambivalence with internal uncertainty. The distinction between these two measures has also been used to show that individuals can be quite certain about their mixed or undecided positions [10,11]. Studies have shown that individuals can experience strong mixed or ambivalent reactions while remaining confident that such a conflicted stance is appropriate, especially regarding morally complex scenarios [6,12]. Behavioral studies have shown that certainty can be experimentally manipulated while ambivalence remains stable [13–15], and neuroimaging work has demonstrated that ratings of ambivalence and certainty activate distinct cortical regions [16].
However, most studies have primarily conceptualized certainty in terms of evaluative or propositional attitudes, directed at beliefs or external judgements. These certainty ratings are directed at correctness or validity of the position, rather than at the certainty of self-identification, which have been shown to be distinct aspects of certainty [14,17]. The internal focus distinguishes it from the certainty associated with attitudes, which often involves an evaluation of an external entity (Cohen & Reed, 2006; [18]. This distinction is crucial for understanding the link between feeling uncertain and feeling ambivalent, as prior research has shown that self-related metacognitive judgments are affected differently by context, and related to different cognitive processes, than judgements of beliefs or external objects [19–21]. As such, different traits and sources of information, such as affective knowledge and interoceptive physiology, may influence certainty of self-ambivalent judgements in distinct ways compared to external judgements [21–23]. Yet, the methods and frameworks used to understand ambivalence-certainty links in the domain of attitudes may be fruitfully applied to studying self-related judgements [24], and may be particularly important for understanding links between ambivalence and well-being.
Trait-level moderators of affective uncertainty
Certainty about one’s affective state can serve as a crucial piece of information in navigating especially emotionally complex states, and how affectively certain one is during complex scenarios may relate to their emotional intelligence [17,25]. The term emotional intelligence has been used to refer to the socio-affective skills, not explained by traditional cognitive intelligence, that help individuals thrive and navigate the problems we face in our daily lives. Research on emotional intelligence has traditionally described the construct as a set of interrelated skills such as perspective-taking, empathy, emotion perception, emotion regulation, and affect labeling [26–30]. These constructs are typically measured with trait-level scales, such as the [31]. These skills may explain differences in how and when individuals generate different affective states, and in what scenarios they judge that their own affective state is appropriate to the context. In addition to general measures of emotional intelligence, several related personal traits may also affect the experience of mental clarity for emotions. For example, alexithymia is a condition characterized by a difficulty in identifying and expressing one’s own feelings, which may be due to insensitivity to the specific meanings behind internal signals from the body or to underdeveloped emotion schemas [32]. Alexithymic traits may be especially related to mixed emotions, which may involve more complex physiological signals, and are known to involve schemas which do not develop till later in development than univalent states [33,34]. Another related concept that may shape the clarity of emotional states is meta-mood. The Trait Meta-Mood Scale (TMMS), developed by Salovey et al. [29], provides a widely used framework for assessing individual differences in meta-emotional processes, or the ways individuals reflect upon and manage their own emotions. The TMMS comprises three core dimensions: Attention to Feelings, Clarity of Feelings, and Mood Repair. Attention to Feelings captures the extent to which individuals notice and value their emotional experiences; Clarity of Feelings reflects how clearly they understand and differentiate their emotional states; and Mood Repair assesses the perceived ability to regulate negative emotions and maintain emotional balance. Together, these constructs offer a nuanced understanding of emotional competence, with implications for mental health, coping strategies, and interpersonal functioning [35].
Overall, confidence in identifying one’s own emotional state is likely a multifaceted process involving physiological interoception, knowledge of emotional labels, and metacognitive processes [36]. The ability to accurately assess one’s own affective uncertainty is a key component of emotional intelligence, allowing individuals to better understand and manage their emotional experiences [29,30]. While these measures are mostly considered trait-level phenomena, there is less work linking them to trial-by-trial state-level self-judgements [35].
Mixed emotions and affective uncertainty
Research suggests that there may be differences from person to person in how mixed feelings relate to well-being. In some individuals, mixed feelings are related to coping, future improvements in mental health, or progression towards goals; in others, they lead to distress and can even be a sign of worse mental health [37,38] & Wytykowska, 2014; [39] & Traue, 2013; [40–42]. These differences in the effects of mixed feelings may be due to these personally different factors [41,43,44]. It is well-established that there are substantial individual differences in who experiences mixed emotions and how they are experienced [45–47]. Many of these differences arise due to variability in intrinsic personal traits [44,45]. For example, people with higher levels of openness and neuroticism on the ‘Big 5’ personality traits have been found to experience mixed emotions more often in daily life [45,48,49] As mixed feelings can involve different patterns of emotion appraisals, cognitive and personality factors shape the frequency and subjective nature of these experiences across individuals [41,50]. It is also possible that these factors shape whether individuals experience mixed feelings, and believe that they can experience them, through processes which may shape conscious appraisals of valence into bipolar or bivariate representations [33,51,52].
Mixed emotions may be particularly likely to elicit affective uncertainty, as they pose a unique challenge for interpreting one’s own internal state [53,54]. In previous work, we suggested that individuals with less interoceptive accuracy and emotional intelligence may be less likely to experience mixed feelings, and less able to identify how they feel when they do experience them [33]. However, no studies have directly tested the relationship between affective certainty and these traits, especially in the context of complex feelings. Previous work has shown stable trait-level individual differences in attitude certainty (with some level of domain specificity), and as such, there is reason to believe trait-level patterns also explain how individuals judge their own emotional states [24,25]. Given the potential relationship between mental health and how people relate to mixed emotions, there is important theoretical motivation for disentangling these two phenomena. Furthermore, studies on traits such as alexithymia and meta-mood, which are important for the awareness of feelings, have called upon mixed feelings to be an important future direction of study but these studies have not yet been conducted [1,33,41,44,46,48,52,55,56]. With this study, we aimed to understand why the relationship between state-level judgments of affective certainty and the experience of mixed emotions differs across individuals. We hypothesized that traits such as emotional intelligence, alexithymia, and meta-mood clarity would moderate the relationship between emotional complexity and certainty, helping to explain who feels certain versus uncertain when reporting intense objective ambivalence.
STUDY 1: Piloting of certainty measure and mixed feeling induction/measurement
We first conducted this study with 140 undergraduate student volunteers at University of Southern California, in part to pilot whether subjects would report meaningful variation in affective certainty on a trial by trial basis. Furthermore, we used this initial study to test various possible methods of calculating the “mixed-ness” of feelings that have been used in previous literature [57].
Hypotheses
H1: We expected a general trend that most people would express less affective certainty when reporting greater mixed feelings. Our subsequent hypotheses focus on how we expect this effect to be moderated by various traits:
H2: Higher self-reported emotional intelligence would lead to a weakening in the negative relationship between ambivalence and certainty, as individuals with higher emotional intelligence may have more experience with complex emotional states
H3: Higher alexithymia scores would lead to a strengthening of the negative relationship between ambivalence and certainty, since mixed feelings as a complex state, and more developmentally advanced schema, may be even more difficult to identify than more typical univalent states.
H4: Higher interoceptive awareness would lead to a weakening of the negative relationship between ambivalence and certainty, since interoceptive ability may help subjects be more confident about their emotional state from being more in touch with ‘bodily evidence’.
Methods
Participants
Data was collected from 140 undergraduates (92 female, 48 male; mean age = 20.21, standard deviation = 3.22) at the University of Southern California who received course credit for their participation. 43.6% of subjects identified as Asian, 6.5% as Black, 14.2% as Hispanic or Latino, and 37.1% as White.
Stimuli selection
The first step of creating a stimulus set was conducting a bulk review of videos to consider including in the pilot study. Our search focused on film noted to induce bittersweet feelings, due to previous work successfully inducing mixed feelings in laboratory settings using bittersweet endings, as well as the general prevalence of the bittersweet trope within film [52,58–60]. The initial search was organized into two categories: live-action film clips and animated videos. Notes were taken on the emotions associated with each clip. Then, we developed a rating system to indicate whether the video elicited bittersweet emotions. Over 300 live-action and 300 animated films were viewed and analyzed, for a total of 603 film clips. Using the rating system, the 603 videos were narrowed down to 85 that achieved a high rating on their ability to elicit bittersweet emotions by a single individual. The 85 selected films were reviewed by a team of 5 that rated each on a scale of 1–5 based on their suitability to function as a good stimulus that elicits ambivalence within viewers. The average of the 5 ratings for each movie was calculated and those with an average rating above 2.5 were chosen as part of the pilot study, narrowing the total number of videos to 47.
Stimuli
Each subject watched 4–5 videos meant to induce mixed feelings out of 45 potential videos. These video stimuli ranged in length from approximately 2–10 minutes long, and consisted of excerpts from movies, television, and animated short films.
Procedure
Subjects first completed demographic measures of age, gender identity, race, and ethnicity. Next, each subject was shown 4–5 different videos. After watching each individual video, subjects were asked to complete the following ratings:
- 1). How familiar were you with this clip before watching? (“Never seen it before”, “Seen it once before”, “Seen it a few times”, “Seen it many times before”)
- 2). “How certain are you that you know how this video made you feel?” (0%, 20%, 40%, 60%, 80%, 100%).
- 3). How positive did the clip make you feel (1–5 Likert scale)
- 4). How negative did the clip make you feel (1–5 Likert scale)
- 5). How calm-excited did the clip make you feel (1–5 Likert scale)
- 6). Check off every emotion you felt from the clip? [Happy, Excited, Love, Amusement, Fearful, Sad, Angry, Disgusted, Nostalgic, Bittersweet, Conflicted, Awe]
We chose to assess affective uncertainty through a single global item, rather than through a multiple item scale, to assure subjects would have time to do multiple trials of the task and to prioritize the brevity of the measure in assessing the subject’s current state [44]. Additionally, we specifically made the decision that subjects would rate their certainty prospectively, before giving their exact valence ratings, rather than retrospectively. This was done with the hope of influencing subjects to respond from a general gut feeling of whether they “knew how they felt”, rather than from reflecting retrospectively on whether their specific numerical ratings were “accurate”. We aimed for similarity to the “feeling of knowing” construct from the metacognition literature.
After watching all videos, subjects completed the following measures of individual differences:
- 1). The Schutte Self Report Emotional Intelligence Scale (SSEIT) [31]- a self-report measure of 4 aspects of emotional intelligence: emotion perception, utilizing emotion, managing self-relevant emotions, and managing other’s emotions
- 2). The Toronto Alexithymia Scale [32]- a measure of difficulty naming and describing emotions
- 3). The Multidimensional Assessment of Interoceptive Awareness (MAIA) [61]- a trait measure of introspective ability of one’s own bodily sensations
Analysis
All analyses were conducted using R version 4.1.1 and the lme4 package [62]. All plots were made with sjPlot [63]. Data from this study is available upon request.
Measures of mixed feelings
Part of the difficulty in studying mixed feelings is operationalizing their measurement. We used two different measurements of mixed feelings in order to determine their comparability and suitability for gauging the occurrence of mixed feelings on a trial-by-trial basis:
- 1). An interaction effect between positive and negative valence [64].
- 2). The Griffin formula for ambivalence: (Positive+Negative)/2 - |Positive-Negative| [65]. This theory posits that ambivalence requires two specific conditions to be met. First, ambivalence arises when attitude components have at least moderate intensity, calculated as “(Positive + Negative)/2.” Second, for ambivalence to occur, the magnitudes of the two attitude components must be similar, and this similarity is calculated as “|Pos - Neg|.” As the magnitude difference between the two components increases (meaning the similarity in magnitude decreases), the attitude tends to become more strongly aligned with the more intense component. However, if the similarity is kept constant, ambivalence increases directly with intensity. Therefore, ambivalence is determined by both the similarity in magnitude of the components plus their overall intensity.
Constructed models
To test each hypothesis, we constructed 2 separate mixed-effects linear models: one for each of the 2 methods of calculating mixed feelings. The outcome variable of every model was the affective certainty during the trial, with the 6 options between 0 and 100% being coded as 1–6. Every model included a random intercept to account for the effect of individual subjects. Models always included positive and negative valence as additional variables to the measure of mixed feelings.
Results
All of the models had a total of 674 observations at the first level, and 140 groups in the second level of the model: one for each individual subject.
Uncertainty and mixed feelings
In both models testing the relationship between mixed feelings and certainty, greater mixed feelings predicted less certainty, whereas increases in both positive and negative feelings independently predicted increased certainty. (Tables 1 and 2; Fig 1)
Predicted certainty of knowing how you feel in a trial, as predicted by positive and negative valence ratings. When positive ratings are high and negative are low, and vice versa, certainty is generally higher. When positive and negative ratings are both high concurrently, certainty begins to decrease.
Individual differences and the relationship between mixed feelings and uncertainty
While interoception and alexithymia were predictive of certainty in general, they did not have a significant interaction with mixed feelings in any model (S1 and S2 Tables). Emotional intelligence did not significantly interact with the relationship between mixed feelings and certainty in the models using the minimum, gradual threshold, or Griffin methods of calculating mixed feelings (S3 Table). Yet, the three-way interaction between positive feelings, negative feelings, and emotional intelligence significantly predicted increased certainty (Table 3). A closer examination of this result showed that while increasingly intense co-occurring positive and negative feelings were associated with decreases in certainty, higher emotional intelligence led to a weakening of this effect (Fig 2).
When positive ratings are high and negative are low, and vice versa, certainty is generally higher. When positive and negative ratings are both high concurrently, certainty begins to decrease, but this effect is lessened in individuals with relatively higher emotional intelligence scores.
Exploring the link between emotional intelligence and certainty of mixed feelings
We next explored the 4 sub-scales of the SSEIT to determine if any specific aspect of emotional intelligence was driving this effect. We found that the Managing Own Emotions subscale and the Utilizing Emotions subscale had the same three-way interaction effect with positive and negative feelings that the total SSEIT score had, whereas the Perceiving Emotions and Managing Other’s Emotions subscales did not (S4 Table).
Study 2: Pre-registered follow-up study
We decided to investigate whether our findings would replicate in a larger sample more representative of the United States population. A new sample was recruited using the Prolific online subject pool service. In this study, we added a measure of trait meta-mood, to investigate whether trait-levels of emotional awareness were related to the trial-by-trial measure of uncertainty we measured. We also reduced the sample of videos to those most effective at inducing positive, negative, or mixed feelings, based on ratings from the first study’s pool of participants, by removing videos that consistently received ratings of 1 and 2 in both valence categories
We pre-registered this follow-up study at OSF Registries (https://osf.io/anbvj). After pre-registration, we additionally tested the effect of adding a random effect for stimulus to the models, but this did not change the significance of any predictors in the analyses.
Pre-registered hypotheses
Hypothesis 1: Participants will be more uncertain of how they feel when reporting a co-occurrence of positive and negative valence (mixed feelings).
Hypothesis 2a: Participants with higher emotional intelligence will exhibit a weaker relationship between mixed feelings and uncertainty.
Hypothesis 2b: Higher scores on the “managing self-relevant emotions” sub-scale of the emotional intelligence scale specifically will lead to a weaker relationship between mixed feelings and uncertainty.
Hypothesis 3: The three measures of the meta-mood scale (Clarity, Repair, and Attention) will all lead to a weaker relationship between mixed feelings and uncertainty.
Methods
Ethics
This study was approved by the Institutional Review Board at the University of Southern California. Written informed consent was from subjects before participation.
Participants
Data was collected on Prolific from 311 subjects (149 female, 154 male, 5 non-binary, 2 who reported ‘other’, and 1 who preferred not to say) in the United States with ages ranging from 18–65 (mean = 35.08, standard deviation = 11.82). 1.6% of subjects identified as American Indian, 10% as Asian, 15.1% as Black, 12.5% as Hispanic or Latino, 0.6% as Native Hawaiian or Other Pacific Islander, and 68.8% as White. Subjects were paid $7.50 for the 50 minute study. All data was obtained on October 7th, 2022.
Procedure
Each subject watched 4 random videos meant to induce mixed feelings out of 28 potential videos, with each video being evenly distributed across the total sample. Valence and emotional category ratings for these stimuli are included at the end of the Supplementary Materials. After each video, subjects answered the same questions as the previous study.
After watching all videos, subjects completed the following measures of individual differences, the first two for our pre-registered hypotheses, and the following 2 for exploratory purposes:
Analysis
This dataset is publicly available at https://osf.io/2t43c.
Data exclusion
Following pre-registered procedures, subjects’ data was excluded entirely if their total time taking the survey was less than the total length of all the videos they watched. Observations were excluded from the Hypothesis 1 analyses if any of certainty, positive valence, or negative valence is missing. Additionally, in all other analyses, subjects’ data were excluded from the analysis if they did not complete the entire relevant scale. 43 subjects clicked to start the study but did not complete it, and 7 subjects timed out and did not complete the study. Data was automatically collected till 311 participants completed the survey.
Results
Uncertainty and mixed feelings
Subjects reported a range of positive-negative valence combinations across trials, ranging from purely univalent to intense ambivalence (see S1 Fig). We again found that mixed feelings had a significant negative relationship with certainty in both models, whereas positive and negative feelings individually were positively associated with certainty (Fig 3; Table 4).
When positive ratings are high and negative are low, and vice versa, certainty is generally higher. When positive and negative ratings are both high concurrently, certainty begins to decrease.
Individual differences and the relationship between mixed feelings and uncertainty
While emotional intelligence itself was predictive of certainty, there was no significant interaction with mixed feelings in this sample (Table 5). The managing one’s own emotions subscale was also not a significant predictor, nor was its interaction with mixed feelings (S5 Table). Of the meta-mood subscales, the clarity subscale had a significant interaction with mixed feelings, in which high scores were associated with a decrease in the negative relationship between mixed feelings and certainty (Fig 4; Table 6). Attention and mood repair did not have a significant interaction effect (S6 Tables).
When positive ratings are high and negative are low, and vice versa, certainty is generally higher. When positive and negative ratings are both high concurrently, certainty begins to decrease, but this effect is lessened in individuals with relatively higher clarity scores.
Exploratory analyses of the Big 5
Extraversion, Openness, and Emotional Stability did not significantly predict certainty in any model (S7-S9 Tables). Agreeableness and Conscientiousness significantly predicted certainty, but did not significantly interact with positive, negative, or mixed valence (S10 Table). Greater Conscientiousness significantly predicted greater certainty (also S10 Table). Additionally, there was a significant negative interaction between negativity and conscientiousness in predicting certainty (S11 Table).
Discussion
Mixed feelings and affective certainty
Consistently in both samples, we find that the intensity of mixed feelings is associated with affective uncertainty. Specifically, as concurrent positive and negative feelings increase in intensity, participants report less certainty in identifying how they feel. While prior work has explored the relationship between attitudinal ambivalence and certainty, often focusing on certainty about beliefs or external evaluations [8,67,68] our study specifically examined a state-level metacognitive assessment of the identifiability of one’s own current emotional experience. Our data reveals meaningful variability in this affective certainty, particularly in the context of mixed emotions. Our results underscore that individuals differ in their confidence in identifying their feelings, and importantly, this variability is partially explained by individual trait differences.
Emotional intelligence
In Study 1, emotional intelligence as measured by the SSEIT interacted with the negative association between certainty and mixed feelings. Specifically higher emotional intelligence was associated with a weaker version of the effect. The effect was mainly driven by the managing emotion subscale of the SSEIT. However, this finding wasn’t replicated in our pre-registered analysis – which differed demographically in terms of gender, age, and race.
A recent study had a seemingly contradictory finding concerning mixed emotions and emotional intelligence: higher emotional intelligence was associated with experiencing less mixed feelings in workplace scenarios, and this effect was mostly driven by the Managing Emotion ability [69] The authors suggest that the relationship is driven by high emotion-management down-regulating conflicting affect, leading to more univalent states. In our study, we specifically aimed to induce mixed feelings. It is possible that individuals with high emotional intelligence do often regulate mixed feelings away, but when scenarios truly call for them, they are more certain that they feel them, and that they should be feeling them. It is also possible that our paradigm, using popular media, induced different types of mixed feelings than in the aforementioned study. Mixed feelings induced by different contexts may involve different types of interactions between emotional and cognitive/appraisal processes [41,44,50,70–72]. It is possible that these various instances of mixed feelings have different relationships to emotional intelligence.
Trait meta-mood and trial-by-trial certainty
In our second study we found that the clarity sub-scale of the Trait Meta-Mood scale interacted with the negative relationship between mixed feelings and certainty, in line with prior work [29]. Our results demonstrate a link between two similar constructs: certainty and clarity. Our results suggest that our trial-by-trial certainty measure capturing the state-level self judgement is probing the same cognitive function that is traditionally assessed on a trait-level basis. The clarity sub-scale has frequently been found to blunt the negative effect of stressors on general and life satisfaction [73–75]. Interestingly, many studies on mixed feelings have focused on life satisfaction, often finding positive effects [37,76]; while others have found vast individual differences and even negative effects [41,42,77–80]. Clarity may be an important factor in explaining these individual differences, where reported mixed feelings that stem from a lack of clarity about one’s affective state are related to distress, whereas clear mixed feelings can be a sign of processing complicated affective scenarios. Previous studies have found that mixed feelings which subjects feel certain about are more stable overtime than ones for which they feel uncertain [12,16,81]. Future studies could test whether this holds true with a paradigm where subjects view the stimuli again on later dates. This could give an additional measure of attitude stability, as well as be used to investigate whether uncertain subjects may become more certain of ambivalent feelings overtime with additional processing of the stimulus. In this way, the clarity trait could represent a speed of processing complex affective scenarios, leading to less occurrence of uncertain feelings in daily life.
Age and cultural effects on mixed emotions
The similarities and differences between the results of our first study and our pre-registered study demonstrate the importance of understanding which emotion-trait relationships are generalizable across populations, versus which may differ based on social and demographic factors [44,82,83]. The interaction between emotional intelligence, certainty, and mixed feelings did not replicate in the sample that was demographically representative of the United States population. It is possible that the relationships between measures of emotional intelligence, affective certainty, and mixed feelings were strongly related to the specific demographic factors of our first sample. Specifically, our sample of undergraduate students was much younger than the replication sample, and had a plurality of subjects identifying as Asian, whereas the replication sample had a majority of subjects identifying as White. Previous research has found significant differences in the experience of, and comfort with, mixed emotions between groups of different ages [71,84], and cultural backgrounds [80,83,85–87]. These findings have included younger adults having less comfort with mixed feelings, as well as Asian-American and people natively from Asian countries having more comfort with mixed feelings. The interplay between these demographic factors in our first sample may lead to emotional intelligence explaining more of the variability in how strong the relationship between uncertainty and mixed feelings is. Future studies with larger samples should investigate how demographic factors, and interactions between them, affect these complex relationships between traits, feelings, and certainty, especially in an international sample.
Implications for future research on mixed emotions
Our results suggest several directions for future work on mixed emotions. Affective uncertainty has promise in shedding light on individual variations in mixed feelings, brought about by different traits and cognitive abilities. Given the established literature on traits that moderate certainty in ambivalent attitudinal judgments, it would be valuable to directly test which of these same traits overlap or differ with those that moderate certainty about one’s own affective state [8,12,24,36,44,88,89]. Testing both judgements in the same subjects could further illuminate the similarities and differences between metacognitive processes applied to beliefs versus internal feelings. Additionally, this format could be used for testing whether in the moment manipulations, such as changes to presented information and context surrounding the positive and negative aspects of the stimuli, can influence affective certainty in a similar manner to manipulations to subjective ambivalence [13,16].
To deepen our understanding of these connections, future studies should explore affective certainty during mixed emotional experiences across a wider range of contexts [44,89,90], moving beyond film-induced emotions to capture mixed feelings encountered in daily life and in response to various types of meaningful events [91,92]. This is especially important, as we know that real-world scenarios, such as contexts that force decision-making, can increase the link between mixed emotions and psychological distress [68,93]. On this note, affective uncertainty for mixed emotions may be particularly relevant to various psychiatric disorders, explaining difficulties in handling complex affective situations [1,36].
Some of the variance in our data could be related to how subjects interpret the certainty question differently. Cognitive processes and individual lay theories about emotion may influence how subjects assess and report the identifiability of their feelings, especially in the face of ambivalence [51,52,94]. Future work could explicitly investigate how individuals understand and interpret the concept of affective uncertainty, as this in itself could provide valuable insights into the factors that contribute to varying subjective experiences of emotional clarity and ambivalence. However, despite this potential source of variability in interpretation, our finding of a consistent negative relationship between the intensity of mixed feelings and affective certainty, replicating across two demographically different samples, underscores that our measure is capturing a meaningful and generalizable phenomenon related to the confidence in identifying one’s own mixed emotional state.
Conclusions
This study demonstrates variation in the experiences of mixed feelings both between subjects, and between individual trials. Our results support the commonly observed link between experiencing ambivalence and a sense of uncertainty within the domain of self-related judgements, specifically showing that higher intensity of co-occurring positive and negative affect is associated with lower affective certainty. Importantly, our analyses reveal that this relationship is not uniform; various individual traits moderate this effect, indicating that some individuals are indeed able to experience intense mixed feelings while still feeling fully certain about the identifiability of their affective state. These findings suggest that affective certainty ratings provide a meaningful insight into self-awareness for affect, particularly in complex emotional scenarios.With this baseline knowledge, more advanced techniques of measuring self-awareness for emotion can be developed. Mixed feelings are a prime candidate for demonstrating the important interplay between metacognitive processes, personalized traits, and emotion: these relationships should be studied further. Finally, these results may demonstrate a broad generalizability of this uncertainty-mixed feelings association, though at different strengths depending on various factors. We may have a natural tendency to feel that positivity and negativity do not go together, even when we are, in fact, experiencing them.
Supporting information
S1 Fig. Counts of positive and negative valence ratings across 1237 trials Matrix displays counts of each possible combination of positive and negative valence rating across all subjects in Study 2.
https://doi.org/10.1371/journal.pone.0332417.s001
(DOCX)
S1 Appendix. Supplemental Results Tables from Study 1 Results of mixed-effects-models (674 observations, 140 subjects) predicting certainty of knowing of how you feel from valence and and personality measures.
Significance of predictors determined with t-tests using Satterhwaitte’s method CI = 95% confidence interval.
https://doi.org/10.1371/journal.pone.0332417.s002
(DOCX)
S2 Appendix. Supplemental Results Tables from Study 2 Results of mixed-effects-models (1233–1237 observations, 310–311 subjects) predicting certainty of knowing of how you feel from valence and personality measures.
Significance of predictors determined with t-tests using Satterhwaitte’s method CI = 95% confidence interval.
https://doi.org/10.1371/journal.pone.0332417.s003
(DOCX)
S3 Appendix. Stimuli Ratings Across Both Studies Subject (N = 451 ratings across both studies for video stimuli.
Each subject rated 4–5 videos.
https://doi.org/10.1371/journal.pone.0332417.s004
(DOCX)
References
- 1. Bailen NH, Wu H, Thompson RJ. Meta-emotions in daily life: Associations with emotional awareness and depression. Emotion. 2019;19(5):776–87. pmid:30080076
- 2. Lee H-H, Liu GK-M, Chen Y-C, Yeh S-L. Exploring quantitative measures in metacognition of emotion. Sci Rep. 2024;14(1):1990. pmid:38263192
- 3. Thompson RJ, Boden MT. State emotional clarity and attention to emotion: a naturalistic examination of their associations with each other, affect, and context. Cogn Emot. 2019;33(7):1514–22. pmid:30691348
- 4. Vaccaro AG, Fleming SM. Thinking about thinking: A coordinate-based meta-analysis of neuroimaging studies of metacognitive judgements. Brain Neurosci Adv. 2018;2:2398212818810591. pmid:30542659
- 5. Ng WJR, See YHM, Wallace LE. When objective ambivalence predicts subjective ambivalence: An affect–cognition matching perspective. Personality and Social Psychology Bulletin. 2022.
- 6. Durso GRO, Petty RE, Briñol P, Siev JJ, Hinsenkamp LD, Sawicki V. Dampening affect via expectations: The case of ambivalence. J Pers Soc Psychol. 2021;121(6):1172–94. pmid:34043405
- 7. Priester JR, Petty RE. The gradual threshold model of ambivalence: relating the positive and negative bases of attitudes to subjective ambivalence. J Pers Soc Psychol. 1996;71(3):431–49. pmid:8831157
- 8.
van Harreveld F, Nohlen HU, Schneider IK. The ABC of ambivalence: Affective, behavioral, and cognitive consequences of attitudinal conflict. Advances in experimental social psychology. Elsevier; 2015. p. 285–324.
- 9. See YHM, Luttrell A. When dueling emotions and conflicting beliefs predict subjective ambivalence: The role of meta-bases. Journal of Experimental Social Psychology. 2021;97:104204.
- 10. Hong J, Lee AY. Feeling mixed but not torn: The moderating role of construal level in mixed emotions appeals. Journal of Consumer Research. 2010;37(3):456–72.
- 11. Schneider IK, Schwarz N. Mixed feelings: the case of ambivalence. Current Opinion in Behavioral Sciences. 2017;15:39–45.
- 12. Luttrell A, Petty RE, Briñol P. The interactive effects of ambivalence and certainty on political opinion stability. Journal of Social and Political Psychology. 2020;8(2):525–41.
- 13. DeMarree KG, Brinol P, Petty RE. Reducing subjective ambivalence by creating doubt: A metacognitive approach. Social Psychological and Personality Science. 2015;6(7):731–9.
- 14. Petrocelli JV, Tormala ZL, Rucker DD. Unpacking attitude certainty: attitude clarity and attitude correctness. J Pers Soc Psychol. 2007;92(1):30–41. pmid:17201540
- 15. Rucker DD, Petty RE. When resistance is futile: consequences of failed counterarguing for attitude certainty. J Pers Soc Psychol. 2004;86(2):219–35. pmid:14769080
- 16. Luttrell A, Stillman PE, Hasinski AE, Cunningham WA. Neural dissociations in attitude strength: Distinct regions of cingulate cortex track ambivalence and certainty. J Exp Psychol Gen. 2016;145(4):419–33. pmid:26854498
- 17.
Koriat A, Levy-Sadot R. Processes underlying metacognitive judgments: information-based and experience-based monitoring of one’s own knowledge. In Chaiken S, Trope Y, editors. Dual-process theories in social psychology. The Guilford Press;1999. pp. 483–502.
- 18.
Gross SR, Holtz R, Miller N. Attitude certainty. Attitude strength. Psychology Press. 2014. p. 215–45.
- 19. Katyal S, Fleming SM. The future of metacognition research: Balancing construct breadth with measurement rigor. Cortex. 2024;171:223–34. pmid:38041921
- 20. Schwarz N, Clore GL. Mood, misattribution, and judgments of well-being: Informative and directive functions of affective states. Journal of Personality and Social Psychology. 1983;45(3):513.
- 21. DeMarree KG, Morrison KR, Wheeler SC, Petty RE. Self-ambivalence and resistance to subtle self-change attempts. Pers Soc Psychol Bull. 2011;37(5):674–86. pmid:21383072
- 22. Nohlen HU, Van Harreveld F, Rotteveel M, Barends AJ, Larsen JT. Affective responses to ambivalence are context-dependent: A facial EMG study on the role of inconsistency and evaluative context in shaping affective responses to ambivalence. Journal of Experimental Social Psychology. 2016;65:42–51.
- 23. Jiang S, Wang S, Wan X. Metacognition and mentalizing are associated with distinct neural representations of decision uncertainty. PLoS Biol. 2022;20(5):e3001301. pmid:35559898
- 24. DeMarree KG, Petty RE, Turnes PB. Self-certainty: Parallels to attitude certainty. International Journal of Psychology and Psychological Therapy. 2007;7(2):159–88.
- 25. DeMarree KG, Petty RE, Briñol P, Xia J. Documenting individual differences in the propensity to hold attitudes with certainty. J Pers Soc Psychol. 2020;119(6):1239–65. pmid:32584098
- 26. Beck L, Kumschick IR, Eid M, Klann-Delius G. Relationship between language competence and emotional competence in middle childhood. Emotion. 2012;12(3):503–14. pmid:22148995
- 27. Goldsmith HH, Davidson RJ. Disambiguating the components of emotion regulation. Child Dev. 2004;75(2):361–5. pmid:15056191
- 28. Hall L, Haggerty D, Cooper J, Golden C, Dornheim L. Development and validation of a measure of emotional intelligence. Personality and Individual Differences. 1998;25:167–77.
- 29.
Salovey P, Mayer JD, Goldman SL, Turvey C, Palfai TP. Emotional attention, clarity, and repair: exploring emotional intelligence using the trait meta-mood scale. 1995.
- 30. Schultz D, Izard CE, Abe J. The emotion systems and the development of emotional intelligence. Emotional Intelligence. 2005:51–67.
- 31. Schutte NS, Malouff JM, Hall LE, Haggerty DJ, Cooper JT, Golden CJ, et al. Development and validation of a measure of emotional intelligence. Personality and Individual Differences. 1998;25(2):167–77.
- 32. Bagby RM, Parker JD, Taylor GJ. The twenty-item Toronto Alexithymia Scale--I. Item selection and cross-validation of the factor structure. J Psychosom Res. 1994;38(1):23–32. pmid:8126686
- 33. Vaccaro AG, Kaplan JT, Damasio A. Bittersweet: The Neuroscience of Ambivalent Affect. Perspect Psychol Sci. 2020;15(5):1187–99. pmid:32758063
- 34. Smith JP, Glass DJ, Fireman G. The understanding and experience of mixed emotions in 3-5-year-old children. J Genet Psychol. 2015;176(1–2):65–81. pmid:25695201
- 35. Norman E, Furnes B. The Concept of “Metaemotion”: What is There to Learn From Research on Metacognition?. Emot Rev. 2016;8(2):187–93. pmid:27110281
- 36. Morie KP, Crowley MJ, Mayes LC, Potenza MN. The process of emotion identification: considerations for psychiatric disorders. Journal of Psychiatric Research. 2022;148:264–74.
- 37. Berrios R, Totterdell P, Kellett S. When feeling mixed can be meaningful: The relation between mixed emotions and eudaimonic well-being. Journal of Happiness Studies. 2018;19:841–61.
- 38. Braniecka A, Trzebińska E, Dowgiert A, Wytykowska A. Mixed emotions and coping: the benefits of secondary emotions. PLoS One. 2014;9(8):e103940. pmid:25084461
- 39. Jerg-Bretzke L, Walter S, Limbrecht-Ecklundt K, Traue HC. Emotional ambivalence and post-traumatic stress disorder (PTSD) in soldiers during military operations. Psychosoc Med. 2013;10:Doc03. pmid:23798980
- 40. Losada A, Márquez-González M, Vara-García C, Gallego-Alberto L, Romero-Moreno R, Pillemer K. Ambivalence and guilt feelings: Two relevant variables for understanding caregivers’ depressive symptomatology. Clin Psychol Psychother. 2018;25(1):59–64. pmid:28809070
- 41. Oh VYS. Torn Between Valences: Mixed Emotions Predict Poorer Psychological Well-Being and Job Burnout. J Happiness Stud. 2022;23(5):2171–200. pmid:35095334
- 42. Verplanken B. When bittersweet turns sour: Adverse effects of nostalgia on habitual worriers. Euro J Social Psych. 2012;42(3):285–9.
- 43. Larsen JT, Coles NA, Jordan DK. Varieties of mixed emotional experience. Current Opinion in Behavioral Sciences. 2017;15:72–6.
- 44. Moore MM, Martin EA. Taking Stock and Moving Forward: A Personalized Perspective on Mixed Emotions. Perspect Psychol Sci. 2022;17(5):1258–75. pmid:35559728
- 45. Barford KA, Smillie LD. Openness and other Big Five traits in relation to dispositional mixed emotions. Personality and Individual Differences. 2016;102:118–22.
- 46. Hui CM, Fok HK, Bond MH. Who feels more ambivalence? Linking dialectical thinking to mixed emotions. Personality and Individual Differences. 2009;46(4):493–8.
- 47. Rafaeli E, Rogers GM, Revelle W. Affective synchrony: individual differences in mixed emotions. Pers Soc Psychol Bull. 2007;33(7):915–32. pmid:17551163
- 48. Barford KA, Koval P, Kuppens P, Smillie LD. When good feelings turn mixed: Affective dynamics and big five trait predictors of mixed emotions in daily life. European Journal of Personality. 2020;34(3):393–411.
- 49. Mill A, Kööts-Ausmees L, Allik J, Realo A. The Role of Co-occurring Emotions and Personality Traits in Anger Expression. Front Psychol. 2018;9:123. pmid:29479333
- 50. Oh VYS, Tong EMW. Specificity in the Study of Mixed Emotions: A Theoretical Framework. Pers Soc Psychol Rev. 2022;26(4):283–314. pmid:35383513
- 51. Koh AH, Liew K, Uchida Y. The ease of experiencing positive emotions in negative contexts. Motivation and Emotion. 2023;47(3):431–47.
- 52. Larsen JT, McGraw AP. Further evidence for mixed emotions. J Pers Soc Psychol. 2011;100(6):1095–110. pmid:21219075
- 53. Anderson EC, Carleton RN, Diefenbach M, Han PKJ. The Relationship Between Uncertainty and Affect. Front Psychol. 2019;10:2504. pmid:31781003
- 54. Van den Bos K. Making sense of life: The existential self trying to deal with personal uncertainty. Psychological Inquiry. 2009;20(4):197–217.
- 55. Aaron RV, Snodgress MA, Blain SD, Park S. Affect labeling and other aspects of emotional experiences in relation to alexithymia following standardized emotion inductions. Psychiatry Res. 2018;262:115–23. pmid:29428774
- 56. Park J, Naragon-Gainey K. Daily experiences of emotional clarity and their association with internalizing symptoms in naturalistic settings. Emotion. 2019;19(5):764.
- 57. Berrios R, Totterdell P, Kellett S. Eliciting mixed emotions: a meta-analysis comparing models, types, and measures. Front Psychol. 2015;6:428. pmid:25926805
- 58. Eder J. Films and existential feelings. Projections. 2016;10(2):75–103.
- 59. Hanich J, Wagner V, Shah M, Jacobsen T, Menninghaus W. Why we like to watch sad films: The pleasure of being moved in aesthetic experiences. Psychology of Aesthetics, Creativity, and the Arts. 2014;8(2):130.
- 60. Larsen JT, Green JD. Evidence for mixed feelings of happiness and sadness from brief moments in time. Cogn Emot. 2013;27(8):1469–77. pmid:23668305
- 61. Mehling WE, Acree M, Stewart A, Silas J, Jones A. The Multidimensional Assessment of Interoceptive Awareness, Version 2 (MAIA-2). PLoS One. 2018;13(12):e0208034. pmid:30513087
- 62. Bates D, Mächler M, Bolker B, Walker S. Fitting linear mixed-effects models using lme4. arXiv preprint. 2014.
- 63.
Lüdecke D. sjPlot: Data visualization for statistics in social science. R package version; 2018.
- 64. Berrios R, Totterdell P, Kellett S. Silver linings in the face of temptations: how mixed emotions promote self-control efforts in response to goal conflict. Motivation and Emotion. 2018;42:909–19.
- 65. Thompson MM, Zanna MP, Griffin DW. Let’s not be indifferent about (attitudinal) ambivalence. Attitude strength: Antecedents and consequences. 1995;4:361–86.
- 66. Gosling SD, Rentfrow PJ, Swann WB. A very brief measure of the Big-Five personality domains. Journal of Research in Personality. 2003;37(6):504–28.
- 67. Armitage CJ, Conner M. Attitudinal ambivalence: A test of three key hypotheses. Personality and Social Psychology Bulletin. 2000;26(11):1421–32.
- 68. Van Harreveld F, Rutjens BT, Rotteveel M, Nordgren LF, Van Der Pligt J. Ambivalence and decisional conflict as a cause of psychological discomfort: Feeling tense before jumping off the fence. Journal of Experimental Social Psychology. 2009;45(1):167–73.
- 69. Robinson MD, Irvin RL, Persich MR, Krishnakumar S. Bipolar or Independent? Relations Between Positive and Negative Affect Vary by Emotional Intelligence. Affect Sci. 2020;1(4):225–36. pmid:36042817
- 70. Schindler I, Wagner V, Jacobsen T, Menninghaus W. Lay conceptions of “being moved”(“bewegt sein”) include a joyful and a sad type: implications for theory and research. Plos one. 2022;17(10):e0276808.
- 71. Charles ST, Piazza JR, Urban EJ. Mixed Emotions Across Adulthood: When, Where, and Why?. Curr Opin Behav Sci. 2017;15:58–61. pmid:29085868
- 72. Kreibig SD, Gross JJ. Understanding Mixed Emotions: Paradigms and Measures. Curr Opin Behav Sci. 2017;15:62–71. pmid:28804752
- 73. Extremera N, Durán A, Rey L. The moderating effect of trait meta-mood and perceived stress on life satisfaction. Personality and Individual Differences. 2009;47(2):116–21.
- 74. Extremera N, Fernández-Berrocal P. Perceived emotional intelligence and life satisfaction: Predictive and incremental validity using the Trait Meta-Mood Scale. Personality and Individual Differences. 2005;39(5):937–48.
- 75. Ramos NS, Fernandez-Berrocal P, Extremera N. Perceived emotional intelligence facilitates cognitive-emotional processes of adaptation to an acute stressor. Cognition and Emotion. 2007;21(4):758–72.
- 76.
Sedikides C, Wildschut T. Nostalgia: a bittersweet emotion that confers psychological health benefits . In: The Wiley handbook of positive clinical psychology;2016. pp. 125–36.
- 77. Berrios R, Totterdell P, Kellett S. Individual differences in mixed emotions moderate the negative consequences of goal conflict on life purpose. Personality and Individual Differences. 2017;110:18–22.
- 78. Newman DB, Sachs ME. Variation in bittersweet nostalgic feelings and their divergent effects on daily well-being. Emotion. 2022.
- 79. Newman DB, Sachs ME, Stone AA, Schwarz N. Nostalgia and well-being in daily life: An ecological validity perspective. Journal of Personality and Social Psychology. 2019.
- 80. Scheibe S, Blanchard-Fields F, Wiest M, Freund AM. Is longing only for Germans? A cross-cultural comparison of Sehnsucht in Germany and the United States. Dev Psychol. 2011;47(3):603–18. pmid:21219068
- 81. Tormala ZL, Rucker DD. Attitude certainty: A review of past findings and emerging perspectives. Social and Personality Psychology Compass. 2007;1(1):469–92.
- 82.
Moore MM. Mixed emotions: Advances in theory and methods. UC Irvine; 2021.
- 83. Zheng W, Yu A, Li D, Fang P, Peng K. Cultural Differences in Mixed Emotions: The Role of Dialectical Thinking. Front Psychol. 2021;11:538793. pmid:33505326
- 84. Schneider S, Stone AA. Mixed emotions across the adult life span in the United States. Psychol Aging. 2015;30(2):369–82. pmid:25894487
- 85. An S, Ji L-J, Marks M, Zhang Z. Two Sides of Emotion: Exploring Positivity and Negativity in Six Basic Emotions across Cultures. Front Psychol. 2017;8:610. pmid:28473791
- 86. Miyamoto Y, Uchida Y, Ellsworth PC. Culture and mixed emotions: co-occurrence of positive and negative emotions in Japan and the United States. Emotion. 2010;10(3):404–15. pmid:20515228
- 87. Williams P, Aaker JL. Can mixed emotions peacefully coexist?. Journal of Consumer Research. 2002;28(4):636–49.
- 88. Haddock G, Foad C, Windsor-Shellard B, Dummel S, Adarves-Yorno I. On the Attitudinal Consequences of Being Mindful: Links Between Mindfulness and Attitudinal Ambivalence. Pers Soc Psychol Bull. 2017;43(4):439–52. pmid:28903656
- 89. Norris CJ, Larsen JT. Feeling good and bad about nothing at all: Evidence that the status quo can elicit mixed feelings. Emotion. 2020;20(6):1104–8. pmid:30896205
- 90. Mejía ST, Hooker K. Mixed Emotions Within the Context of Goal Pursuit. Curr Opin Behav Sci. 2017;15:46–50. pmid:29201977
- 91. Ersner-Hershfield H, Mikels JA, Sullivan SJ, Carstensen LL. Poignancy: mixed emotional experience in the face of meaningful endings. J Pers Soc Psychol. 2008;94(1):158–67. pmid:18179325
- 92. Shirai M, Kimura T. Degree of Meaningfulness of an Event’s Ending Can Modulate Mixed Emotional Experiences Among Japanese Undergraduates. Percept Mot Skills. 2022;129(4):1137–50. pmid:35510361
- 93. Berrios R, Totterdell P, Kellett S. Investigating goal conflict as a source of mixed emotions. Cogn Emot. 2015;29(4):755–63. pmid:25040183
- 94. Schwarz N. Cognitive aspects of survey methodology. Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition. 2007;21(2):277–87.