Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Multimodal prediction of trait emotional intelligence–Through affective changes measured using non-contact based physiological measures

  • Vrinda Prajapati ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    vrinda.twinkling@gmail.com

    Affiliation Advanced Technology Development Centre, Indian Institute of Technology Kharagpur, Kharagpur, West Bengal, India

  • Rajlakshmi Guha,

    Roles Conceptualization, Methodology, Supervision, Writing – review & editing

    Affiliation Centre for Education Technology, Indian Institute of Technology Kharagpur, Kharagpur, West Bengal, India

  • Aurobinda Routray

    Roles Conceptualization, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Department of Electrical Engineering, Indian Institute of Technology Kharagpur, Kharagpur, West Bengal, India

Abstract

Inability to efficiently deal with emotionally laden situations, often leads to poor interpersonal interactions. This adversely affects the individual’s psychological functioning. A higher trait emotional intelligence (EI) is not only associated with psychological wellbeing, educational attainment, and job-related success, but also with willingness to seek professional and non-professional help for personal-emotional problems, depression and suicidal ideation. Thus, it is important to identify low (EI) individuals who are more prone to mental health problems than their high EI counterparts, and give them the appropriate EI training, which will aid in preventing the onset of various mood related disorders. Since people may be unaware of their level of EI/emotional skills or may tend to fake responses in self-report questionnaires in high stake situations, a system that assesses EI using physiological measures can prove affective. We present a multimodal method for detecting the level of trait Emotional intelligence using non-contact based autonomic sensors. To our knowledge, this is the first work to predict emotional intelligence level from physiological/autonomic (cardiac and respiratory) response patterns to emotions. Trait EI of 50 users was measured using Schutte Self Report Emotional Intelligence Test (SSEIT) along with their cardiovascular and respiratory data, which was recorded using FMCW radar sensor both at baseline and while viewing affective movie clips. We first examine relationships between users’ Trait EI scores and autonomic response and reactivity to the clips. Our analysis suggests a significant relationship between EI and autonomic response and reactivity. We finally attempt binary EI level detection using linear SVM. We also attempt to classify each sub factor of EI, namely–perception of emotion, managing own emotions, managing other’s emotions, and utilization of emotions. The proposed method achieves an EI classification accuracy of 84%, while accuracies ranging from 58 to 76% is achieved for recognition of the sub factors. This is the first step towards identifying EI of an individual purely through physiological responses. Limitation and future directions are discussed.

Introduction

Emotions help in optimizing adaptation but are not always helpful and become dysfunctional when the wrong type of emotions are perceived and expressed at the wrong time or at the wrong intensity level, thus requiring efficient emotion regulation [1]. Inability to efficiently handle emotionally laden situations, leads to affect related problems in the long run. Mental health problems have their peak onset during young adulthood; they are prevalent in college students with the most common ones being substance abuse, anxiety, depression and other mood disorders. This may be because college corresponds to a challenging time as many students may face stressful experiences for the first time such as working, being in a significant relationship, and dealing with cultural differences [25]. Seventy five percent of those who will have a mental health disorder have had their first onset by the age of 25 years [6]. Regardless, there is inadequate treatment and lack of acknowledgment of mental health symptoms due to fear of personal stigma, denial (not perceiving treatment as urgent or essential), and lack of time, leading to persistence of these problems [7].

It has been found that people with higher levels of emotional intelligence are not only less prone to mental health problems but also typically achieve more positive life outcomes, such as psychological wellbeing, educational attainment, and job-related success. When faced with a stressful situation, emotionally intelligent individuals show a more adaptive response than those with low EI, such as reduced reactivity (less mood deterioration, less physiological arousal), and faster recovery once the threat has passed. EI is associated with better stress management, lower levels of psychological distress, higher resilience to peer pressure in connection to risky behaviour, less prone to substance abuse, and lower risk of mood disorders [810]. EI has also been found to reliably predict important outcomes like depression in adults [11]. In addition to better mental health, high EI is also associated with better physical health, career adaptability, decision making, job performance, job satisfaction, better quality of life [12, 13].

As Dr. Robert Tett reported “EI can be assessed in a number of ways. A great way would be to have people face real or simulated situations that are emotionally charged and then just see how they react. E.g. Do they recognize their feelings, and can they describe them in words? Are their reactions appropriate in meeting the demands of a situation, or are they counterproductive? Do they react off-the-cuff? Do they show concern for others? How do they show that concern? And so forth” [14]. Which is precisely the goal of this work, to predict EI level of an individual based on his/her physiological responses to emotionally charged situations.

Rationale

Most importantly, higher EI has been found to be associated with willingness to seek professional and non-professional help for personal-emotional problems, depression and suicidal ideation [8]. Thus this makes it necessary to find out the low EI individuals and approach them to help them increase their EI and deal with emotions better. The problem of low treatment seeking in low EI college students may be addressed by the use of technology. Web based methods to screen college students for mood disorders have been found to increase the rate of help-seeking behaviour among at-risk students [2]. It has been found that although the self-report measures of EI have high validity and reliability, individuals tend to fake their responses in high stake situations, which varies as a function of degree of how important the consequences of test results could be expected to be, more high-stakes situations being associated with more faking [15]. If there is no subsequent consequence of responding to a psychological assessment questionnaire, the participant is likely to respond honestly, on the other hand, fake responses are likely if the consequence may be adverse, like losing a job or making a therapist appointment. Sometimes individuals may be unaware of their level of emotional skills due to which their responses to a self-report questionnaire may be biased and they will be less likely to identify and internalise feedback from others concerning their negative EI performance. This highlights the importance of developing systems that assesses, mood related and other problems through physiological measures, which are objective, unbiased and cannot be faked.

Significant research is being conducted on detecting anxiety [16], depression [17] and other mental health related issue through physiological measures [18, 19]. But in addition to that it would be beneficial to screen individuals for their emotional intelligence as well. Why should we wait till the onset of a mental health problem? Healthy students having low EI are more prone to mental health problems than their high EI counterparts, identifying low EI individuals and giving them the appropriate EI training will aid in preventing the onset itself [811].

Emotions

Emotion is a psycho-physiological process triggered by conscious and or unconscious perception of an object or situation and is accompanied by various affective states giving rise to a set of physiological responses [20]. There is disagreement regarding how emotions are represented in the brain: either as discrete categories (happiness, sadness, disgust etc) or as points in a continuous dimensional space (valence and arousal). Although both the models posit that, processes mediated by the central nervous system give rise to the emotional states but their emergence is characterized via different mechanisms [21]. Even though people categorise their emotional experiences into discrete categories empirical evidence suggests that what exists in brain and body is affect which is continuous and emotions are constructed by multiple brain networks working together. Affect is defined as the underlying experience or sense of feeling, ranging from unpleasant to pleasant (valence), and from agitated to calm (arousal). Emotion is a much more complex mental construction [22]. As stated in the theory of constructed emotion “In every waking moment, your brain uses past experience, organized as concepts, to guide your actions and give your sensations meaning. When the concepts involved are emotion concepts, your brain constructs instances of emotion” [22]. Along with concepts, your interoceptive predictions provide information regarding the internal state of the body and produces basic affective feelings of pleasure, displeasure, arousal and calmness. The individual gives a name to these affective experiences based on the factors mentioned above [2227].

A recent study showed that though results from neurological studies are supporting the notion that emotions are categorically organized response patterns, given the broad array of emotions considerable information beyond valence and arousal is required to differentiate emotional states [21]. We therefore used videos targeting discrete emotional states (joy, disgust, sadness, anger, and fear) for emotion elicitation, [21]. Since people experience an emotion when they conceptualize an instance of affective feeling, an emotional stimulus say, of fear will not produce the same sensations in everyone’s body, and will thus produce different experiences [23]. One of the factors that could lead to individual differences in affective experience is emotional intelligence [28].

Measuring emotions

The most frequently used methods to assess emotional state of an individual are through self-report questionnaires and recording respondent’s physiological responses to stimuli which indicate activation of the autonomic nervous system. Despite significant research on the measurement characteristics of emotion self-reports and physiological measures, there is still doubt regarding the degree to which these 2 measures converge [29, 30]. Various researchers have found that self-report and physiological measures of emotion do not correlate implying that there may be important differences between the factors that drive responses to emotion self-reports and those that drive physiological reactions [31, 32]. Though physiological reactions occur prior to self-reports and possibly guide self-report, other factors like the tendency to engage in a socially desirable responding, ability to regulate their emotions, and lack of emotional self-awareness may influence the responses [29, 33]. In this study we also observe how EI affects emotional experience both physiologically and in self-report feedback form.

Autonomic nervous system (ANS)

All aspects of emotion, whether it is generation, expression, experience, or recognition of emotion lead to ANS [34]. In addition to affective processes, ANS mediates patterns of brain activation in physiological, cognitive and behavioural processes as well [35]. The complex interplay between CNS and ANS and between the sympathetic and parasympathetic subsystems is modulated by descending, ascending, and bidirectional neural connections which can be described by a functional integrated model called the Central Autonomic Network (CAN). Through this model/system, the brain directly/indirectly controls visceromotor, neuroendocrine, and behavioural responses that are critical for goal-directed behaviour, adaptability, and health and also regulates for homeostasis, facilitates short-term deviations from homeostasis by allocating resources to cope with new tasks, and coordinates the continuous bidirectional flow of information [35]. The primary output of CAN is mediated by sympathetic and parasympathetic neurons which at the sino atrial node produce the complex beat to beat variability that characterises the heart rate time series. HRV is directly related to the output from CAN [36].

ANS is an extremely dynamic system, and the major organ systems innervated by it are–cardiovascular, respiratory and electro dermal systems, and changes in their functioning reflect activation levels of SNS (sympathetic nervous system) and PNS (Parasympathetic nervous system). An event occurrence typically causes a change in the cyclical functioning of the cardiovascular and respiratory systems; also the responses of these 2 systems can be measured using non-contact based sensors, thus in this work we will measure the psychophysiological response patterns to emotion using cardiovascular and respiratory parameters [37].

Cardiovascular activity.

The ease with which an individual can transition between various arousal states is dependent on the ability of the ANS to rapidly vary heart rate (HR) which is reflected as heart rate variability (HRV) and acts as an indicator for autonomic flexibility and emotion regulation (ER) capacity [38]. HRV at rest indicates the ER capacity of an individual which is a major component of EI and, a lower resting state HRV is associated with greater difficulties with emotion regulation [39, 40]. HRV is the beat to beat variability and can be calculated using both time domain and frequency domain measures. Most commonly used time domain measures for short term recordings are RMSSD and SDNN which indicate high frequency variations/ vagal modulation and overall variability respectively. In the study of emotions and autonomic responses special attention has been given to heart rate variability due to tonic parasympathetic influence emanating from the Vagal nerve as it is responsive to environmental demands and underlies the ability to regulate emotions and respond adaptively to emotional provocation [41].

Respiratory activity.

Respiratory patterns vary with valence and arousal of emotion [42] and reflect the dimension of emotional response that is linked to response requirements of the emotional situations. The breathing cycle can be characterized by tidal volume (Vt) (i.e. the volume that is displaced during one breath), duration of inspiration (Ti), duration of expiration (Te), and total cycle duration (Ttot), and is regulated mainly by a central inspiratory drive mechanism, which determines the intensity of the inspiratory stimulus, and a periodic rhythm generator which cyclically switches the drive mechanism on and off. An increase in inspiratory drive primarily increases Vt/Ti (the mean inspiratory flow rate), respiratory minute volume (Vmv). Although rhythm generator is a main determinant of duration of inspiratory phase, but if Vt increases greatly rhythm generator is overruled and termination of inspiration is brought about by an afferent vagal reflex, that is triggered by the stretch receptors in the lungs. Expiration duration is primarily a function of the degree of filling of the lungs during the previous inspiration, and of the resistance that the outflow of air encounters, and thus may be regarded as a passive process [43].

Emotional intelligence

Emotional intelligence (EI) is the ability, capacity, or skill to identify, assess, and manage the emotions of one’s self, of others and of groups [44]. It’s the juncture at which cognition and emotion meet, and facilitates our capacity for resilience, motivation, empathy, reasoning, stress management, communication, and our ability to read and navigate a plethora of social situations and conflicts [45]. Emotional intelligence refers adaptive emotional functioning. Meta analytic studies have found that higher emotional intelligence is associated with a variety of better outcomes, including employment and academic performance, and better mental and physical health [46].

History of EI.

EI emerged as a major psychological construct in 1990 when Salovey and Mayer defined it as “the ability to monitor one’s own and others’ feelings and emotions, to discriminate among them and to use this information to guide one’s thinking and actions” [47]. It gained popularity when Daniel Goleman published the book ―Emotional Intelligence: Why It can Matter More than IQ [4850].

Later, Mayer and Salovey considered EI as a form of pure intelligence and argued that it is best conceived as ability and assessed through performance tests that assess maximum performance [46]. But realising the drawbacks associated with the objective nature of questions in performance based/ability EI test, various researchers started utilizing self-report questions that assessed behavioural tendencies [51, 52]. Other measures of EI were developed that started incorporating additional factors that would fall under a broader definition of EI along with the typical EI facets [47]. Reuven Bar-On conceptualised EI as an array of non-cognitive capabilities, competencies, and skills that influence one’s ability to succeed in coping with environmental demands and pressures [4850, 53] Petrides and Furnham posited that emotional intelligence can be conceptualized as a trait or as typical functioning, situated between the upper and lower extremes of personality hierarchies.

Types of EI.

EI types can be differentiated on the basis of model or measurement technique. The ability, trait and mixed models of EI differ in what elements they consider constitute EI. When considering measurement technique EI can be divided into ability and trait EI, which differ in method used to measure the construct (questionnaire or performance based) and not on the facets that the various models encompass. In short, distinction between EI measures is unrelated to the distinction between EI models [54]. While ability EI is objective and performance based, a trait approach to assessing emotional intelligence draws on self or other’s reports to gather information regarding the display of emotional intelligence characteristics in daily life [55, 56]. Ability EI is assessed via performance tests and captures what an individual is capable of doing in an emotional situation measured via maximum performance tests. The problem with this approach is that it uses scoring procedures like “consensus” and “expert scoring” to create correct responses among a number of equally logical alternatives leading to various problems repeatedly noted in literature. It is unclear whether the scores reflect confounding with vocabulary size, conformity to social norms, theoretical knowledge about emotions, stereotypical judgements or some other factors [57].

Trait EI focuses on emotion related dispositions and affect related aspects of personality and captures how much of this knowledge/competence translates into practice [58]. Trait EI theory recognises the inherent subjectivity of emotional experience and maintains that certain profiles will be advantageous in some contexts but not in others [57]. Trait EI is currently measured only using self-report questionnaires or via interview with psychologists.

Measures of EI.

According to the original four-branch model of emotional intelligence [59] by Salovey and Mayer, EI consists of the interrelated functions of (a) accurately perceiving emotion in the self and others; (b) using emotion to assist thinking, including decision making; (c) understanding emotion in the self and others; and (d) effectively managing emotion in the self and others. Researchers have pointed out that both ability and trait conceptualization share value and can be complimentary [46, 60] Moreover both these concepts can fit within this four-branch model of emotional intelligence and are important dimensions of adaptive emotional functioning [55]. An individual may have, for example, the ability to assist others regulate emotions (measured through ability measures), but not typically use this ability (measured through trait measures) for motivational or other reasons.

Some of the widely used trait EI measures include TEIque, SSEIT, EQi. Most of these measures based on the different models of EI incorporate additional emotion related facets, competencies and create combinations of personality traits that are particularly effective in situations with emotional and social implications [61]. But fundamentally digress from the core concept of EI, staying in the personality domain and the term ‘trait’ in trait EI became associated with personality and not just as a measurement technique difference [62, 63].

Physiological correlates of EI.

Various affective studies have attempted to investigate the association between Emotional intelligence and physiological emotional response. High trait EI individuals have been found to use adaptive strategies to down regulate negative emotions like stress, anger, sadness, fear, jealousy and shame; and to maintain positive ones like joy [58]. Emotionally Intelligent individuals use adaptive attention processing patterns and have higher emotional attention regulation, as they pay more attention to positive emotional stimuli relative to negative and neutral stimuli [64, 65]. They have reduced HPA (hypothalamic–pituitary–adrenal) axis reactivity, which buffers the effect of stress by lowering the increase in heart rate in response to stress [66, 67], and greater grey matter volume and density in ventromedial prefrontal cortex (vmPFC) which is responsible for emotional processing [68] With respect to functional correlates, trait EI is associated with neurological activity in both resting and active/emotionally laden conditions with higher trait EI individuals showing greater resting left frontal activation [69].

Our work

This work builds on and examines the influence of level of EI (measured using SSEIT) on emotional autonomic response patterns, namely cardiovascular and respiratory measures, and can be divided into 2 parts. We first conduct an experiment to understand the relation between autonomic (cardiac and respiratory) responses and reactivity to emotion elicitation with the level of EI using cardiovascular and respiratory measures. The reactivity is measured as the change in the autonomic parameters from baseline to emotion elicitation. An increase and decrease in these parameters is referred to as activation and withdrawal respectively. Secondly, we build a model to predict EI level of an individual using these measures. More specifically the data collected during first study is used to classify user’s EI level (high or low), with the time domain cardiac and respiratory parameters indicating response, and the difference in these parameters from baseline to emotional state indicating reactivity, observed while viewing film clips of 5 basic emotions (joy, disgust, sadness, anger, and fear). We designed a study with movie scenes as they have been found to be one of the most effective method of mood induction as they can generate a dynamic context using stimuli that are similar to those in real life, and without the ethical problem that arise when manipulating emotions, [70] can elicit discrete emotions and is also very effective in prolonged maintenance of both subjective and physiological changes in emotion [71, 72]. Also the data is recorded using commercial sensors to ensure ecological validity and scalability of the employed framework for large scale profiling applications. To our knowledge, this is the first work to connect EI and emotional physiological responses using a machine learning approach. Screening individuals for their level of emotional intelligence, will not only aid in identifying low EI individuals with depression anxiety etc. as all these constructs are related, but will also help in finding individuals who are at risk of developing mood disorders due to low EI (which hinders their ability to handle everyday emotional situations) and provide them with appropriate training and guidance.

Materials and methods

Participants

Fifty one college students (Mage = 25.15, SD age = 2.97, 22 females) participated in the study. Exclusion criteria included any ongoing physical or mental health problems and or use of medications, alcohol or caffeine (on the day of the experiment). Healthy participants who had proper sleep the previous night, had timely breakfast and lunch, were not experiencing any physical or mental discomfort such as headache, nausea, cough and cold, low mood or pain in any part of the body were included in the study. The subject sample consisted of young adults in the age range 18 to 30 and with near equal number of males and females. The experiment was conducted at the same time every day between 4:00 pm to 6:00 pm. The sample size of 51 was decided on the basis of power analysis by G*Power software with α: 0.05 and β: 0.80 [73]. All the participants signed an informed consent form before taking part in the study, and were also informed that they had the right to quit the experiment at any time. They were debriefed about the purpose of the study at the end of the experiment. The experimental procedure and the video content shown to the participants were approved by the Institutional Ethics Committee (IEC) of IIT Kharagpur.

Measures

Physiological measures–FMCW radar sensor.

Electromagnetic radars have shown potential to be used for remote sensing of bio signals such as breathing and heartbeat signals in a more easy and comfortable way than contact based and wearable devices [74, 75]. Currently 3 main types of radar systems for vital signs monitoring are available—pulse radar (ultra-wide band radar), continuous wave (CW) Doppler radar, and frequency modulated continuous wave (FMCW) radar [75]. Compared to CW and pulse radars, the FMCW radar has a higher range and speed resolution, and its ability to distinguish multiple targets and extract target fretting information, makes it a mainstream choice in the field of life detection, [75] also mm-wave frequencies give high-resolution sensing of displacements in an environment in the order of sub-mm changes [76]. Therefore this paper uses Texas Instruments (TI) mm-wave FMCW radars which have shown to measure respiration and heart signals with high accuracy which is comparable to traditional contact based sensors (93% when compared to contact based sensors like airflow sensor, and smart bracelet Mi 3; and >80% when compared to ECG) [7476]. The physiological data was recorded using the FMCW radar sensor, mmWave TI sensor (AWR1642). AWR1642 Boost is a single chip automotive radar sensor with built in micro controller using FMCW technology. It is a high frequency module working in 76 GHz to 81 GHz band. This module has two transmitter and four receiver antennas for the data collection. It is a real-time millimetre-wave radar-based, non-contact vital sign monitoring system that is capable of detecting the heart and breath waveform and has a sampling rate of 20 frames per second. It provides high accuracy in the range of 0.6 to 1 m [77]. It has a built in DSP and ARM processor for post processing and gives accurate heartbeat waveforms and respiratory waveforms. During experiment the sensor was kept inside a black box.

The FMCW radar sensor includes the radio frequency (RF) transmit (TX) and receive (RX), analog clocking, and digital circuit—analog-to-digital converters (ADCs), microcontrollers (MCUs), and digital signal processors (DSPs). It sends a linear FMCW signal generated by the synthesizer. The radar signal gets reflected when it encounters an object. Then, the orthogonal receiver is responsible for capturing the echo signal and orthogonally mixing it with the transmitted signal. A low-pass filter is used to filter out the high frequency part and obtain the IF signal. Finally, the IF signal is sampled by an ADC [75]. The heart waveform is later analysed and parameters such as heart rate (HR) and heart rate variability (RMSSD) were extracted by the standardised methods [78] using MATLAB. Similarly respiratory waveform was analysed to obtain parameters such as inspiration time (Ti), expiration time (Te), total breath time (Ttot), and tidal volume (Vt). Thermal facial videos were also recorded, but that data has not been included in the current study. A diagram of the experimental setup showing where the sensors were placed is shown in Fig 1 below.

Psychological measures–SSEIT and Feedback form.

1. SSEIT (Schutte Self report Emotional Intelligence Test). Trait EI was measured using the Schutte Self Report Emotional Intelligence Test (SSEIT). It is a self-report TEI scale which consists of 4 factors—perception of emotion, managing own emotions, managing other’s emotions, and utilization of emotion. It is a 33-item self-report inventory in which the respondents rate themselves using a 5-point scale. This scale was chosen as it has been found to be distinct from standard personality factors [28].

The 4 subscales for the 4 factor structure of this scale is the most widely used structure and is based on the factor analtic studies by Petrides and Furnham [79], Ciarrorchi [28], and Saklofske et al. Some studies argued against the internal consistency of ‘utilization od emotion’ subscale, suggesting the use of a 3 factor model instead [55]. But a recent study revealed evidence for the usefulness of SSEIT and its 4 subscales for measuring EI and its subfcators respectively [59]. Psychometric properties of the scale are given below:

  1. Internal consistency: Various studies found the internal consisitency of the scale to be .87. Based on the responses from university students, the internal consisitency for the subscales was found to be Perception of Emotion, .80; Managing Own Emotions, .78; Managing Others’ Emotions, .66; and Utilisation of Emotion, .55 (the alpha for this sub scale was not reported) [55].
  2. Test retest reliability: A two-week test–retest reliability of .78 was found for the total scale scores [55].
  3. Validity: Significant convergent and divergent validity has been found for this scale through multiple studies [55].

2. Feedback form. Emotional Experience Feedback form was given at the end of each emotion eliciting video, in which the respondent had to rate how emotional he/she felt while watching the video (intensity) and also the valence and arousal they experienced. The ratings ranged from 1 to 5, with 1 indicating not at all and 5 indicating extremely.

Rationale behind choosing SSEIT.

While aiming to develop a physiological measure of EI we decided to go with a measure based on the original framework of EI [62] which covers all the important facets of EI and at the same time captures the subjective nature of emotions. SSEIT attempts to assess characteristic, or trait, emotional intelligence and is based on Salovey and Mayer’s (1990)original model [54, 55] Although it was designed to measure overall EI, it performs better as a multidimensional scale measuring 4 distinct factors including optimism/mood regulation (regulation of emotions in self), appraisal of emotions (perception of emotion), social skills (regulating emotions in others) and utilization of emotions (strategically utilizing emotions) which has been confirmed [51, 80].

The scale may be used to help individuals who are at risk for performing poorly at tasks that require emotional intelligence, (as in establishing themselves in a new setting such as a college). The finding that emotional intelligence scale scores predicted first-year college grades suggests the ability of the scale to help identify these individuals. Once identified, these at-risk individuals might benefit from special guidance, training or support [52]. The scale has also been found to be distinct from standard personality factors [28].

Moreover, the explanatory models of personality that view surface dimension of personality have a distal basis in emotion control. Meaning, that an individual’s personality is based on how he/ she handles emotions [81] Thus we decided to use a measure of EI which stems from the original EI model and not from the personality model. Also despite the correlations found with some personality factors, the SSEIT has been found to be distinct from personality [10].

Procedure

An overview of our EI prediction framework is presented in Fig 2 below. To study the EI-Affect relationship we performed a study where user’s physiological responses were recorded first at baseline and then as they viewed 5 affective film clips chosen from standardized databases. Explicit feedback in the form of intensity, valence and arousal of emotion experienced was obtained after they viewed each movie clip. User’s EI measures were compiled using Schutte Self Report Emotional Intelligence Test (SSEIT).

One Monitor with webcam and a FMCW radar sensor was used for the experiment. Thermal camera was also used to record facial thermal videos of the participant’s but that data has not been included in this paper. Following an informed consent form, and SSEIT questionnaire, the user was asked to sit in front of the monitor, wear headphones and click a start button on the screen which simultaneously started a video clip (neutral video followed by the film clip), the webcam and the FMCW sensor.

Each user performed the experiment in 5 sessions, one session for each emotion lasting about 5 minutes occurring on separate days. Each emotional film clip was preceded by a 1 minute neutral video of cattle grazing on a farm to bring the participants to a baseline state. The physiological recordings done during this period served as baseline. The physiological parameters taken while watching the emotional videos served as the emotional response and the difference in parameters from baseline to emotional response served as emotional reactivity. On viewing each clip users provided their feedback affective ratings.

Stimuli: We adopted 5 movie clips from earlier studies (such as The Emotional Movie Database [82], Emotion Elicitation Using Films [83], and The Indian Spontaneous Expression Database for Emotion Recognition [84]) for our study. These clips are between 1–5 minutes long and have shown to efficiently induce the intended emotions in the user. Some videos were found to elicit multiple emotions, which were rejected as they may lead to a mixed emotional expression. The final clips used are mentioned in Fig 3.

Physiological feature extraction

The heart beat waveform obtained was filtered using the Savitzky-Golay filter for noise and random body movement’s artefacts reduction and the SNR enhancement without distorting the heartbeat signal. R peaks were detected to obtain the RR intervals from which time domain features namely RMSSD (Root mean square of successive differences), and HR (Heart rate) were extracted for the overall trial (cardiac autonomic response) and the difference in RMSSD and HR from baseline to emotional state (cardiac autonomic reactivity) was also calculated. HRV at baseline was also taken as it is an objective indicator of emotion regulation capacity [40]. Respiratory waveform was first smoothed, followed by peak and valley detection for inspiration and expiration respectively. Four parameters were then calculated–Inspiration time (time from each expiration valley to the next inspiration peak), Expiration Time (Time from each Inspiration peak to the next expiration valley), Tidal Volume (height of waveform for each breathing cycle), and Total breath time (time of each breath cycle). Similar to cardiac reactivity, respiratory reactivity was also measured as difference in the four parameters from baseline to emotional state. Both cardiac and respiratory reactivity are represented with Δ. In total 6 features were obtained for baseline and for each emotion elicitation.

Statistical analysis

All the data was screened for potential outliers and missing values. There was no missing data or outliers. Inspection of skew, kurtosis, and histograms for the variables indicated the presence of reasonably normal distributions among variables. One sampled t–test was conducted on the feedback form ratings to see if they were significantly different from 0 for all the emotion elicitations. One way ANOVA was used on all the variables (EI scores, physiological response and reactivity and emotion feedback scores) to find out if there were any significant gender differences. In order to study the association between EI scores and autonomic (cardiac and respiratory) response and reactivity, bivariate correlations were performed between SSEIT scores and autonomic responses at baseline, and autonomic response and reactivity to the 5 emotions. All the statistical analysis was performed using SPSS software.

SVM classifier

Machine learning systems are systems that learn from known data, called training phase, and return a model that can be used to map/classify unknown input data into a category [85]. Various classifiers like Decision trees, K-nearest neighbours, SVM use different decision algorithms for these classification tasks, we chose to use SVM, as they have proven to be highly effective in various studies of affective computing, and efficiently maintain sufficient flexibility with regard to their internal main parameter optimization [86, 87].

A support vector machine classifies binary classes by finding and using a class boundary, the hyper plane, maximizing the margin in the given training data. The training data samples along the hyper planes near the class boundary are called support vectors, and the margin is the distance between the support vectors and the class boundary hyperplanes. The SVM are based on the concept of decision planes (that separates between assets of objects having different class memberships) that define decision boundaries. SVM makes the decision boundary in such a way that the separation between the 2 classes is as wide as possible.

Results

Since the data was assuming normality we used parametric tests for our statistical analysis. Subjects were asked to rate the extent to which they felt the intended emotion on a 5 point scale (1: not at all, 5: extremely) immediately after the video got over. Feedback form ratings indicated that the intended emotion was successfully induced with varying intensity. One sampled t–test showed that the ratings were significantly different from 0 for all the emotion elicitations, Table 1 below present’s descriptive statistics for the EI scores and feedback form ratings.

thumbnail
Table 1. Descriptive statistics for SSEIT scores and feedback form rating.

https://doi.org/10.1371/journal.pone.0254335.t001

Gender differences

One way ANOVA was used to observe any significant gender differences regarding (Table 2) EI scores, physiological response and reactivity at (Table 3) baseline, (Table 4) joy, (Table 5) disgust, (Table 6) sadness, (Table 7) anger, (Table 8) fear, and (Table 9) emotion feedback scores.

thumbnail
Table 3. ANOVA for baseline cardiac and respiratory responses of males and females.

https://doi.org/10.1371/journal.pone.0254335.t003

thumbnail
Table 4. ANOVA for autonomic (cardiac and respiratory) response and reactivity during joy of males and females.

https://doi.org/10.1371/journal.pone.0254335.t004

thumbnail
Table 5. ANOVA for autonomic (cardiac and respiratory) response and reactivity during disgust of males and females.

https://doi.org/10.1371/journal.pone.0254335.t005

thumbnail
Table 6. ANOVA for autonomic (cardiac and respiratory) response and reactivity during sadness of males and females.

https://doi.org/10.1371/journal.pone.0254335.t006

thumbnail
Table 7. ANOVA for autonomic (cardiac and respiratory) response and reactivity during anger of males and females.

https://doi.org/10.1371/journal.pone.0254335.t007

thumbnail
Table 8. ANOVA for autonomic (cardiac and respiratory) response and reactivity during fear of males and females.

https://doi.org/10.1371/journal.pone.0254335.t008

thumbnail
Table 9. ANOVA for emotion feedback form rating for all emotions by males and females.

https://doi.org/10.1371/journal.pone.0254335.t009

The Bonferroni method was used to counteract the problem of multiple comparisons. Since there are total 71 variables, for the difference to be significant, the p value should be less than 0.05 / 71 i.e., 0.0007. Thus, no significant gender differences were found for any of the variables.

Association between EI, autonomic response and reactivity

Bivariate correlations were used to assess the relationship between, cardiac response, cardiac reactivity, respiratory response and respiratory reactivity, with Emotional intelligence and gender which are given below.

Cardiac response and EI.

The total EI score and all its sub- factors was associated with Baseline RMSSD. The total EI score along with the sub factors ‘perception of emotion’ and ‘managing own emotions’ showed a significant association with Disgust HR as well. Fig 4 below shows mean cardiac responses of high and low EI individuals (the EI scores were divided into 2 groups at the median–high and low EI) and Table 10 shows the Pearson correlations between them.

thumbnail
Fig 4. Mean cardiac response of high and low EI individuals.

https://doi.org/10.1371/journal.pone.0254335.g004

thumbnail
Table 10. Pearson correlation between cardiac response parameters and emotional intelligence scores.

https://doi.org/10.1371/journal.pone.0254335.t010

Cardiac reactivity and EI.

The total EI score was associated with Neutral RMSSD, Δ Disgust HR, Δ SAD RMSSD and Δ ANGER RMSSD. Of interest, EI score was not associated with cardiac response during joy. Sub-factors of EI–Perception of emotion, managing own emotions, managing other’s emotions, and utilization of emotions- also showed various significant correlations. All the sub factors were associated with Baseline RMSSD among others. Perception of emotion was associated with Δ Disgust HR, and Anger RMSSD. Managing other’s emotions showed association with Δ Disgust HR, Δ Sad RMSSD. Utilization of emotion was associated with Δ Joy RMSSD, and Δ Anger RMSSD. Surprisingly ‘Managing own emotions’ branch did not show any correlation with cardiac autonomic reactivity, nor did cardiac autonomic reactivity during fear show any correlation with EI scores. High EI individuals portrayed cardiac vagal withdrawal (RMSSD) during all 5 emotion elicitations while low EI individuals portrayed cardiac vagal activation during joy disgust and fear. Fig 5 below shows mean cardiac reactivity of high and low EI individuals and Table 11 shows the Pearson correlations between them.

thumbnail
Fig 5. Mean cardiac reactivity of high and low EI individuals.

https://doi.org/10.1371/journal.pone.0254335.g005

thumbnail
Table 11. Pearson correlations between cardiac reactivity parameters and emotional intelligence scores.

https://doi.org/10.1371/journal.pone.0254335.t011

Respiratory response and EI.

The tidal volume during sadness was associated with Total EI and sub factors ‘perception of emotion’ and ‘managing other’s emotions’. Perception of emotion was also associated with tidal volume at baseline. Finally ‘utilization of emotion’ showed a significant correlation with tidal volume during both anger and fear. Fig 6 below shows mean respiratory response of high and low EI individuals and Table 12 shows the Pearson correlations between them.

thumbnail
Fig 6. Mean respiratory response of high and low EI individuals.

https://doi.org/10.1371/journal.pone.0254335.g006

thumbnail
Table 12. Pearson correlations between cardiac reactivity parameters and emotional intelligence scores.

https://doi.org/10.1371/journal.pone.0254335.t012

Respiratory reactivity and EI.

The total EI score and ‘utilization of emotion’ showed association with Δ Anger Tidal volume, the latter also showed association with Δ Disgust Tidal Volume. Perception of emotion was correlated with Δ Joy Inspiration time. Fig 7 below shows mean respiratory reactivity of high and low EI individuals and Table 13 shows the Pearson correlations between them. High and low EI individual showed significantly different activation and withdrawal of respiratory response during each emotion. Higher EI showed a lower respiratory reactivity to joy. During disgust high EI showed an increase in expiration time while low EI showed a decrease. In sadness, anger, and fear higher EI showed a much greater increase in expiration time (and as a result total breath time) from baseline and a lower increase in inspiration time from baseline.

thumbnail
Fig 7. Mean respiratory reactivity of high and low EI individuals.

https://doi.org/10.1371/journal.pone.0254335.g007

thumbnail
Table 13. Pearson correlation between cardiac reactivity parameters and Emotional Intelligence scores.

https://doi.org/10.1371/journal.pone.0254335.t013

EI recognition results

For binary trait EI recognition, we first dichotomised the SSEIT scores based on the median. This resulted in an even distribution of high and low EI labels for the total EI score. We also checked whether the physiological response patterns to emotion could also predict each sub factor of EI, namely–Perception of Emotion, Managing own emotions, Managing other’s emotions, and Utilization of emotions which were also dichotomized based on their median. A 5 fold cross-validation scheme was used to compute the classification results and avoid over fitting. Different models were tested for predicting level of EI using different set of predictor variables to find out which set of autonomic predictors most efficiently predict level of EI. The set of predictor variables used for each model are: 1) Cardiac response, 2) Cardiac reactivity, 3) Cardiac response and reactivity, 4) Breath response, 5) Breath reactivity, 6) Breath response and reactivity, 7) Autonomic (cardiac + breath) response, 8) Autonomic reactivity, and 9) Autonomic response and reactivity. We also examined if applying PCA (with 99% variance) improved accuracy of the models. The model accuracies, before and after PCA, is shown in Figs 8 and 9 respectively. Table 14 presents the recognition results, with the best F1 scores achieved using each set of predictor variables denoted in bold.

thumbnail
Fig 8. Model accuracy with linear SVM for different sets of predictors.

1: Cardiac response; 2: Cardiac reactivity; 3: Cardiac response and reactivity; 4: Respiratory response; 5: Respiratory reactivity; 6: Respiratory response and reactivity; 7: Autonomic (cardiac + breath) response; 8: Autonomic reactivity; 9: Autonomic response and reactivity.

https://doi.org/10.1371/journal.pone.0254335.g008

thumbnail
Fig 9. Model accuracy with linear SVM and PCA for different sets of predictors.

1: Cardiac response; 2: Cardiac reactivity; 3: Cardiac response and reactivity; 4: Respiratory response; 5: Respiratory reactivity; 6: Respiratory response and reactivity; 7: Autonomic (cardiac + breath) response; 8: Autonomic reactivity; 9: Autonomic response and reactivity.

https://doi.org/10.1371/journal.pone.0254335.g009

From the recognition results we can provide following conclusions: Trait Emotional intelligence leads to changes in the physiological response to different emotions measured as autonomic response and reactivity to film clips. For total EI level recognition a better than chance recognition F1 score (>0.5) is achieved with all the 9 models after PCA. For the EI sub factor level recognition also, a better than chance recognition F1 score (>0.5) is achieved with all the 9 models after PCA except for prediction of ‘managing other’s emotions’ sub factor from ‘cardiac response and reactivity’.

Best F1 score for EI prediction is achieved from cardiac response and reactivity (0.85) with PCA. Considering the sub factors, highest F1 scores is achieved for ‘perception of emotion ability’ (0.80). For both total EI and EI sub factors prediction, highest Accuracy and F1 Score is achieved from cardiac parameters, except ‘utilization if emotion’ which was predicted best by autonomic (cardiac + breath) response and reactivity (F1 = 0.71).

Discussion and conclusion

In the current study, we first explored the relationship between trait EI and autonomic emotional response patterns and then examined the accuracy of the latter in predicting level of EI using linear SVM. To the best of our knowledge, only one study has been conducted for predicting EI using physiological measures, by IIT Delhi and IBM research group. They used standardised multiple choice questions as ground truth measure of EI which was indicated using audio signal parameters (like initial response time, pause time etc.) while responding to interview questions, and Watson personality insights tool which is a service on the IBM cloud that predicts personality characteristics, needs and values through written text [88]. Despite various studies examining EI and its association with emotional response, no work has been done on modelling trait EI based on emotional behaviour. We also explored gender differences regarding EI scores, autonomic emotional response patterns and emotion feedback rating for 5 basic emotion elicitations–joy, disgust, sadness, anger, and fear. No significant gender differences were found for any of the variables. Earlier studies have reported varying results regarding the difference in EI in males and females, ranging from women having relatively higher EI than men [89], among creative professionals men having higher EI than women [89], and among nursing students women reportedly having higher EI than men [90]. Research has shown that low EI males have lower parasympathetic and higher sympathetic activity at rest and are thus more prone to developing hypertension [91]. Two of the trait EI factors ‘perception of emotions’ and ‘managing own emotions’ have also shown significant correlation with cardiovascular measures of emotional arousal during sadness and cheerfulness in females [92]. Higher EI has also been found to be associated with higher cardiac autonomic flexibility [93]. Earlier studies have also shown that gender differences in emotional experience vary with the type of emotion, which have been found particularly strongly for anger and fear as men and women differ in how intensely they experience and inhibit these emotions [94]. Even though the difference was not statistically significant, it was observed that the average feedback form rating for all the emotions was higher in females than males (Table 9). A recent study similarly reported that while watching emotion eliciting videos, men have more intense emotional experience (physiological arousal evoked by external stimuli) and women have higher emotional expressivity (external expression of subjective experience including self-report) [95]. Since emotional experience and expressivity belong to different reaction systems, the inconsistency between them is understandable and has been previously observed by various researchers [9597].

The few studies done on the association between trait EI and physiological responses show inconsistent results, a recent work by Zysberg found no association between trait EI and the cardiac vagal regulation during self-induced sadness unlike what was observed in the meta-analysis recently done by Ainize et al. [98] Thus, it should be highlighted that there is a lack of research on the effects of TEI on biological variables, other than the few mentioned above, not much is known about the physiological correlates of trait EI [69]. After exploring gender differences, we invstigated the association between trait EI and autonomic response and reactivity to emotion eliciting videos. Emotional intelligence and emotion regulation are highly related frameworks. Emotional intelligent individuals are those who carefully review the context before deciding whether and how they should regulate their emotion, and are able to do so in a flexible adaptive manner [1]. High EI showed significant association with RMSSD at baseline indicating high emotion regulation capacity and autonomic flexibility, [40] which is in line with previous research as EI is associated with efficient handling of emotions personally and socially as low HRV at baseline is associated with difficulties in emotion regulation [39]. Maximum significant correlation were observed between Total EI score and all the physiological parameters followed by sub factor ‘perception of emotion’. Least correlation with the physiological parameters was observed with the sub factor ‘managing other’s emotions’ which may be due to lack of any measure pertaining specifically to social interaction. Participants with higher trait EI exhibited a cardiac vagal withdrawal indicated by decrease in RMSSD from baseline to emotional state. Consistent with previous studies, wherein higher EI individuals showed increased reactivity to emotion eliciting videos, [1] we found that high EI individuals had a greater increase in heart rate in response to all 5 emotions as compared to their low EI counterparts indicating higher emotional reactivity in high EI individuals. With respect to respiratory parameters, EI scores correlated mostly with Tidal volume. The significantly greater increase in expiration time by higher EI individuals during negative emotions (disgust, sadness, anger, and fear) shows the individual’s attempt to relax as increasing expiration time activates the parasympathetic nervous system putting the body in a state of rest and digest [99]. This result explains the increased subjective resistance to negative emotions and lower negative state affectivity of higher EI individuals [58, 66]. Emotion elicitation results in a modification in ANS activity due to emotional arousal and reactivity and a significant difference was observed in emotional reactivity of high and low EI individuals which explains how high EI individuals fundamentally differ from low EI individuals in how they handle various emotions. This is in line with previous research wherein an EEG study showed association between trait EI and frontal asymmetries indicating difference in emotional dispositions of high and low EI individuals [100]. Our results show that higher EI individuals experience all emotions to the fullest and also attempt to regulate them in order to maintain a balance. They do not suppress emotional experinece neither do they constantly regulate negative emotions. They are sensitive to affective cues and leave room for emotions to emerge [1].

For EI prediction an SVM machine learning algorithm was used along with PCA with 99% variance. For EI level prediction we achieved an F1 score of 0.85 and accuracy of 84% with cardiac response and reactivity. A better than chance F1 score (<0.5) and accuracy were also achieved for prediction of all the sub factors of EI. Highest accuracy and F1 scores for prediction of sub factors ‘perception of emotion’ (F1 = 0.80, Accuracy = 76%), and ‘managing own emotions’ (F1 = 0.70, Accuracy = 66%) was obtained using only cardiac reactivity as predictor. ‘Managing other’s emotions’ (before PCA, F1 = 0.69, Accuracy = 60%) and ‘Utilization of emotion’ (F1 = 0.71, Accuracy = 56%) were best predicted by autonomic reactivity, and autonomic response and reactivity respectively.

This work makes the following research contributions: (i) We studied gender differences with respect to EI score, physiological response and reactivity to various emotions and the emotional feedback form rating; (ii) We examined the association between trait EI and autonomic response and reactivity to five emotions–joy, disgust, sadness, anger and fear–which showed how an individual’s trait EI can plays a role in the way they physiologically respond to emotion elicitation; (iii) Emotional Intelligence has traditionally been assessed via the questionnaires, or by maximal performance tests. Differently we recognize the level of trait EI by examining psychophysiological emotional response patterns. It is the first step towards creating a physiological indicator of trait EI. The only other work in this domain is by Agarwal P. et al. [88] which used audio parameters along with a personality test to predict EI with an accuracy of 67%; and (iv) we use non-contact based, off-the-shelf sensors for physiological recordings and also the prediction model only uses physiological measures. This enhances the ecological validity of our work, and affirms its utility and promise for commercial applications. We have uploaded the dataset for future use.

Limitations and future directions

This study has various limitations that cannot be ignored. Firstly, as mentioned earlier a measure pertaining to social interaction needs to be included, to make the prediction more accurate. Other Trait EI measures should be taken into consideration for creating a more detailed model. This study was conducted on students of IIT Kharagpur, a more diverse sample size both with respect to age and location should be studied to observe any cultural or age-related differences. Overall further research needs to be conducted to gain better understanding of EI, emotions, affect, physiological response to emotions, and their association with one another. Lastly for cardiac measures only RMSSD was considered, other time domain and frequency domain parameters should be considered in future studies.

In future work, the model accuracy can be improved by adding parameters that measure specific facets of EI such as sociability, empathy etc. of an individual e.g., eye tracker data can be used to observe whether the individuals focus on faces or on inanimate objects on a given screen which has been shown to indicate social anxiety in an individual [101]. Also emotional repair after the emotional video ends could also be measured for a complete assessment of emotional response patterns of an individual. Several other machine learning models could also be applied for improving EI prediction performance. Future studies can also explore why emotional experience and expressivity differ from each other. Exploring the connection of EI with emotional experience, expressivity, and emotion regulation strategies will aid in developing a more accurate and reliable system for EI prediction.

References

  1. 1. Peña-Sarrionandia A, Mikolajczak M, Gross JJ. Integrating emotion regulation and emotional intelligence traditions: a meta-analysis. Frontiers in psychology. 2015 Feb 24;6:160. pmid:25759676
  2. 2. Pedrelli P, Nyer M, Yeung A, Zulauf C, Wilens T. College students: mental health problems and treatment considerations. Academic Psychiatry. 2015 Oct 1;39(5):503–11. pmid:25142250
  3. 3. Hunt J, Eisenberg D. Mental health problems and help-seeking behavior among college students. Journal of adolescent health. 2010 Jan 1;46(1):3–10. pmid:20123251
  4. 4. Sarkar S, Gupta R, Menon V. A systematic review of depression, anxiety, and stress among medical students in India. Journal of Mental Health and Human Behaviour. 2017 Jul 1;22(2):88.
  5. 5. Bhujade VM. Depression, anxiety and academic stress among college students: A brief review. Indian Journal of Health & Wellbeing. 2017 Jul 1;8(7).
  6. 6. Kessler RC, Amminger GP, Aguilar‐Gaxiola S, Alonso J, Lee S, Ustun TB. Age of onset of mental disorders: a review of recent literature. Current opinion in psychiatry. 2007 Jul;20(4):359. pmid:17551351
  7. 7. Loya F, Reddy R, Hinshaw SP. Mental illness stigma as a mediator of differences in Caucasian and South Asian college students’ attitudes toward psychological counseling. Journal of Counseling Psychology. 2010 Oct;57(4):484.
  8. 8. Austin EJ, Saklofske DH, Egan V. Personality, well-being and health correlates of trait emotional intelligence. Personality and Individual differences. 2005 Feb 1;38(3):547–58.
  9. 9. Riley H, Schutte NS. Low emotional intelligence as a predictor of substance-use problems. Journal of drug education. 2003 Dec;33(4):391–8. pmid:15237864
  10. 10. Saklofske DH, Austin EJ, Minski PS. Factor structure and validity of a trait emotional intelligence measure. Personality and Individual differences. 2003 Mar 1;34(4):707–21.
  11. 11. Ciarrochi J, Chan AY, Bajgar J. Measuring emotional intelligence in adolescents. Personality and individual differences. 2001 Nov 1;31(7):1105–19.
  12. 12. Petrides KV, Mikolajczak M, Mavroveli S, Sanchez-Ruiz MJ, Furnham A, Pérez-González JC. Developments in trait emotional intelligence research. Emotion Review. 2016 Oct;8(4):335–41.
  13. 13. Amir Bhochhibhoya MS. Exploring the relationships of physical activity, emotional intelligence, and mental health among college students.
  14. 14. Systems, S. a. (n.d.). How is EI measured? Retrieved from: https://www.sigmaassessmentsystems.com/:; https://www.sigmaassessmentsystems.com/ei-measured/
  15. 15. Sjöberg L. Correction for faking in self-report personality tests. Scandinavian journal of psychology. 2015 Oct;56(5):582–91. pmid:26043667
  16. 16. Šalkevicius J, Damaševičius R, Maskeliunas R, Laukienė I. Anxiety level recognition for virtual reality therapy system using physiological signals. Electronics. 2019 Sep;8(9):1039.
  17. 17. Plested JF, Gedeon TD, Zhu XY, Dhall A, Geocke RR. Detection of universal cross-cultural depression indicators from the physiological signals of observers. In2017 Seventh International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) 2017 Oct 23 (pp. 185–192). IEEE.
  18. 18. Yang TH, Wu CH, Huang KY, Su MH. Coupled HMM-based multimodal fusion for mood disorder detection through elicited audio–visual signals. Journal of Ambient Intelligence and Humanized Computing. 2017 Nov 1;8(6):895–906.
  19. 19. Garcia-Ceja E, Riegler M, Nordgreen T, Jakobsen P, Oedegaard KJ, Tørresen J. Mental health monitoring with multimodal sensing and machine learning: A survey. Pervasive and Mobile Computing. 2018 Dec 1;51:1–26.
  20. 20. Koelstra S, Muhl C, Soleymani M, Lee JS, Yazdani A, Ebrahimi T, et al. Deap: A database for emotion analysis; using physiological signals. IEEE transactions on affective computing. 2011 Jun 9;3(1):18–31.
  21. 21. Kragel PA, LaBar KS. Multivariate neural biomarkers of emotional states are categorically distinct. Social cognitive and affective neuroscience. 2015 Nov 1;10(11):1437–48. pmid:25813790
  22. 22. Barrett LF. How emotions are made.
  23. 23. Barrett LF. Solving the emotion paradox: Categorization and the experience of emotion. Personality and social psychology review. 2006 Feb;10(1):20–46. pmid:16430327
  24. 24. Barrett LF. The theory of constructed emotion: an active inference account of interoception and categorization. Social cognitive and affective neuroscience. 2017 Jan 1;12(1):1–23. pmid:27798257
  25. 25. Barrett LF, Lindquist KA, Bliss-Moreau E, Duncan S, Gendron M, Mize J, et al. Of mice and men: Natural kinds of emotions in the mammalian brain? A response to Panksepp and Izard. Perspectives on Psychological Science. 2007 Sep;2(3):297–312. pmid:19079552
  26. 26. Feldman LA. Are emotions natural kinds. Perspectives on Psychological Science. 2006;1(1):28–52. pmid:26151184
  27. 27. Barrett LF, Wager TD. The structure of emotion: Evidence from neuroimaging studies. Current Directions in Psychological Science. 2006 Apr;15(2):79–83.
  28. 28. Ciarrochi JV, Chan AY, Caputi P. A critical evaluation of the emotional intelligence construct. Personality and Individual differences. 2000 Mar 1;28(3):539–61.
  29. 29. Ciuk D, Troy A, Jones M. Measuring emotion: Self-reports vs. physiological indicators. Physiological Indicators (April 16, 2015). 2015 Apr 16. pmid:25651953
  30. 30. Khalaf A, Nabian M, Fan M, Yin Y, Wormwood J, Siegel E, et al. Analysis of multimodal physiological signals within and between individuals to predict psychological challenge vs. threat. Expert Systems with Applications. 2020 Feb 1;140:112890.
  31. 31. Mauss I, Wilhelm F, Gross J. Is there less to social anxiety than meets the eye? Emotion experience, expression, and bodily responding. Cognition and Emotion. 2004 Aug 1;18(5):631–42.
  32. 32. Mauss IB, Levenson RW, McCarter L, Wilhelm FH, Gross JJ. The tie that binds? Coherence among emotion experience, behavior, and physiology. Emotion. 2005 Jun;5(2):175. pmid:15982083
  33. 33. Korpal P, Jankowiak K. Physiological and self-report measures in emotion studies: Methodological considerations. Polish Psychological Bulletin. 2018:475–81.
  34. 34. Levenson RW. The autonomic nervous system and emotion. Emotion Review. 2014 Apr;6(2):100–12.
  35. 35. Riganello F, Giuliano D, Garbarino S, Sannita WG. Heart rate variability and the two-way interaction between CNS and the central autonomic network. Experimental & Clinical Cardiology. 2014;20(9):5584–95.
  36. 36. Thayer JF, Siegle GJ. Neurovisceral integration in cardiac and emotional regulation. IEEE Engineering in Medicine and Biology Magazine. 2002 Nov 7;21(4):24–9. pmid:12222113
  37. 37. Kreibig SD, Schaefer G, Brosch T. Psychophysiological response patterning in emotion: Implications for affective computing. A blueprint for an affectively competent agent: Cross-fertilization between emotion psychology, affective neuroscience, and affective computing. 2010 Sep 23:105–30.
  38. 38. Steinmetz JP, Vögele C, Theisen-Flies C, Federspiel C, Sütterlin S. The relationship between emotion regulation capacity, heart rate variability, and quality of life in individuals with alcohol-related brain damage. Psychology research and behavior management. 2016;9:219. pmid:27616894
  39. 39. Williams DP, Cash C, Rankin C, Bernardi A, Koenig J, Thayer JF. Resting heart rate variability predicts self-reported difficulties in emotion regulation: a focus on different facets of emotion regulation. Frontiers in psychology. 2015 Mar 10;6:261. pmid:25806017
  40. 40. Appelhans BM, Luecken LJ. Heart rate variability as an index of regulated emotional responding. Review of general psychology. 2006 Sep;10(3):229–40.
  41. 41. Rash JA, Prkachin KM. Cardiac vagal reactivity during relived sadness is predicted by affect intensity and emotional intelligence. Biological psychology. 2013 Feb 1;92(2):106–13. pmid:23182876
  42. 42. Gomez P, Stahel WA, Danuser B. Respiratory responses during affective picture viewing. Biological psychology. 2004 Nov 1;67(3):359–73. pmid:15294392
  43. 43. Wientjes CJ. Respiration in psychophysiology: methods and applications. Biological psychology. 1992 Nov 1;34(2–3):179–203. pmid:1467393
  44. 44. Serrat O. Understanding and developing emotional intelligence. InKnowledge solutions 2017 (pp. 329–339). Springer, Singapore.
  45. 45. Sinha D., & Sinha S. (2017) The Relational Dynamics of Emotional Intelligence and Effective Communication In Verma P.(Ed.), Effective communication, management & organizational growth (pp. 11–28) New Delhi: Variety Books
  46. 46. Kirk BA, Schutte NS, Hine DW. Development and preliminary validation of an emotional self-efficacy scale. Personality and Individual Differences. 2008 Oct 1;45(5):432–6.
  47. 47. Salovey P, Mayer JD. Emotional intelligence. Imagination, cognition and personality. 1990 Mar;9(3):185–211. pmid:2348356
  48. 48. Goleman D. Emotional intelligence. New York, NY, England.
  49. 49. Feldman J, Mulle K. Put emotional intelligence to work: Equip yourself for success. American Society for Training and Development; 2008.
  50. 50. Joy ST. Enhancement of emotional intelligence and spiritual intelligence among B Ed Student teachers.
  51. 51. O’Connor PJ, Hill A, Kaya M, Martin B. The measurement of emotional intelligence: A critical review of the literature and recommendations for researchers and practitioners. Frontiers in psychology. 2019 May 28;10:1116. pmid:31191383
  52. 52. Schutte NS, Malouff JM, Hall LE, Haggerty DJ, Cooper JT, Golden CJ, et al. Development and validation of a measure of emotional intelligence. Personality and individual differences. 1998 Aug 1;25(2):167–77.
  53. 53. Bar-On R. The development of a concept of psychological well-being (Doctoral dissertation, Rhodes University).
  54. 54. Siegling AB, Saklofske DH, Petrides KV. Measures of ability and trait emotional intelligence. InMeasures of personality and social psychological constructs 2015 Jan 1 (pp. 381–414). Academic Press.
  55. 55. Schutte NS, Malouff JM, Bhullar N. The assessing emotions scale. InAssessing emotional intelligence 2009 (pp. 119–134). Springer, Boston, MA.
  56. 56. Dhani P, Sharma T. Emotional Intelligence: History, Models and Measures.
  57. 57. Petrides KV. Ability and trait emotional intelligence.
  58. 58. Mikolajczak M, Nelis D, Hansenne M, Quoidbach J. If you can regulate sadness, you can probably regulate shame: Associations between trait emotional intelligence, emotion regulation and coping efficiency across discrete emotions. Personality and individual differences. 2008 Apr 1;44(6):1356–68.
  59. 59. Hussein AR, Acquah EO, Musah MB. Testing the Cross-Cultural Validity of Schutte Self-Report Emotional Intelligence Test (SSEIT) Scale. INTERNATIONAL JOURNAL OF ACADEMIC RESEARCH IN BUSINESS AND SOCIAL SCIENCES. 2019 Dec;9(12).
  60. 60. Neubauer AC, Freudenthaler HH. Models of emotional intelligence. Emotional intelligence: An international handbook. 2005:31–50.
  61. 61. Alegre A, Pérez-Escoda N, López-Cassá E. The relationship between trait emotional intelligence and personality. Is trait EI really anchored within the big five, big two and big One Frameworks?. Frontiers in psychology. 2019 Apr 24;10:866. pmid:31068861
  62. 62. Zysberg LE, Raz SE. Emotional intelligence: Current evidence from psychophysiological, educational and organizational perspectives. Nova Science Publishers; 2015.
  63. 63. Gayathri N, Meenakshi K. Emotional Intelligence in the Indian Context. Global Journal of Human Social Science Linguistics & Education. 2013;13(8):11–24.
  64. 64. Lea RG, Qualter P, Davis SK, Pérez-González JC, Bangee M. Trait emotional intelligence and attentional bias for positive emotion: an eye tracking study. Personality and Individual Differences. 2018 Jul 1;128:88–93.
  65. 65. Elfenbein HA, Jang D, Sharma S, Sanchez-Burks J. Validating emotional attention regulation as a component of emotional intelligence: A Stroop approach to individual differences in tuning in to and out of nonverbal cues. Emotion. 2017 Mar;17(2):348. pmid:27762568
  66. 66. Mikolajczak M, Roy E, Luminet O, Fillée C, De Timary P. The moderating impact of emotional intelligence on free cortisol responses to stress. Psychoneuroendocrinology. 2007 Sep 1;32(8–10):1000–12. pmid:17935898
  67. 67. Laborde S, Brüll A, Weber J, Anders LS. Trait emotional intelligence in sports: A protective role against stress through heart rate variability?. Personality and Individual Differences. 2011 Jul 1;51(1):23–7.
  68. 68. Tan Y, Zhang Q, Li W, Wei D, Qiao L, Qiu J, et al. The correlation between emotional intelligence and gray matter volume in university students. Brain and Cognition. 2014 Nov 1;91:100–7. pmid:25282329
  69. 69. Sarrionandia A, Mikolajczak M. A meta-analysis of the possible behavioural and biological variables linking trait emotional intelligence to health. Health psychology review. 2019 Jul 17:1–25. pmid:31284846
  70. 70. Fernández CM, Pascual JM, Soler JR, Fernández-Abascal EG. Spanish validation of an emotion-eliciting set of films. Psicothema. 2011 Nov;23(4):778–85. pmid:22047873
  71. 71. Fernández-Aguilar L, Ricarte J, Ros L, Latorre JM. Emotional differences in young and older adults: films as mood induction procedure. Frontiers in psychology. 2018 Jul 3;9:1110. pmid:30018584
  72. 72. Fernández-Aguilar L, Navarro-Bravo B, Ricarte J, Ros L, Latorre JM. How effective are films in inducing positive and negative emotional states? A meta-analysis. PloS one. 2019 Nov 21;14(11):e0225040. pmid:31751361
  73. 73. Mayr S, Erdfelder E, Buchner A, Faul F. A short tutorial of GPower. Tutorials in quantitative methods for psychology. 2007 Jan 1;3(2):51–9.
  74. 74. Alizadeh M, Shaker G, De Almeida JC, Morita PP, Safavi-Naeini S. Remote monitoring of human vital signs using mm-Wave FMCW radar. IEEE Access. 2019 Apr 23;7:54958–68.
  75. 75. Wang Y, Wang W, Zhou M, Ren A, Tian Z. Remote Monitoring of Human Vital Signs Based on 77-GHz mm-Wave FMCW Radar. Sensors. 2020 Jan;20(10):2999. pmid:32466309
  76. 76. Alizadeh M. Remote vital signs monitoring using a mm-wave FMCW radar (Master’s thesis, University of Waterloo).
  77. 77. Al-Masri E, Momin M. Detecting Heart Rate Variability using Millimeter-Wave Radar Technology. In2018 IEEE International Conference on Big Data (Big Data) 2018 Dec 10 (pp. 5282–5284). IEEE.
  78. 78. Shaffer F, Ginsberg JP. An overview of heart rate variability metrics and norms. Frontiers in public health. 2017 Sep 28;5:258. pmid:29034226
  79. 79. Petrides KV, Furnham A. On the dimensional structure of emotional intelligence. Personality and individual differences. 2000 Aug 1;29(2):313–20.
  80. 80. O’Connor PJ, Athota VS. The intervening role of agreeableness in the relationship between trait emotional intelligence and Machiavellianism: Reassessing the potential dark side of EI. Personality and Individual Differences. 2013 Oct 1;55(7):750–4.
  81. 81. Cloninger CR, Svrakic DM, Przybeck TR. A psychobiological model of temperament and character. Archives of general psychiatry. 1993 Dec 1;50(12):975–90. pmid:8250684
  82. 82. Carvalho S, Leite J, Galdo-Álvarez S, Gonçalves ÓF. The emotional movie database (EMDB): A self-report and psychophysiological study. Applied psychophysiology and biofeedback. 2012 Dec 1;37(4):279–94. pmid:22767079
  83. 83. Ray RD, Gross JJ. Emotion elicitation using films. Handbook of emotion elicitation and assessment. 2007 Apr 19;9.
  84. 84. Happy SL, Patnaik P, Routray A, Guha R. The Indian spontaneous expression database for emotion recognition. IEEE Transactions on Affective Computing. 2015 Nov 5;8(1):131–42.
  85. 85. Mitchell RK, Agle BR, Wood DJ. Toward a theory of stakeholder identification and salience: Defining the principle of who and what really counts. Academy of management review. 1997 Oct 1;22(4):853–86.
  86. 86. Kapoor A, Burleson W, Picard RW. Automatic prediction of frustration. International journal of human-computer studies. 2007 Aug 1;65(8):724–36.
  87. 87. Hsu CW, Chang CC, Lin CJ. A practical guide to support vector classification.
  88. 88. Agarwal P, Ray A, Shah A, Gugnani A, Halli P, Atreja S, et al. Multimodal Web Application to Infer Emotional Intelligence of Adolescent Counsellor. In2019 Grace Hopper Celebration India (GHCI) 2019 Nov 6 (pp. 1–5). IEEE.
  89. 89. Torres OV, Estep JC, Gwin M, Villalta I. Gender Differences in Negative Mood, Emotional Intelligence and Tobacco Use among Young Adults. Substance Use & Misuse. 2020 Jun 12:1–1.
  90. 90. Štiglic G, Cilar L, Novak Ž, Vrbnjak D, Stenhouse R, Snowden A, et al. Emotional intelligence among nursing students: Findings from a cross-sectional study. Nurse education today. 2018 Jul 1;66:33–8. pmid:29655019
  91. 91. Garg S, Agarwal JL. Relationship of Emotional Intelligence with Pre-Hypertension and its Impact on Autonomic Nervous System as Assessed by Heart Rate Variability in Adult Males. International Journal of Physiology. 2019;7(4):246–50.
  92. 92. Papousek I, Freudenthaler HH, Schulter G. The interplay of perceiving and regulating emotions in becoming infected with positive and negative moods. Personality and Individual Differences. 2008 Oct 1;45(6):463–7.
  93. 93. Prajapati V, Routray A, Guha R. Cardiac autonomic flexibility is associated with higher emotional intelligence. Cogent Psychology. 2020 Jan 1;7(1):1870809.
  94. 94. Labouvie-Vief G, Lumley MA, Jain E, Heinze H. Age and gender differences in cardiac reactivity and subjective emotion responses to emotional autobiographical memories. Emotion. 2003 Jun;3(2):115. pmid:12899414
  95. 95. Deng Y, Chang L, Yang M, Huo M, Zhou R. Gender differences in emotional response: Inconsistency between experience and expressivity. PloS one. 2016 Jun 30;11(6):e0158666. pmid:27362361
  96. 96. Kret ME, De Gelder B. A review on sex differences in processing emotional signals. Neuropsychologia. 2012 Jun 1;50(7):1211–21. pmid:22245006
  97. 97. Evers C, Hopp H, Gross JJ, Fischer AH, Manstead AS, Mauss IB. Emotion response coherence: A dual-process perspective. Biological psychology. 2014 Apr 1;98:43–9. pmid:24239595
  98. 98. Zysberg L, Raz S. Emotional intelligence and emotion regulation in self-induced emotional states: Physiological evidence. Personality and Individual Differences. 2019 Mar 1;139:202–7.
  99. 99. Komori T. The relaxation effect of prolonged expiratory breathing. Mental illness. 2018 May 15;10(1). pmid:30046408
  100. 100. Mikolajczak M, Bodarwé K, Laloyaux O, Hansenne M, Nelis D. Association between frontal EEG asymmetries and emotional intelligence among adults. Personality and Individual Differences. 2010 Jan 1;48(2):177–81.
  101. 101. Grillon H, Riquier F, Thalmann D. Eye-tracking as diagnosis and assessment tool for social phobia. In2007 Virtual Rehabilitation 2007 Sep 27 (pp. 138–145). IEEE.