Figures
Abstract
The main aim of this study is to introduce an implicit personality assessment method (e.g., implicit association test) to Kuwait. We adapted an existing personality-related implicit association test (IAT; Big Five IAT), while also constructed the first trait EI IAT based on Petrides’ four-factor model. We investigated the psychometric properties of the implicit association test through assessing the reliability of scores and also their relationship with their corresponding explicit measures. The measures were administered to 1458 university students in Kuwait. The zero-order correlations showed that the explicit and implicit measurement approaches led to non-converging constructs in the case of both trait EI and the Big Five. Lastly, we believe that we were successfully able to introduce the concept of personality-related implicit association tests to the Kuwaiti sample. Subsequently, the IATs presented in our study will allow researchers to study a relatively new personality field, that is the implicit personality.
Citation: Hasan NN, Petrides KV, Hull L (2023) The relationship between explicit and implicit personality: Evidence from the Big Five and trait emotional intelligence. PLoS ONE 18(10): e0287013. https://doi.org/10.1371/journal.pone.0287013
Editor: Sónia Brito-Costa, Polytechnic Institute of Coimbra: Instituto Politecnico de Coimbra, PORTUGAL
Received: January 18, 2023; Accepted: May 29, 2023; Published: October 9, 2023
Copyright: © 2023 Hasan et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data files generated and analysed in this study are publicly available from the Figshare database (https://doi.org/10.5522/04/22202371).
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Historically, psychologists interested in studying the personality differences among individuals relied on self-report measures. These measures are direct and scientifically categorised under explicit measures. Explicit measures assess mental structures and processes accessible through introspection [1]. In other words, participants are asked directly to respond to items concerning their explicit needs, motives, values, and traits. For example, when you ask people directly how they feel about a product, you are using an explicit question.
In contrast, when you do not ask people directly about their feeling but assess their behaviour or how they perform a task (e.g., whether they come back to buy the same product again), you are using an indirect method. This indirect measurement method is referred to as implicit measure. Implicit measures are contrary to their explicit counterparts in which the earlier assess the mental structures and processes that are inaccessible through introspection [1]. Accordingly, one may define implicit measures as an indirect assessment tool that people may be unaware of or are unwilling to report [2]. Undoubtedly, response latencies are the most common implicit measure during the last decade.
In response to latency studies, researchers are interested in measuring the reaction times when participants perform a certain task. Thus, the participants are not asked about their feelings, instead, they focus on performing an objective task in which inferences are drawn from their timed performance.
Implicit association tests, known as IAT [3], are the most common response latency that relies on reaction times to assess different personality aspects such as attitudes and traits. Their main advantage over their explicit counterparts is that they are less susceptible to faking [4, 5]. It is obvious as people tend to distort their explicit feelings, attitudes, or traits to present themselves to others favourably. Accordingly, IAT is developed to make it hard for participants to control their responses (i.e., to fake their responses) and reveal things that people may not even know that they possess.
Petrides and Furnham [6] studied the EI construct and pointed out that different measurements lead to different constructs (e.g., trait EI vs. ability EI). We also argue that the implicit and explicit measures refer to two different personality-related constructs based on the measurement method: implicit personality and explicit personality. Although one method (i.e., implicit measure) overcomes the disadvantages of the other (i.e., explicit measure), we believe that they complement each other and neither one is superior. As suggested by James and LeBreton [1], researchers should study both aspects to develop a comprehensive understating of one’s personality and the consequential behaviours or constructs. More importantly, Lane and colleagues [7] presented a table comprising the correlation indices between an implicit measure and its corresponding explicit measure. Compared to what we argued, the correlation between the implicit and its corresponding explicit measure was weak in the majority of cases.
Implicit association test
The IAT was introduced by Greenwald and colleagues [3] to assess implicit attitudes. Two years later, Greenwald and Farnham [8] introduced this measurement method to the personality field. The key concept behind the IAT is that inferences about one’s attitudes, feelings, or traits are based on reactions time (i.e., the time taken to perform the task). The logic behind relying on reaction times is based on the idea that people perform better (i.e., with speed and accuracy) when the task is aligned with their cognitive associations. In other words, when the task demands conflict with one’s automatic mental links, the test takers are slowed down and make more mistakes. In short, it is based on the association between the participant’s reaction time to categorise stimuli related to two pairs of concepts: target and attribute.
The IAT test comprises five separate categorisation tasks, represented by seven blocks. In the first categorisation task (Block 1), the participant is asked to sort words relating to the concepts (e.g., Me and Others) into categories. In the second task (Block 2), participants are asked to perform the same sorting task, but this time with different concepts (e.g., Emotionality and Logicality). In the third task (Blocks 3 and 4), the categories are combined in a way that presents two concepts on the left of the screen, while the other two on the right (e.g., Me + Emotionality and Others + Logicality). In the fourth task (Block 5), the placement of the concepts presented in Block 2 switches (e.g., Logicality on the left and Emotionality on the right) and the participant is asked to perform the same sorting task. In the fifth task (Blocks 6 and 7), all concepts are combined again, but in a different combination than in Blocks 3 and 4 (e.g., Me + Logicality and Others + Emotionality). Noteworthy, in the subsequent three IAT subtests, the first categorisation task is eliminated as it will already have been presented in the first subtest (i.e., in the Me and Others categorisation task). An illustration of these blocks is presented in Fig 1 using one of the trait EI sub-IATs from our study, which was based on the guidelines by Lane et al. [7].
In concepts such as the Big Five and trait EI, several IATs, each called sub-IAT, are used to assess the underlying constructs. For instance, the Big Five IAT consists of five sub-IATs corresponding to the five constructs representing the Big Five [9]. Similarly, the trait EI IAT consists of four sub-IATs corresponding to the four factors of trait EI [10].
In both concepts, the first categorisation task was only presented in the first sub-IAT and eliminated from the following sub-IATs for two reasons. First, the participant has already been introduced to the concepts related to the first categorisation task (i.e., Me + Others) which is one of this IAT’s aims. Second, to avoid adding unnecessary trials that lead to longer tests, as adding these trials will result in including 140 more trials. Clearly, adding these trials will increase the likelihood of respondent fatigue [11], which can threaten the validity of our results.
Building IAT blocks
As shown in Fig 1, the IAT comprises seven blocks. In Block 1, the participants are asked to rapidly classify stimulus (in our case, a word) into the concept me (by pressing the left assigned key “E” in English keyboard and “ث” in Arabic keyboard) and others (by pressing the right assigned key “I” in English keyboard and “هـ” in Arabic keyboard). The same task is repeated in Block 2 with two different concepts, emotionality and logicality. In Block 3, the previous two tasks are combined, and the participants are asked to perform the classification task with two concepts on each side; when the stimulus belongs to the concepts me or emotionality, the participant will have to press the left key. The same task is performed in Block 4 but with more trials. In Block 5, the task in Block 2 is reversed. The participants will press the left key if the stimulus belongs to the logicality concept and the right key for the emotionality concept. In the last two blocks, Block 6 and 7, the concepts are reversed from Blocks 3 and 4, and participants are asked to perform the same classification task.
Several considerations must be concerned when constructing an IAT. The first consideration is related to defining the construct because this will affect the choices of the categories in the next stage. Many categories have an obvious comparison category, such as me and others categories, in our study. However, in some cases, choosing the comparable category is not an obvious step. In such cases, it is advised to use a mutually exclusive category from the same domain. For example, Grumm and Collani [12] used extraversion and introversion categories in their study. Therefore, we followed the advice to use an approach to choose the appropriate categories in our study.
After choosing the appropriate categories, the IAT developer must ensure that the stimuli under each category are well-chosen. Lane et al. [7] stated stimuli matter when they discussed the contradictory attitudes toward America when the category America was presented by the names of certain presidents compared to flag images and other common sightseeing. Furthermore, they suggested avoiding negated stimuli because participants tend to take more time to process the negations and classify it properly, which indeed affects the response time. We believe that the stimuli must undergo pilot testing in which participants should be given the four categories and a shuffled list of all stimuli and asked to perform the classification task. By doing this, we can ensure whether the stimuli list under each category is appropriate.
As shown in Fig 2, two different colours are used for targets and attribute categories. It helps to reduce the task ambiguity when two pairs are shown on a certain task instead of one category on each side, as suggested by Lane et al. [7].
Note. English translations in quotation marks were not shown to participants.
Another stimuli-related concern is the number of stimuli used under each category. The first aspect involves whether an equal number of stimuli should be used under each category. This aspect is under-researched within the field; however, we see no clue in including the unequal number of stimuli under each category. The second aspect is related to the appropriate number of stimuli. Several studies using different numbers of stimuli (e.g., as low as four and as high as 25 stimuli) concluded that stimuli number does not affect the magnitude effect nor the reliability of the scores [3, 13].
Furthermore, the IAT comprises three single-categorisation practice blocks (Blocks 1, 2, and 5) and four double categorisation critical blocks (Blocks 3, 4, 6, and 7). We followed the suggestions in the literature [3, 7, 13] to include 20 trials in Blocks 3 and 6 and 40 trials in Blocks 4 and 7. In Block 5, we included 40 trials to reduce the first combined pair effect on the IAT scores because participants would show greater IAT effects for whichever combined pair is shown first (i.e., order effect) [13, 14]. Also, the IAT was designed through Qualtrics to counterbalance the double categorisation blocks among participants.
Last, as suggested by Lane et al. [7], we included error feedback to the participants whenever the stimulus is wrongly classified (i.e., a red “X” appears in the middle of the screen). The participant is instructed to press the other key to correct his response, and an error penalty is added to his recorded response time.
The logic behind IAT
In IAT, the task response time is the measurement core, and all conclusions are based on it. As stated earlier, when the IAT was first presented, it was presumed that the participant would perform the classification task more accurately and faster if the associated categories shared the same keys on the keyboard.
For that logic, the response time for each task is recorded and stored. Afterwards, the differences in the responses time to a certain pairing of the target and attribute (e.g., Me + Emotionality and Others + Logicality) are compared to the reversed set (e.g., Me + Logicality and Others + Emotionality). This comparison estimates the association strength between the two sets of pairing. To elaborate, if the task response time is faster for the first set, we can conclude that the relative association in the first set is stronger than the other set. Hence, the participants reflect an implicit preference to view themselves as emotional over being logical.
Scoring and interpreting IAT effects
At early stages, researchers reported the IAT effects as the differences in mean response time between two combined pairings (i.e., Blocks 4 and 7) until Greenwald and colleagues [15] introduced an improved scoring algorithm (called D) that overcomes all early IAT scoring methods issues. D is the difference in mean response time between the IAT’s two combined tasks (e.g., Me + Emotionality and Me + Logicality), divided by its associated (i.e., inclusive) standard deviation. They also recommended deleting all trials greater than 10,000 milliseconds (i.e., very slow) and all subjects for which more than 10% of their trials have a response time lesser than 300 milliseconds (i.e., button mashers).
Lane et al. [7] pointed out five advantages of using D. First, D minimises the correlation between the IAT effects and individuals’ mean response time. Second, it minimises the effect of the IAT blocks’ order. Third, it minimises the effect of IAT experience on selecting new IATs. Fourth, it retains higher internal consistency values. Last, it maximises the correlations between the corresponding implicit and explicit measures. Further, Rudman [2] pointed out that it reduced the unwanted error variance caused by individual differences in performing the task and cognitive skills. Therefore, D is used throughout this study during IAT use.
The IAT D score is called an IAT effect size. Rudman [2] suggested that the D statistic estimates IAT effect size magnitude and the values of.15, .35, and .60 correspond to small, medium, and large effect sizes, respectively. Further, the D statistic can be transformed into a more familiar effect size measure, Cohen’s d, dividing D by the sample’s standard deviation.
The Big Five personality
Undoubtedly, the five-factor model of personality, known as the Big Five, is the most popular personality model. Although the origin of this model is unclear, it is obvious that this model emerges based on Cattel’s system that depends on the factor analytic approach [16]. The researcher showed that the five-factor model was robust in many studies following the factor analytic approach. In other words, much of what is meant by the term personality is explained by the five-factor model.
Nevertheless, the factor names and their interpretations were inconsistent among the researchers. For example, Norman’s [17] five factors were surgency, agreeableness, conscientiousness, emotional stability, and culture. While Costa and McCrae’s [9] most popular five factors were extraversion, agreeableness, conscientiousness, neuroticism, and openness to experience. Frequently, there is a global consensus on factors’ labels: I. Extraversion or surgency; II. Friendliness or agreeableness; III. Conscientiousness; IV. Neuroticism or emotional stability; and V. Openness to experience or intellect.
Trait emotional intelligence
Trait emotional intelligence (trait EI) is described as a set of emotional perceptions that may be assessed using self-report measures [18]. Because trait EI is primarily concerned with people’s judgements of their emotional capacity, it is often referred to as "trait emotional self-efficacy”. The Trait Emotional Intelligence Questionnaire is used as a vehicle to study the paradigm.
The Big Five and trait EI
Several studies have been conducted to examine the relationship between the Big Five factors of personality and trait EI [19–29]. This is not surprising given that trait EI is considered as a personality trait and investigating its association with a well-established personality taxonomy such as the Big Five model should be a concerned. In most of these studies, the personality factor of Neuroticism showed the greatest correlation with the global trait EI, among the other Big Five factors of personality. Extraversion and Conscientiousness also showed a relatively stronger correlations with the global trait EI, compared to Agreeableness and Openness.
The present study
Almost twenty years ago, the concept of implicit personality was introduced to the psychology field by Greenwald and Farnham [8]. However, the concept did not receive much attention in Arab countries like Kuwait. In fact, to our knowledge, there has only been a single implicit personality study in an Arabic country [30]. It investigated aggressive behaviour through the Conditional Reasoning Test, in Egyptian samples. Obviously, the measures used to assess the implicit personality have not yet been introduced to any Kuwaiti sample. This explains why we are interested in conducting the present study in Kuwait.
The overall aim of this study is to introduce a novel approach to assess implicit personality through implicit association test (IAT) in Kuwaiti Arabic for use in general population. Specifically, we were interested in a) adapting the Big Five IAT and b) constructing the trait EI IAT. For the Big Five IAT, we adapted the English Big Five IAT developed by Back et al. [31] into Kuwaiti-Arabic. While for the trait EI IAT, we followed the IAT construction guidelines presented in the introduction, similar to Back’s et al. [31] methodology to construct a personality related IAT. We also aim to examine the relationship between explicit and implicit data in order to look at whether our data supports Nosek and Smyth [32] view. Accordingly, we will test the following hypotheses:
- H1: There will be low correlations between trait EI scores obtained by the explicit (TEIQue-SF) and implicit (trait EI IAT) measures.
- H2: There will be low correlations between the Big Five scores obtained by the explicit (NEO-FFI) and implicit (Big Five IAT) measures.
Materials and methods
Pilot study and cultural adaptation design and procedure
The ITC [33] test adaptation guidelines were considered in the adaptation of the English Big Five IAT, and accordingly, an expert committee was formed, with members tasked with forward- and back-translating the measure. First, the stimuli were obtained from the English Big Five IAT version by Back and his colleagues [31]. After that, two committee members translated these stimuli into simple Arabic. The two forms were not identical in terms of identifying the same stimuli in Arabic by the two forward translators. However, this is due to the existence of several synonyms for every word in Arabic. Therefore, these discrepancies were resolved by choosing the most appropriate and cultural-reflective stimuli. Subsequently, a synthesised form was sent to the back-translating team, who, in return, constructed two English forms of the stimuli. The researcher compared the two forms, and the same issue of multiple synonyms, but in English, appeared. The two back-translators followed the same procedures followed by the forward translators in identifying the most appropriate stimuli considering the two versions. All materials were then reviewed by one of the committee members and approved for piloting without any amends.
After piloting the Big Five IAT for the first time, the Agreeableness subtest showed an unacceptable reliability estimate of .42 through the split-half method. We contacted the committee to revise the stimuli, and the same translation procedure was followed again. In the forward translation stage, the committee members decided to use a different synonym of every problematic stimulus within this subtest. After that, the back-translation and the final revision procedures were followed. The committee approved the final version of this subtest and suggested performing a focus group before piloting the subtest again. The participants in the focus group were able correctly to categorise each stimulus under the purposed category without any mistakes. Therefore, we decided to proceed with the revised version of this subtest for the second pilot of the Agreeableness subtest within the Big Five IAT. Accordingly, the final version of the Big Five IAT comprised 5 sub-IATs corresponding to the five factors of: Neuroticism, Extraversion, Openness, Agreeableness, and Conscientiousness.
We also constructed the first trait EI IAT draft following the guidelines by Lane and colleagues [7]. We created a list of stimuli through identifying the appropriate Arabic synonyms that can be classified under each trait EI factor. The list of stimuli was accepted by the expert committee. Thus, four different sub-IATs were constructed corresponding to the four-factor trait EI model proposed by Petrides [10]: Well-being, Self-control, Emotionality, and Sociability. The four trait EI sub-IATs were developed using Qualtrics to pilot it.
After piloting the trait EI IAT, we looked at the reliability estimates obtained through split-half and Cronbach’s alpha methods. The estimates suggested a possible issue with the Emotionality factor of trait EI, as can be seen found in S1 Table. Therefore, we decided to revise the list of stimuli following the same procedures explained above for the Agreeableness sub-IAT.
Main study design and procedure
We used a convenience sample design and approached participants via an anonymous Qualtrics link (online). These participants differed from those used for the pilot samples, and the final IAT versions were again implemented on the main study sample. Several faculty members within Kuwaiti higher education institutions were contacted individually to help disseminate the Qualtrics link. Participants did not provide any personal self-identifying information, and provided their consent to participate by clicking on “I consent to participate in this study”.
The Qualtrics link comprises five sections after consenting to participate in the study. The participants were asked to answer demographic questions in the first section. The second and third sections concerned the explicit and implicit Big Five factor measures, respectively. The fourth and fifth sections concerned the explicit and implicit trait EI measures, respectively.
This study was approved by the University College London-Departmental Ethics Committee (CEHP/2021/586). All research methods were conducted in accordance with relevant guidelines and regulations.
Participants
The first pilot sample of university students comprises 57 participants completed the trait EI IAT. The second pilot sample of university students comprises 64 participants completed the Big Five IAT. The third pilot sample of university students comprises 34 participants completed the revised Agreeableness sub-IAT. Sample sizes are complied with the suggestions from the measure’s piloting literature [34].
The main study sample included 1458 university students in Kuwait with a mean age of 22.34 years (SD = 7.62 years). The characteristics of our sample can be found in Table 1. We did not identify any missing values in our dataset, and therefore, all participants were included in our study for further analysis.
Measures
Trait EI IAT.
The TEI IAT is a four-IAT subtests reflecting the four factors model proposed by Petrides [10]. The first subtest comprises five separate categorisation tasks, represented by seven blocks. In the other subtests, the first block is eliminated as the task was already done in the first subtest. An illustration of these blocks is presented in Fig 1 using one of the sub-IATs from our study. The IAT is developed following the guidelines by Lane and colleagues [7] as shown earlier in the Building IAT Blocks section.
In general, for each block, a mutually exclusive stimulus that belongs to either a left or a right side of the concept will appear in the middle of the participant’s screen. The task asks the participant to classify each stimulus by pressing two pre-specified keys (a left and a right key) on his keyboard. During this classification task, the response time to each stimulus is recorded for further analysis. The list of stimulus and categories used in our study can be found in S1 Appendix.
Big Five IAT.
The Big Five IAT is a five-IAT subtests reflecting the big five personality dimensions proposed by Costa and McCrae [9]. The English stimulus were obtained from the English Big Five IAT version by Back and his colleagues [31] and the full list of stimulus and categories can be found in S2 Appendix. As we did in the trait EI IAT, only the first subtest included the first block of me + others categorisation task.
Kuwaiti Arabic Trait Emotional Intelligence Questionnaire (TEIQue-SF).
The TEIQue-SF is a 30-items inventory providing comprehensive coverage of the sampling domain of trait EI in adults [10]. The items are responded to a 7-point Likert scale. All TEIQue instruments are available, free of charge, for research purposes from www.psychometriclab.com. In this study, we used the Kuwaiti-Arabic adaptation of TEIQue-SF [35], which has shown robust psychometric properties in Kuwaiti samples.
Kuwaiti-Arabic NEO-FFI.
The NEO-FFI is the short form of the NEO-PI developed by Costa and McCrae [9]. The inventory comprises 60 items providing scores on the Big Five factors: Neuroticism (N), Extraversion (E), Openness (O), Agreeableness (A), and Conscientiousness (C). One limitation is that it does not yield scores at the facet level as the NEO-PI. However, we used it in our study due to circumstances relating to our project (esp., limited time). We used Alansari’s [36] Kuwaiti-Arabic adaptation.
Data analysis plan
Descriptive statistics and reliability estimates will be calculated using R 4.0.5 [37]. The iatgen package [38] will be used to perform all analyses. Participants will be considered button mashers and dropped from the final analysis if they had too many fast responses (i.e., more than 10% of their responses were below 300 ms).
The reliability estimates will be computed based on creating pairs of reaction times from compatible/incompatible blocks, calculating their differences, and apply them to Cronbach’s alpha analysis [14].
Additionally, we will model the interrelationships between the two implicit constructs (i.e., trait EI and Big Five) through SEM based on the relationships reported in Petrides et al. [25]. The analysis will be carried out through Mplus [39], and the corresponding parameters will be estimated with the robust maximum likelihood estimator (MLR) to deal with deviations from normality.
Results
Pilot study results
Three pilot studies were conducted to look at the descriptive statistics and reliability estimates of the scores obtained by the trait EI and the Big Five IATs. The test-related information of these pilot studies can be found in S1 Table. The first pilot study comprised 57 participants who completed the trait EI IAT. The number of participants who completed the test dropped from 57 participants who completed the first subtest to 55 participants who completed the last subtest. Also, the number of button mashers increased as participants approached the end of the overall test. The reliability estimates through the split-half method ranged between .43 and .79. In comparison, the estimates through Cronbach’s alpha ranged between .57 and .70.
The second pilot study comprised 64 participants who completed the Big Five IAT. The results can be found in S1 Table. The number of participants who completed the test dropped from 64 participants who completed the first subtest to 51 participants who completed the last subtest. Also, the number of button mashers increased as participants approached the end of the overall test. The reliability estimates through the split-half method ranged between .42 and .82. In comparison, the estimates through Cronbach’s alpha ranged between .61 and .81.
The third pilot study comprised 34 participants who only completed the revised Agreeableness factor of the Big Five sub-IAT and Emotionality factor of trait EI sub-IAT. The results can be found in S1 Table. Thirty-four participants completed the two revised sub-IAT. The reliability estimate using the split-half and Cronbach’s alpha methods jumped to .83 and .74, respectively, for the Agreeableness sub-IAT. The reliability estimates using the same two methods were .64, and .63, respectively, for the Emotionality sub-IAT. In both cases, the reliability estimates were higher in the revised version.
Main study results
The IAT-related information for the 9 sub-IATs are shown in Table 2. Descriptive statistics for all variables are shown in Table 3 (N = 1458). All skewness and kurtosis values were within the acceptable ranges (-3.00 to +3.00) and (-10.00 to +10.00), respectively [40].
Gender-based reliability estimates for all measures are shown in Table 4. Overall, the implicit measures showed higher reliability estimates compared to their explicit counterparts.
The relationship between explicit-implicit constructs
The zero-order correlations between the explicit-implicit constructs are shown in Table 5. For the trait EI factors, they ranged from -.01 to .11 (overall sample), -.02 to .16 (males), and .01 to .10 (females). Similarly, low values were observed for the Big Five factors. These correlations ranged from—.03 to .10 (overall sample), -.06 to .17 (males), and -.02 to .08 (females). Thus, the results showed that our two hypotheses were borne out by our data.
Discussion
Objectives and hypotheses
In this study we aimed to introduce the implicit personality concept to the Kuwaiti psychology field accompanied by adapting and constructing their measurement method. In the introduction, we distinguished between the concepts of explicit and implicit personality through their measurement methods. For instance, explicit personality is assessed through self-report measures by asking the participants to directly choosing a response from a given scale. While implicit personality is assessed indirectly using certain type of tests like the IAT.
Accordingly, we adapted one IAT to assess the Big Five factors indirectly (i.e., implicitly) in Kuwaiti sample. In more details, we adapted the five sub-IATs corresponding to the five-factor model of personality proposed by Costa and McCrae [9]. The stimuli we used in this test were obtained from Back et al. [31]. Also, we considered their methodology along with Lane’s et al. [7] guidelines to construct the first trait EI IAT in the literature as shown in the present study. Through these adapted and newly designed measures, we successfully measured the implicit constructs to test the hypotheses we advanced earlier.
First, we assessed the psychometric properties of our IAT measures. Our reliability analysis yielded satisfactory estimates; however, we believe that the very meaning of internal consistency is questionable within the IAT context. This is because these estimates within the IAT context refer to whether responses time between trials are consistent or not, rather than whether the actual D-scores are consistent [38].
Our results showed that, in general, reliability estimates for implicit measures were higher than for explicit measures. This is at odds with other research showing that explicit measures of personality tend to have higher reliabilities than implicit measures [12, 41, 42]. However, the cross-cultural dimension of our study is a potential confounding factor and further work will be necessary on this point.
Main findings of our study
We examined the relationships between the explicit and implicit measures of trait EI and the Big Five, separately, through zero-order correlations. The results supported our earlier hypotheses that we will find weak correlations between the scores obtained by explicit and implicit measures for both the Big Five factors and the four trait EI factors. These results are consistent with Lane et al. [7] who reported similarly low correlations between explicit and implicit personality measurements across numerous constructs. It appears that these two methodologies tap into two distinct aspects of personality. Thus, they can be seen as complementary methodologies, that offers full understating of both personality aspects (explicit and implicit), rather than two alternative methodologies for the assessment of personality.
Given the fact that this type of measure is introduced for the first time to Kuwaiti sample, we expected that the error rate will be relatively high in the first sub-IAT of each construct as shown by our results. However, the error rate decreased continuously as the participants approached the end of the IAT. This suggests that experiencing more IATs can help the participant to perform the categorisation tasks more accurately.
The implications of these results
The implications of the current study are manifold. First, concerning the field of personality, this study contributes to the broad personality literature in two unique ways. The first contribution is our attempt to construct the first trait EI IAT based on Petrides’s [10] four-factor of trait EI model. This is highly novel in the broad implicit personality literature and also in the trait EI literature. The reliability results obtained from our trait EI IAT were promising, however, the validity of the results is still questionable and further investigations shall be made by future researchers. The second contribution is our finding of lack of correlations between the scores obtained from the implicit measures administered in our study and their explicit counterparts. Lane et al. [7] found similarly low correlations between the two measurement types in their review of numerous studies. Clearly, our findings support the view that implicit personality represents a unique aspect of one’s personality. Researchers should not view implicit measures as an alternative way of measuring the same construct, but as two distinct personality aspects (i.e., traits).
Second, concerning policymakers, we believe that we have introduced a novel implicit personality measurement method, which can help us to identify personality traits that people are unwilling to report through self-report measures (i.e., explicit measures). This will benefit policymakers in Kuwait as well as the international context because several organisations rely on psychological measures and other job-related qualifications to hire certain staff members (e.g., leaders). In fact, this is not surprising as certain personality traits (e.g., trait EI) showed significant predictive effects on job performance [43]. Accordingly, some participants may provide desirable responses to obtain higher trait EI scores [44] in order to secure a position in a certain job. Therefore, there is a need for an indirect measurement tool that can offer another view of one’s personality traits, which was offered in the current study.
The limitations of this study
While our study findings are robust, it is important to acknowledge the limitations of the study in order to provide a balanced and accurate interpretation of the results. In this study, we relied on a non-probability sampling method (i.e., convenience sampling method). Although it was the most appropriate for our study design because we wanted to recruit as large as possible a sample size with restricted time frame and funds [45]. Yet, these methods have a high degree of bias, which threatens the validity of the results obtained in our studies. In addition, it limits us from generalising our findings to the general population.
Another significant limitation in our study is the length of the included measures. Ben-Nun [11] suggested that long measures can lead to a phenomenon called respondent fatigue. This phenomenon occurs when participants become exhausted of the measure’s task, and therefore, affects the quality of the data provided by them. Perhaps, one way to mitigate it is by decreasing the number of tasks without affecting the quality of the measure. Accordingly, we only included the first categorisation task in the first sub-IAT of both trait EI and the Big Five and eliminated this task from the following sub-IATs.
We presented the number of participants who completed each sub-IATs along with the number of button mashers from pilot and main studies. The results from all studies showed that the number of participants was decreasing as they approach the end of the IAT. Also, the number of button mashers was increasing as the participants approached the end of the IAT. Thus, suggesting that the respondent fatigue has occurred in these participants, even though we decreased the number of tasks to mitigate this phenomenon. As a further step, we eliminated these participants from our data analyses in order to avoid any threats to the validity of our results.
Besides the aforementioned attempts to control the respondent fatigue, we also ensured that the instructions given to the participants were clear and concise. This is also to ensure that participants do not spend much of the study time in reading the instructions.
Future lines of research
In this study, we provided comprehensive tools to assess implicit personality. The measures presented here were adapted and validated following the most comprehensive and updated cross-cultural adaptation guidelines. This, in fact, is also a big contribution to Kuwaiti psychology, as it promotes the research of these novel constructs across different settings in the country.
Two more important directions can also be pinpointed from the results of the current study. As we discussed earlier, one is the need to rethink about the concept of reliability (esp., internal consistency) of implicit data. That said, future researchers should revisit the meaning of the reliability in this context. Also, they should consider coming up with a better methodology to assess and interpret the internal consistency of the scores. Another direction is the study of the meaning of the implicit aspects of the Big Five and trait EI. Our results clearly indicated no correlation between explicit and implicit measures, which raises the question of what implicit personality reflects. We believe that they refer to the unconscious and automatic aspects of a person’s personality, which are deeply ingrained in an individual and unconsciously influence their behaviour and thought patterns. Frankly, we believe that these two directions can be thought of as research projects in their own night.
Conclusions
Taking altogether, we believe that this study makes a contribution by introducing implicit association test as a vehicle to assess implicit personality constructs in Kuwait. These implicit personality assessment methodologies are highly novel and original in Kuwaiti Psychology field. Not only in Kuwait, but the findings presented in the present study also contributes to the growing implicit personality literature, as we presented results from a relatively large sample. These results supported the idea that the implicit aspect of personality should be thought of as a distinct aspect of personality. Thus, researchers within the field should view it as a different aspect of human personality rather than only viewing it as another method to measure personality.
Supporting information
S1 Table. The iat-related information for each sub-IAT (pilot studies).
https://doi.org/10.1371/journal.pone.0287013.s001
(DOCX)
S1 Appendix. List of stimuli used for the trait EI IAT.
https://doi.org/10.1371/journal.pone.0287013.s002
(DOCX)
S2 Appendix. List of stimuli used for the Big Five IAT.
https://doi.org/10.1371/journal.pone.0287013.s003
(DOCX)
Acknowledgments
We would like to thank all professors who helped us to recruit participants. Also, we would like to thank all participants that took part in the study and enabled this research to be possible.
References
- 1.
James LR, LeBreton JM. Assessing the implicit personality through conditional reasoning. Washington: American Psychological Association; 2012.
- 2.
Rudman LA. Implicit measures for social and personality psychology. Los Angeles Etc.: Sage; 2011.
- 3. Greenwald AG, McGhee DE, Schwartz JLK. Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology. 1998;74(6):1464–80. pmid:9654756
- 4. Steffens MC. Is the Implicit Association Test Immune to Faking? Experimental Psychology. 2004 Jun;51(3):165–79. pmid:15267125
- 5. Vecchione M, Dentale F, Alessandri G, Barbaranelli C. Fakability of Implicit and Explicit Measures of the Big Five: Research findings from organizational settings. International Journal of Selection and Assessment. 2014 Apr 23;22(2):211–8.
- 6. Petrides KV, Furnham A. On the dimensional structure of emotional intelligence. Personality and Individual Differences. 2000 Aug;29(2):313–20.
- 7.
Lane KA, Banaji MR, Nosek BA, Greenwald AG. Understanding and Using the Implicit Association Test: IV: What We Know (So Far) about the Method. In: Wittenbrink B, Schwarz N, editors. Implicit measures of attitudes. The Guilford Press; 2007. p. 59–102.
- 8. Greenwald AG, Farnham SD. Using the Implicit Association Test to measure self-esteem and self-concept. Journal of Personality and Social Psychology. 2000;79(6):1022–38. pmid:11138752
- 9.
Costa PT, McCrae RR. The Revised NEO Personality Inventory (NEO-PI-R). In: Goyle GJ, Matthews G, Saklofske DH, editors. The SAGE handbook of personality theory and assessment, Vol. 2. Personality measurement and testing. Sage Publications, Inc.; 2008. p. 179–198.
- 10.
Petrides KV. Technical Manual for the Trait Emotional Intelligence Questionnaires. London: London Psychometric Laboratory; 2009.
- 11.
Ben-Nun P. Respondent fatigue. In: Lavrakas PJ, editor. Encyclopedia of survey research methods. Sage Publications, Inc.; 2008. p. 743.
- 12. Grumm M, von Collani G. Measuring Big-Five personality dimensions with the implicit association test–Implicit personality traits or self-esteem? Personality and Individual Differences. 2007 Dec;43(8):2205–17.
- 13. Nosek BA, Greenwald AG, Banaji MR. Understanding and Using the Implicit Association Test: II. Method Variables and Construct Validity. Personality and Social Psychology Bulletin. 2005 Feb;31(2):166–80. pmid:15619590
- 14. Schnabel K, Asendorpf JB, Greenwald AG. Assessment of Individual Differences in Implicit Cognition. European Journal of Psychological Assessment. 2008 Jan;24(4):210–7.
- 15. Greenwald AG, Nosek BA, Banaji MR. Understanding and using the Implicit Association Test: I. An improved scoring algorithm. Journal of Personality and Social Psychology. 2003;85(2):197–216. pmid:12916565
- 16. Digman JM. Personality Structure: Emergence of the Five-Factor Model. Annual Review of Psychology. 1990 Jan;41(1):417–40.
- 17. Norman WT. Toward an adequate taxonomy of personality attributes: Replicated factor structure in peer nomination personality ratings. The Journal of Abnormal and Social Psychology. 1963;66(6):574–83.
- 18. Petrides KV, Pita R, Kokkinaki F. The location of trait emotional intelligence in personality factor space. British Journal of Psychology [Internet]. 2007 May;98(2):273–89. pmid:17456273
- 19. Alegre A, Pérez-Escoda N, López-Cassá E. The Relationship Between Trait Emotional Intelligence and Personality. Is Trait EI Really Anchored Within the Big Five, Big Two and Big One Frameworks? Frontiers in Psychology [Internet]. 2019 Apr 24;10(866). pmid:31068861
- 20. Al-Dassean KA. Psychometric properties of the Arabic version of the Trait Emotional Intelligence Questionnaire Short Form (TEIQue-SF). Cogent Psychology. 2023 Feb 7;10(1).
- 21. Freudenthaler HH, Neubauer AC, Gabler P, Scherl WG, Rindermann H. Testing and validating the trait emotional intelligence questionnaire (TEIQue) in a German-speaking sample. Personality and Individual Differences. 2008 Nov;45(7):673–8.
- 22. Li X, Zhang W, Xiang Y. Big Five personality traits and envy: The mediating role of emotional intelligence. Social Behavior and Personality: an international journal. 2023 Jan 12;51(1):1–11.
- 23. Perazzo MF, Abreu LG, Pérez-Díaz PA, Petrides KV, Granville-Garcia AF, Paiva SM. Trait Emotional Intelligence Questionnaire-Short Form: Brazilian Validation and Measurement Invariance between the United Kingdom and Latin-American Datasets. Journal of Personality Assessment. 2020 May 4;1–10.
- 24. Pérez-González JC, Sanchez-Ruiz MJ. Trait emotional intelligence anchored within the Big Five, Big Two and Big One frameworks. Personality and Individual Differences. 2014 Jul;65:53–8.
- 25. Petrides KV, Vernon PA, Schermer JA, Ligthart L, Boomsma DI, Veselka L. Relationships between trait emotional intelligence and the Big Five in the Netherlands. Personality and Individual Differences. 2010 Jun;48(8):906–10.
- 26. Robinson E, Hull L, Petrides KV. Big Five model and trait emotional intelligence in camouflaging behaviours in autism. Personality and Individual Differences. 2020 Jan;152:109565.
- 27. Siegling AB, Vesely AK, Petrides KV, Saklofske DH. Incremental Validity of the Trait Emotional Intelligence Questionnaire–Short Form (TEIQue–SF). Journal of Personality Assessment [Internet]. 2015 Apr;97(5):525–35. pmid:25830494
- 28. Van der Linden D, Tsaousis I, Petrides KV. Overlap between General Factors of Personality in the Big Five, Giant Three, and trait emotional intelligence. Personality and Individual Differences. 2012 Aug;53(3):175–9.
- 29. Vernon PA, Villani VC, Schermer JA, Petrides KV. Phenotypic and Genetic Associations Between the Big Five and Trait Emotional Intelligence. Twin Research and Human Genetics. 2008 Oct 1;11(5):524–30. pmid:18828735
- 30. Gadelrab HF. An Investigation of Differential Relationships of Implicit and Explicit Aggression: Validation of an Arabic Version of the Conditional Reasoning Test for Aggression. Journal of Personality Assessment. 2018 Aug 30;101(6):609–20. pmid:30160525
- 31. Back MD, Schmukle SC, Egloff B. Predicting actual behavior from the explicit and implicit self-concept of personality. Journal of Personality and Social Psychology. 2009;97(3):533–48. pmid:19686006
- 32. Nosek BA, Smyth FL. A Multitrait-Multimethod Validation of the Implicit Association Test. Experimental Psychology. 2007 Jan;54(1):14–29.
- 33. ITC Guidelines for Translating and Adapting Tests (Second Edition). International Journal of Testing. 2017 Dec 21;18(2):101–34.
- 34. Johanson GA, Brooks GP. Initial Scale Development: Sample Size for Pilot Studies. Educational and Psychological Measurement [Internet]. 2009 Dec 18;70(3):394–400.
- 35. Hasan NN, Petrides KV, Hull L, Hadi F. Trait emotional intelligence profiles of professionals in Kuwait. Frontiers in Psychology. 2023 Feb 17;14. pmid:36874848
- 36.
Alansari BM. The Psychometric Properties of NEO-FFI-S Based on the Kuwaiti Society. [مدى كفاءة قائمة العوامل الخمسة الكبرى للشخصية في المجتمع الكويتي]. Egypt: Derasat Nafsiyah; 1997.
- 37.
Team RStudio. RStudio: Integrated Development Environment for R. Version 4.0.5. Boston, MA: 2021.
- 38. Carpenter TP, Pogacar R, Pullig C, Kouril M, Aguilar S, LaBouff J, et al. Survey-software implicit association tests: A methodological and empirical analysis. Behavior Research Methods. 2019 Sep 12;51(5):2194–208. pmid:31515742
- 39.
Muthén LK, Muthén BO. Mplus User’s Guide. Los Angeles, CA: Muthén & Muthén; 1998–2017.
- 40.
Brown TA. Confirmatory factor analysis for applied research. New York: Guilford; 2015.
- 41. Schmukle SC, Egloff B. A Latent State-Trait Analysis of Implicit and Explicit Personality Measures. European Journal of Psychological Assessment. 2005 Jan;21(2):100–7.
- 42. McDaniel MJ, Beier ME, Perkins AW, Goggin S, Frankel B. An assessment of the fakeability of self-report and implicit personality measures. Journal of Research in Personality. 2009 Aug;43(4):682–5.
- 43. Sackett PR, Zhang C, Berry CM, Lievens F. Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology. 2021 Dec;107(11):2040–2068. pmid:34968080
- 44. Siegling AB, Nielsen C, Petrides KV. Trait emotional intelligence and leadership in a European multinational company. Personality and Individual Differences. 2014 Jul;65:65–8.
- 45. Galloway A. Non-Probability Sampling. Encyclopedia of Social Measurement. 2005;2:859–64.