Figures
Abstract
Objectives and methods
In order to assess the internal consistency, fit indexes, test-retest reliability, and validity of the Personality Inventory for the DSM-5 (PID-5) and its associations with age, gender, and education, 471 non-clinical (69,6% female; mean age: 37,63) and 314 clinical participants (69,7% female, mean age: 37,41) were administered the Hungarian translation of the PID-5, as well as the SCL-90-R and the SCID-II Personality Questionnaire.
Results
We found that; (a) temporal consistency of the Hungarian PID-5 was confirmed by one-month test-retest reliability analysis, (b) validity of the PID-5 instrument is acceptable in the clinical and the non-clinical sample as well, based on significant correlations with SCID-II and SCL-90-R, (c) PID-5 facets’ and domains’ associations with gender, age, and level of education are in accordance with previous findings.
Citation: S. Nagy Z, Salgó E, Bajzát B, Hajduska-Dér B, Unoka ZS (2022) Reliability and validity of the Hungarian version of the Personality Inventory for DSM-5 (PID-5). PLoS ONE 17(7): e0266201. https://doi.org/10.1371/journal.pone.0266201
Editor: Stephan Doering, Medical University of Vienna, AUSTRIA
Received: November 20, 2021; Accepted: March 15, 2022; Published: July 14, 2022
Copyright: © 2022 S. Nagy et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All data files are available at OSF: https://osf.io/zcm92/.
Funding: This work was supported by the following grants: Hungarian National Research, Development and Innovation Fund [grant numbers NKFI-132546]. Zsolt Szabolcs Unoka is the PI. Hungarian National Research, Development and Innovation Fund [grant numbers NKFI-129195]. Zsolt Szabolcs Unoka is a co-investigator.
Competing interests: The authors have declared that no competing interests exist.
1. Introduction
In the Alternative Model for Personality Disorders (AMPD) in the Diagnostic and Statistical Manual of Mental Disorders (DSM-5, section III), specific personality disorders (PD) are defined by typical impairments in personality functioning (Criterion A) and characteristic pathological personality traits (Criterion B) [1]. The AMDP retained only 6 of the 10 DSM-IV PDs and changed the Personality Disorder Not Otherwise Specified (PDNOS) category to a PD-Trait Specified diagnosis. The AMDP has not been accepted as the official diagnostic system for use in the DSM-5, partly because of the limited research support for its specific components. Since its publication, more than hundred publications investigated the validity of the AMDP in different languages [3, 7] and it needs further validation and examination whether it is generalizable to Hungarian language and culture. Although another study has already been published about the psychometric properties of the PID-5 in a Hungarian clinical and community sample [19], we found that this study had some psychometric and scientific limitations besides its strengths, and it is worth using another adaptation of the PID-5 mesure. First of all, our Hungarian translation of the PID-5 scale had been approved by the American Psychiatric Association (APA).
Moreover, we added some important extensions to the investigation of the psychometric properties of the PID-5 by including a 1-month test-retest reliability of the scales, by using SCID-II and SCL-90-R correlations as validity criteria, and by presenting three different models of the PID-5 internal structure in the confirmatory factor analysis.
Pathological personality traits (Criterion B), proposed by Krueger, Derringer, Markon, Watson, and Skodol [2] are organized into five broad domains: Negative Affectivity, Detachment, Antagonism, Disinhibition, and Psychoticism. Within the five broad trait domains, there are 25 specific trait facets [1]. APA (https://www.psychiatry.org/psychiatrists/practice/dsm/educational-resources/assessment-measures) provided different kinds of measures (self-report, informant, rating scale) for assessing maladaptive personality traits. The Personality Inventory is a self-report and other-informant measure for the DSM–5 (PID–5) [2]. Since its introduction, several studies examined various aspects of PID-5’s psychometric properties in non-clinical and clinical samples (see a review by Al-Dajani et al. [3]). We aim to further examine the psychometric properties of the Hungarian version of PID-5 in non-clinical and clinical samples. Our decision to use a non-clinical sample as well is based on the theory that traits that describe personality disorders are experienced at a less extreme level among healthy persons [4].
Internal consistencies of PID-5 domains and facets have been studied extensively, and mixed internal consistency scores were demonstrated. Coefficient alphas [5] for domain scales were between .75-.92 and .87-.96 and for facets ranged from .46-.77 to .94-.96, demonstrating some possible issues with scale reliability at the facet level (see Al-Dajani et al. [3]). Two versions of the domain scoring algorithm are used in the literature. The 25 facets version, which uses all the 25 facets in the definitions of the five domains, and the 15 facets version, which uses only 3 facets per domain [6]. Both versions derived from the study of Krueger et al. [2] which identified five higher order factors by explorative factor analysis of 25 facets. In order to eliminate cross-loadings of facets, three traits with the highest factor loadings were selected for each domain [2]. This scoring instruction was published in the APA copyright version of the PID-5 [6]. Further studies that investigated the five-factor exploratory factor model of the PID-5 facets also found facets that have cross-loadings on more than one domain and the number, magnitude and domain location of the loadings for crossloading facets varies across study samples [7].
In an attempt to address the variable nature of PID-5 factor analytic results, Watters and Bagby [7] conducted a meta-analysis of the PID-5 lower-order factor structure. They found that the level of crossloadings decreased when multiple samples were combined, and that the 15 facets scoring version of domains showed the lowest number of cross-loading facets (only anhedonia loaded on two domains substantially). A comparison of the factor structures of the three models is in Table 1.
One of our objective is to compare the factor structure of the 15 and 25 facets scoring version by confirmatory factor analysis. We also intend to quantify whether substantive differences in results occur because of using different domain scoring methods. In order to compare the different methods used in research examining the psychometric properties of PID-5 with exploratory or confirmatory factor analysis, Table 2 presents an overview of methods for such studies. This mini-review is also a means to compare the results of studies that analyze the psychometric properties of PID-5 in different languages.
We found one study that examined the test-retest reliability of the PID–5. Wright et al. [8] found that across an average of 1.44 years, Cohen’s d ranged between .17 (Antagonism) and 0.00 (Negative Affectivity) for the domains whose range is in the little to no change area according to Cohen’s guidelines [9] and between little and small change was found for the facets (d = .02 (Depressivity) and -.30 (Submissiveness).
The current study aimed to examine the psychometric properties of the Hungarian PID-5 facet and domain scales among Hungarian-speaking adults from a non-clinical community sample as well as in a Hungarian clinical sample. Specifically, we analyzed its facets and domains’ internal consistency and test-retest reliability. In addition, we tested the assumption of whether the DSM-5 traits are indeed maladaptive personality traits by analyzing their correlations with general personality disorder severity measured by the sum of the SCID-II screening questionnaire and general distress measured by SCL-90-R GSI. We also analyzed the specific associations between PID-5 domains and facets with personality disorder dimensions measured by the SCID-II screening questionnaire and the nine symptom dimensions of SCL-90-R. Finally, we analyzed the associations between PID-5 traits and age, gender, and education.
2. Methods
2.1. Participants and procedure
471 non-clinical participants were recruited by 20 psychology students who received class credit for their work. Each student aimed to collect data by using snowball sampling techniques by reaching around 50 volunteers with no known psychiatric disorders. Data was also gathered from 314 clinical patients of Semmelweis University’s Department of Psychiatry and Psychotherapy. Participants were stratified according to gender and age range. The majority of the non-clinical participants were female (69,6%) and their mean age was 37.63 years (SD: 12.96, their ages were between 18 and 74 years). The majority of the clinical participants were female as well (69,7%) and their mean age was 37,41 years (SD: 13,34, their ages were between 18 and 74 years). Every participant was Caucasian.
Based on SCID II interview, 173 participants (55,1%) in the clinical sample had at least one diagnosis of personality disorder, 117 subjects (37,3%) had multiple diagnoses (two or more personality disorders). No information was available on the clinical history of 64 individuals. The distribution of the different types of personality disorder was as follows:
Avoidant 21,6% (54 subjects); Dependent 16,06% (40 subjects); Obsessive-compulsive 18,145% (45 subjects); Passive-aggressive 13,2% (33 subjects); Depressive 24,4% (61 subjects); Paranoid 14,8% (37 subjects); Schizotype 2,4% (6 subjects); Schizoid 1,2% (3 subjects); Histrionic 14% (35 subjects); Narcissistic 17,6% (44 subjects) and Borderline 30,8% (77 subjects).
Participants completed all questionnaires online in Google-docs, a secure online survey tool. Each participant gave written consent to participate by choosing the "agree with" option in response to an informed consent form.
In the clinical sample some of the data was missing, and these missing data were not replaced, therefore the sample sizes vary in each analysis. There were 92 individuals who did not mark an answer for at least one item of the PID-5 questionnaire. One participant was excluded from the analysis due to too much missing data (50%), for the others, the number of missing data did not exceed 10%. The sample size was the lowest (222) in the analyzes where all PID-5 items were included in the confirmatory factor analysis (CFA). In CFAs when the complete factor structure was analyzed, the sample sizes varied between 222–241. Sample sizes ranged from 295 to 307 for item-level analyzes and from 265 to 277 for domain-level analyzes. No data were missing in the analyzes on facet- and domain scales, as the scores on the scales were calculated by averaging.
In addition, 93 (62 female) non-clinical subjects participated in the test-retest reliability study. The age of the participants in the test-retest reliability study varied from 19 to 62 years (Mean: 40.32; SD: 13.08). The descriptive statistics of the samples can be found in Table 3. The local Ethical Committee of the ELTE PPK (2018/8) approved the study protocol. The Regional and Institutional Committee of Science and Research Ethics of Semmelweis University approved the research procedure.
2.2. Measures
2.2.1. Personality Inventory for the DSM-5 (PID-5).
The PID-5 is a 220-item inventory that assesses personality disorder traits according to the DSM-5 trait model [2]. Items are rated on a 4-point Likert-type scale from 0 (Very False or Often False) to 3 (Very True or Often True). The PID-5 yields scale scores for 25 facets and the following five domains: Negative Affectivity, Detachment, Antagonism, Disinhibition, and Psychoticism. The official Hungarian translation used in the current study has been permitted by APA. Two independent translators translated the PID-5 into Hungarian, then a group of experts compared the two translations and agreed on a first version. We distributed the first version among patients of the Department of Psychotherapy at Semmelweis University, who commented on it, and based on their comments, we made corrections to the translation. There was no back translation made. A Hungarian version is freely available at the following site: https://lelekbenotthon.hu/pid-5-dsm-5-szemelyisegkerdoiv/
2.2.2. The Structured Clinical Interview for DSM-IV Axis II Personality Questionnaire (SCID-II PQ).
SCID-II PQ [10, 11] contains 119 items in a yes/no response format, corresponding to the DSM-IV personality disorders’ criteria. Regional and Institutional Committee of Science and Research Ethics of Semmelweis University recommended to leave out items referring to antisocial personality disorder, therefore we used only 104 items. In the present study, the PDs were expressed dimensionally by averaging the scores (range 0–1) of each SCID-II-PQ item per PD. Higher scores are reflecting more of the personality characteristic being assessed. We followed Hopwood et al.’s [12] method and eschewed categorical PDs in favor of continuous symptom counts for this study. In our non-clinical sample, where participants do not fit to a full PDs diagnosis, the use of continuous scales of PDs seemed to be a viable method. The SCID-II screening questionnaire has good reliability and validity data [13]. For the current study, we calculated PD scores for those PD-s which are proposed to be retained in DSM-5—except for Antisocial Personality Disorder -, as well as a total score of SCID-II by averaging. We did not measure the symptoms of Antisocial Personality Disorder since our ethical committee did not allow us to use the antisocial modul of the SCID-II-PQ for legal and ethical reasons. The internal consistency of SCID-II-PQ scales ranged from α = .55 (schizoid) to α = .89 (borderline).
2.2.3. Symptom Check List-90-Revised (SCL-90-R).
In order to assess the level of general distress and nine specific symptom dimensions (Somatization (SOM); Obsessive-compulsive (O-C); Interpersonal sensitivity (I-S); Depression (DEP); Anxiety (ANX); Hostility (HOS); Phobic anxiety (PHOB); Paranoid ideation (PAR); and Psychoticism (PSY), the Hungarian version of the SCL-90-R [14] was used. For analysis, a Global Severity Index (GSI) and the subscale scores were calculated by averaging. The internal consistency of these scales ranged from α = .82 (anger-hostility) to α = .95 (depression).
2.3. Data analytic procedure
MANOVA was run to analyze gender differences along with the 25 personality disorder traits, Pearson and Spearman’s correlation were calculated to evaluate the relationship between PID5 traits and age as well as educational level.
The reliability of the Hungarian PID-5 was examined by calculating the internal consistencies of the facet and domain scores (Cronbach’s alpha). We examined the 1-month test-retest reliabilities for the PID–5 scales by using Pearson correlation coefficients and Cohen’s d, which can establish a magnitude of change within this time interval. According to Cohen [9] d of .2 - .5 means small change, d of .5 - .8 means medium change, and if the value of d is higher than 0.8 the change can be considered large.
Confirmatory factor analysis (CFA) was conducted to test the unidimensionality of the PID-5 scales and to explore the factor structure of PID-5 facets and domains. Model fit was evaluated using the usual fit indexes: Comparative Fit Index (CFI), Root Mean Square Error of Approximation (RMSEA), Standardized Root Mean Square Residual (SRMR). The CFI is acceptable if the value is higher than .90, the RMSEA and SRMR indexes should be less than .10 for adequate fit [15–17].
To examine the validity of the Hungarian PID-5, relationships of PID-5 scales with scales of SCID II PQ and SCL90-R were explored using correlation analysis.
3. Results
3.1. Reliability
3.1.1. Internal consistency.
Internal consistency results are reported in Tables 4 and 5. Alpha coefficients for the Hungarian PID-5 domain scores ranged from .88 (Detachment) to .95 (Psychoticism) in the non-clinical sample, and from .90 (Antagonism) and .95 (Psychoticism) in the clinical sample. For the facets, scores ranged from .53 (Suspiciousness) to .95 (Eccentricity) in the non-clinical sample, and from .71 (Suspiciousness and Restricted Affectivity) to .95 (Eccentricity) in the clinical sample. The mean alpha for the domain scores was .90 (non-clinical) and .92 (clinical) and .81 (non-clinical) and .84 (clinical) for the facet scores. In summary, most scales have appropriate reliability, except for the Suspiciousness facet in the non-clinical sample, the reliability of which is low.
3.1.2. Test-retest reliability and magnitudes of change.
As it is shown in Table 4, internal reliability coefficients of PID-5 dimensions on test-retest sample were between .64 for Irresponsibility, .96 for Eccentricity. Test-retest correlation coefficients (Pearson) were between .53 (Callousness) and .86 (Risk-taking), which reflects a moderate and strong connection between the two measurements. Utilizing Cohen’s d to establish magnitude of change within a one month interval, a small amount of change (i.e., d of .2–.4; Cohen, 1988) was observed in Negative Affectivity (d = –.30), and in Disinhibition (d = –.20) domains, and in Anxiousness (d = –.22), Separation Insecurity (d = –.21), Withdrawal (d = –.22), Restricted Affectivity (d = –.23), Distractibility (d = –.33). In other domains and facets, we found a smaller d than–.20, which reflects little to no change according to Cohen’s guidelines (Cohen, 1988).
3.1.3. Confirmatory factor analysis.
We ran a Confirmatory Factor Analysis in order to explore the factor structure of PID-5 traits; results are reported in Tables 4 and 5. We analyzed the fitting of all the three factor structures found in the literature (the APA model [1], the early Krueger model [2] and the Watters-Bagby model [7]). The results showed that the RMSE and SRMR fit indices reach the good or acceptable level in both samples in case of all the three models, while CFI scores indicate a poor fit in all samples and models in almost all domains. Based on the APA model, the Disinhibition scale fits well in both samples, and Detachment fits well in the clinical sample. According to the results of item-level CFA, CFI of the PID-5 facet scales ranged from .81 to .99 in the non-clinical sample, and from .63 to .99 in the clinical sample. The values of RMSEA ranged from .01 to .22, and the SRMR ranged from .01 to .13 in the non-clinical sample, and in the clinical sample RMSEA ranged from .04 to .15, while the SRMR ranged from .01 to .15. (For more detail, see Tables 4 and 5.) These results indicate poor fit of 11 out of the 25 PID-5 facets in the non-clinical sample, and of 13 out of the 25 facets in the clinical sample. The scales that are found to fit the least in both samples are Emotional Lability, Unusual Beliefs, Depressivity, Perseveration, Restricted Affectivity and Risk Taking.
3.2. Validity
3.2.1. Correlations between PID-5 traits and SCID-II as well as SCL-90-R scores.
Correlations between PID-5 traits and SCID-II personality disorder scores and SCL-90-R scores are reported in Tables 6 and 7. We found that correlations of PID-5 domains and SCID-II total PD score are significant in both the clinical and the non-clinical groups with a Bonferroni adjusted p-value. Effect sizes are moderate or strong. Correlations between the traits and SCID-II total score are stronger in the clinical sample, where correlations are moderate to strong, except for weak correlations with Intimacy Avoidance, Submissiveness and Risk Taking. In the non-clinical sample, correlations between the traits and SCID-II total score are mostly moderate, with the exceptions of avoidance, Submissiveness, Risk Taking and Rigid Perfectionism, Restricted Affectivity and Attention Seeking, which are also weakly correlated.
Different personality disorder scores of SCID-II-PQ are significantly correlated to the expected PID-5 domains and traits with moderate or strong effect size, however, the correlations are stronger in the clinical sample. There are only a few exceptions: Intimacy Avoidance has only a weak relationship with Avoidant- and Obsessive-Compulsive PD. Restricted Affectivity is weakly correlated to Schizotypal- and Obsessive-Compulsive PD and the correlation between Borderline PD and Risk Taking is also weak.
Total score of SCL-90-R has significant (Bonferroni corrected) correlations with all PID-5 scales, except for Risk Taking in the clinical sample. Correlations are moderate to strong, except for Attention Seeking, Callousness, Grandiosity, Impulsivity, Irresponsibility, Restricted Affectivity in both samples as well as Deceitfulness and Submissiveness in clinical sample. The effect sizes of these latter correlations are weak.
At domain level, the PID-5 negative affectivity, detachment, disinhibition and psychoticism show significant, moderate or strong correlations with all the SCL90-R scales. PID-5 antagonism has weak relationship to SCL-90 R scales.
With regards to the facet level, as expected, the strongest relations were found between the PID-5 and the SCL-90-R counterparts. PID-5 anxiousness shows moderate correlation with the SCL-90-R anxiety scale and the PID-5 depressivity displays high correlation with the SCL-90-R depression scale. Furthermore, PID-5 hostility is correlated with SCL-90-R hostility, while PID-5 suspiciousness correlates with the SCL-90-R paranoid ideation, all of them with moderate effect sizes.
However, there are several PID-5 traits that do not correlate with some of the SCL-90-R dimensions in the clinical sample, these are: callousness, deceitfulness, grandiosity, intimacy avoidance, manipulativeness, risk taking and submissiveness.
3.2.2. Differences between clinical and non-clinical samples, gender, age and education.
Associations between PID-5 domains and facets comparing clinical and non-clinical groups, gender differences, as well as correlations with age and education are reported in Table 8.
3.2.2.1. Clinical and non-clinical differences. MANOVA was run to analyze clinical and non-clinical differences along with the 25 personality disorder traits and the 5 domains. Based on the 25 traits we found significant differences with a large effect size (Wilks’s l = .449; F (25, 759) = 37.31; p < .001; h2 = .551). More specifically, the Manipulativness, Deceitfulness and Risk Taking traits did not show significant differences between the clinical and non-clinical groups; for all the other traits, scores were significantly higher in the clinical group. At the domain level, the difference was also significant with a large effect size (Wilks’s l = .564; F (25, 779) = 120.606; p < .001; h2 = .436).
3.2.2.2. Gender differences. According to our results, the male and female profiles of personality disorder traits were significantly different and the difference had a large effect size in both the clinical (Wilks’s l = .755; F (25, 288) = 3.735; p < .001; h2 = .245) and the non-clinical sample (Wilks’s l = .70; F (25, 445) = 7.64; p < .001; h2 = .30). Significant difference between males and females was found at the domain level as well, and the difference had a large effect size in both the clinical (Wilks’s l = .896; F (5, 308) = 7.14; p < .001; h2 = .104) and the non-clinical (Wilks’s l = .857; F (5, 465) 15.564; p < .001; h2 = .0143) sample. Along the higher order domains, in the non-clinical sample we found significant differences between women and men in every domain except for Disinhibition; females scored significantly higher in the Negative Affectivity domain and lower in the other domains. However, based on the effect sizes, difference in the Negative Affectivity domain is trivial, in Detachment and Psychoticism difference is small, and in Antagonism the difference is moderate. In the clinical group at the domain level we found significant differences only in the Negative Affectivity domain, where females scored higher, and in the Antagonism domain, where males scored higher. On the facet level, there are significant gender differences along 17 traits in the non-clinical group; effect sizes are between .011 and .12.
3.2.2.3. Age and education. There are several traits and domains showing significant correlations with age, but the correlation coefficients are very weak, except for the Deceitfulness trait and the Antagonism domain related to it, where we found a weak negative correlation, mostly in the clinical sample.
We also found some significant but very weak correlations with education on both the domain and the facet levels. There is a weak negative correlation between Suspiciousness and education in the clinical sample (r = 28).
4. Discussion
The results of the present study supported the hypothesis that the Hungarian translation of the PID-5 is a reliable and valid measure of the proposed DSM-5 maladaptive traits, and our findings provide valuable information for assessing personality pathology in non-clinical and clinical populations. Specifically, we found that
- based on the Cronbach alphas, most of the scales have appropriate reliability in both samples, except for the Suspiciousness facet in the non-clinical sample; however, item-level CFA resulted in several poorly fitting trait scales
- test-retest reliability estimates and effect sizes reflect small to no changes;
- we did not find significant differences among the three different models in terms of the factor structure of PID-5 traits, however, the APA model was found to fit slightly better than the others
- validity of the PID-5 instrument is acceptable in both the clinical and the non-clinical sample, as PID-5 scales show a significant correlations with the equivalent scales of SCID-II and SCL-90-R
- there are significant differences between the personality disorder traits of clinical and non-clinical populations
- male and female profiles of personality disorder traits were significantly different in both samples, but in the non-clinical sample there are more significant differences at the facet and the domain level as well;
- there are significant negative correlations between age and PID-5 domains in the non-clinical sample, except for the Detachment domain; and in the clinical sample, Antagonism and Disinhibition is significantly and negatively correlated with age
- we did not find strong significant associations between education and PID-5 traits and domains
Based on our results our conclusion is that we recommend the Hungarian version of the PID-5 for future clinical research and practice. In the following, we highlight selected findings that contribute to the current literature on the PID-5 and the new DSM-5 trait model in general.
First, according to the analysis of the internal consistency index (Cronbach alpha) and the item-level, CFA fit indexes of PID-5 facets, six scales of the Hungarian PID-5 were poorly fitting based on several fit indices in both samples. These are Emotional Lability, Unusual Beliefs, Depressivity, Perseverance, Risk Taking, and Restricted Affectivity. Some of the fit indices of Emotional Lability and Perseverance did not meet minimal standards in other studies either [18]. Restricted Affectivity and Risk Taking also showed inadequate model fit in another research analyzing the psychometric properties of another translation of the Hungarian PID-5 [3, 19]. In our research, the only scale with an unacceptable Cronbach alpha level was Suspiciousness (.54) in the non-clinical sample. The reliability of the Suspiciousness scale was weak in several other psychometric analysis of PID-5 [3], suggesting that this is not a specific characteristic of the Hungarian version of PID-5. We analyzed the factor loadings of the items of the 6 problematic scales and some of them were very low, under .2 (Emotional Lability: item 18, 138, 181, Unusual Beliefs: item 143, Depressivity: item 86, Perseverance: item 46, Restricted Affectivity: item 45, Risk taking: items 98, 164). It might be necessary to revise and rewrite these problematic items in order to increase reliability.
Second, temporal consistency of the Hungarian PID-5 has been confirmed by a one-month test-retest reliability analysis. Based on Cohen’s d values, small to no change was observed along with PID-5 facet scales within the one-month interval. The small amount of change observed in the Negative Affectivity (d = –.30), and in the Disinhibition (d = –.20) domains is similar to the findings of Wright and colleagues [8] who observed a small degree change in 6 out of the 25 traits after 1,5 years. Wright considers that the small negative change might be explained by some amelioration of symptomatology and shows that although PD traits are highly stable, some traits might be dynamically associated with the change of psychosocial functioning over time. In our study, test-retest correlation coefficients were between .53 (Callousness) and .86 (Risk-taking), which reflects a moderate to strong connection between the two measurements. In comparison with other self-report measures of psychopathology in other studies [20], PID-5 scales have similar stability coefficients.
Third, we did not find significant differences among the three different models in terms of the factor structure of PID-5 traits. According to our analysis, those models that include all the 25 traits fit weakly in every domain based on the CFI scores. However, the APA model—that builds up the five domains out of 15 facets—, was found to fit slightly better than the others. The Disinhibition domain proved to be a good fit in both samples, and the Detachment domain was fitting well in the clinical sample based on every fit index. The weak CFI scores could be explained by that many items of the scales load onto several factors simultaneously, however, this does not mean that the scales are inconsistent because they have acceptable Cronbach alpha levels.
Fourth, validity of the PID-5 instrument is acceptable in the clinical and the non-clinical sample as well. PID-5 scales are significantly correlated with SCID-II total PD score and SCL-90-R global severity index. Furthermore, different personality disorder scores of SCID-II-PQ are significantly correlated with the expected PID-5 domains and traits with moderate or strong effect size. Moreover, PID-5 domains show significant correlations with all the SCL90-R scales, and as expected we found strong relations between the PID-5 facets and their SCL-90-R counterparts. These results support the hypotheses that the Hungarian PID-5 is a valid measurement of personality pathology.
However we found some unexpected results as well. PID-5 Intimacy avoidance shows only a weak, almost negligible relationship with Avoidant PD, and has no significant correlations with 7 out of the 9 SCL-90-R dimensions, but only in the clinical sample. According to these results, further studies are needed to understand how PID-5 Intimacy avoidance scale can describe the pathological avoidance behavior. We also found that PID-5 Risk taking scale does not correlate significantly with Global Severity Index of SCL-90-R, and 8 of the 9 SCL-90-R subscales in the clinical sample, and although its relationship is significant with Borderline PD, it is only with weak effect size. Furthermore, Risk Taking is one of the four PID-5 traits that does not differentiate significantly between clinical and non-clinical samples. Our results support that Risk taking is a reliable scale of PID-5, but the question arises as to how pathological it can be considered. There are two other PID-5 traits, Deceitfulness and Manipulativeness, which are not correlated significantly with many SCL-90-R dimensions. It suggests that these traits might be independent from psychological distress.
Fifth, we found significant differences among clinical and non-clinical participants in four domains (no difference in Antagonism) and in 22 out of 25 facets, with mostly medium effect sizes. (See Table 8.) In the majority of comparisons, clinical participants received significantly higher scores than non-clinical participants. No significant differences were observed for the facets of Deceitfulness, Manipulativeness and Risk Taking between the two samples; these facets all belong to the Antagonism domain. This finding is only partially in line with Bach and colleagues’ findings [21], where they observed no significant differences between clinical and non-clinical groups for the facets of Manipulativeness and Attention Seeking. Scores in the Antagonism domain are relatively low in both samples, meaning that antisocial personality functioning was not characteristic in our clinical sample either. The low level of Antagonism domain in the clinical sample might be explained by the fact that our clinical sample consisted of the participants of the four weeks long psychotherapy program of our department and severe antisocial traits and the diagnosis of antisocial personality disorder with traits of primary psychopathy are exclusion criteria for our treatment program.
Sixth, we found significant differences between the profiles of females and males in PID-5 domains and facets in both samples. Females presented higher scores in the Negative Affectivity domain in both samples, while men score significantly higher in the Antagonism domain in both samples. However, based on effect sizes, the difference between genders in Negative Affectivity is small. In this domain, Emotional Lability scores are higher in females and the difference has medium effect size, but with Anxiousness and Separation Anxiety differences are negligible.
These results are partially in line with the findings of Bastiaens et al. [22] on a clinical sample, where females scored higher on Negative Affectivity and lower on Antagonism than males. However, Bastiaens and colleagues found that females scored higher on Disinhibition, which domain showed no difference in neither of our samples. Moreover, in our non-clinical sample at the facet level males scored higher on the Irresponsibility, Distractibility, Manipulativeness and Risk Taking scales, which is in accordance with the results of Fossati et al. [23], and with reports of higher scores on Conscientiousness in females [24, 25].
Seventh, regarding age, a significant negative relation was found with Negative Affectivity, Antagonism, Disinhibition, and Psychoticism in the non-clinical sample. In the clinical sample, only Antagonism and Disinhibition showed significant negative relation with age. In previous PID-5 studies, inverted relations were found between age and the facets of Antagonism, Disinhibition and Psychoticism [23]. In a different study, similar associations were found in a clinical sample [22]. In a non-clinical sample, again, an inverted relation was found between age and Antagonism and Disinhibition [26]. Our results are in line with the results of longitudinal studies in the US and cross-sectional studies from many cultures that were using self-report measures of personality traits, namely that the broad factors of Neuroticism, Extraversion, and Openness to Experience decline from adolescence to adulthood, whereas Agreeableness and Conscientiousness increase [27].
Eighth, we did not find strong significant associations between education and PID-5 traits and domains. This is contradicted by some earlier findings, for example the study of Bastiaens et al. [22] found that Disinhibition was significantly negatively related to education.
Our results are limited by that our measure of personality disorders (SCID-II-PQ) was based only on self-reports. We did not measure the symptoms of Antisocial personality disorder since our ethical committee did not allow us to use the antisocial modul of the SCID-II-PQ for legal and ethical reasons. There was many data missing in the clinical sample, which led to a smaller sample size than originally planned.
Even in light of these limitations, our study shed new light on some aspects of PID5, as well as replicating some previous results [12, 28] in a linguistically and culturally different non-clinical and clinical sample.
References
- 1.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, DC; 2013.
- 2. Krueger RF, Derringer J, Markon KE, Watson D, Skodol AE. Initial construction of a maladaptive personality trait model and inventory for DSM-5. Psychol Med. 2012 Sep;42(9):1879–90. Epub 2011 Dec 8. Erratum in: Psychol Med. 2012 Sep;42(9):1891. pmid:22153017; PMCID: PMC3413381.
- 3. Al-Dajani N, Gralnick TM, Bagby RM. A Psychometric Review of the Personality Inventory for DSM-5 (PID-5): Current Status and Future Directions. J Pers Assess. 2016;98(1):62–81. Epub 2015 Nov 30. Erratum in: J Pers Assess. 2018 Jul-Aug;100(4):448. pmid:26619968.
- 4. Samuel DB, Carroll KM, Rounsaville BJ, Ball SA. Personality disorders as maladaptive, extreme variants of normal personality: borderline personality disorder and neuroticism in a substance using sample. J Pers Disord. 2013 Oct;27(5):625–35. pmid:24044664; PMCID: PMC4125199.
- 5. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika, 1951 16, 297–334.
- 6.
Krueger RF, Derringer J, Markon KE, Watson D, Skodol AV. The Personality Inventory for DSM–5 (PID-5)-Adult. Washington, DC: American Psychiatric Association. 2013, Retrieved from http://www.psychiatry.org/practice/dsm/dsm5/onlineassessment-measures
- 7. Watters CA, Bagby RM. A meta-analysis of the five-factor internal structure of the Personality Inventory for DSM-5. Psychol Assess. 2018 Sep;30(9):1255–1260. Epub 2018 Jun 28. pmid:29952594.
- 8. Wright AG, Calabrese WR, Rudick MM, Yam WH, Zelazny K, Williams TF, et al. Stability of the DSM-5 Section III pathological personality traits and their longitudinal associations with psychosocial functioning in personality disordered individuals. J Abnorm Psychol. 2015 Feb;124(1):199–207. Epub 2014 Nov 10. pmid:25384070; PMCID: PMC4333076.
- 9.
Cohen J. Statistical power analysis for the behavioral sciences (2nd ed.). 1988, Hillsdale, NJ: Erlbaum.
- 10.
First MB, Gibbon M, Spitzer RL, Williams JB, Benjamin LJ. User’s guide for the structured interview for DSM-IV personality disorders. 1995, New York: New York State Psychiatric Research Institute. Biometrics Research Department.
- 11. Szádóczky E, Rózsa S, Unoka Zs, User’s Guide for the Structured Clinical Interview for DSM-IV Axis I (SCID-I), 2006, Hungarian Version. OS Hungary Kft.
- 12. Hopwood CJ, Thomas KM, Markon KE, Wright AG, Krueger RF. DSM-5 personality traits and DSM–IV personality disorders. 2012, Journal of Abnormal Psychology, 121, 424. pmid:22250660
- 13. Jacobsberg L, Perry S, Frances A. Diagnostic agreement between the SCID-II screening questionnaire and the personality disorder examination. 1995, Journal of Personality Assessment, 65, 428–432. pmid:8609583
- 14. Derogatis LR, Cleary PA. Confirmation of the dimensional structure of the SCL‐90: A study in construct validation. 1977, Journal of clinical psychology, 33, 981–989. https://doi.org/10.1002/1097-4679(197710)33:4<981::AID-JCLP2270330412>3.0.CO;2-0
- 15. Anderson JC, Gerbing DW. Some methods for respecifying measurement models to obtain unidimensional construct measurement. 1982, Journal of Marketing Research, 19, 453–460. https://doi.org/10.1177/002224378201900407
- 16. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. 1999, Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118
- 17. Marsh HW, Hau K-T, Balla JR, Grayson D. Is more ever too much? The number of indicators per factor in confirmatory factor analysis. 1998, Multivariate Behavior Research, 33, 181–220. pmid:26771883
- 18. Zimmermann J, Altenstein D, Krieger T, Holtforth MG, Pretsch J, Alexopoulos J, et al. The structure and correlates of self-reported DSM-5 maladaptive personality traits: findings from two German-speaking samples. J Pers Disord. 2014 Aug;28(4):518–40. Epub 2014 Feb 10. pmid:24511899.
- 19. Labancz E, Balázs K. Kuritárné Szabó I. The psychometric properties of the Hungarian version of the Personality Inventory for DSM-5 in a clinical and a community sample. 2020. Curr Psychol https://doi.org/10.1007/s12144-020-00831-z
- 20. Samuel DB, Hopwood CJ, Ansell EB, Morey LC, Sanislow CA, Markowitz JC, et al. Comparing the temporal stability of self-report and interview assessed personality disorder. J Abnorm Psychol. 2011 Aug;120(3):670–80. pmid:21443287; PMCID: PMC4793384.
- 21. Bach B, Sellbom M, Simonsen E. Personality Inventory for DSM-5 (PID-5) in Clinical Versus Nonclinical Individuals: Generalizability of Psychometric Features. Assessment. 2018 Oct;25(7):815–825. Epub 2017 May 13. pmid:28503935.
- 22. Bastiaens T, Claes L, Smits D, De Clercq B, De Fruyt F, Rossi G, et al. The Construct Validity of the Dutch Personality Inventory for DSM-5 Personality Disorders (PID-5) in a Clinical Sample. Assessment. 2016 Feb;23(1):42–51. Epub 2015 Mar 3. pmid:25736039.
- 23. Fossati A, Somma A, Krueger RF, Markon KE, Borroni S. On the relationships between DSM-5 dysfunctional personality traits and social cognition deficits: A study in a sample of consecutively admitted Italian psychotherapy patients. Clin Psychol Psychother. 2017 Nov;24(6):1421–1434. Epub 2017 May 11. pmid:28493518.
- 24. Costa PT, Terracciano A, McCrae RR. Gender differences in personality traits across cultures: robust and surprising findings. J Pers Soc Psychol. 2001 Aug;81(2):322–331. pmid:11519935
- 25. Schmitt DP, Realo A, Voracek M, Allik J. Why can’t a man be more like a woman? Sex differences in Big Five personality traits across 55 cultures. J Pers Soc Psychol. 2008 Jan;94(1):168–182. Erratum in: J Pers Soc Psychol. 2009 Jan;96(1):118. pmid:18179326.
- 26. Van den Broeck J, Bastiaansen L, Rossi G, Dierckx E, De Clercq B, Hofmans J. Hierarchical structure of maladaptive personality traits in older adults: joint factor analysis of the PID-5 and the DAPP-BQ. J Pers Disord. 2014 Apr;28(2):198–211. Epub 2013 Jun 20. pmid:23786271.
- 27. McCrae RR, Costa PT Jr, Hřebíčková M, Urbánek T, Martin TA, Oryol VE, et al. Age differences in personality traits across cultures: self‐report and observer perspectives. 2004, European Journal of Personality, 18, 143–157. https://doi.org/10.1002/per.510
- 28. Anderson J, Snider S, Sellbom M, Krueger R, Hopwood C. A comparison of the DSM-5 Section II and Section III personality disorder structures. Psychiatry Res. 2014 May 30;216(3):363–72. Epub 2014 Jan 11. pmid:24656519.
- 29. Bo S, Bach B, Mortensen EL, Simonsen E. Reliability and Hierarchical Structure of DSM-5 Pathological Traits in a Danish Mixed Sample. J Pers Disord. 2016 Feb;30(1):112–29. pmid:25905735
- 30. Coelho O, Pires R, Ferreira AS, Gonçalves B, AlJassmi M, Stocker J. Arabic Version of the Personality Inventory for the DSM-5 (PID-5) in a Community Sample of United Arab Emirates Nationals. Clin Pract Epidemiol Ment Health. 2020 Jul 30;16:180–188. pmid:32874193
- 31. De Clercq B, De Fruyt F, De Bolle M, Van Hiel A, Markon KE, Krueger RF. The hierarchical structure and construct validity of the PID-5 trait measure in adolescence. J Pers. 2014 Apr;82(2):158–69. pmid:23647646
- 32. De Fruyt F, De Clercq B, De Bolle M, Wille B, Markon K, Krueger RF. General and maladaptive traits in a five-factor framework for DSM-5 in a university student sample. Assessment. 2013 Jun;20(3):295–307. pmid:23405016
- 33. Fang S, Ouyang Z, Zhang P, He J, Fan L, Luo X, Zhang J, Xiong Y, Luo F, Wang X, Yao S, Wang X. Personality Inventory for DSM-5 in China: Evaluation of DSM-5 and ICD-11 Trait Structure and Continuity With Personality Disorder Types. Front Psychiatry. 2021 Mar 26;12:635214. pmid:33841206
- 34. Ferrer A, Londono NH, Calvete E, Krueger RF. The Psychometric Properties of the Personality Inventory for the DSM-5 (PID-5) in a Colombian Clinic Sample. Universitas Psychologica. 2019. 18 (1) https://doi.org/10.11144/Javeriana.upsy18-1.ppoi
- 35. Fossati A, Krueger RF, Markon KE, Borroni S, Maffei C. Reliability and validity of the personality inventory for DSM-5 (PID-5): predicting DSM-IV personality disorders and psychopathy in community-dwelling Italian adults. Assessment. 2013 Dec;20(6):689–708. pmid:24065702
- 36. Gutiérrez F, Aluja A, Peri JM, Calvo N, Ferrer M, Baillés E, Gutiérrez-Zotes JA, Gárriz M, Caseras X, Markon KE, Krueger RF. Psychometric Properties of the Spanish PID-5 in a Clinical and a Community Sample. Assessment. 2017 Apr;24(3):326–336. pmid:26391204
- 37. Gutiérrez F, Ruiz J, Peri JM, Gárriz M, Vall G, Cavero M. Toward an Integrated Model of Pathological Personality Traits: Common Hierarchical Structure of the PID-5 and the DAPP-BQ. J Pers Disord. 2019 Jun 18:1–S18. pmid:31210573
- 38. Quilty LC, Ayearst L, Chmielewski M, Pollock BG, Bagby RM. The psychometric properties of the personality inventory for DSM-5 in an APA DSM-5 field trial sample. Assessment. 2013 Jun;20(3):362–9. pmid:23588687
- 39. Roskam I, Galdiolo S, Hansenne M, Massoudi K, Rossier J, Gicquel L, Rolland JP. The Psychometric Properties of the French Version of the Personality Inventory for DSM-5. PLoS One. 2015 Jul 20;10(7):e0133413. pmid:26193699
- 40. Shojaei Z, Mohammadi A, Zarei M. Psychometric Properties of the Persian Version of Personality Inventory for DSM-5 (PID-5) in Psychiatric Patients. Iran J Psychiatry Behav Sci. 14(4):e87974
- 41. Somma A, Borroni S, Maffei C, Giarolli LE, Markon KE, Krueger RF, Fossati A. Reliability, Factor Structure, and Associations With Measures of Problem Relationship and Behavior of the Personality Inventory for DSM-5 in a Sample of Italian Community-Dwelling Adolescents. J Pers Disord. 2017 Oct;31(5):624–646. pmid:28072038
- 42. Thimm JC, Jordan S, Bach B. Hierarchical Structure and Cross-Cultural Measurement Invariance of the Norwegian Version of the Personality Inventory for DSM-5. J Pers Assess. 2017 Mar-Apr;99(2):204–210. pmid:27661474
- 43. Thomas KM, Yalch MM, Krueger RF, Wright AG, Markon KE, Hopwood CJ. The convergent structure of DSM-5 personality trait facets and five-factor model trait domains. Assessment. 2013 Jun;20(3):308–11. pmid:22946103
- 44. Wright AG, Thomas KM, Hopwood CJ, Markon KE, Pincus AL, Krueger RF. The hierarchical structure of DSM-5 pathological personality traits. J Abnorm Psychol. 2012 Nov;121(4):951–7. pmid:22448740