Many studies have assessed emotion recognition in patients with Borderline Personality Disorder and considerable evidence has been accumulated on patients’ ability to categorize emotions. In contrast, their ability to detect emotions has been investigated sparsely. The only two studies that assessed emotion detection abilities found contradictory evidence on patients’ ability to detect angry faces.
To clarify whether patients with Borderline Personality Disorder show enhanced detection of angry faces, we conducted three experiments: a laboratory study (n = 53) with a clinical sample and two highly powered web studies that measured Borderline features (n1 = 342, n2 = 220). Participants in all studies completed a visual search paradigm, and the reaction times for the detection of angry vs. happy faces were measured.
Consistently, data spoke against enhanced detection of angry faces in the Borderline groups, indicated by non-significant group (Borderline vs. healthy control) × target (angry vs. happy) interactions, despite highly satisfactory statistical power to detect even small effects.
Citation: Hepp J, Hilbig BE, Kieslich PJ, Herzog J, Lis S, Schmahl C, et al. (2016) Borderline Personality and the Detection of Angry Faces. PLoS ONE 11(3): e0152947. https://doi.org/10.1371/journal.pone.0152947
Editor: Kim Felmingham, University of Tasmania, AUSTRALIA
Received: January 14, 2016; Accepted: March 20, 2016; Published: March 31, 2016
Copyright: © 2016 Hepp et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The research reported on was supported by grants to Prof. Benjamin E. Hilbig from the Baden-Württemberg Foundation, Germany (http://www.bwstiftung.de/forschung/) and from the German Research Foundation [HI 1600/1-1] (http://www.dfg.de/). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Borderline Personality disorder (BPD) is a severe psychiatric disorder that affects around 1 to 3% of the adult population and is characterized by marked affective instability, impulsivity, and interpersonal problems [1, 2]. Dysfunctional emotion processing is considered one of the central factors that contribute to the phenomenology of this disorder. As a first step in the emotion processing continuum, the question of how well BPD patients can recognize emotions in others has gained particular interest in the past . Numerous studies on emotion recognition in BPD have been conducted and finally summarized in two comprehensive literature reviews [4, 5] as well as two recent meta-analyses [6, 7]. We argue that the studies summarized therein actually capture two distinct aspects of emotion recognition, namely emotion categorization and emotion detection, and present new evidence on the relatively under-researched aspect of emotion detection.
According to a recent series of experiments, emotion categorization and detection are distinct processes that require distinct abilities and should thus be discriminated from each other . Emotion categorization requires the ability to correctly identify and verbally label a presented emotion. In previous studies on BPD samples, this ability was measured by asking participants to indicate which emotion they saw in a face by choosing the correct term from a set of pre-defined answering options. A meta-analysis on these studies revealed an emotion categorization deficit across all emotions and selective deficits for differentiating between disgust and anger .
In contrast, emotion detection does not require specific emotions to be named and distinguished from one another; it simply comprises the ability to accurately perceive whether any emotional content is present in a face or not. Emotion detection has previously been captured using morphing paradigms in which an initially neutral face gradually changes into an emotional one. The earliest stage in the morphing process at which participants perceive some degree of emotion in the face (and therefore stopped the morphing process) thus indicates their emotion detection abilities. Evidence on BPD patients’ performance in this task was mixed. Two studies found no difference regarding emotion detection between healthy controls (HC) and BPD patients  or youth with BPD symptoms . Others found superior  and still others found inferior  emotion detection performance in the included BPD groups. Finally, high BPD symptom counts predicted a lower detection threshold for angry male faces in a non-patient sample . Evidently, clear conclusions regarding BPD patients’ emotion detection abilities are not possible based on this body of work. One potential problem with morphing studies is that they assess not only emotion detection but also an additional element of emotion categorization, because, once the morphing process is stopped, participants still have to label the displayed emotion. To gain a better understanding of BPD patients’ emotion detection abilities it thus seems necessary to assess detection in paradigms that do not also include categorization.
So far, only two studies have addressed emotion detection outside of morphing studies. The first study by Schulze and colleagues used a rapid, continuous stream of stimuli consisting of facial photographs that were cropped into a standard oval shape . Several trials included a happy or angry face, whereas others included only neutral looking faces. After each trial, participants indicated whether an emotional face was present or not. No main effect of group was found, but BPD patients were selectively more sensitive towards angry stimuli, producing greater hitrates for angry faces than the HC group. A second study by Hagenhoff and colleagues  assessed emotion detection abilities for happy and angry faces using the face-in-the-crowd-paradigm . In this paradigm, emotional faces have to be detected in “crowds” (i.e. matrices) of neutral faces. In the past, the face-in-the-crowd paradigm has repeatedly revealed an anger superiority effect (ASE): angry faces in neutral crowds were detected faster and with fewer errors than happy faces in neutral crowds . Hagenhoff and colleagues employed line drawings of round faces (“smiley faces”) and analyzed the reaction times with which participants were able to detect angry faces. They found no overall group difference but also no detection advantage for angry faces in the BPD group, which stands in contrast to the previous findings by Schulze and colleagues.
In sum, while there is considerable previous evidence on emotion categorization in BPD [6, 7], evidence on emotion detection is sparse. Moreover, the only two existing studies that have used paradigms that assess emotion detection directly found contradicting evidence for the angry condition [14, 15]. Schulze and colleagues found an increased sensitivity for angry faces while Hagenhoff and colleagues found no specific advantage for angry faces. As a result of this, it remains entirely unclear whether patients’ detection abilities are in fact altered, particularly for angry faces, and further studies are clearly needed to resolve this.
In an effort to shed further light on this topic we conducted a detection-only study. In line with the procedure of the two previous detection studies, we focused on happy and angry stimuli. Specifically, we chose to use a face-in-the-crowd-paradigm similar to the one Hagenhoff and colleagues used. We preferred this paradigm to the one employed by Schulze and colleagues because it is a more immediate measure of emotion detection: in the face-in-the-crowd paradigm participants respond immediately to a detected face, whereas in the other paradigm participants indicate whether they have detected an emotional face with delay, at the end of a picture sequence. For the face-in-the-crowd paradigm, we intended to improve upon previous material by creating a new set of geometrically controlled facial stimuli that would minimize confounding visual effects: when happy stimuli are drawn such that eyebrows and mouth are parallel to the facial surround, this can cause greater sensitivity for the angry faces simply because these are more salient . In line with previous studies using the face-in-the-crowd paradigm, we expected that (1) BPD and HC participants would all show an ASE regarding reaction times, thus detecting angry faces faster than happy faces. Additionally we assessed whether using geometrically controlled stimuli (2) BPD patients would show an anger detection advantage in the form of a stronger ASE in the face-in-the-crowd paradigm, mirroring the one previously found by Schulze and colleagues.
Methods Study 1
Twenty-nine female BPD patients and 28 female HCs were recruited between May 2011 and December 2011. Patients were recruited through a patient database at the Central Institute of Mental Health, Mannheim, Germany, and healthy control participants were recruited through advertisements in local newspapers After applying a criterion for a minimal usable trial number of 90% per condition, twenty-seven participants remained in the BPD group and 26 participants comprised the control group. BPD patients were diagnosed by an experienced clinician using the German version of the structured clinical interview for the DSM-IV  and the International Personality Disorder Examination . General exclusion criteria were comorbid diagnoses of schizophrenia, bipolar disorder, developmental disorder, or substance dependency. The majority of patients were unmedicated (61.5%); several took antidepressants (19.2%), neuroleptics (7.7%), or a combination of both (11.5%). Patients had on average 1.9 comorbid disorders (SD = 1.5), which included mainly anxiety disorders (n = 19), mood disorders (n = 12), eating disorders (n = 4), other personality disorders (n = 3), and each one case of pain disorder, alcohol abuse, and trichotillomania. Patients mean score of 2.05 (SD = 0.84) on the Borderline-Symptom-List, indicated symptom severity similar to that observed in other patient samples . Patients further had a mean score of 27.48 (SD = 10.14) on the Beck-Depression-Inventory , indicating clinically relevant depressive symptoms. Controls’ mean score of 0.37 on the Borderline-Symptom-List (SD = 0.41) and 5.27 (SD = 5.22) on the Beck-Depression-Inventory indicated the absence of clinically relevant BPD and depressive symptoms. Further, HC fulfilled no criteria for any present or past mental disorder. Patients (aged 18 to 42, M = 26.63, SD = 6.15) were matched to HC (aged 18 to 38, M = 25.19, SD = 5.43) for age and level of education.
In the face-in-the-crowd paradigm, each trail consisted of a 3×3 matrix of faces which followed a 1000ms inter-trail-interval. Participants were instructed to indicate as fast and accurately as possible whether a target face was present in the matrix (press A = “target present”, press L = “target absent”). Target faces included a happy, angry and a blue baseline stimulus. Stimuli were schematic faces designed using the vector drawing program Inkscape . Importantly, angry and happy stimuli were geometrically controlled variants of the neutral face: Their eyebrows and mouth were exact mirror images of each other. Thus, in geometrical terms, they differed from the neutral face to exactly the same extent. Parallelism of eyebrows and facial surround was minimized by including hair. The blue stimulus, which served as a neutral baseline, was an exact copy of the neutral stimulus, but with blue eyebrows and mouth. An exemplary matrix with the stimuli included here is presented in Fig 1.
The study was reviewed and ethics approval was granted by the ethics committee of the University of Heidelberg before the study began (committee name: Medizinische Ethik-Kommission II der Medizinischen Fakultät Mannheim der Universität Heidelberg). At the beginning of the study all participants provided informed written consent after obtaining detailed information about the study procedure. The ethics committee approved of this procedure. Capacity to consent was determined by the patient’s diagnostician and was given for all participants. Next, participants provided demographical information and then filled in several questionnaires not pertinent to the current investigation. Next, participants completed four practice trials of the face-in-the-crowd paradigm, followed by a set of 216 experimental trials, consisting of 108 noise trials (no target) and 36 target trials for each type of target (angry/happy/blue).
Results Study 1
The dataset for Study 1 can be accessed in S1 Dataset. Reaction times (in ms) were log-transformed due to non-normality. Extreme outliers with a reaction time more than 2.5 SD above the sample mean were excluded (1.2% of trials). All statistical analyses were conducted for correctly answered trials only (M = 93.6% of all trials, SD = 14.0%). All means, standard deviations and confidence intervals are presented separately for both groups in Table 1. Data was analyzed using a repeated measures ANOVA with reaction times as the dependent variable (see Table 2).
Hypothesis 1: As hypothesized, the ASE was present for both groups, indicated by a significant main effect of target type (see Table 2). Post-hoc t-tests confirmed the expected order of means: angry faces were detected significantly faster than happy faces, t(52) = -10.04, p < .001, d = -1.38, 95% CI [-1.76,-0.99], and blue faces, t(52) = -5.68, p < .001, d = -0.78, 95% CI [-1.09,-0.46].
Hypothesis 2: Contrary to this hypothesis, BPD patients did not show a stronger ASE than HCs, indicated by a non-significant group×target interaction (see Fig 2). Note that all result patterns remained unchanged when repeating analyses (i) without the blue condition, (ii) when dummy-coding for participants’ medication status, (iii) when using non-transformed reaction times, and (iv) when using hitrates as the dependent variable.
Discussion Study 1
The non-significant group×target interaction points to an equally strong ASE for both BPD patients and HCs. This is in line with a previous study employing the same paradigm but different stimuli  and speaks against enhanced emotion detection for angry faces in BPD. However, upon close inspection this finding cannot be taken as conclusive evidence that there is no such effect: With the given sample of n = 53, α = .05 and β = .05, the empirical correlation among repeated measures of r = .80, and a non-sphericity correction of ε = .87, a sensitivity power analysis conducted with g*Power  indicated that the interaction effect that can be ruled out within a conventional level of statistical confidence is Cohen’s f = 0.15 (all reported f values in the following analyses refer to the square root of the ratio of effect variance and pooled within groups variances as implemented in g*Power 3.0). Stated simply, this is the smallest effect for which we have sufficient power (1-ß ≥ .95). Consequently, a truly small effect of f = 0.10 or less according to Cohen  cannot be excluded with sufficient certainty given the sample size. Thus, we cannot determine whether there really were no differences in emotion detection between the groups, or whether we lacked the sample size to find an existing small effect.
Consequently, it appeared appropriate to conduct a second study with sufficient statistical power to detect even a small effect. To this end, we recruited a large online-sample in which we measured BPD features, a method that has been successfully applied in other studies of BPD . We hypothesized that (1) the general ASE would be replicated and set out to test whether, in this much larger sample, (2) the ASE would be stronger in the group with high BPD scores than in that with low scores.
Methods Study 2
To determine the necessary sample size for ruling out small effects, an a priori power analysis was conducted. To make this replication directly comparable to study 1, we maintained the analytical framework of a repeated measures ANOVA with two groups. The necessary sample size to detect a small effect of f = 0.10, with α = .05 and 1–β = .95 for the interaction term of the repeated measures ANOVA is n = 338. Power analysis was based on the g*Power default value for the correlation among repeated measures of r = .50 and a conservative value of ε = .70. Since we expected drop-out and that some cases would not meet the requirements for adequate data quality, we oversampled by approximately 15%.
Three-hundred-and-ninety-one German speaking participants were recruited via social networks and BPD-related websites such as self-help groups. We ensured that the final dataset contained no repeated participations (identified by an identical IP address, sex, and age) and only retained participants who confirmed to have participated seriously. After applying filters for a minimal trial number of 90% per target type, 342 participants remained in the final dataset. Participants were aged 18 to 60 (M = 25.5, SD = 6.7), 75.7% were female, and 28.9% of participants were recruited from BPD forums or BPD self-help groups.
While collecting data online, we carefully followed the standards for web-based experiments . At the beginning of the study all participants provided informed written consent after obtaining detailed information about the study procedure. Next, participants completed a personality inventory the results of which are reported elsewhere , followed by the VEI. Next, 210 trials of the face-in-the-crowd paradigm were presented; 35 for each target type (angry, happy, blue) and 105 noise trials. Upon completing this task, participants answered several control questions to ensure serious participation.
Results Study 2
The dataset for Study 2 can be accessed in S2 Dataset. Data were filtered and log-transformed exactly as in Study 1. Next, a group with VEI scores below the clinical cut-off score of 38  and one with participants scoring above were formed. The group below cut-off comprised 203 participants, their VEI scores ranging from 7 to 37, M = 24.3, SD = 7.3, and 139 participants scored above cut-off with scores from 38 to 69, M = 50.1, SD = 8.7. The VEI showed a high internal consistency of α = .92 in this sample.
Hypothesis 1: The ASE found in study 1 was replicated across groups. Again, post-hoc t-tests showed angry faces were detected faster than happy faces, t(341) = -22.1, p < .001, d = -1.20, 95% CI [-1.34,-1.05], and blue faces, t(341) = -9.88, p < .001, d = -0.53, 95% CI [-0.65,-0.42].
Hypothesis 2: As in Study 1, the magnitude of the ASE did not differ between groups (see Table 2; Fig 2). Note that the result patterns remained unchanged when repeating analyses (i) without the blue condition, (ii) using non-transformed reaction times, (iii) using extreme groups of participants with a VEI score ≤ 24 (average rating of maximal 1 on all VEI items) in one group and with a score ≥ 48 in the other (average rating of minimal 2 on all VEI items), (iv) when using hit rates as the dependent variable, (v) in a linear mixed model with the continuous VEI score and target type as predictors.
Discussion Study 2
As in Study 1, the ASE did not differ between groups. However, for the current sample, G*Power  sensitivity analysis for the interaction term indicated that an effect as small as f = 0.07 could be ruled out. The power analysis was based on the observed correlation among repeated measures of r = .74, a non-sphericity correction of ε = .68 and a conventional level of α = .05. Thus, the current sample size implied sufficient power to detect even small effects. Nonetheless, a null-finding such as the present one should be as rigorously subject to replication as a study showing an effect. Thus, to further test the preliminary conclusion that there is no group×target interaction, we decided to replicate our own results in a third study, using another large, web-based sample. Moreover, to ensure that the null finding was not limited to the specific material we used , we created a second set of stimulus material with different identities and varying emotional intensities.
Methods Study 3
Analogous to Study 2, we performed an a priori power analysis. The necessary sample size to detect a small effect of f = 0.10 with 1–β = .95 and α = .05 was determined as n = 198. Assuming a correlation among repeated measures in a similar range as in Study 1 and Study 2 (both r = .75), we adopted the slightly more conservative value of r = .70. We recruited participants in the same fashion as in Study 2 and again oversampled by approximately 15%. Two-hundred-and-twenty-eight participants completed the entire study. All participants provided informed written consent at the beginning of the study and after having obtained detailed information about the study procedure. After applying the previous filter for a minimal trial number, 220 participants remained in the final dataset. Of the remaining participants (aged 18 to 58, M = 28.1, SD = 8.6), 82.7% were female, and 35.0% were recruited from BPD-related websites.
Procedure and Material
BPD features were again assessed using the borderline scale of the VEI . The new material for the face-in-the-crowd paradigm was created using Inkscape . Twelve different identities (six female, six male) were constructed in the variants angry, happy and neutral. The intensity of the emotional expression, that is, the degree to which mouths and eyebrows were curved, was varied. To create unsystematic and heterogeneous crowds, neutral faces were randomly selected from the stimulus set per trial and randomly assigned to a position in the 3×3 matrix (see Fig 1 for an exemplary matrix). Each of the 12 angry/happy target faces was presented 3 times, always in a random position in the matrix, within a crowd of randomly selected neutral faces. Hence, participants completed 36 target trials showing angry/happy faces each. The blue baseline stimulus was no longer included, thus participants completed 72 noise trials with neutral matrices. The procedure was identical to that in Study 2.
Results Study 3
The dataset for Study 3 can be accessed in S3 Dataset.
Data were transformed, filtered and participants were divided into two groups exactly as in Study 2, with 119 participants scoring above and 101 scoring below the clinical cut-off of the VEI. VEI scores ranged from 38 to 68, M = 51.5, SD = 8.0, in the group above the clinical cut-off and from 5 to 37, M = 24.7, SD = 7.9, in the group below the cut-off. In this sample, the VEI’s internal consistency was α = .93.
Hypothesis 1: The ASE was replicated across groups. Post-hoc t-tests showed that angry stimuli were detected faster than happy ones, t(219) = -11.27, p < .001, d = -0.76, 95% CI [-0.91,-0.60]. As in study 2, the result patterns remained unchanged when repeating analyses (i) using non-transformed reaction times, (ii) using extreme groups of participants with a VEI score ≤ 24 in one group and with a score ≥ 48 in the other, (iii) when using hitrates as the dependent variable, (iv) in a linear mixed model with the continuous VEI score and target type as predictors. Hypothesis 2: As previously, there was no significant group×target interaction. G*Power sensitivity analysis for the interaction term indicated that in this sample an effect as small as f = 0.07 could be ruled out. Power-analysis based on the empirical correlation among repeated measures of r = .81 and α = .05.
In a laboratory experiment (Study 1), we tested the hypothesis that BPD patients might differ from HCs in detecting angry faces, indicated by an increased ASE in the face-in-the-crowd paradigm. We did observe a strong ASE, but it did not differ between BPD patients and controls. However, as power analyses revealed, this finding was inconclusive as it may have been the result of the small sample size and thus inherently low statistical power to detect small effects. Hence, we conducted two further studies with large samples and thus sufficient power to rule out even small effects.
For studies 2 and 3, participants were recruited online and BPD features were measured. Participants were divided into two groups based on the clinical cut-off score (one group with, one without clinically significant BPD features). It is important to note that 41% of the sample in study 2 and 54% of the sample in study 3 had clinically relevant BPD features above the clinical cut-off, due to recruitment efforts in the BPD online community. Studies 2 and 3 replicated the pattern observed in study 1: a general ASE was found, but no indication of a group×target type interaction was present, speaking against enhanced anger detection in BPD. Due to the larger sample size, even a small (interaction) effect could be ruled out. Thus, the null findings yield support for the null hypothesis within a conventional level of statistical certainty. Note that study 3 replicated this pattern using heterogeneous stimuli with different identities and varying emotional intensities. The finding is in line with a previous study that employed the same paradigm , yet different stimuli, and stands in contrast to the finding by Schulze and colleagues .
Regarding limitations of the study, the samples of Studies 2 and 3 must be viewed with some caution. Although measuring BPD features in two large online samples solved the problem of insufficient statistical power, the VEI’s clinical threshold is of course not equivalent to a clinical diagnosis, even though the VEI cut-off is known to correspond very well with diagnoses based on the DSM-IV (82% accordance) , (73% accordance) . Also, the influence of third variables such as comorbid diagnoses, substance abuse, medication status etc. could not be controlled for in the web samples.
The results imply that it is necessary to differentiate between emotion detection and emotion categorization in BPD. The first requires the ability to perceive the mere presence of an emotion, whereas emotion categorization requires further cognitive processing. Our experiments repeatedly revealed no difference between patients and controls for the detection of angry faces, which suggests that impairments in emotion processing may only arise later, when faces are evaluated and categorized [6, 7]. A recent study that measured BPD features in a student sample supports the notion of normal emotion detection yet altered (that is, greater) emotion recognition abilities .
Our results further have implications for clinical research. It is our view that patient-based, fully-controlled lab-studies and large-scale web-studies could serve as complementary approaches. Indeed, most conclusive evidence will necessarily entail compatible findings from both sources. Given that small-sample, patient-based studies are clearly more common in clinical research, our recommendation is to complement these with large-scale, web-based samples more often and thus test whether effects (or null findings) hold when both the type-I and type-II error are low.
Conceived and designed the experiments: J. Hepp BEH SL IN. Performed the experiments: J. Hepp BEH J. Herzog IN. Analyzed the data: J. Hepp PJK. Contributed reagents/materials/analysis tools: J. Hepp BEH PJK CS IN. Wrote the paper: J. Hepp BEH PJK J. Herzog SL CS IN.
- 1. Tomko RL, Trull TJ, Wood PK, Sher KJ. Characteristics of borderline personality disorder in a community sample: Comorbidity, treatment utilization, and general functioning. J Pers Disord. 2014;28(5):734–50. pmid:25248122
- 2. Torgersen S, Kringlen E, Cramer V. The prevalence of personality disorders in a community sample. Archives of general psychiatry. 2001;58(6):590–6. pmid:11386989
- 3. Schmahl C, Herpertz SC, Bertsch K, Ende G, Flor H, Kirsch P, et al. Mechanisms of disturbed emotion processing and social interaction in borderline personality disorder: state of knowledge and research agenda of the German Clinical Research Unit. Borderline Personal Disord Emot Dysregul. 2014;1(1):1–17.
- 4. Domes G, Schulze L, Herpertz SC. Emotion recognition in borderline personality disorder- a review of the literature. J Pers Disord. 2009;23(1):6–19. pmid:19267658
- 5. Lazarus SA, Cheavens JS, Festa F, Rosenthal MZ. Interpersonal functioning in borderline personality disorder: A systematic review of behavioral and laboratory-based assessments. Clin Psychol Rev. 2014;34(3):193–205. pmid:24534643
- 6. Daros AR, Zakzanis KK, Ruocco AC. Facial emotion recognition in borderline personality disorder. Psychol Med. 2013;43(9):1953–63. pmid:23149223
- 7. Mitchell AE, Dickens GL, Picchioni MM. Facial Emotion Processing in Borderline Personality Disorder: A Systematic Review and Meta-Analysis. Neuropsychol Rev. 2014;24(2):166–84. pmid:24574071
- 8. Sweeny TD, Suzuki S, Grabowecky M, Paller KA. Detecting and categorizing fleeting emotions in faces. Emotion. 2013;13(1):76–91. pmid:22866885
- 9. Domes G, Czieschnek D, Weidler F, Berger C, Fast K, Herpertz SC. Recognition of facial affect in borderline personality disorder. J Pers Disord. 2008;22(2):135–47. pmid:18419234
- 10. Jovev M, Chanen A, Green M, Cotton S, Proffitt T, Coltheart M, et al. Emotional sensitivity in youth with borderline personality pathology. Psychiatry Res. 2011;187(1):234–40.
- 11. Lynch TR, Rosenthal MZ, Kosson DS, Cheavens JS, Lejuez CW, Blair RJR. Heightened sensitivity to facial expressions of emotion in borderline personality disorder. Emotion. 2006;6(4):647–55. pmid:emo-6-4-647.
- 12. Robin M, Pham-Scottez A, Curt F, Dugre-Le Bigre C, Speranza M, Sapinho D, et al. Decreased sensitivity to facial emotions in adolescents with Borderline Personality Disorder. Psychiatry Res. 2012.
- 13. Veague HB, Hooley JM. Enhanced sensitivity and response bias for male anger in women with borderline personality disorder. Psychiatry Res. 2014;215:687–93. pmid:24485062
- 14. Schulze L, Domes G, Köppen D, Herpertz SC. Enhanced detection of emotional facial expressions in borderline personality disorder. Psychopathology. 2012;46(4):217–24. pmid:23006779
- 15. Hagenhoff M, Franzen N, Gerstner L, Koppe G, Sammer G, Netter P, et al. Reduced sensitivity to emotional facial expressions in borderline personality disorder: effects of emotional valence and intensity. J Pers Disord. 2013;27(1):19–35. pmid:23342955
- 16. Hansen CH, Hansen RD. Finding the face in the crowd: An anger superiority effect. J Pers Soc Psychol. 1988;54(6):917–24. pmid:psp-54-6-917.
- 17. Öhman A, Lundqvist D, Esteves F. The face in the crowd revisited: A threat advantage with schematic stimuli. J Pers Soc Psychol. 2001;80(3):381–96. pmid:psp-80-3-381.
- 18. Purcell DG, Stewart AL. Still another confounded face in the crowd. Atten Percept Psychophys. 2010;72(8):2115–27. pmid:21097856
- 19. Wittchen H-U, Fydrich T, Zaudig M. SKID: Strukturiertes Klinisches Interview für DSM-IV; Achse I und II. Achse I: psychische Störungen. SKID-I. Göttingen: Hogrefe; 1997.
- 20. Mombour W, Zaudig M, Berger R, Berner W, Cranach M, Giglhuber О, et al. International Personality Disorder Examination (IPDE) ICD-10 Modul—Deutschsprachige Ausgabe Im Auftrag der WHO. Göttingen: Hogrefe Testzentrale; 1996.
- 21. Bohus M, Limberger MF, Frank U, Chapman AL, Kühler T, Stieglitz R- D. Psychometric properties of the borderline symptom list (BSL). Psychopathology. 2007;40:126–32. pmid:17215599
- 22. Beck AT, Ward C, Mendelson M. An inventory for measuring depression. Arch Gen Psychiatry. 1961;4(6):561–71.
- 23. The Inkscape Team. Inkscape (Version 0.48.1) [Computer software] 2011 [cited 2011 10/03]. Available: http://inkscape.org/. Accessed 10/03 2011.
- 24. Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39(2):175–91. pmid:2007-11814-002.
- 25. Cohen J. Statistical power analysis for the behavioral sciences (2nd edition). Hillsdale, NJ: Lawrence Erlbaum Associates; 1988.
- 26. Chapman AL, Leung DW, Lynch TR. Impulsivity and emotion dysregulation in borderline personality disorder. J Pers Disord. 2008;22(2):148–64. pmid:18419235
- 27. Groves JA, Engel RR. The German adaptation and standardization of the Personality Assessment Inventory (PAI). J Pers Assess. 2007;88(1):49–56. pmid:2007-01945-007.
- 28. Morey LC. Personality Assessment Inventory professional manual. Odessa, FL: Psychological Assessment Resources; 1991.
- 29. Bell-Pringle VJ, Pate JL, Brown RC. Assessment of borderline personality disorder using the MMPI-2 and the Personality Assessment Inventory. Assessment. 1997;4(2):131–9. pmid:1997-04648-003.
- 30. Stein MB, Pinsker-Aspen JH, Hilsenroth MJ. Borderline pathology and the Personality Assessment Inventory (PAI): An evaluation of criterion and concurrent validity. J Pers Assess. 2007;88(1):81–9. pmid:2007-01945-011.
- 31. Reips U-D. Standards for Internet-based experimenting. Exp Psychol. 2002;49(4):243–56. pmid:2002-06471-001.
- 32. Hepp J, Hilbig BE, Moshagen M, Zettler I, Schmahl C, Niedtfeld I. Active versus reactive cooperativeness in Borderline Psychopathology: A dissection based on the HEXACO model of personality. Pers Indiv Dif. 2014;56:19–23.
- 33. Snowden RJ, Craig R, Gray NS. Detection and recognition of emotional expressions: Effects of traits of personality disorder and gender. Pers Indiv Dif. 2013;54(2):158–63.