Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Can anxiety and race interact to influence face-recognition accuracy? A systematic literature review

  • Isabeau K. Tindall ,

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Visualization, Writing – original draft, Writing – review & editing

    Isabeau.Tindall@research.uwa.edu.au

    Affiliations School of Psychological Science, University of Western Australia, Perth, Western Australia, Australia, Centre for Transformative Work Design, Curtin University, Perth, Western Australia, Australia

  • Guy J. Curtis,

    Roles Conceptualization, Formal analysis, Methodology, Supervision, Validation, Writing – review & editing

    Affiliation School of Psychological Science, University of Western Australia, Perth, Western Australia, Australia

  • Vance Locke

    Roles Supervision, Writing – review & editing

    Affiliation Discipline of Psychology, Murdoch University, Perth, Western Australia, Australia

Abstract

Wrongful convictions continue to occur through eyewitness misidentification. Recognising what factors, or interaction between factors, affect face-recognition is therefore imperative. Extensive research indicates that face-recognition accuracy is impacted by anxiety and by race. Limited research, however, has examined how these factors interact to potentially exacerbate face-recognition deficits. Brigham (2008) suggests that anxiety exacerbates other-race face-recognition deficits. Conversely, Attentional Control Theory predicts that anxiety exacerbates deficits for all faces. This systematic review examined existing studies investigating the possible interaction between anxiety and face-race to compare these theories. Recent studies included in this review found that both anxiety and race influence face-recognition accuracy but found no interaction. Potential moderators existing in reviewed studies, however, might have influenced their results. Separately, in some studies reviewed, anxiety induced during retrieval impacted recognition, contrasting with the conclusions of previous reviews. Recommendations for future research are given to address moderators potentially impacting results observed previously.

Introduction

The ability to accurately recognise a face is a vital skill needed for daily functioning. Faces are often the key feature we pay attention to when looking at someone and the primary information source for discerning whether someone we see is known or unknown [1]. Facial recognition ability can be dissociated from both general intelligence and other types of recognition memory, such as memory for objects [2]. Human beings are considered experts at recognising faces; however, this ability is fallible [3, 4]. Because accurately recognising faces is important, extensive research has investigated what affects this ability [3].

Two factors extensively researched regarding their influence on face-recognition accuracy are anxiety [5] and race [6]. The potential interaction between these variables has direct relevance to many real-world situations, such as eyewitness identification [5, 6]. When witnessing a crime, an individual will likely become anxious. Further, the individual committing the crime may be from a different racial group than the witness. This systematic literature review combines the available literature focusing on the influence of anxiety and race on face-recognition accuracy.

Anxiety

Anxiety can be broadly defined as the anticipation of future threat or danger, characterised by anticipatory cognitive, behavioural, and affective changes in response to the possibility of uncertain future negative events [7]. According to Attentional Control Theory (ACT) [8], anxiety can lead to a reduction in performance on cognitive tasks, such as those used to examine face-recognition accuracy [5, 9]. Specifically, the drop in cognitive performance that occurs within the context of face-recognition occurs via insufficient inhibition of task-irrelevant stimuli while experiencing anxiety [8].

ACT argues that individuals when experiencing anxiety emphasise the processing of threat-related stimuli, either internal (i.e. task-irrelevant thoughts) or external (i.e. processing task-irrelevant stimuli), instead of monitoring performance on the task at hand [8]. Therefore, anxiety impairs attentional control through interfering with the balance between the stimulus-driven system (attends to salient and visible stimuli) and goal-driven systems (monitors task performance), such that the stimulus-driven system is given precedence [10]. The amount of disruption caused by this threat processing is directly proportional to the amount of anxiety experienced, such that the higher the level of anxiety, the larger the impairment in attentional control, and subsequently, the greater the drop in cognitive performance [8]. Different sources of anxiety, such as situational stress, and/or having a strong innate predisposition to becoming anxious increases the tendency to give precedence to processing of task-irrelevant threat stimuli [8].

Moderators impacting effect anxiety on face-recognition accuracy

Within the literature, several moderators potentially influencing how anxiety impacts performance have been identified. Anxiety is not a unidimensional concept, but rather, is considered to be multidimensional [11, 12]. Anxiety is commonly separated into the dimensions of state anxiety; the transient anxiety response, and trait anxiety; the stable tendency to become state anxious [12]. The State-Trait Anxiety Inventory (STAI) is often used to measure these forms of anxiety [13]. However, recently, it has been argued that anxiety should be further separated into the dimensions of cognitive anxiety; anxiety symptoms related to thought processes, and somatic anxiety; anxiety related to physiological symptoms [11]. Recent studies have suggested that these dimensions differently impact performance on cognitive tasks [1416]. For instance, anxiety inductions that induce anxiety through physiological anxiety symptoms, such as the 7.5% CO2 Challenge, due to inducing an unconditioned anxiety response [17, 18], have been argued to disrupt face-recognition accuracy to a larger magnitude than cognitive anxiety inductions. Therefore, the type of anxiety induction used may moderate the strength of the anxiety response, and therefore, the effect of anxiety on face-recognition accuracy [19, 20].

Another moderator that has been found to impact the effect of anxiety on face-recognition accuracy is face-stimuli valence [2125]. Individuals when experiencing heightened state and/or trait anxiety give preferential processing to negative (i.e. angry, fear or sad) face-stimuli as compared to non-negative stimuli (i.e. happy or neutral) [26, 27]. Greater processing therefore increases recognition accuracy for this type of stimuli when experiencing anxiety [9]. For instance, in numerous studies, high trait anxious individuals [26, 28], and those experiencing heightened state anxiety [26], had increased face-recognition accuracy for negative stimuli. Therefore, it is important to either control for stimuli-valence through using face-stimuli of the same valence, or purposely measuring the impact of stimuli-valence on face-recognition accuracy.

Memory phase of induced anxiety

In addition to seeing anxiety as a multidimensional concept, and measuring the impact of face-stimuli valence, it is also important to consider the phase of memory formation in which the anxiety was induced, as this can also influence face-recognition accuracy through disrupting recognition [19, 29, 30]. Recognition consists of two stages: encoding, where information is stored into memory [31], and retrieval, where previously-encoded information is accessed [32]. According to Deffenbacher et al. [5], anxiety may only impact face-recognition accuracy when induced during encoding. Applying the principles of ACT [8], anxiety can interfere with encoding through the preferential allotment of cognitive resources to worrying thoughts; with this impairing task performance [5, 10, 33]. Theoretically, anxiety experienced during retrieval might also inhibit memory [19] through interfering with previously-encoded memories [34]. However, although possible in theory, evidence for the impact of anxiety on retrieval in terms of face-recognition accuracy has been inconsistent [19, 20, 29, 35].

Race

Race also affects face-recognition accuracy [6]. Termed the Own-Race Bias (ORB) in the literature, the ORB is the tendency to have lower face-recognition accuracy, specifically, fewer hits (correctly identifying a previously seen face) and hit-rate (probability of correctly responding affirmatively to seeing a face previously) for other-race faces. Individuals also have increased false alarms (incorrectly perceiving a face as previously seen) and false-alarm rate (probability of incorrectly indicating seeing a face previously) for individuals of another race [6, 36, 37]. Further, individuals have a reduced d-prime (d′: accuracy of correctly identifying a target as previously seen or unseen) and more liberal response criterion (response bias: tendency to respond liberally or strictly to whether a face has been seen previously, irrespective of accuracy) for other-race faces as compared to own-race faces [6]. The ORB is highly robust, with this effect exhibited in White [6, 36] and Asian [38] individuals viewing White, Asian, Black and Middle Eastern faces [36].

Many models have been created to explain the ORB, broadly categorised into perceptual learning and social cognitive theories (i.e. feature-selection model, see [39]; cognitive disregard model, see [40], ingroup/outgroup model, see [37]; multidimensional face-space model, see [41, 42]). Of these models, research has found most support for the ingroup/outgroup model of face processing (IOM) [37] and the multidimensional face-space model (MDS) [41, 42].

According to the IOM [37], when individuals encounter someone from another race, they automatically categorise them as an outgroup exemplar and therefore impersonalise them when stored into memory [37, 43]. The MDS model suggests that memory for faces is stored in a multidimensional space in which each individual’s identity is represented by a unique point [41, 42]. Perceptual experience with different faces refines the face space so that it can be used to discriminate identities of highly familiar categories, such as human faces [44]. Individuals have more perceptual experience with individuals of their own-race, and so their multidimensional space consists of more own-race, and less other-race examples. This experience leads to better discrimination accuracy for own-race, and increased discrimination errors, for other-race individuals [41].

Moderators impacting effect of race on face-recognition accuracy

According to the IOM [37], categorisation as part of the outgroup is not specific to race, and ingroup/outgroup classifications according to gender (own-gender bias; see [45]) have also been found [46]. The review article conducted by Herlitz et al. [45] suggests that an own-gender bias is reliability exhibited in research examining face-recognition accuracy. This own-gender bias, however, is only present in female participants, as males do not express this bias [45]. Moderating the impact of perceptual experience on face-recognition accuracy according to the MDS model [41, 42], is the quality of other-race contact [47, 48]. According to the review article by Brigham [49], self-reported interracial contact is positively associated with face-recognition accuracy for other-race faces. Further, the motivation to gain individuating experience with other-race individuals [47] also moderates the influence of perceptual expertise on face-recognition accuracy. Several studies have supported this perspective, as individuals with increased individuating experience or contact, were better able to holistically process other-race faces, and subsequently, had higher other-race face-recognition accuracy [47, 48, 50]. Therefore, own-group biases and the amount of perceptual expertise with other-race indiviudals needs to be considered when examining the impact of race on face-recognition accuracy.

Anxiety and ORB interaction

As outlined above, anxiety and race can influence face-recognition accuracy when acting separately. Therefore, it is plausible that if these factors were to cooccur, they could interact to alter face-recognition accuracy. Brigham [49] previously suggested that intergroup anxiety and race could interact to exacerbate face-recognition deficits for other-race faces. According to Brigham [49] this interaction occurs through intergroup anxiety reducing face-recognition accuracy for other-race individuals via an increased reliance on categorisation. Anxiety increases categorisation by reducing the cognitive resources available for individuation of faces [51]. Increased reliance on categorisation subsequently increases the reliance on stereotypes for outgroup individuals, as a way of inferring information about the individuals’ racial group [36, 37, 43, 49, 52, 53]. This theory can be adapted to situations involving other types of anxiety, such as anxiety coming from an external source (i.e. state anxiety; [29]) to potentially explain exacerbated other-race face-recognition deficits while highly state anxious. Specifically, Bodenhausen [54] indicated that incidental affect, such as anxiety, can influence outgroup perceptions through increased stereotyping, despite coming from a situation unrelated to the intergroup context.

Unlike the theory adapted from Brigham [49], ACT [8], does not predict an interaction between anxiety and race. Therefore, studies seeking to examine the impact of anxiety on face-recognition accuracy, as per ACT [8], do not normally consider the influence of race on observed results. For instance, a substantial number of previous studies measuring the impact of anxiety on face-recognition accuracy have used mixed-race participants and/or mixed-race stimuli but have failed to examine the influence of race [5557]. Further, some studies have failed to even record the race of face-stimuli and/or participants altogether (for instance see: [20, 35, 58, 59]).

Although an interaction between anxiety and race has been proposed by Brigham [49], limited research has investigated whether anxiety and race can interact to alter face-recognition accuracy. Because of this, it is important to systematically examine studies that have measured both the impact of anxiety and race on face-recognition accuracy within the same study. Despite the theory by Brigham [49] exisiting within the literature for over a decade, the interaction of these factors has received minimal attention. Further, as outlined above, it is well established that there are several potential moderators of the impact of anxiety and race on face-recognition accuracy. Therefore, when examining studies looking at the interaction between anxiety and race, it is also important to examine the impact of these potential moderators.

The current study

The purpose of the present systematic literature review, in light of the above, was to examine the possible interaction between anxiety and race in the context of face-recognition accuracy. Because moderators unique to anxiety and race may influence the relationship between these two variables, potential moderators were examined separately. The goals of the current study were explored through three sequential steps. Firstly, this review examined how potential moderators that have been previously identified could influence the effect of anxiety on face-recognition accuracy. For example, how stimuli-valence influences face-recognition accuracy [22]. The influence of anxiety, when induced during either encoding or retrieval, was also examined at this point, as according to ACT [8], anxiety when induced during either encoding or retrieval, can produce memory deficits. The second step examined the influence of moderators specific to race. Potential moderators examined were the influence of possible own-gender biases, as outlined in the IOM [37] and the impact of perceptual expertise and contact on face-recognition accuracy. Lastly, this review directly examined the interaction between anxiety and race, and whether this interaction was in the direction predicted by Brigham [49], or if results supported ACT [8]. We also discuss at this point, how potential moderators identified by the first two steps reduce confidence in results observed.

Method

Protocol

This review was conducted following the Preferred Reporting Items for Systematic Literature Review and Meta-Analysis (PRISMA) guidelines for systematic reviews and meta-analyses [60] (see S1 Table) and was preregistered on the Open Science Framework (https://osf.io/ja28t). It must be noted that after peer-review of this article, an additional inclusion criterion was added, such that we have only included studies that examined the interaction between anxiety and race.

Search procedure

The following electronic databases were searched from their inception through to 7 February 2020: PubMed, PsycINFO, PsycARTICLES, ProQuest, Scopus, Web of Science and Wiley Library (see S1 File for more detail). Search strategies for each database are shown in S1 Appendix. The search was constructed around the differing types of “anxiety” and “face recognition” and were adapted for each database. Due to overlap with eyewitness memory research, searches also included terms such as "stress", "arousal" and "eyewitness memory". Studies measuring related concepts such as stress, however, were only included if they defined this concept such that it would meet the definition of anxiety provided earlier in this paper.

Race was not explicitly searched for to broaden results identified due to extensive variation in ethnic identifications and terms associated with race. Therefore, studies examining how anxiety affects face recognition were examined first, due to this being the first step, and then these studies were further examined according to those examining race, and the interaction between anxiety and race.

Search strategies for databases were cleared by a librarian at the University of Western Australia. Each database search was modified according to available Boolean terms and ability for truncation or proximity searching. Due to common variations in phrasing, terms like “face recognition”, were searched via proximity searching. Where proximity searching was not available or appropriate, the most common phrase variation was searched instead.

Only articles that were in English, full-text, and peer reviewed were included. Abstracts and titles of identified records were screened, and the full articles of potentially eligible studies retrieved. Firstly, all duplicates were removed. Two reviewers then screened the titles and abstracts of the remaining papers individually and obtained full-text of potentially eligible studies. The studies were then checked in detail, with eligible papers included in the systematic literature review. Once included papers were selected, backwards and forward searching of these papers’ references were conducted to find further eligible studies. These articles were then assessed for eligibility according to inclusion and exclusion criteria.

Inclusion and exclusion criteria

Included studies 1) used an experimental study design, 2) measured face-recognition accuracy as one of the main focuses, 3) face stimuli portrayed any emotional valence (e.g. happy, sad, neutral) from any race (e.g. White, Asian, Black), 4) participants were ≥18 years, with or without a psychiatric diagnosis and from any gender or race, 5) with anxiety explicitly measured, where 6) anxiety was either non-induced (i.e. compared high anxiety to low anxiety), induced through an induction eliciting anxiety, or reduced through a reduction procedure decreasing anxiety and 7) examined the interaction between anxiety and race.

Excluded studies 1) had a main focus on facial expression, object recognition or reaction times, 2) the main focus on anxiety reduction was through a clinical therapy (such as cognitive behaviour therapy), 3) examined artificial facial recognition (i.e., through use of artificial intelligence), and 4) focused on the influence of another clinical diagnosis (such as developmental, intellectual disabilities or traumatic brain injury), in addition to how anxiety affects face recognition.

The specific number of included and excluded papers at each step, according to the inclusion and exclusion criteria are listed in Fig 1.

thumbnail
Fig 1. Flowchart of the results for the literature search.

https://doi.org/10.1371/journal.pone.0254477.g001

Data extraction

In line with the first step, data items were extracted according to moderators affecting the influence of anxiety on face-recognition accuracy within studies examining the interaction between anxiety and race. Identified moderators included: the influence of participant gender and stimuli on results (see Table 2). The interaction between stimuli-valence and anxiety, within both clinical and non-clinical populations (see Table 3). An indication of whether anxiety was measured through the STAI, and the influence of inducing anxiety during either encoding or retrieval (also see Table 2). According to the second step, the influence of an own-group bias, specifically gender, was examined. Where applicable, gender was also presented in Table 3 due to overlapping themes. As specified by the third step, the interaction between anxiety and race was examined (see Table 4). Due to limited studies commenting on perceptual expertise and contact (n = two), this information was presented in Table 4, as per step two.

Results specific to each of the three steps were recorded according to the signal detection measures they most closely represented [37, 61]; hits/hit-rate, misses, false alarms/false-alarm rate, correct rejections, response bias, and d′. Not all studies examined recognition accuracy via signal detection measures or used a closely related measure. These results were therefore labelled ‘general recognition accuracy’ as a way of highlighting that they did not align with signal-detection measures.

Risk of bias and quality assessment.

An adapted version of the Cochrane Collaboration’s tool for assessing risk of bias [62] assessed bias over five categories (see Table 1, for average scores, and S2 Table for detailed scoring). Selection bias was separated into a) random sequence generation; specifying allocation into different conditions must be described, and b) allocation concealment; stating concealment of allocation into experimental and control conditions should occur before conducting the experiment. Performance bias consisted of a) participants and personnel blinding, which was modified to blinding of participants only, as the experimenter needed to know condition assignment to carry out the anxiety induction/reduction. 3) Detection bias consisting of blinding of outcome assessment; where knowledge of allocation to control or experimental conditions was low risk if this knowledge would not affect the outcome measure. 4) Attrition bias consisting of incomplete outcome data, and 5) reporting bias (selective reporting), defined as reporting bias due to selectively reporting outcome variables. Each study was given a total score, with a maximum score of 6, reflecting the five categories (plus the two sub-categories of category one).

thumbnail
Table 1. Characteristics of included studies examining the impact of the potential interaction between anxiety and race on face-recognition accuracy.

https://doi.org/10.1371/journal.pone.0254477.t001

Results

Characteristics of included studies

Initially, 30258 records were extracted (see Fig 1). After removing duplicates, reading titles and abstracts, and screening full-texts and searching references, nine articles remained that examined the interaction between anxiety and race. Demographic information related to the included papers, specifically, article authors, experiment design, participant characteristics, induction conditions, anxiety manipulation, and relevant questionnaires given, are presented in Table 1.

As seen in Table 1, all participants either came exclusively from a university sample of students and/or staff (n = eight), or from a university sample as well as those from the wider community (n = one).

All studies used a racial face-recognition paradigm, where own-race and other-race face-stimuli was used. Two studies, in addition to using a racial face-recognition paradigm, presented face-stimuli to participants using an implicit association test [47] or a dot-probe task [36].

In studies using an anxiety manipulation (six out of nine), the manipulation used across studies was non-uniform. Manipulations used were threat of electric shock [63] (n = one), emotive videos [30] (n = one), stereotype priming [36] (n = one), immigration threat induction [67] (n = one), public speaking task [29] (n = one), anagram task [29] (n = one), and use of 7.5% CO2 Challenge [19] (n = one). It must be noted that the public speaking task and anagram task were used during experiment one and experiment two of the same study [29]. Most studies using an anxiety manipulation compared the anxiety condition to a control condition [19, 29, 36, 67]. Further, in some studies included, anxiety manipulations, in addition to inducing anxiety symptoms, also induced other affective symptoms, such as fear and increased perception of threat (three out of nine).

Anxiety symptoms across studies were measured using various anxiety scales. Anxiety was measured using the STAI in several studies [19, 29, 36], while other studies used varying rating scales measuring affect (including anxiety symptoms) on a continuum [30, 63, 67]. Three studies measured non-induced anxiety symptoms, with one study [47] measuring intergroup anxiety, one study [38] measuring social anxiety and another [68], shyness (which is associated with social anxiety).

Risk of bias

As seen in Table 1, most studies were not affected by substantial bias; with an average rating of 4.22 for studies examining the interaction between anxiety and race.

Potential moderators of anxiety and race

Gender.

The impact of gender, and interaction of gender with other variables, within included studies are presented in Table 2. All studies recorded participant gender (n = nine), face-stimuli gender (n = nine) and a majority used a mixed-gender sample of both participants and face stimuli (n = five). No studies used the same gender participants and stimuli. Most studies examined the impact of gender on face-recognition accuracy (five out of nine). Further, of studies reporting on gender a minority found an impact of gender on face-recognition accuracy (two out of five). In one of these studies [63], an increased d′ for female as compared to male face-stimuli occurred in female participants, indicating an own-gender bias. Further, in this study [63], an increased d′ for female participants also occurred within the moderate-anxiety condition compared to high-anxiety condition. Additionally, in another study [30], individuals had increased recognition accuracy for female own-race stimuli as compared to all other types of face-stimuli.

thumbnail
Table 2. Gender of participant and stimuli for included studies, with associated results, including interaction with other variables.

https://doi.org/10.1371/journal.pone.0254477.t002

Face-stimuli valence.

Impact of face-stimuli valence on results are presented in Table 3. Most studies either did not record face-stimuli valence (n = four) or used stimuli displaying only a neutral facial expression (n = four). Only one study [38] used stimuli of more than one valence and recorded the impact of emotional expression on face-recognition accuracy. Further, this study [38] also recorded the impact of stimuli-valence on the interaction between anxiety and race. All studies used a non-clinical sample of participants. Further, all studies reporting the outcome of the manipulation inducing anxiety were successful. Experiment two of the study by Wilson et al.[67] did not report the effectiveness of the anxiety manipulation, as did the study by Wang et al [68]. Only studies with a reported successful anxiety manipulation are discussed due to the inability of determining anxiety impact without a successful anxiety manipulation.

thumbnail
Table 3. Influence of face-stimuli valence and anxiety on face-recognition accuracy, and stage of memory anxiety induced (encoding or retrieval), for included studies.

https://doi.org/10.1371/journal.pone.0254477.t003

In the only study reporting on stimuli-valence [38], stimuli-valence interacted with the ORB, as individuals with higher as compared to lower social anxiety reported a reduced happiness advantage for happy own-race faces.

Memory phase of anxiety induction

As seen in Table 3, use of a psychological induction (n = four) was more prevalent than physiological induction (n = two). The induction was successful in all studies examining the influence of anxiety induced during encoding, with the exception of experiment two in the study by Wilson et al. [67]. Further, the manipulation was also successful in the studies inducing anxiety during retrieval [19, 29, 30]. Only studies successfully inducing anxiety were reviewed due to the inability of determining anxiety impact without a successful manipulation of anxiety. In several studies, when anxiety was induced during encoding, recognition accuracy (d′ or hits) was higher when experiencing lower anxiety as compared to higher anxiety [29, 63]. Further, false-alarms were lower when experiencing lower anxiety as compared to high in the study by Brigham et al [63].

For studies inducing anxiety during retrieval, only one study reported a difference in recognition accuracy between those experiencing high anxiety as compared to low anxiety [19]. This study [19] induced anxiety through physiological means. One study [30] that induced anxiety at retrieval did not report on the impact of this on face-recognition accuracy.

Use of STAI.

Half of studies using an anxiety induction measured state and/or trait anxiety with the STAI (three out of six). Additionally, half of studies examining physiological anxiety used the STAI to measure induced anxiety (one out of two).

Effect of race and interaction between anxiety and race

Studies examining the interaction between anxiety and race are presented in Table 4. All studies examining the relationship between anxiety and race recorded face-race and participant race and therefore controlled for the ORB. One study [30] found a significant negative correlation between anxiety and other-race stimuli according to general recognition accuracy. No elaboration on this interaction, however, was given. This study also found an increased hit-rate for other-race faces in the joy condition as compared to fear and control conditions. Most other studies examining recognition accuracy failed to find a significant interaction between anxiety and race [19, 29, 36, 38, 63].

thumbnail
Table 4. Race of participant and stimuli of studies and results of studies examining the interaction between anxiety and race.

https://doi.org/10.1371/journal.pone.0254477.t004

Some studies [29, 36], however, did find differences between face-recognition accuracy according to level of anxiety. In Horry et al. [36], a negative correlation occurred between anxiety and d′ in the control condition, as more anxious participants were less accurate, with the opposite discovered in the anxiety condition. In Curtis et al. [29], however, when anxiety was induced during encoding in the anxiety condition, d′ was significantly worse than the control condition.

Discussion

The goal of this systematic literature review was to examine whether anxiety and race, when acting together, could affect face-recognition accuracy. Specifically, this review aimed to investigate whether results supported an interaction between anxiety and race, as predicted by Brigham [49]; or no interaction, but performance reductions, as suggested by ACT [8]. We also explored the influence of moderators affecting anxiety and race which could potentially influence this relationship. The potential influence of anxiety induced during encoding or retrieval was also examined as a way of elucidating whether anxiety can influence face-recognition accuracy when induced during both phases of memory.

Relationship between anxiety and race

According to Brigham [49], anxiety and race can interact to influence face-recognition accuracy. Several studies reviewed, indicated support for this perspective [30, 47]. In the study by Johnson et al. [30] a negative correlation existed between anxiety and other-race recognition accuracy suggesting that anxiety reduced face-recognition accuracy for other-race faces. This result occurred despite no difference in the ORB arising between the fear condition and control condition. It must be noted, however, that the non-significant difference in the ORB between these conditions does not comment on the impact of anxiety. Fear and anxiety can be considered distinct affective states [73, 74]. Further, the video priming fear used in the fear condition might have omitted important components of anxiety in the response elicited, thereby impacting findings within this condition. Specifically, the video induction might not have provoked worry over future misfortune, which is a cognitive component of anxiety that creates rumination and the diversion of processing resources to worry thoughts [8]. Therefore, future studies examining the interaction between anxiety and race should use an induction specifically seeking to induce anxiety. Additionally, the correlational result between anxiety and race should be further examined as correlations do not allow for concrete conclusions regarding causality.

In Walker et al. [47], intergroup anxiety was also correlated with other-race (White) face-recognition accuracy in South Asian participants. In their discussion they indicated that intergroup anxiety impaired the ability to differentiate other-race faces through decreased attentional focus. It must be noted that the conclusion drawn from the results presented in Walker et al. [47] and that reported in the results section of their paper were inconsistent. The directionality of the correlation reported within Walker et al. [47] between intergroup anxiety and d′ for other-race (White) individuals was indicated as positive, while their discussion suggested this was negative. Therefore, although their discussion does indicate support for the interaction proposed by Brigham [49], due to the discrepancy, the findings of Walker et al. [47] should be interpreted with caution.

The findings of Johnson et al. [30] specific to anxiety, and Walker et al. [47], as per their discussion, supports the theory adapted from Brigham [49]. The correlation between anxiety and race in Johnson et al. [30], separately from their findings regarding fear, also suggests that anxiety unrelated to the intergroup context can interact with race [29]. As said above, however, due to the correlational result of Johnson et al. [30] and the inconsistent findings of Walker et al [47], further research needs to be conducted to fully provide support for Brigham [49].

Proposing an alternative interaction to Brigham [49], Wilson et al. [67] found reduced own-race face-recognition accuracy in the threat condition as compared to control condition. The reduction in own-race recognition accuracy was so large in this study that recognition accuracy was comparable to other-race face-recognition accuracy. This finding was explained according to increased distinctiveness threat for own-race participants when feeling threatened by an outgroup encroaching on their ingroup distinctiveness [66]. This finding was not expected, nor predicted. Studies included in this review suggest that anxiety, under certain circumstances, can either increase [30, 47] or decrease [67] own-race or other-race face-recognition accuracy. Potentially, situations where ingroup distinctiveness is challenged could lead anxiety to impair own-race recognition accuracy. While anxiety provoking situations where ingroup distinctiveness is not challenged, might instead impair other-race face-recognition accuracy. Due to limited studies supporting either perspective and caution regarding the interpretation of findings, future research needs to explore this possibility using an experimental design capable of testing both theories.

Despite above findings indicating a potential interaction between anxiety and race, several other studies reviewed did not support an interaction. Curtis et al. [29] and Attwood et al. [19] reported a reduction in face-recognition accuracy when state anxious during encoding and retrieval, respectively. Neither study, however, found that face-recognition accuracy for other-race faces was influenced by state anxiety. These findings, therefore, supported ACT [8], as anxiety reduced face-recognition accuracy, but did not interact with race. Further, in several other studies reviewed [36, 38, 63], an interaction between anxiety and race also did not occur. Potential reasons for why these studies were unable to find an interaction between anxiety and race, are elaborated below. This discussion is centred around the impact of several moderators identified during the first two aims of this systematic literature review, which might have reduced the chance of finding an interaction. The impact of anxiety induced at either encoding or retrieval, on face-recognition accuracy is also explored at this point.

Moderators

Face-stimuli valence.

In our review, most studies either did not report on the impact of face-stimuli valence on face-recognition accuracy or used neutral face-stimuli. The only study examining the impact of face-stimuli valence [38] found that more socially anxious individuals had a less pronounced happiness advantage for own-race faces than those that were less anxious. Therefore, despite social anxiety impairing recognition for happy own-race faces when anxious, recognition accuracy for these faces was still higher than for angry faces. Although this finding is in contrast with previous research indicating preferential processing of negative stimuli [26, 27], it highlights that stimuli-valence can moderate the influence of anxiety on face-recognition accuracy [38]. Therefore, the lack of interaction between anxiety and race found in the study by Kikutani [38], might have occurred due to stimuli-valence impacting this relationship [75]. The uncontrolled stimuli-valence in several other studies reviewed [29, 36, 63, 68], might have also impaired the ability to find an interaction through masking effects caused by heightened error of measurement and statistical noise [75]. Future studies need to experimentally control for stimuli-valence when seeking to explore the interaction between anxiety and race.

Gender.

Although most studies commenting on the influence of gender, did not find an impact of gender on face-recognition accuracy, these discussions were very brief and only mentioned without elaboration. In two studies reviewed, however, gender moderated the impact of anxiety and race on face-recognition accuracy. In the study by Brigham et al. [63], gender moderated the influence of anxiety on face-recognition accuracy through increased recognition accuracy for female participants within the moderate-anxiety condition compared to high-anxiety condition. Further, gender also moderated the own-race bias in Johnson et al. [30] with higher recognition accuracy for female own-race face-stimuli compared to all other types of face-stimuli. Additionally, although not reflected strongly by the results of this review, extensive evidence indicates the presence of an own-gender bias within female participants [45]. Therefore, like with stimuli-valence, gender might also have moderated the relationship between anxiety and race through masking effects [75]. Indeed, within several studies [19, 68] reviewed where an interaction between anxiety and race did not occur, the impact of gender was not examined. Therefore, future studies need to control for gender by either using same gender participants and stimuli, or by purposely controlling for gender experimentally.

Contact and individuating experience.

In support of the review article by Brigham [49], perceptual expertise (specifically contact and individuating experience) also interacted with face-recognition accuracy for different race faces [47] such that increased contact was related to better face-recognition accuracy. Despite this, an interaction between anxiety and race in Walker et al. [47] was still present. This suggests that increased perceptual expertise could have facilitated an interaction between anxiety and race, through strengthening the impact of race. Therefore, future research should measure the moderating influence of perceptual expertise with other-race individuals in future studies.

Characteristics of included studies.

Other factors associated with characteristics of included studies might have also impacted the potential of finding an interaction between anxiety and race. Although most studies used a racial face-recognition paradigm including both an encoding; learning phase, and retrieval; test phase, several others did not [36, 47]. In Horry et al. [36], faces were initially presented through a dot-probe task [76]. Although this design is effective for looking at attentional biases, it is a suboptimal method for examining face-recognition accuracy, as faces are presented concurrently [29].

As seen above, all studies which did not find an interaction [19, 29, 36, 38, 63] between anxiety and race, were potentially impacted by at least one moderator indicated within this review. Specifically, face-stimuli valence [29, 36, 38, 63], gender [19], or methodological characteristics [36]. Therefore, until these moderators are accounted for, it is unclear whether an interaction between anxiety and race can occur.

Memory phase of anxiety induction.

Separately from the interaction between anxiety and race and relevant moderators, this review examined the influence of anxiety on encoding and retrieval. In several reviewed studies, anxiety induced during encoding influenced face-recognition accuracy. These results corroborate with Deffenbacher et al. [5], who stated that anxiety may only influence encoding. In reviewed studies examining the influence of anxiety induced during encoding, most studies found an increased d′ or hits when experiencing lower anxiety [29, 63], with increased false alarms when experiencing heightened anxiety [63]. These results also support ACT, as participants experiencing lower levels of anxiety had increased cognitive performance compared to those subjected to increased anxiety [8].

Contrary to Deffenbacher et al. [7] who suggested that anxiety may only influence face-recognition accuracy during encoding, the study by Attwood et al. [19] discovered that anxiety induced during retrieval could also influence face-recognition accuracy. Why anxiety induced during retrieval reduced face-recognition accuracy is unclear. Speculation suggests that these findings occurred because of fundamental differences existing between the anxiety manipulations used in these studies. In Attwood et al. [19], anxiety was altered through physiological means, as state anxiety was induced through the 7.5% CO2 challenge. In Curtis et al. [29], anxiety did not affect face-recognition accuracy; however, anxiety was induced during retrieval through a cognitive anxiety induction.

Cognitive manipulations rely on a learned anxiety reaction [77]. That is, to become state anxious to a cognitive manipulation, such as a public speaking task (e.g. [29]), individuals need to have learned through experience to become state anxious to this stressor. Physiological anxiety manipulations, on the other hand, elicit an unconditioned or innate response [17, 18, 77], leading to a stronger overall reaction. Therefore, the fact that a physiological stressor reduced face-recognition accuracy during retrieval, and a cognitive stressor did not, suggests that a larger anxiety response is needed to disturb the retrieval, as compared to encoding phase of memory. This conclusion is supported by the finding that memory retrieval is strongly influenced by acute anxiety [78].

Results of the current review, therefore, suggest that anxiety can influence face-recognition accuracy during retrieval when the anxiety manipulation is physiological. Future research should test this hypothesis by comparing the anxiety response elicited by psychological and physiological anxiety inductions during both encoding and retrieval. Such research should be done while also measuring if individuals reacting less to psychological inductions and having lower anxiety, produce smaller indicators of anxiety (both physiological and psychological). This measurement should be done when using an anxiety scale specifically measuring physiological anxiety, such as the State-Trait Inventory for Cognitive and Somatic Anxiety (STICSA) [11]. Half of studies in this review measured physiological anxiety using the STAI [13] which has been criticised for not capturing anxiety related to physiological symptoms [11, 79].

Limitations

Several limitations were associated with how the current review was conducted and existed within the studies themselves. Although most studies reviewed used signal detection measures, some did not. Heterogeneity also existed between studies in terms of the type of anxiety examined (i.e., social anxiety or intergroup anxiety). Further, in some studies reviewed, the manipulations used to induce anxiety also induced other affective states, such as fear. Additionally, not all studies included used a face-recognition paradigm for both the encoding and retrieval phases which might have also influenced results.

Conclusions

Anxiety was found to reduce face-recognition accuracy when induced during either encoding or retrieval. Physiological anxiety was suggested to have a better chance of disrupting retrieval due to not relying on a learned anxiety response [77]. In our review, anxiety was found to disrupt cognitive performance and subsequently influence face-recognition accuracy, therefore supporting ACT [8]. Although some results supported Brigham [49] related to race-specific recognition errors elicited by anxiety, support for this perspective was limited. Further, in one study reviewed [67], an interaction occurred between anxiety and race; however, the direction was contrary to that expected by Brigham [49]. Several moderators were identified that potentially affected the relationship between anxiety, race, and face-recognition accuracy. These moderators could potentially have reduced or altered the ability to find an interaction between these factors. Until potential moderators are addressed by future research, it cannot be adequately concluded whether anxiety and race can combine to affect face-recognition accuracy, and the direction of this relationship.

Acknowledgments

We would like to thank the Librarian at the University of Western Australia for their advice during the initial literature search.

References

  1. 1. Johnston RA, Edmonds AJ. Familiar and unfamiliar face recognition: A review. Memory. 2009;17(5):577–96. pmid:19548173
  2. 2. Wilmer JB, Germine L, Chabris CF, Chatterjee G, Williams M, Loken E, et al. Human face recognition ability is specific and highly heritable. Proceedings of the National Academy of sciences. 2010;107(11):5238–41. pmid:20176944
  3. 3. Lindsay RCL, Mansour JK, Bertrand MI, Kalmet N, Melsom EI. Face recognition in eyewitness memory. In: Calder AG, Rhodes G, Johnson M, Haxby J, editors. Oxford handbook of face perception. New York: Oxford University Press; 2011. p. 307–28.
  4. 4. Tanaka JW. The entry point of face recognition: Evidence for face expertise. Journal of Experimental Psychology: General. 2001;130(3):534–43. pmid:11561926
  5. 5. Deffenbacher KA, Bornstein BH, Penrod SD, McGorty EK. A meta-analytic review of the effects of high stress on eyewitness memory. Law and human behavior. 2004;28(6):687–706. pmid:15732653
  6. 6. Meissner CA, Brigham JC. Thirty years of investigating the own-race bias in memory for faces: A meta-analytic review. Psychology, Public Policy, and Law. 2001;7(1):3–35.
  7. 7. Grupe DW, Nitschke JB. Uncertainty and anticipation in anxiety: An integrated neurobiological and psychological perspective. Nature Reviews Neuroscience. 2013;14(7):488–501. pmid:23783199
  8. 8. Eysenck MW, Derakshan N, Santos R, Calvo MG. Anxiety and cognitive performance: attentional control theory. Emotion. 2007;7(2):336–53. pmid:17516812
  9. 9. Lundh L-G, Öst L. Recognition bias for critical faces in social phobics. Behaviour research and therapy. 1996;34(10):787–94. pmid:8952121
  10. 10. Corbetta M, Shulman GL. Control of goal-directed and stimulus-driven attention in the brain. Nature reviews neuroscience. 2002;3(3):201–15. pmid:11994752
  11. 11. Ree MJ, French D, MacLeod C, Locke V. Distinguishing cognitive and somatic dimensions of state and trait anxiety: Development and validation of the State-Trait Inventory for Cognitive and Somatic Anxiety (STICSA). Behavioural and Cognitive Psychotherapy. 2008;36(3):313–32.
  12. 12. Spielberger CD. Assessment of state and trait anxiety: Conceptual and methodological issues. Southern Psychologist. 1985;2(4):6–16.
  13. 13. Spielberger CD, Gorsuch RL, Lushene R, Vagg PR, Jacobs GA. Manual for the State-Trait Anxiety Inventory STAI (Form Y). Palo Alto, CA: Consulting Psychologists Press; 1983.
  14. 14. Edwards EJ, Edwards MS, Lyvers M. Cognitive trait anxiety, situational stress, and mental effort predict shifting efficiency: Implications for attentional control theory. Emotion. 2015;15(3):350–9. pmid:25642722
  15. 15. Edwards MS, Edwards EJ, Lyvers M. Cognitive trait anxiety, stress and effort interact to predict inhibitory control. Cognition and Emotion. 2016;1(1):1–16. pmid:26934479
  16. 16. Spalding DM, Obonsawin M, Eynon C, Glass A, Holton L, McGibbon M, et al. Impacts of trait anxiety on visual working memory, as a function of task demand and situational stress. Cognition and Emotion. 2020:1–20. pmid:32757695
  17. 17. Cooper RM, Bailey JE, Diaper A, Stirland R, Renton LE, Benton CP, et al. Effects of 7.5% CO2 inhalation on allocation of spatial attention to facial cues of emotional expression. Cognition and Emotion. 2011;25(4):626–38. pmid:21547765
  18. 18. Diaper A, Nutt DJ, Munafò MR, White J, Farmer EW. Effects of 7.5% CO2-induced anxiety on individual performance during a group computer combat game. Millitary Psychology. 2013;25(6):615–22.
  19. 19. Attwood AS, Catling JC, Kwong AS, Munafò MR. Effects of 7.5% carbon dioxide (CO 2) inhalation and ethnicity on face memory. Physiology & behavior. 2015;147(1):97–101. pmid:25890273
  20. 20. Bolton S, Robinson O, J. The impact of threat of shock-induced anxiety on memory encoding and retrieval. Learning & Memory. 2017;24(10):532–42. pmid:28916628
  21. 21. Coles ME, Heimberg RG. Recognition bias for critical faces in social phobia: A replication and extension. Behaviour Research and Therapy. 2005;43(1):109–20. pmid:15531356
  22. 22. LeMoult J, Joormann J. Attention and memory biases in social anxiety disorder: The role of comorbid depression. Cognitive Therapy and Research. 2012;36(1):47–57. pmid:23087492
  23. 23. Luo Y, Fernández G, Hermans E, Vogel S, Zhang Y, Li H, et al. How acute stress may enhance subsequent memory for threat stimuli outside the focus of attention: DLPFC-amygdala decoupling. Neuroimage. 2018;171(1):311–22. pmid:29329979
  24. 24. Nakashima SF, Morimoto Y, Takano Y, Yoshikawa S, Hugenberg K. Faces in the dark: interactive effects of darkness and anxiety on the memory for threatening faces. Frontiers in Psychology. 2014;5(1091). pmid:25324803
  25. 25. Paunovic N, Lundh L-G, Öst L-G. Memory bias for faces that are perceived as hostile by crime victims with acute post-traumatic stress disorder. Cognitive Behaviour Therapy. 2003;32(4):203–14. pmid:16291552
  26. 26. Doty TJ, Japee S, Ingvar M, Ungerleider LG. Fearful face detection sensitivity in healthy adults correlates with anxiety-related traits. Emotion. 2013;13(2):183–8. pmid:23398584
  27. 27. Mogg K, Bradley BP. Some methodological issues in assessing attentional biases for threatening faces in anxiety: A replication study using a modified version of the probe detection task. Behaviour research and therapy. 1999;37(6):595–604. pmid:10372472
  28. 28. Surcinelli P, Codispoti M, Montebarocci O, Rossi N, Baldaro B. Facial emotion recognition in trait anxiety. Journal of anxiety disorders. 2006;20(1):110–7. pmid:16325118
  29. 29. Curtis GJ, Russ A, Ackland C. More Inaccurate But Not More Biased: Anxiety During Encoding Impairs Face Recognition Accuracy But Does Not Moderate the Own‐Ethnicity Bias. Applied Cognitive Psychology. 2015;29(4):621–7. pmid:25521191
  30. 30. Johnson KJ, Fredrickson BL. “We All Look the Same to Me” Positive Emotions Eliminate the Own-Race Bias in Face Recognition. Psychological science. 2005;16(11):875–81. pmid:16262774
  31. 31. Tulving E, Kapur S, Craik F, Moscovitch M, Houle S. Hemispheric encoding/retrieval asymmetry in episodic memory: positron emission tomography findings. Proceedings of the National Academy of Sciences. 1994;91(6):2016–20. pmid:8134342
  32. 32. Huijbers W, Schultz AP, Vannini P, McLaren DG, Wigman SE, Ward AM, et al. The encoding/retrieval flip: interactions between memory performance and memory stage and relationship to intrinsic cortical networks. Journal of cognitive neuroscience. 2013;25(7):1163–79. pmid:23384193
  33. 33. Mueller JH. Anxiety and performance. In: Smith AR, M JD, editors. Handbook of human performance State and trait. 3. London, UK: Academic Press; 1992. p. 127–60.
  34. 34. Cadle CE, Zoladz PR. Stress time-dependently influences the acquisition and retrieval of unrelated information by producing a memory of its own. Frontiers in Psychology. 2015;6:910. pmid:26175712
  35. 35. Garibbo M, Aylward J, Robinson OJ. The impact of threat of shock-induced anxiety on the neural substrates of memory encoding and retrieval. Social Cognitive and Affective Neuroscience. 2019;14(10):1087–96. pmid:31680142
  36. 36. Horry R, Wright DB. Anxiety and terrorism: Automatic stereotypes affect visual attention and recognition memory for White and Middle Eastern faces. Applied Cognitive Psychology. 2009;23(3):345–57.
  37. 37. Sporer SL. Recognizing faces of other ethnic groups: An integration of theories. Psychology, Public Policy, and Law. 2001;7(1):36–97.
  38. 38. Kikutani M. Influence of social anxiety on recognition memory for happy and angry faces: comparison between own-and other-race faces. Quarterly Journal of Experimental Psychology. 2018;71(4):870–8. pmid:28292217
  39. 39. Rhodes G, Locke V, Ewing L, Evangelista E. Race coding and the other-race effect in face recognition. Perception. 2009;38(2):232–41. pmid:19400432
  40. 40. Rodin MJ. Who is memorable to whom: A study of cognitive disregard. Social Cognition. 1987;5(2):144–65.
  41. 41. Valentine T. A unified account of the effects of distinctiveness, inversion, and race in face recognition. The Quarterly Journal of Experimental Psychology. 1991;43(2):161–204. pmid:1866456
  42. 42. Valentine T, Endo M. Towards an exemplar model of face processing: The effects of race and distinctiveness. The Quarterly Journal of Experimental Psychology. 1992;44(4):671–703. pmid:1615169
  43. 43. Hugenberg K, Young SG, Bernstein MJ, Sacco DF. The categorization-individuation model: an integrative account of the other-race recognition deficit. Psychological review. 2010;117(4):1168. pmid:20822290
  44. 44. O’Toole AJ, Natu V. Computational perspectives on the other-race effect. Visual Cognition. 2013;21(9–10):1121–37.
  45. 45. Herlitz A, Lovén J. Sex differences and the own-gender bias in face recognition: a meta-analytic review. Visual Cognition. 2013;21(9–10):1306–36.
  46. 46. Wang B. Gender difference in recognition memory for neutral and emotional faces. Memory. 2013;21(8):991–1003. pmid:23432017
  47. 47. Walker PM, Hewstone M. The influence of social factors and implicit racial bias on a generalized own‐race effect. Applied Cognitive Psychology: The Official Journal of the Society for Applied Research in Memory and Cognition. 2008;22(4):441–53.
  48. 48. Walker PM, Silvert L, Hewstone M, Nobre AC. Social contact and other-race face processing in the human brain. Social Cognitive and Affective Neuroscience. 2008;3(1):16–25. pmid:19015091
  49. 49. Brigham JC. The role of race and racial prejudice in recognizing other people. In: Willis-Esqueda C, editor. Motivational Aspects of Prejudice and Racism. New York: Springer; 2008. p. 68–110.
  50. 50. Bukach CM, Cottle J, Ubiwa J, Miller J. Individuation experience predicts other-race effects in holistic processing for both Caucasian and Black participants. Cognition. 2012;123(2):319–24. pmid:22397819
  51. 51. Sarason IG. Experimental approaches to test anxiety: Attention and the uses of information. Spielberger CD, editor. New York: Academic Press; 1972.
  52. 52. Bodenhousen GV. Affective influences on stereotyping and intergroup relations. In: P FJ, editor. Handbook of affect and social cognition. Mahwah, NJ: Lawrence Erlbuam Associates Publishers 2001. p. 319–43.
  53. 53. Wilder DA. The role of anxiety in facilitating stereotypic judgments of outgroup behavior. Affect, cognition, and stereotyping: Interactive processes in group perception. New York, USA: Academic Press, Inc; 1993. p. 87–109.
  54. 54. Bodenhousen GV. Emotions, Arousal, and Stereotypic Judgments: A Heuristic Model of Affect and Stereotyping. In: Mackie DM, Hamilton DL, editors. Affect, cognition and stereotyping: Interactive processes in group perception. San Diego, CA: Academic Press; 1993. p. 13–37.
  55. 55. Avery SN, VanDerKlok RM, Heckers S, Blackford JU. Impaired face recognition is associated with social inhibition. Psychiatry Research. 2016;236:53–7. pmid:26776300
  56. 56. Bielak T, Moscovitch DA. Friend or Foe? Memory and Expectancy Biases for Faces in Social Anxiety. Journal of Experimental Psychopathology. 2012;3(1):42–61.
  57. 57. Davis JM, McKone E, Dennett H, O’Connor KB, O’Kearney R, Palermo R. Individual differences in the ability to recognise facial identity are associated with social anxiety. PLoS One. 2011;6(12):e28800. pmid:22194916
  58. 58. Li S, Weerda R, Milde C, Wolf OT, Thiel CM. Effects of acute psychosocial stress on neural activity to emotional and neutral faces in a face recognition memory paradigm. Brain Imaging and Behavior. 2014;8(4):598–610. pmid:24402653
  59. 59. Park J-I, Kim G-W, Jeong G-W, Chung GH, Yang J-C. Brain Activation Patterns Associated with the Effects of Emotional Distracters during Working Memory Maintenance in Patients with Generalized Anxiety Disorder. Psychiatry Investigation. 2016;13(1):152–6. WOS:000368650300018. pmid:26766958
  60. 60. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of internal medicine. 2009;151(4):264–9. pmid:19622511
  61. 61. McNicol D. A primer of signal detection theory. London: Allen & Unwin; 1972.
  62. 62. Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928. pmid:22008217
  63. 63. Brigham JC, Maass A, Martinez D, Whittenberger G. The effect of arousal on facial recognition. Basic and Applied Social Psychology. 1983;4(3):279–93.
  64. 64. Brigham JC, Severy LJ. An empirically derived grouping of Whites on the basis of expressed attitudes toward Blacks. Representative Research in Social Psychology. 1973;4(2):48–55.
  65. 65. Brigham JC, Woodmansee JJ, Cook SW. Dimensions of verbal racial attitudes: Interracial marriage and approaches to racial equality. Journal of Social Issues. 1976;32(2):9–21.
  66. 66. Woodmansee JJ, Cook SW. Dimensions of verbal racial attitudes: Their identification and measurement. Journal of Personality and Social Psychology. 1967;7(3):240–50. pmid:6065851
  67. 67. Wilson JP, Hugenberg K. When under threat, we all look the same: Distinctiveness threat induces ingroup homogeneity in face memory. Journal of Experimental Social Psychology. 2010;46(6):1004–10.
  68. 68. Wang QD, Hu C, Short LA, Fu GY. The Influence of Shyness on the Scanning of Own- and Other-Race Faces in Adults. Plos One. 2012;7(12):e52203. WOS:000312694300080. pmid:23284933
  69. 69. Cheek JM. The revised Cheek and Buss shyness scale. Unpublished manuscript1983.
  70. 70. Greenwald AG, McGhee DE, Schwartz JLK. Measuring individual differences in implicit cognition: The Implicit Association Test. Journal of Personality and Social Psychology. 1998;74(6):1464–80. pmid:9654756
  71. 71. Glass CR, Merluzzi TV, Biever JL, Larsen KH. Cognitive assessment of social anxiety: Development and validation of a self-statement questionnaire. Cognitive Therapy and Research. 1982;6(1):37–55.
  72. 72. Spielberger CD, Gorsuch RL, Lushene RE. Manual for the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press; 1970.
  73. 73. Öhman A. Fear and anxiety: Overlaps and dissociations. In: Lewis M, Haviland-Jones JM, Barre FL, editors. Handbook of Emotions. New York, NY: Guildford Press; 2008. p. 709–29.
  74. 74. White TL, Depue RA. Differential association of traits of fear and anxiety with norepinephrine-and dark-induced pupil reactivity. Journal of personality and social psychology. 1999;77(4):863–77. pmid:10531676
  75. 75. Westfall J, Judd CM, Kenny DA. Replicating studies in which samples of participants respond to samples of stimuli. Perspectives on Psychological Science. 2015;10(3):390–9. pmid:25987517
  76. 76. MacLeod C, Mathews A, Tata P. Attentional bias in emotional disorders. Journal of abnormal psychology. 1986;95(1):15–20. pmid:3700842
  77. 77. Bailey JE, Dawson GR, Dourish CT, Nutt DJ. Validating the inhalation of 7.5% CO2 in healthy volunteers as a human experimental medicine: a model of generalized anxiety disorder (GAD). Journal of Psychopharmacology. 2011;25(9):1192–8. pmid:21994314
  78. 78. Gagnon SA, Wagner AD. Acute stress and episodic memory retrieval: neurobiological mechanisms and behavioural consequences. Annals of the New York Academic of Science. 2016;1369(1):55–75. pmid:26799371
  79. 79. Roberts KE, Hart TA, Eastwood JD. Factor structure and validity of the State-Trait Inventory for Cognitive and Somatic Anxiety. Psychological Assessment. 2016;28(2):134–46. pmid:26011481