Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The interplay between cognitive biases, attention control, and social anxiety symptoms: A network and cluster approach

Abstract

Cognitive models of social anxiety highlight the importance of different cognitive biases (e.g., attention bias, interpretation bias) and executive dysfunctions, which have, however, mostly been investigated in isolation. The present study explored their interplay using two statistical approaches: (1) network analysis to identify the unique associations between cognitive functions, and (2) cluster analysis to reveal how these associations (or combinations) are manifested in a population. Participants from the general population (N = 147) completed measures of attention control, attention bias, interpretation bias, and social anxiety symptoms. Network analysis showed an association between social anxiety symptoms and interpretation bias, although no other significant associations emerged. Cluster analysis identified a group of participants characterized by an adaptive cognitive pattern (i.e., low cognitive biases, good executive function); and a group exhibiting a more maladaptive pattern (i.e., high interpretation bias, good alerting but poor executive function). The maladaptive group showed higher levels of social anxiety than the adaptive group. Results highlight the strong association between social anxiety symptoms and interpretation bias, while challenging the putative role of attention bias. Attention control, particularly executive function, may limit the impact of cognitive bias on anxiety symptoms.

Introduction

Cognitive biases and attention control in social anxiety

Cognitive theories of social anxiety highlight the role of cognitive dysfunctions in the etiology and maintenance of the disorder [1]. Social anxiety is characterized by intense fear of one or several social situations in which individuals may be observed and negatively appraised by others [2]. A striking feature of social anxiety is that the fear persists although socially anxious individuals cannot fully avoid social situations and often do not receive any negative feedback in these situations [3, 4]. Cognitive models explain this phenomenon by stressing the relevance of biased or impaired information processing. For example, attention bias toward threat is thought to impede habituation; additionally, impaired attention control may exacerbate this effect [5].

In the context of anxiety, two types of cognitive biases are particularly relevant: biases in attention and interpretation. Attention bias in social anxiety is typically operationalized as faster engagement to [6] or slower disengagement [7, 8] from socially threatening stimuli relative to neutral ones. Threatening stimuli may be angry or disgusted faces or words related to embarrassment and shame [4, 9]. In the context of social anxiety, facial expressions are considered to be relevant and ecologically valid stimuli [10, 11] as they contain information about potential judgement by other people [12]. Different paradigms have been used to explore attention biases, such as the Emotional Stroop Task [13], the Emotional Spatial Cueing Task [14, 15], the Dot Probe Task [16], and the Visual Search Task [17, 18]. Although there is an ongoing debate on the validity and reliability of these paradigms [19], the Visual Search Task (VST) is known to be a more reliable measure of attention bias in social anxiety [9, 20]. It requires participants to quickly detect a threatening face surrounded by neutral faces. Individuals with social anxiety symptoms have been shown to engage more quickly with threatening relative to neutral faces [2022] and angry compared to happy faces [10, 23], implying an attention bias for social threat. However, recent studies suggested that this effect may be smaller and less robust than previously assumed [6, 24, 25].

Interpretation bias is particularly relevant to social anxiety as information in social contexts is often ambiguous [26]. Neutral or even positive comments or facial expressions can easily be interpreted as negative or threatening, e.g., a smile as an indicator that one is being made fun of [26]. Such negative interpretations have been consistently found in social anxiety [27] both at clinical and subclinical levels [28]. Interpretation biases have been assessed using different paradigms, such as the Ambiguous Scenario Task [2932], the Sentence Completion Task [33], and the Scrambled Sentence Task [3436]. The Scrambled Sentence Task (SST) asks participants to build complete emotional sentences, by using five out of six words which can result in either a positive or negative sentence. The SST is thought to be less influenced by conscious control (e.g., social desirability) than other interpretation-bias tasks.

The biased cognition found in social anxiety can be linked to individual differences in attention control [37]. Research has shown that attention control acts as a possible moderator between cognitive biases and psychopathology [3840]. Deficient attention control has been observed in individuals with social anxiety [5] in relation to emotional [41] as well as non-emotional stimuli [42, 43]. Researchers have suggested a model of attention [44, 45] with three components of attention control: (1) the alerting network, which facilitates sensitivity for new stimuli and preparedness to react; (2) the orienting network, which selects information by engaging or disengaging attention; and (3) the executive function network, which controls attention and solves conflicts between reaction alternatives. In anxiety (not limited to social anxiety), evidence is relatively consistent that anxiety is positively associated with the alerting and negatively associated with the executive function network [4648]. However, the role of attention control in social anxiety is less clear. Whereas symptoms of social anxiety correlate positively with the alerting network [49], they are either negatively [42, 43] or positively associated [49] with the orienting network. Furthermore, social anxiety symptoms were found to have a negative [46] or null association [49] with the executive function network. These mixed findings may be explained by the fact that many studies measured only single components of attention control [42].

Although a number of studies have provided empirical (even if inconsistent) evidence for the associations between social anxiety and different cognitive biases, these biases have typically been investigated in isolation [37, 50, 51]. Therefore, it is largely unknown if (and how) different types of cognitive biases and dysfunctions are related to each other. Researchers have called for more comprehensive investigations on multiple types of cognitive (dys)functions and combined cognitive biases in social anxiety [26]. This approach would clarify whether various cognitive biases interact with and adversely influence each other. There is preliminary evidence for such an interaction in depression [52]. For instance, it has been shown that biased interpretation mediates the association between biases in attention and memory [53] and that a combination of several biases exacerbates symptoms [54]. As of yet, such empirical evidence with regard to social anxiety is still scarce [5557]. The current study explored such interplay between cognitive biases and attention control with a particular focus on attention and interpretation bias as well as three attentional networks (i.e., alerting, orienting, and executive attention). Understanding these interdependent connections between different cognitive (dys)functions is crucial in understanding the maintenance of social anxiety.

The present study

The aim of the current study was twofold. First, we investigated associations between social anxiety symptoms and different cognitive measures encompassing attention bias, interpretation bias, and components of attention control, using network analysis. As such, this is a conceptual replication of Heeren and McNally [56], who performed network analyses on a set of cognitive measures and social anxiety symptomatology. They found that fear and avoidance of social situations as well as the orienting component of attention control are the most central variables, i.e., the variables that had the strongest associations with other variables in the network. However, the expected associations between anxiety and attention biases did not emerge. There are several possible reasons for these null associations. For example, the researchers used a Spatial Cueing Task as a measure of attention bias, which has been criticized for its poor psychometric properties [58]. Additionally, the task used verbal stimuli, which may be less effective to cause attention capture than pictorial stimuli [11]. To remedy these limitations, the current study used a VST with facial stimuli. Another important addition was the use of the SST to assess interpretation bias, which allowed us to inspect how interpretation bias is associated with attention bias and different components of attention control in the psychological network of social anxiety.

Second, we explored the interaction between multiple cognitive features, for which we used hierarchical cluster analysis on the multiple cognitive measures. This analysis informs how individuals can be grouped on the basis of their profiles of cognitive measures, whereas the network approach visualizes the proximity (i.e., correlations) between cognitive measures in a given population. The unique advantage of the cluster analysis is that this analysis clarifies if there are groups of individuals who possess single vs. multiple cognitive dysfunctions and if this group difference is related to social anxiety.

Although these two types of analyses are exploratory by nature, we hypothesized that the network analysis would yield positive associations between social anxiety symptoms and attention bias, between social anxiety symptoms and interpretation bias, and between attention bias and interpretation bias. Also, we expected negative associations between social anxiety symptoms and components of attention control, and between attention bias and components of attention control. For the cluster analysis we expect to identify a group of individuals with multiple cognitive biases (e.g., attention and interpretation biases), who would show higher levels of social anxiety symptoms than other groups (with single or no cognitive bias).

Material and methods

Participants

We performed a priori power analysis to determine the sample size. We first reviewed published studies to find a good prior for the correlations between the cognitive measures and social anxiety (see S1 Table in S1 File). Second, we simulated data from the identified correlations with varying sample sizes, and for each simulated dataset, we tested whether each edge was identified through a partial-correlation-network analysis under the assumption of alpha = 0.05 applying Bonferroni correction. With 500 iterations, the power to detect the edge between measures of interpretation bias and social anxiety achieved 0.83 for N = 150.

In an attempt to increase variance of observed anxiety symptomatology, participants were recruited from the general population. Inclusion criteria were: age > 18 years; no lifetime diagnosis of a severe neurological disorder (e.g., Multiple Sclerosis, Epilepsy); normal or corrected-to-normal vision; and good knowledge of the German language.

Participants (N = 157; 121 women) were recruited through printed advertisements on the university campus and local supermarkets. The study was advertised digitally via a mailing list offered by LMU Munich and recruitment groups on Facebook. The mean age was 23.41 (SD = 7.07) years. Most participants (59%) were university students, with 29% having already obtained a university degree. Undergraduate psychology students received course credit for their participation; alternatively, participants were offered a lottery to win one of five Amazon vouchers (worth €25 each).

Data of seven participants were excluded (six had technical issues; one was not fluent in German), resulting in a sample of N = 150. Out of those, three additional participants had to be excluded due to an accuracy rate lower than .80 in the Attentional Network Task.

All participants provided written informed consent prior to participation. The study protocol (57_Takano_b) was approved by the Ethics Committee of the Department of Psychology at LMU Munich.

Measures

Additional information on the measures used can be found in the S1 File.

Social anxiety symptoms: Social phobia inventory

To measure symptoms of social anxiety, the German version [59] of the Social Phobia Inventory [60] was administered. The questionnaire consists of 17 self-rated items. It measures severity of central symptoms of social anxiety within the last week on a five-point Likert scale, with possible scores ranging from 0 to 68. For both clinical and subclinical samples, the Social Phobia Inventory (SPIN) has been shown to be internally consistent (α = .95) and highly correlated (between r = .80 and r = .88, p < .01) with other social anxiety scales [61]. Cronbach’s alpha for the current sample is α = .72, with scores ranging from 10 to 48 and 33% of the sample scoring above a cut-off of 25 [61], see S1 and S2 Figs in S1 File.

Interpretation bias: Scrambled sentence task

The Scrambled Sentence Task [62, 63] measures interpretation biases. Participants are presented with scrambled sentences consisting of six boxes each containing one word (e.g., “nervous don’t groups very me make”). Out of these six boxes, five must be selected by clicking on them as quickly as possible (within 10s) to build a grammatically correct sentence, which can either be negative (e.g., “groups make me very nervous”) or positive (e.g., “groups don’t make me nervous”). Participants are instructed to build the sentence that first comes to their mind (Fig 1). As soon as participants have clicked on a word, their response cannot be corrected. In the current study, the task consisted of five practice trials and 20 experimental trials (10 neutral sentences, 10 emotional sentences) presented in random order, with sentences presented at 1.8% of screen in height. At the beginning of the Scrambled Sentence Task (SST), participants were told to respond as quickly and accurately as possible. As in previous SST studies [53], a cognitive load task was added to avoid deliberate response strategies. Before the first experimental trial, participants were told to memorize a 6-digit-number (presented for 7000ms) which they were asked to recall at the end of the test.

thumbnail
Fig 1. Experimental set-up of the SST.

Schematic flow of a trial in the Scrambled Sentence Task (a) and example Target displays (b). Participants are presented with a scrambled sentence (see top line of Panel b) and required to click on five of the six words in an order that produces a grammatically correct sentence (see bottom line of Panel b). In this display, the sentence (“nervous don’t groups very me make”) is unscrambled in a positive fashion (“groups don’t make me nervous”).

https://doi.org/10.1371/journal.pone.0282259.g001

Since the SST was originally developed for interpretation bias in depression, the current study adapted the stimulus set for social anxiety. Based on the DSM-5 criteria for social anxiety [2] as well as the SPIN [60] and the Social Interaction Anxiety Scale [64], new sentences relevant to socially anxious symptomatology were developed. Neutral sentences were taken from the original German stimulus set for depression.

For data analysis, a negative bias in interpretation was calculated as the ratio of negatively completed sentences divided by the total number of correctly completed emotional sentences, with a higher score indicating a greater bias. Split-half reliability with odd-even trials was r = .35 in our data (N = 150). Incorrect trials (954 trials, 31.8%) were excluded, as well as latencies below 1000ms (zero trials, 0%) and above 10000ms (52 trials, 1.6%).

Attention bias: Visual search task

Attention bias was assessed using the VST [65, 66]. In this task, participants are instructed to detect a target among distractors as quickly as possible, i.e., to find one divergent stimulus among an array of identical stimuli. When presented with an array of stimuli arranged around a fixation cross, participants must perform a detection task to determine whether a display includes a divergent stimulus (target-present trial) or whether all stimuli within the array are identical (target-absent trial). Similar to previous studies using a VST [6770], the current study used an array of eight faces arranged in a square and required participants to press the “Y”-key (for “yes”, on a QWERTZ keyboard) on target-present trials or the “N”-key (for “no”) on target-absent trials. Participants were asked to respond as quickly and accurately as possible. Two thirds of all trials were target-present trials, trials were presented in random order. Within each trial, only faces of one of four models were used so that only the facial expression could differ. The VST follows a 2x2x3 factorial design (target-present vs. target-absent; facilitation vs. interference condition; happy vs. angry vs. neutral target).

Target-present trials either consisted of one emotional target (happy or angry) surrounded by neutral distractors (facilitation condition) or one neutral target surrounded by identical emotional distractors (interference condition). Target-absent trials consisted of either happy, angry or neutral faces only. To control for order effects, one half of participants received two blocks of the interference condition first (Version A), while the other half started with two blocks of the facilitation condition (Version B). After 20 practice trials, participants received a total of four blocks of 48 trials each, resulting in a total of 192 trials. They received error feedback throughout the entire task. Fixation and inter-trial intervals were set to a default, while each array was presented until a response was given (Fig 2).

thumbnail
Fig 2. Experimental set-up of the VST.

Experimental trial (a) and example “search task” arrays of the facilitation (b) and interference (c) conditions of the VST. Participants are presented with an array of eight faces and required to detect whether there is a divergent target present or whether all faces are the same. Both example arrays represent target-present trials.

https://doi.org/10.1371/journal.pone.0282259.g002

Similar to previous studies [71], two scores were calculated: A disengagement score was calculated by subtracting RTs of interference trials with happy faces from RTs of interference trials with angry faces (RT interference angry–RT interference happy), i.e., a higher score indicated greater difficulty disengaging from angry relative to happy faces. An engagement score was calculated by subtracting RTs of facilitation trials with angry faces from RTs of facilitation trials with happy faces (RT facilitation happy–RT facilitation angry), i.e., a higher score indicated greater vigilance towards angry relative to happy faces. Since these scores use target trials only, non-target trials were removed. Odd-even reliability for the current sample was r = .12 for the engagement and r = .08 for the disengagement score (N = 150). Despite the low reliability we decided to run the analyses as planned. For analysis, incorrect trials (2208 trials, 11.2%) were excluded, as well as latencies below 200ms (2 trials, < 0.01%) and above 2000ms (2137 trials, 10.3%). Additionally, trials 3 SDs above or below each participant’s mean were discarded as outliers (21 trials, < 0.01%).

Attention control: Attentional network task

The Attentional Network Task [72] measures the three components of attention according to Petersen & Posner [44]: i.e., alerting, orienting, and executive function. For a detailed description of the Attentional Network Task (ANT), see S1 File. In this current study, participants went through 24 practice trials, followed by three blocks of 96 trials each, resulting in a total of 288 trials. Before each block, participants were asked to respond as quickly and accurately as possible.

For data analysis, three scores of attention control were calculated: An alerting score was calculated by subtracting RTs of trials with no cues and trials with double cues. An orienting score was calculated by subtracting RTs of trials with center cues and trials with spatial cues. An executive function score was calculated by subtracting RTs of trials with incongruent flankers and trials with congruent flankers. Higher score values each indicate greater attention control capacities. Consistent with other studies [72, 73], only correct responses were included in our statistical analyses. Odd-even reliability for this current sample is at r = .32 for the alerting score, r = .05 for the orienting score, and r = .46 for the executive function score (N = 147, three participants were excluded due to an accuracy rate lower than .80). For analysis, incorrect trials (1433 trials, 3.1%) were excluded, as well as latencies below 200ms (32 trials, < 0.01%) and above 1000ms (166 trials, < 0.01%). Additionally, trials 3 SDs above or below each participant’s mean were discarded as outliers (533 trials, 1.2%).

Procedure

Participants were tested between February and December 2019 in a behavioral lab at the Department of Psychology at LMU Munich. After providing written informed consent, participants sat in front of one of 10 computers divided by partitions, in a dimly lit room. All instructions were provided on the computer screen. The software Inquisit 5 Lab [74] was used for task administration. Stimuli were displayed on a 22-inch monitor, viewed from a distance of approximately 65 cm.

Participants first responded to a questionnaire assessing demographic data and exclusion criteria. ANT, VST and SST were administered in random order across participants. Upon completion of all behavior tasks, participants filled in the SPIN. The entire assessment took between 45 and 60 minutes in total.

Statistical analyses

Network analysis.

We estimated a partial correlation network with Bonferroni correction (alpha = 0.05). In a network diagram, each node represents a cognitive or symptom variable, whereas each edge represents a significant partial correlation after controlling for the other variables in the variable space. Responses were scaled automatically. We also estimated a network with regularization (graphical lasso), which produced results similar to the partial correlation network. The network analysis was performed using the R packages bootnet [75] and qgraph [76].

Cluster analysis

All cognitive measures (i.e., ANT, VST, SST; standardized prior to the analysis) were submitted to hierarchical clustering. We used Ward’s method on the Euclidian distance, as it has been shown to be superior to other methods of hierarchical clustering [77] and can effectively uncover underlying structures [78]. Analysis was performed using the R package NbClust [79].

Results

Descriptive information of the sample as well as zero-order correlations are presented in Table 1. The SPIN score had a significant correlation only with the SST score (r = .45), but not with the other cognition measures. In line with previous findings [8083], individuals with higher levels of social anxiety symptoms interpreted ambiguous sentences about social situations more negatively.

Network analysis

We submitted the observed correlations to network analysis. Both the Bonferroni corrected and the regularized lasso networks (standard tuning parameter of γ = 0.5) yielded the same result; a network with only one edge. The connection between symptoms of social anxiety (SPIN) and interpretation bias (SST) was positive, i.e., more severe anxiety symptoms were associated with stronger interpretation bias. All remaining associations displayed edges of zero weight, suggesting that attention bias (VST) and attention control (ANT) had no meaningful edge within the network. The regularized network is depicted in Fig 3 (see S3 Fig in S1 File for the Bonferroni correction with identical results).

thumbnail
Fig 3. Diagram of regularized network with tuning parameter set to γ = 0.5.

ANT: Alert, Orient, Execut = Attention Network Test: Alerting, Orienting, Executive function. VST: Diseng, Engage = Visual Search Task: disengagement, engagement; SST = Scrambled Sentence Task; SPIN = Social Phobia Inventory.

https://doi.org/10.1371/journal.pone.0282259.g003

Within the regularized lasso network, we tested different tuning parameters between 0 and 1; however, results remained unchanged except for a weak negative association between the engagement and disengagement components of attention bias (VST), see S4 Fig in S1 File. Regardless of tuning, we concluded that the only stable connection in a partial correlation network between the observed variables proved to be a positive association between symptoms of social anxiety and interpretation bias. Due to this small number of edges and low edge weights, further analysis of network centrality measures was abandoned as it would not have yielded meaningful results. See S5 Fig in S1 File for edge-weight accuracy.

Hierarchical clustering

We performed ANOVAs to clarify the group differences for each measure and found statistically significant group differences in each measure except for the VST engagement score. The detailed results can be found in S2 Table (see S1 File). Hierarchical cluster analysis suggested a three-cluster solution (see Fig 4). The number of clusters was determined by visual inspection of the dendogram (see S6 Fig in S1 File) as well as a set of indices (e.g., Hubert index and D index), the majority of which proposed two or three clusters.

thumbnail
Fig 4. Profiles of cognitive functions identified by hierarchical clustering.

ANT: Alt, Ort, Exc = Attention Network Test: Alerting, Orienting, Executive function [higher score indicates better functioning in each domain]. VST: Disen, Engag = Visual search task: disengagement, engagement [higher score indicates greater attention bias]. SST = Scrambled Sentence Task [higher score indicates greater interpretation bias]. SPIN = Social Phobia Inventory [higher score indicates greater symptom severity].

https://doi.org/10.1371/journal.pone.0282259.g004

We interpreted these clusters as follows: (1) “Maladaptive Cognition Pattern” (n = 62; 42.2%), (2) “Adaptive Cognition Pattern” (n = 60; 40.8%), and (3) “Distracted Cognition Pattern” (n = 25; 17.0%). The “Maladaptive Cognition Pattern” was characterized by overall poor performances on the ANT (the highest alerting scores indicating high sensitivity for new stimuli, combined with relatively low scores in executive function) and the highest scores for interpretation bias (SST). While this pattern showed low scores for attention bias (VST), i.e., weaker bias for threatening stimuli, the ANT scores suggest a strong sensitivity and preparedness towards new stimuli, which goes along with the highest level of social anxiety among the three patterns. In contrast, the “Adaptive Cognition Pattern” showed similarly low scores for attention bias, but lower alerting scores (i.e., sensitivity) and the highest scores for executive function. In combination with low anxiety symptoms (SPIN), this pattern displayed good cognitive functioning without significant biases toward negative stimuli in attention or interpretation, suggesting a potential positive impact of executive function capacities. Lastly, the “Distracted Cognition Pattern” was characterized by the highest scores for disengagement in the VST, i.e., strong difficulty disengaging from angry relative to happy faces, combined with low scores in executive function and interpretation bias. Seeing as this pattern displayed low to mediocre anxiety symptomatology as measured by the SPIN, it may not necessarily relate to anxiety symptoms and rather a general sensitivity toward threatening stimuli.

Discussion

We performed network and cluster analyses to investigate associations among attention control, cognitive biases, and social anxiety symptoms. Network analysis was applied to find associations between cognitive (dys)functions and social anxiety symptoms, and hierarchical clustering to identify groups of people with similar cognitive functioning and to relate the identified clusters to social anxiety symptoms.

The network analysis revealed a positive association between social anxiety symptoms (SPIN) and interpretation bias (SST), confirming the notion that more severe anxiety symptomatology goes along with more negative interpretations. This is in line with previous studies which found increased negative interpretations in socially anxious compared to non-anxious individuals [see 27 for a meta-analysis]. The positive association between anxiety symptoms and interpretation bias supports the Cognitive Model of Social Phobia by Clark and Wells [1], which postulates a vicious cycle. Biased information processing leads to a significantly more negative perception of social situations, which, in turn, increases fear in those situations and further exacerbates negative interpretations thereof [12]. Thus, ambiguous or mildly negative situations are catastrophized and appear to reinforce socially anxious individuals’ negative self-image as well as their belief that others think negatively about them [84, 85].

Contrary to our expectations, however, we found neither a significant association between social anxiety symptoms (SPIN) and attention control (ANT), nor between social anxiety symptoms (SPIN) and attention bias (VST). While an overall bias for emotional stimuli could be revealed, i.e., participants detected emotional targets significantly faster than neutral targets, this bias was not correlated with social anxiety symptoms. These findings are not consistent with previous research presuming a stable correlation between social anxiety and attention bias [21, 22, 57, 86] as well as between social anxiety and altered attention control [42, 43].

However, some previous studies have yielded similarly inconsistent results. Regarding attention bias, socially anxious individuals showed neither significantly faster engagement with nor slower disengagement from socially threatening words [87], angry faces [71, 88], disgusted faces [37], or emotional faces in general [89]. Interestingly, the expected attention bias could also not be found in the network study by Heeren and McNally [56], neither for engagement with nor for disengagement from fear-relevant stimuli. This may indicate that attention bias is not as relevant to social anxiety as previously assumed. Likewise, with regard to attention control, as noted in the introduction, the ANT has produced an inconsistent pattern of results in relation to social anxiety.

There are several possible explanations for these null associations in the current study. Most critically, both the VST and ANT showed low or modest reliability in our data. This suggests that the scores are highly influenced by measurement error, i.e., the individual differences in attention functioning that should be captured by these tasks are obscured. The rather high error rates and RT exclusions as well as the comparably low reliability could also indicate that some participants were not sufficiently focused during the task. In interpreting the results, this needs to be taken into account. However, it needs to be noted that low reliability is an issue with the majority of measures for cognitive biases [5] and thus a limitation which affects the entire field. Additionally, results could be confounded by the task set-up of the VST. It is conceivable that inter-trial intervals were not sufficiently long in the current study, at 60ms. Participants may not have had enough time to move on from one trial to the next. In attention tasks such as the Stroop Task, shorter inter-trial intervals are associated with slower reactions, higher error rates and diminished self-monitoring [90], as well as increased post-error slowing [91]. Moreover, scoring assumed a bias for negative stimuli over positive stimuli. Instead, there might be a general bias for emotional over neutral stimuli regardless of facial expression [23, 92, 93]. Alternatively, socially anxious individuals may tend to also interpret neutral faces as threatening [94], which might have obscured attention bias. Other possibly confounding variables such as levels of depression [95] were not measured. Regarding attention control (ANT), it could be that anxious individuals do experience a deficit but use other cognitive capacities to compensate, making the deficit harder to detect [96]. Since cognitive performance such as working memory was not measured in this study, this assumption may require further exploration in future studies. Lastly, as pointed out by Leung and colleagues [57], the expected interrelations between different cognitive biases may be easier to detect when biases are measured in one single domain (e.g., facial stimuli only). Since the current study used verbal stimuli to measure interpretation bias and facial stimuli to measure attention bias, transfer between domains may have diminished effects.

In addition to network analysis, exploratory hierarchical clustering suggested that a combination of multiple cognitive measures may be important in investigating cognitive functions in social anxiety. We identified three clusters with “adaptive”, “maladaptive”, and “distracted” cognitive features. There was a difference in the social anxiety symptoms as measured by the SPIN between the “adaptive” and “maladaptive” cognitive patterns. The fact that the “maladaptive” pattern combines both higher levels of social anxiety symptoms and higher levels of interpretation bias appears consistent with the findings of the network analysis, as it suggests strong interpretation bias as a cognitive phenotype of social anxiety. The differences between the “adaptive” and “maladaptive” cognitive patterns appear to be in line with the assumption that attention control may act as a moderator between cognitive biases and psychopathology [3840]. With high scores for the executive function component of the ANT, the “adaptive” pattern displays low interpretation bias as well as low anxiety symptoms, suggesting that attention control may be able to positively impact cognitive biases and thus reduce anxiety symptoms. Previous studies have shown that individuals with higher levels of social anxiety are more likely to display attention biases (i.e., initial engagement with threatening stimuli), but attention control may be able to compensate by subsequent disengagement of attention [40]. In this vein, strong capacities in executive function might have a compensatory effect on anxiety [4648] and possibly limit the impact of threatening stimuli on information processing [40]. This effect in social anxiety has already been replicated [37], yet by measuring attention control via questionnaire rather than experimental task. Accordingly, anxious persons often show deficits in inhibition [5, 97, 98], as can be observed in the ANT scores of the “maladaptive” pattern. This cluster is not only characterized by low executive function, but the highest alerting scores. This is associated with more severe anxiety symptoms, which might indicate that strong alerting capacities may increase anxiety [4649]. However, in line with previous studies [42, 4749], the association between orienting capacities and anxiety symptoms remains inconclusive.

Important to note are limitations of this study. The computational techniques implemented in this study provide an indication of possible associations, but cannot infer direction or temporality of the observed relationships. Network as well as cluster analyses are useful tools in identifying possible links between several variables of interest. However, results remain exploratory and cross-sectional in nature, prohibiting claims on causality. Similarly, one cannot judge the stability of these effects over time, as replicability of networks overall is being debated [99, 100]. Hence, generalizability is limited.

Reliability of all measures is relatively low, with SPIN and VST in particular showing low internal consistency. This limits stability and generalizability of our results, and thus interpretability as well. Low reliability is an inherent problem in cognitive bias research and needs to be addressed in future studies (e.g., by testing reliability more systematically, or developing more reliable tasks such as the Dual Probe Task).

Lastly, results are limited by a relatively homogenous sample. Recruiting participants from the general population rather than exclusively from a clinical sample [56] was meant to increase variance in social anxiety symptoms. However, the sample turned out to consist mostly of highly educated, well-functioning individuals (77% women) with smaller individual differences than we expected initially. Although a third of our sample scored above the cut-off of the SPIN (i.e., experiencing clinically significant levels of anxiety symptoms), more severe levels of symptoms as well as cognitive dysfunctions might not be covered, and thus possible ceiling effects cannot be ruled out. Future studies with analogue samples may consider inducing social-evaluative stress to increase the likelihood of observing effects [5].

Conclusions

The current study offers a conceptual replication of previous findings regarding the interplay between symptomatology and cognitive functions in social anxiety. These findings confirm the importance of observing several of these variables together rather than separately to better understand the maintenance of symptoms.

A solid association between social anxiety symptoms and interpretation bias confirms the latter as a worthwhile target for therapeutic interventions. The role of attention bias as well as attention control seems less clear. While the current study suggests a compensating effect of executive function capacities, these results are preliminary and future studies should explore this further, ideally via several different paradigms within one design. Results of the cluster analysis show that a wide range of variables can be used to describe cognitive patterns in social anxiety. Since these results are exploratory in nature, however, further studies with a larger sample size are needed to critically examine them and their therapeutic value.

References

  1. 1. Clark DM, Wells A. A cognitive model of social phobia. In: Heimberg RG, Liebowitz MR, Hope DA, Schneier FR, editors. Social Phobia: Diagnosis, Assessment, and Treatment. New York, USA: Guilford Press; 1995. p. 69–93.
  2. 2. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Washington, D.C.: Author; 2013.
  3. 3. Clark DM, McManus F. Information processing in social phobia. Biol Psychiatry [Internet]. 2002;51(1):92–100. Available from: http://www.sciencedirect.com/science/article/pii/S0006322301012963. pmid:11801234
  4. 4. Hirsch CR, Clark DM. Information-processing bias in social phobia. Clin Psychol Rev [Internet]. 2004;24(7):799–825. Available from: http://www.sciencedirect.com/science/article/pii/S0272735804000972. pmid:15501557
  5. 5. Van Bockstaele B, Verschuere B, Tibboel H, De Houwer J, Crombez G, Koster EHW. A review of current evidence for the causal impact of attentional bias on fear and anxiety. Psychol Bull. 2014;140(3):682–721. pmid:24188418
  6. 6. Bantin T, Stevens S, Gerlach AL, Hermann C. What does the facial dot-probe task tell us about attentional processes in social anxiety? A systematic review. J Behav Ther Exp Psychiatry [Internet]. 2016;50:40–51. Available from: http://www.sciencedirect.com/science/article/pii/S0005791615000646. pmid:26042381
  7. 7. Fox E, Russo R, Dutton K. Attentional bias for threat: evidence for delayed disengagement from emotional faces. Cogn Emot. 2002;16:355–79. pmid:18273395
  8. 8. Amir N, Elias J, Klumpp H, Przeworski A. Attentional bias to threat in social phobia: facilitated processing of threat or difficulty disengaging attention from threat? Behav Res Ther [Internet]. 2003;41(11):1325–35. Available from: http://www.sciencedirect.com/science/article/pii/S0005796703000391. pmid:14527531
  9. 9. Gilboa-Schechtman E, Shachar-Lavie I. More than a face: a unified theoretical perspective on nonverbal social cue processing in social anxiety. Front Hum Neurosci. 2013;7:904. pmid:24427129
  10. 10. Bradley BP, Mogg K, Millar NH. Covert and overt orienting of attention to emotional faces in anxiety. Cogn Emot [Internet]. 2000 Nov 1;14(6):789–808. Available from: https://doi.org/10.1080/02699930050156636.
  11. 11. Reinholdt-Dunne ML, Mogg K, Bradley BP. Effects of anxiety and attention control on processing pictorial and linguistic emotional information. Behav Res Ther [Internet]. 2009 May 1 [cited 2018 Oct 25];47(5):410–7. Available from: https://www.sciencedirect.com/science/article/abs/pii/S0005796709000266. pmid:19246028
  12. 12. Rapee RM, Heimberg RG. A cognitive-behavioral model of anxiety in social phobia. Behav Res Ther [Internet]. 1997;35(8):741–56. Available from: http://www.sciencedirect.com/science/article/pii/S0005796797000223. pmid:9256517
  13. 13. Williams JMG, Mathews A, MacLeod C. The emotional Stroop task and psychopathology. Psychol Bull. 1996;120(1):3–24. pmid:8711015
  14. 14. Fox E, Russo R, Bowles R, Dutton K. Do threatening stimuli draw or hold visual attention in subclinical anxiety? J Exp Psychol Gen. 2001;130(4):681–700. pmid:11757875
  15. 15. Stormark KM, Nordby H, Hugdahl K. Attentional shifts to emotionally charged cues: Behavioural and ERP data. Cogn Emot [Internet]. 1995 Sep 1;9(5):507–23. Available from: https://doi.org/10.1080/02699939508408978.
  16. 16. MacLeod C, Mathews A, Tata P. Attentional bias in emotional disorders. J Abnorm Psychol. 1986;95(1):15–20. pmid:3700842
  17. 17. Öhman A, Flykt A, Esteves F. Emotion drives attention: Detecting the snake in the grass. J Exp Psychol Gen. 2001;130(3):466–78. pmid:11561921
  18. 18. Rinck M, Becker ES, Kellermann J, Roth WT. Selective attention in anxiety: Distraction and enhancement in visual search. Depress Anxiety [Internet]. 2003 Aug 1;18(1):18–28. Available from: pmid:12900949
  19. 19. MacLeod C, Grafton B, Notebaert L. Anxiety-Linked Attentional Bias: Is It Reliable? Annu Rev Clin Psychol. 2019;15:529–54. pmid:30649926
  20. 20. Gilboa-Schechtman E, Foa EB, Amir N. Attentional Biases for Facial Expressions in Social Phobia: The Face-in-the-Crowd Paradigm. Cogn Emot [Internet]. 1999 May 1;13(3):305–18. Available from: https://doi.org/10.1080/026999399379294.
  21. 21. Baños RM, Quero S, Botella C. Detection and distraction effects for threatening information in social phobia and change after treatment. Depress Anxiety [Internet]. 2008 Jan 1;25(1):55–63. Available from: pmid:17252570
  22. 22. Eastwood JD, Smilek D. Functional consequences of perceiving facial expressions of emotion without awareness. Conscious Cogn [Internet]. 2005;14(3):565–84. Available from: http://www.sciencedirect.com/science/article/pii/S105381000500005X. pmid:16091271
  23. 23. Taylor CT, Bomyea J, Amir N. Attentional bias away from positive social information mediates the link between social anxiety and anxiety vulnerability to a social stressor. J Anxiety Disord [Internet]. 2010;24(4):403–8. Available from: http://www.sciencedirect.com/science/article/pii/S0887618510000319. pmid:20207102
  24. 24. Chen YP, Ehlers A, Clark DM, Mansell W. Patients with generalized social phobia direct their attention away from faces. Behav Res Ther [Internet]. 2002;40(6):677–87. Available from: http://www.sciencedirect.com/science/article/pii/S0005796701000869. pmid:12051486
  25. 25. Rossignol M, Philippot P, Bissot C, Rigoulot S, Campanella S. Electrophysiological correlates of enhanced perceptual processes and attentional capture by emotional faces in social anxiety. Brain Res [Internet]. 2012;1460:50–62. Available from: http://www.sciencedirect.com/science/article/pii/S0006899312007500. pmid:22592075
  26. 26. Hirsch CR, Clark DM, Mathews A. Imagery and Interpretations in Social Phobia: Support for the Combined Cognitive Biases Hypothesis. Behav Ther [Internet]. 2006 Sep 1 [cited 2018 Oct 25];37(3):223–36. Available from: https://www.sciencedirect.com/science/article/abs/pii/S0005789406000402. pmid:16942974
  27. 27. Chen J, Short M, Kemps E. Interpretation bias in social anxiety: A systematic review and meta-analysis. J Affect Disord [Internet]. 2020;276:1119–30. Available from: https://www.sciencedirect.com/science/article/pii/S016503272032574X. pmid:32777650
  28. 28. Beard C. Cognitive bias modification for anxiety: current evidence and future directions. Expert Rev Neurother [Internet]. 2011 Feb 1;11(2):299–311. Available from: pmid:21306216
  29. 29. Amir N, Foa EB, Coles ME. Negative interpretation bias in social phobia. Behav Res Ther. 1998;36:945–57. pmid:9714945
  30. 30. Beard C, Amir N. Negative Interpretation Bias Mediates the Effect of Social Anxiety on State Anxiety. Cognit Ther Res [Internet]. 2010;34(3):292–6. Available from: pmid:20495620
  31. 31. Constans JI, Penn DL, Ihen GH, Hope DA. Interpretive biases for ambiguous stimuli in social anxiety. Behav Res Ther [Internet]. 1999;37(7):643–51. Available from: http://www.sciencedirect.com/science/article/pii/S0005796798001806. pmid:10402689
  32. 32. Stopa L, Clark DM. Social phobia and interpretation of social events. Behav Res Ther [Internet]. 2000;38(3):273–83. Available from: http://www.sciencedirect.com/science/article/pii/S0005796799000431. pmid:10665160
  33. 33. Huppert JD, Pasupuleti R V, Foa EB, Mathews A. Interpretation biases in social anxiety: Response generation, response selection, and self-appraisals. Behav Res Ther [Internet]. 2007;45(7):1505–15. Available from: http://www.sciencedirect.com/science/article/pii/S0005796707000113. pmid:17336922
  34. 34. Bowler JO, Mackintosh B, Dunn BD, Mathews A, Dalgleish T, Hoppitt L. A comparison of cognitive bias modification for interpretation and computerized cognitive behavior therapy: Effects on anxiety, depression, attentional control, and interpretive bias. J Consult Clin Psychol [Internet]. 2012 Dec;80(6):1021–33. Available from: http://search.ebscohost.com/login.aspx?direct=true&db=psyh&AN=2012-24314-001&site=ehost-live. pmid:22963595
  35. 35. Everaert J, Duyck W, Koster EHW. Attention, Interpretation, and Memory Biases in Subclinical Depression: A Proof-of-Principle Test of the Combined Cognitive Biases Hypothesis. Emotion. 2014 Apr;14(2):331–40. pmid:24512247
  36. 36. Rude SS, Wenzlaff RM, Gibbs B, Vane J, Whitney T. Negative processing biases predict subsequent depressive symptoms. Cogn Emot [Internet]. 2002 May 1;16(3):423–40. Available from: https://doi.org/10.1080/02699930143000554.
  37. 37. Taylor CT, Cross K, Amir N. Attentional control moderates the relationship between social anxiety symptoms and attentional disengagement from threatening information. J Behav Ther Exp Psychiatry [Internet]. 2016;50:68–76. Available from: http://www.sciencedirect.com/science/article/pii/S0005791615000750. pmid:26072705
  38. 38. Cisler JM, Koster EHW. Mechanisms of attentional biases towards threat in anxiety disorders: An integrative review. Clin Psychol Rev [Internet]. 2010;30(2):203–16. Available from: http://www.sciencedirect.com/science/article/pii/S0272735809001585. pmid:20005616
  39. 39. Mathews A, MacLeod C. Cognitive Vulnerability to Emotional Disorders. Annu Rev Clin Psychol [Internet]. 2005 Oct 11;1:167–95. Available from: https://doi.org/10.1146/annurev.clinpsy.1.102803.143916. pmid:17716086
  40. 40. Derryberry D, Reed MA. Anxiety-related attentional biases and their regulation by attentional control. J Abnorm Psychol. 2002;111(2):225–36. pmid:12003445
  41. 41. Moriya J, Tanno Y. The time course of attentional disengagement from angry faces in social anxiety. J Behav Ther Exp Psychiatry [Internet]. 2011;42(1):122–8. Available from: http://www.sciencedirect.com/science/article/pii/S0005791610000789. pmid:20797697
  42. 42. Heeren A, Maurage P, Philippot P. Revisiting attentional processing of non-emotional cues in social anxiety: A specific impairment for the orienting network of attention. Psychiatry Res [Internet]. 2015;228(1):136–42. Available from: http://www.sciencedirect.com/science/article/pii/S0165178115002334. pmid:25957649
  43. 43. Moriya J, Tanno Y. Dysfunction of attentional networks for non-emotional processing in negative affect. Cogn Emot [Internet]. 2009 Sep 1;23(6):1090–105. Available from: https://doi.org/10.1080/02699930802335018.
  44. 44. Petersen SE, Posner MI. The attention system of the human brain: 20 years after. Annu Rev Neurosci. 2012;35:73–89. pmid:22524787
  45. 45. Posner MI, Rothbart MK. Research on Attention Networks as a Model for the Integration of Psychological Science. Annu Rev Psychol [Internet]. 2006 Dec 6;58(1):1–23. Available from: https://doi.org/10.1146/annurev.psych.58.110405.085516.
  46. 46. Heeren A, Mogoaşe C, McNally RJ, Schmitz A, Philippot P. Does attention bias modification improve attentional control? A double-blind randomized experiment with individuals with social anxiety disorder. J Anxiety Disord [Internet]. 2015;29:35–42. Available from: http://www.sciencedirect.com/science/article/pii/S0887618514001686. pmid:25465885
  47. 47. Pacheco-Unguetti AP, Acosta A, Callejas A, Lupiáñez J. Attention and Anxiety: Different Attentional Functioning Under State and Trait Anxiety. Psychol Sci [Internet]. 2010 Jan 22;21(2):298–304. Available from: pmid:20424060
  48. 48. Pacheco-Unguetti AP, Acosta A, Marqués E, Lupiáñez J. Alterations of the attentional networks in patients with anxiety disorders. J Anxiety Disord [Internet]. 2011;25(7):888–95. Available from: http://www.sciencedirect.com/science/article/pii/S0887618511000909. pmid:21641180
  49. 49. Moriya J. Attentional networks and visuospatial working memory capacity in social anxiety. Cogn Emot [Internet]. 2018 Jan 2;32(1):158–66. Available from: pmid:27910724
  50. 50. Amir N, Bomyea J. Chapter 14—Cognitive Biases in Social Anxiety Disorder. In: Hofmann SG, DiBartolo PM, editors. Social Anxiety. 2nd ed. San Diego: Academic Press; 2010. p. 373–93.
  51. 51. Spokas ME, Rodebaugh TL, Heimberg RG. Cognitive biases in social phobia. Psychiatry [Internet]. 2007;6(5):204–10. Available from: http://www.sciencedirect.com/science/article/pii/S1476179307000432.
  52. 52. Everaert J, Bernstein A, Joormann J, Koster EHW. Mapping Dynamic Interactions Among Cognitive Biases in Depression. Emot Rev [Internet]. 2020 Jan 28;12(2):93–110. Available from: https://doi.org/10.1177/1754073919892069.
  53. 53. Everaert J, Tierens M, Uzieblo K, Koster EHW. The indirect effect of attention bias on memory via interpretation bias: Evidence for the combined cognitive bias hypothesis in subclinical depression. Cogn Emot [Internet]. 2013 Dec 1;27(8):1450–9. Available from: pmid:23627259
  54. 54. Joormann J D’Avanzato C. Emotion regulation in depression: Examining the role of cognitive processes. Cogn Emot. 2010;24(6):913–39.
  55. 55. Amir N, Bomyea J, Beard C. The effect of single-session interpretation modification on attention bias in socially anxious individuals. J Anxiety Disord [Internet]. 2010;24(2):178–82. Available from: http://www.sciencedirect.com/science/article/pii/S0887618509002084. pmid:19926442
  56. 56. Heeren A, McNally RJ. An integrative network approach to social anxiety disorder: The complex dynamic interplay among attentional bias for threat, attentional control, and symptoms. J Anxiety Disord [Internet]. 2016 Aug 1 [cited 2018 Oct 25];42:95–104. Available from: https://www.sciencedirect.com/science/article/abs/pii/S0887618516301104. pmid:27395806
  57. 57. Leung CJ, Yiend J, Lee TMC. The Relationship Between Attention, Interpretation, and Memory Bias During Facial Perception in Social Anxiety. Behav Ther [Internet]. 2022;53(4):701–13. Available from: https://www.sciencedirect.com/science/article/pii/S0005789422000144. pmid:35697432
  58. 58. Enock PM, Hofmann SG, McNally RJ. Attention Bias Modification Training Via Smartphone to Reduce Social Anxiety: A Randomized, Controlled Multi-Session Experiment. Cognit Ther Res [Internet]. 2014;38(2):200–16. Available from: https://doi.org/10.1007/s10608-014-9606-z.
  59. 59. Stangier U, Steffens M. Social Phobia Inventory—Deutsche Fassung. Frankfurt: Psychologisches Institut der Universität; 2001.
  60. 60. Connor KM, Davidson JRT, Churchill LE, Sherwood A, Weisler RH, Foa EB. Psychometric properties of the Social Phobia Inventory (SPIN): New self-rating scale. Br J Psychiatry [Internet]. 2018/01/02. 2000;176(4):379–86. Available from: https://www.cambridge.org/core/article/psychometric-properties-of-the-social-phobia-inventory-spin/9E4A3EE20D2B1A6C222CDB5807AC086A.
  61. 61. Sosic Z, Gieler U, Stangier U. Screening for social phobia in medical in- and outpatients with the German version of the Social Phobia Inventory (SPIN). J Anxiety Disord [Internet]. 2008;22(5):849–59. Available from: http://www.sciencedirect.com/science/article/pii/S0887618507001697. pmid:17923381
  62. 62. Wenzlaff RM. The mental control of depression: Psychological obstacles to emotional well-being. Handbook of mental control. Englewood Cliffs, NJ, US: Prentice-Hall, Inc; 1993. p. 239–57. (Century psychology series.).
  63. 63. Wenzlaff RM, Bates DE. Unmasking a cognitive vulnerability to depression: How lapses in mental control reveal depressive thinking. J Pers Soc Psychol. 1998;75(6):1559–71. pmid:9914666
  64. 64. Mattick RP, Clarke JC. Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behav Res Ther [Internet]. 1998;36(4):455–70. Available from: http://www.sciencedirect.com/science/article/pii/S0005796797100316. pmid:9670605
  65. 65. Frischen A, Eastwood JD, Smilek D. Visual search for faces with emotional expressions. Psychol Bull. 2008;134(5):662–76. pmid:18729567
  66. 66. Hansen CH, Hansen RD. Finding the face in the crowd: An anger superiority effect. J Pers Soc Psychol. 1988;54:917–24. pmid:3397866
  67. 67. Aktar E, Van Bockstaele B, Pérez-Edgar K, Wiers RW, Bögels SM. Intergenerational transmission of attentional bias and anxiety. Dev Sci [Internet]. 2019 May 1;22(3):e12772. Available from: pmid:30428152
  68. 68. Wieser MJ, Hambach A, Weymar M. Neurophysiological correlates of attentional bias for emotional faces in socially anxious individuals–Evidence from a visual search task and N2pc. Biol Psychol [Internet]. 2018;132:192–201. Available from: http://www.sciencedirect.com/science/article/pii/S0301051118300085. pmid:29307540
  69. 69. Derakshan N, Koster EHW. Processing efficiency in anxiety: Evidence from eye-movements during visual search. Behav Res Ther [Internet]. 2010;48(12):1180–5. Available from: http://www.sciencedirect.com/science/article/pii/S000579671000183X. pmid:20851380
  70. 70. Matsumoto E. Bias in attending to emotional facial expressions: Anxiety and visual search efficiency. Appl Cogn Psychol [Internet]. 2010 Apr 1;24(3):414–24. Available from: https://doi.org/10.1002/acp.1686.
  71. 71. Wermes R, Lincoln TM, Helbig-Lang S. Attentional biases to threat in social anxiety disorder: time to focus our attention elsewhere? Anxiety, Stress Coping [Internet]. 2018 Sep 3;31(5):555–70. Available from: pmid:29877114
  72. 72. Fan J, McCandliss BD, Sommer T, Raz A, Posner MI. Testing the Efficiency and Independence of Attentional Networks. J Cogn Neurosci [Internet]. 2002 Apr 1;14(3):340–7. Available from: pmid:11970796
  73. 73. Fan J, Fossella J, Sommer T, Wu Y, Posner MI. Mapping the genetic variation of executive attention onto brain activity. Proc Natl Acad Sci U S A. 2003;100:7406–11. pmid:12773616
  74. 74. Millisecond. Inquisit 5 [Internet]. 2016. Available from: https://www.millisecond.com.
  75. 75. Epskamp S, Borsboom D, Fried EI. Estimating psychological networks and their accuracy: A tutorial paper. Behav Res Methods [Internet]. 2018;50(1):195–212. Available from: pmid:28342071
  76. 76. Epskamp S, Cramer AOJ, Waldorp LJ, Schmittmann VD, Borsboom D. Qgraph: Network visualizations of relationships in psychometric data. J Stat Softw. 2012;48(4):1–18.
  77. 77. Overall JE, Gibson JM, Novy DM. Population recovery capabilities of 35 cluster analysis methods. J Clin Psychol [Internet]. 1993 Jul 1;49(4):459–70. Available from: https://doi.org/10.1002/1097-4679(199307)49:4%3C459::AID-JCLP2270490402%3E3.0.CO. pmid:8408672
  78. 78. Borgen FH, Barnett DC. Applying cluster analysis in counseling psychology research. Vol. 34, Journal of Counseling Psychology. US: American Psychological Association; 1987. p. 456–68.
  79. 79. Charrad M, Ghazzali N, Boiteau V, Niknafs A. NbClust: An R Package for Determining the Relevant Number of Clusters in a Data Set. J Stat Softw [Internet]. 2014;61(6):1–36. Available from: http://www.jstatsoft.org/v61/i06/.
  80. 80. Amir N, Beard C, Bower E. Interpretation Bias and Social Anxiety. Cognit Ther Res [Internet]. 2005;29(4):433–43. Available from: https://doi.org/10.1007/s10608-005-2834-5.
  81. 81. Castillo MD, Leandro PG. Interpretation bias in anxiety a synthesis of studies with children and adolescents. Procedia—Soc Behav Sci [Internet]. 2010;5:1105–11. Available from: http://www.sciencedirect.com/science/article/pii/S1877042810016174.
  82. 82. Vassilopoulos S.Interpretation and judgmental biases in socially anxious and nonanxious individuals. Behav Cogn Psychother. 2006;34:243–54.
  83. 83. Mobini S, Reynolds S, Mackintosh B. Clinical Implications of Cognitive Bias Modification for Interpretative Biases in Social Anxiety: An Integrative Literature Review. Cognit Ther Res [Internet]. 2013;37(1):173–82. Available from: https://doi.org/10.1007/s10608-012-9445-8.
  84. 84. Wong J, Gordon EA, Heimberg RG. Cognitive-Behavioral Models of Social Anxiety Disorder. In: The Wiley Blackwell Handbook of Social Anxiety Disorder [Internet]. 2014. (Wiley Online Books). Available from:
  85. 85. Heimberg RG, Brozovich FA, Rapee RM. Chapter 24—A Cognitive-Behavioral Model of Social Anxiety Disorder. In: Hofmann SG, DiBartolo PMBTSA (Third E, editors. San Diego: Academic Press; 2014. p. 705–28. Available from: https://www.sciencedirect.com/science/article/pii/B9780123944276000248.
  86. 86. Heimberg RG, Brozovich FA, Rapee RM. A cognitive model of social anxiety disorder: update and extensions. In: Hofmann SG, DiBartolo PM, editors. Social anxiety: clinical, developmental, and social perspectives. 2nd ed. New York, USA: Academic Press; 2010. p. 395–422.
  87. 87. Ononaiye MSP, Turpin G, Reidy JG. Attentional Bias in Social Anxiety: Manipulation of Stimulus Duration and Social-evaluative Anxiety. Cognit Ther Res [Internet]. 2007;31(6):727–40. Available from: https://doi.org/10.1007/s10608-006-9096-8.
  88. 88. de Jong PJ, Martens S. Detection of emotional expressions in rapidly changing facial displays in high- and low-socially anxious women. Behav Res Ther [Internet]. 2007;45(6):1285–94. Available from: http://www.sciencedirect.com/science/article/pii/S0005796706002488. pmid:17113566
  89. 89. Gotlib IH, Kasch KL, Traill S, Joormann J, Arnow BA, Johnson SL. Coherence and Specificity of Information-Processing Biases in Depression and Social Phobia. J Abnorm Psychol. 2004;113(3):386–98. pmid:15311984
  90. 90. Compton RJ, Heaton E, Ozer E. Intertrial interval duration affects error monitoring. Psychophysiology [Internet]. 2017 Aug;54(8):1151–62. Available from: http://search.ebscohost.com/login.aspx?direct=true&db=psyh&AN=2017-17370-001&site=ehost-live pmid:28423188
  91. 91. Danielmeier C, Ullsperger M. Post-Error Adjustments. Front Psychol [Internet]. 2011;2:233. Available from: https://www.frontiersin.org/article/10.3389/fpsyg.2011.00233" xlink:type="simple">https://www.frontiersin.org/article/10.3389/fpsyg.2011.00233 pmid:21954390
  92. 92. Mansell W, Clark DM, Ehlers A, Chen YP. Social Anxiety and Attention away from Emotional Faces. Cogn Emot [Internet]. 1999 Oct 1;13(6):673–90. Available from: https://doi.org/10.1080/026999399379032.
  93. 93. Sluis RA, Boschen MJ. Fear of evaluation in social anxiety: Mediation of attentional bias to human faces. J Behav Ther Exp Psychiatry [Internet]. 2014;45(4):475–83. Available from: http://www.sciencedirect.com/science/article/pii/S0005791614000494. pmid:25039035
  94. 94. Yoon KL, Zinbarg RE. Interpreting neutral faces as threatening is a default mode for socially anxious individuals. J Abnorm Psychol. 2008;117(3):680–5. pmid:18729619
  95. 95. Musa C, Lépine JP, Clark DM, Mansell W, Ehlers A. Selective attention in social phobia and the moderating effect of a concurrent depressive disorder. Behav Res Ther [Internet]. 2003;41(9):1043–54. Available from: http://www.sciencedirect.com/science/article/pii/S0005796702002127. pmid:12914806
  96. 96. Berggren N, Derakshan N. Attentional control deficits in trait anxiety: Why you see them and why you don’t. Biol Psychol [Internet]. 2013;92(3):440–6. Available from: http://www.sciencedirect.com/science/article/pii/S0301051112000695. pmid:22465045
  97. 97. Bishop SJ. Trait anxiety and impoverished prefrontal control of attention. Nat Neurosci. 2009;12:92–8. pmid:19079249
  98. 98. Eysenck MW, Derakshan N. New perspectives in attentional control theory. Pers Individ Dif. 2011;50:955–60.
  99. 99. Epskamp S, Fried EI. A tutorial on regularized partial correlation networks. Psychol Methods. 2016;1–28.
  100. 100. Fried EI, Cramer AOJ. Moving Forward: Challenges and Directions for Psychopathological Network Theory and Methodology. Perspect Psychol Sci [Internet]. 2017 Sep 5;12(6):999–1020. Available from: pmid:28873325