Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Impairment of visually guided associative learning in children with Tourette syndrome

  • Gabriella Eördegh ,

    Contributed equally to this work with: Gabriella Eördegh, Ákos Pertich

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Validation, Writing – original draft

    Affiliation Faculty of Health Sciences and Social Studies, University of Szeged, Szeged, Hungary

  • Ákos Pertich ,

    Contributed equally to this work with: Gabriella Eördegh, Ákos Pertich

    Roles Data curation, Investigation, Visualization, Writing – review & editing

    Affiliation Department of Physiology, Faculty of Medicine, University of Szeged, Szeged, Hungary

  • Zsanett Tárnok,

    Roles Data curation, Investigation, Project administration, Resources

    Affiliation Vadaskert Child and Adolescent Psychiatry, Budapest, Hungary

  • Péter Nagy,

    Roles Conceptualization, Investigation, Resources

    Affiliation Vadaskert Child and Adolescent Psychiatry, Budapest, Hungary

  • Balázs Bodosi,

    Roles Investigation, Methodology, Software

    Affiliation Department of Physiology, Faculty of Medicine, University of Szeged, Szeged, Hungary

  • Zsófia Giricz,

    Roles Data curation, Investigation, Visualization, Writing – review & editing

    Affiliation Department of Physiology, Faculty of Medicine, University of Szeged, Szeged, Hungary

  • Orsolya Hegedűs,

    Roles Data curation, Investigation

    Affiliation Vadaskert Child and Adolescent Psychiatry, Budapest, Hungary

  • Dóra Merkl,

    Roles Data curation, Investigation

    Affiliation Vadaskert Child and Adolescent Psychiatry, Budapest, Hungary

  • Diána Nyujtó,

    Roles Data curation, Investigation

    Affiliation Department of Physiology, Faculty of Medicine, University of Szeged, Szeged, Hungary

  • Szabina Oláh,

    Roles Data curation, Investigation

    Affiliation Vadaskert Child and Adolescent Psychiatry, Budapest, Hungary

  • Attila Őze,

    Roles Conceptualization, Data curation, Investigation, Methodology, Software, Validation

    Affiliation Department of Physiology, Faculty of Medicine, University of Szeged, Szeged, Hungary

  • Réka Vidomusz,

    Roles Data curation, Investigation

    Affiliation Vadaskert Child and Adolescent Psychiatry, Budapest, Hungary

  • Attila Nagy

    Roles Conceptualization, Funding acquisition, Methodology, Resources, Supervision, Writing – review & editing

    nagy.attila.1@med.u-szeged.hu

    Affiliation Department of Physiology, Faculty of Medicine, University of Szeged, Szeged, Hungary

Abstract

The major symptoms of Tourette syndrome are motor and vocal tics, but Tourette syndrome is occasionally associated with cognitive alterations as well. Although Tourette syndrome does not affect the majority of cognitive functions, some of them improve. There is scarce evidence on the impairment of learning functions in patients with Tourette syndrome. The core symptoms of Tourette syndrome are related to dysfunction of the basal ganglia and the frontostriatal loops. Acquired equivalence learning is a kind of associative learning that is related to the basal ganglia and the hippocampi. The modified Rutgers Acquired Equivalence Test was used in the present study to observe the associative learning function of patients with Tourette syndrome. The cognitive learning task can be divided into two main phases: the acquisition and test phases. The latter is further divided into two parts: retrieval and generalization. The acquisition phase of the associative learning test, which mainly depends on the function of the basal ganglia, was affected in the entire patient group, which included patients with Tourette syndrome with attention deficit hyperactivity disorder, obsessive compulsive disorder, autism spectrum disorder, or no comorbidities. Patients with Tourette syndrome performed worse in building associations. However, the retrieval and generalization parts of the test phase, which primarily depend on the function of the hippocampus, were not worsened by Tourette syndrome.

Introduction

Tourette syndrome (TS) is a disorder that presents before the age of 18 years, affecting 1% of school-aged children [14]. The most frequent symptoms are motor and vocal tics [1, 5], which significantly improve in many patients by young adulthood [6]. In addition to these primary symptoms, pure Tourette syndrome is associated with some mild alterations in cognitive functions, mainly in a few executive functions (i.e., verbal fluency, working memory, and Stroop effect), which extend into adulthood [79], and others, which disappear with age (i.e., deficits demonstrated by the Wisconsin Card Sorting Test [10]).

The symptoms of Tourette syndrome are mainly related to dysfunction of the basal ganglia and the connected frontal lobe [11, 12]. Reduced left caudate nucleus volume [13], prefrontal hypertrophy, and structural changes have been described in Tourette syndrome [1416]. The connection between the frontal lobe and the basal ganglia via parallel and overlapping frontostriatal circuits [5, 12, 1722] is significantly weaker in Tourette syndrome [23].

This frontostriatal system is responsible for motor functions and several cognitive functions [24]. However, significant impairment of cognitive functions has only been rarely described in patients with Tourette syndrome without any comorbidities [25], and the impairment often depends on the level of tic severity [2628]. Most impairment has been reported in Tourette syndrome with its most frequent comorbidity, attention deficit hyperactivity disorder (ADHD) [2931]. Previous studies have emphasized that most alterations of cognitive functions are primarily associated with concomitant ADHD and TS [3236]. These results suggest that the cognitive performance of patients with TS + ADHD is more similar to that of patients with ADHD than that of patients with Tourette syndrome [33, 35, 37, 38]. Accordingly, Channon et al. did not find any impairment in explicit or implicit memory or learning processes in Tourette syndrome alone but did find these impairments in TS + ADHD [39]. In reinforcement learning, the results are conflicting, but most results show no difference between patients with Tourette syndrome and healthy controls [26, 4043]. Patients with Tourette syndrome have intact motor sequence learning [44], but the procedural (habit) learning in a probabilistic classification learning, which is connected to the dorsal striatum [45] was significantly altered [46, 47]. However, hippocampus-related learning was not affected in patients with Tourette syndrome alone [47]. Another procedural learning type, implicit probabilistic sequence learning, was not affected or was even better in patients with Tourette syndrome [48, 49]. These learning functions function via frontostriatal loops as well as associative learning, which has not yet been investigated for Tourette syndrome.

Associative learning, in which discrete and often different signals are linked together, is a type of conditioning. For example, when we remember a face, we record all the facial features, and the parts reinforce each other. This basic cognitive function is related to basal ganglia and hippocampus functions. The Rutgers Acquired Equivalence Test [35] investigates this specific learning ability. The primary advantage of this test is that each phase of the paradigm has well-described neural substrates. The acquisition phase, which primarily depends on the function of the basal ganglia [35, 50], tests the association of two different visual stimuli with the help of feedback about the correctness of the responses. In the test phase, which primarily depends on the function of the hippocampus and the mediotemporal lobe [35, 50], the previously learned associations are presented without any feedback (retrieval part), and previously not presented but predictable associations (generalization part) are shown. This learning function was previously investigated in adult patients with Parkinson’s disease, Alzheimer’s disease, schizophrenia, and migraine without aura [35, 5153] but never in children with neurological or psychiatric disorders compared with healthy controls. Thus, the description of this learning ability in Tourette syndrome remains missing. Since Tourette syndrome is related to dysfunction of the basal ganglia and the frontostriatal loops, we hypothesized that the acquisition phase could be primarily affected in the Acquired Equivalence Test. Thus, the primary aim of the present study was to determine whether visually guided associative acquired equivalence learning is affected in children with Tourette syndrome. We also investigated whether similar to other cognitive deficits of patients with Tourette syndrome the ADHD is the primary reason for reduced associative learning ability in patients with Tourette syndrome.

Methods

Participants

Altogether, 46 children with Tourette syndrome participated in the present research. The children were recruited from Vadaskert Child Psychiatry Hospital in Budapest, Hungary. The children were diagnosed by both a licensed clinical psychologist and a board-certified child psychiatrist at the hospital according to the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-V) criteria [1]. A total of 21 patients were diagnosed with Tourette syndrome without any other neurological or psychiatric comorbidities (TS group); 15 were diagnosed with Tourette syndrome and comorbid ADHD (TS + ADHD group); and 10 were diagnosed with Tourette syndrome and some other comorbidity (obsessive compulsive disorder [OCD] or autism spectrum disorder [ASD]; TS + OCD/ASD group). In this study, we analyzed associative learning of patients in the TS, TS + ADHD, and TS + OCD/ASD groups in detail (32 boys and 14 girls, mean age: 11.64±2.38 years, age range: 8–17 years). Children with other neurodevelopmental or psychiatric comorbidities or learning disabilities were excluded. The mean Yale Global Tic Severity Scale (YGTSS) total tic score (TTS) was 20.7±6.4 (range: 8–33) [5, 54] in the whole patient group. Two participants showed minimal tic severity (TTS ≤ 10); 17 showed mild tic severity (score 11–20); and 19 showed moderate to severe tic severity (score > 20). There were no significant differences (Kruskal–Wallis ANOVA, p>0.05) among the patient subgroups according to age, IQ level, and tic severity. Twelve of the children involved in this study (3 from the TS group, 6 from the TS + ADHD group, and 3 from the TS + OCD/ASD group) were medicated because of the symptoms of their disorder. The TS group received dopamine 2 receptor antagonists (haloperidol and risperidone). The TS + ADHD patients received a norepinephrine–dopamine reuptake inhibitor (methylphenidate), a dopamine 2 receptor antagonist (haloperidol), or a partial agonist of the dopamine 2 and serotonin 1A receptors (aripiprazole), a norepinephrine transporter and dopamine reuptake inhibitor (atomoxetine), or melatonin. The TS + OCD/ASD group received selective serotonin reuptake inhibitors (fluvoxamine and sertraline), a partial agonist of the dopamine 2 and serotonin 1A receptors (aripiprazole), a serotonin and dopamine antagonist (risperidone), or a norepinephrine-dopamine reuptake inhibitor (methylphenidate).

The parents of all participants signed an informed consent form and did not receive financial compensation for their participation. The protocol of the study conformed to the tenets of the Declaration of Helsinki in all respects, and it was approved by the Ministry of Human Capacities in Budapest, Hungary (11818-6/2017/EÜIG).

From our database of control children recruited from local schools, 46 control children (31 boys and 15 girls, mean age: 11.55±2.38 years, range: 8–17.5 years) were assorted and individually matched based on sex, age (differing in age by no more than six months), and IQ level to the patient groups. There were no significant differences (Kruskal–Wallis ANOVA, p>0.05) among the control subgroups according to age and IQ level. Table 1 shows the demographic data for the patient and control groups.

thumbnail
Table 1. Demographic parameters of the investigated groups.

https://doi.org/10.1371/journal.pone.0234724.t001

The control group only included children without any known psychiatric, neurological, or neurodevelopmental disorders. All participants (patients and controls) had normal or corrected-to-normal vision and normal hearing. The intactness of color vision was tested by Ishihara plates prior to testing to exclude color blindness [55] both in the patient and control groups. Only patients and controls with normal color vision were analyzed in the present study. We estimated the IQ level with Raven’s Standard [56] and Colored [57] Progressive Matrices [58].

Visually guided associative learning paradigm

The principle of the visual learning paradigm is based on the Rutgers Acquired Equivalence Test [35]. The original visual associative learning test [35] written for iOS (Apple Inc.’s operating system) was slightly modified, translated to Hungarian, and rewritten in Assembly (for Windows) with the written permission of Prof. Catherine E. Myers (Rutgers University, NJ, USA). The test was run on a PC. The testing sessions occurred in a dark and quiet room with the participants sitting at a standard distance (114 cm) from the computer screen with comfortable visibility and legible brightness. The participants were asked to learn associations between antecedent stimuli (four faces: A1, A2, B1, and B2) and consequent stimuli (four fish with different colors: X1, X2, Y1, and Y2). The four possible faces were a male adult, a male child, a female adult, and a female child. The four colors were red, green, blue, and yellow. The antecedent-consequent pairings were randomly generated by the computer from these stimuli for each participant. The acquired equivalence paradigm was structured as follows (Fig 1).

thumbnail
Fig 1. Graphic overview of the visually guided acquired equivalence learning paradigm.

See details in Methods.

https://doi.org/10.1371/journal.pone.0234724.g001

Acquisition phase.

During each trial of the task, participants saw a face and a pair of fish and had to learn through trial and error which of the fish matched which face. In the initial training stages, participants were expected to learn that when face A1 or A2 appears, the correct choice is fish X1 over fish Y1; when face B1 or B2 appears, the correct choice is fish Y1 over fish X1. If the associations are successfully learned, participants also learn that faces A1 and A2 are equivalent with respect to the associated fish (faces B1 and B2 are likewise equivalent with respect to the associated fish). Next, participants learned a new set of pairs: if presented with face A1, they had to choose fish X2 over Y2, and in the case of face B1, fish Y2 over X2. Altogether, six stimulus combinations were shown in the acquisition phase of the paradigm in which the computer provided feedback about the success of the acquisition after each trial. New associations were individually introduced during the acquisition stages. New associations were mixed with trials of previously learned associations. The participants had to achieve a certain number of consecutive correct responses after the presentation of each new association (4 after the presentation of the first association, and 4, 6, 8, 10, and 12 with the introduction of each new association, respectively) to be allowed to proceed. The number of trials in the acquisition phase was not constant. It depended on the performance of the participant in learning the associations.

Test phase (retrieval and generalization parts).

After successful acquisition, the participant continued with the test phase of the paradigm, in which no more feedback was provided about the correctness of the choices. The participant had to recall the six previously built associations (retrieval part) and had to make two new but predictable associations (generalization part). In the generalization part of the test, the participant was asked to choose fish X2 or Y2 when face A2 or B2 was presented. Having learned that faces A1 and A2 were equivalent in the acquisition phase, participants may generalize from learning that if A1 goes with X2, A2 also goes with X2; the same holds for B2 (equivalent to B1) and Y2 (associated with B1). In the test phase, the new associations were mixed with the previously learned associations. The test phase consistently contained 48 trials, including 36 previously built associations (retrieval part) and 12 new, previously not presented but predictable associations (generalization part). The participants’ task throughout the acquisition and testing phases was to indicate their choice in each trial by pressing one of two keyboard buttons labeled LEFT and RIGHT.

Participants were tested individually without a time limit, so they could pay undivided attention to learning. No forced quick responses were expected. While the formal description may imply that the task was difficult, healthy children and intellectually disabled individuals reliably make these kinds of generalizations.

Data analysis

The number of trials in the acquisition phase and the response accuracy (error ratios) in the acquisition phase, the retrieval part of the test phase, and the generalization part of the test phase were analyzed. We registered the number of trials required to complete the acquisition phase (the number of acquisition trials [NAT]), the number of correct and incorrect choices during the acquisition phase, and the number of correct and incorrect responses for known and unknown associations during the retrieval and generalization parts of the test phase. Using these data, the error ratios were calculated by dividing the number of incorrect responses by the total number of responses provided. The proportion of the number of incorrect responses in the acquisition phase (the acquisition learning error ratio [ALER]), the number of incorrect responses divided by the total number of responses [36] in the retrieval part of the test phase (i.e., the retrieval error ratio [RER]), and the number of incorrect responses divided by the total number of responses [12] in the generalization part of the test phase (the generalization error ratio [GER]) were measured.

Statistical analysis

First, we tested the distribution of our data. If the data sets were not normally distributed according to the Shapiro–Wilk normality test, the comparisons between the performance of patients with Tourette syndrome and that of control children were performed with the Mann–Whitney rank test. A Kruskal–Wallis ANOVA was used to compare the performances of the TS, TS + ADHD, and TS + OCD/ASD groups and to compare the performances of the control subgroups, too. The median values and ranges are presented in the results section. If the data were normally distributed according to the Shapiro–Wilk test but the homogeneity of the variance test revealed different variance in the performances of patients with Tourette syndrome and that of healthy control children, Welch’s t-test was used to compare the two groups. The mean and SD values are presented in the results section. Statistical analyses were performed in Statistica 13.4.0.14 (1984–2018 TIBCO Software Inc., Palo Alto, CA, USA) and CogStat 1.8.0 and 1.9.0 (2012–2020 Attila Krajcsi).

Results

In this study, we present the performance of 46 pediatric patients with Tourette syndrome with and without comorbidities and 46 matched healthy control children. All of the participants completed the entire visually guided acquired equivalence learning paradigm.

The performances of the entire Tourette syndrome group with and without comorbidities versus healthy control children

In order to reduce the effect of multiple (twice in this case) application of the same data, the statistical results were evaluated after Bonferroni correction at a significance level of 0.025. The median NAT was 79.0 (range: 42–202, n = 46) in all patients with Tourette syndrome (with and without medication) and 62.0 (range: 46–124, n = 46) in the control group. The NAT values were significantly higher in patients with Tourette syndrome (Mann–Whitney rank test U = 636, p < 0.001). The median ALER was 0.102 (range: 0–0.325, n = 46) in all patients with Tourette syndrome and 0.085 (range: 0–0.186, n = 46) in the control group. The ALER values, similar to the NAT values, were significantly higher in patients with Tourette syndrome (Mann–Whitney rank test U = 690, p = 0.004). In the retrieval part of the test phase, there was no statistically significant difference (Mann–Whitney rank test U = 1.17e+0.3, p = 0.360) between the patients with Tourette syndrome (median: 0.056, range: 0–0.333, n = 46) and the control group (median: 0.083, range: 0–0.472, n = 46). In the generalization part of the test phase, similar to the retrieval part, there was no statistically significant difference (Mann–Whitney rank test U = 1.26e+0.3, p = 0.103) between the patients with Tourette syndrome (median: 0.125, range: 0–0.667, n = 46) and the control group (median: 0.167, range: 0–0.917, n = 46, Fig 2).

thumbnail
Fig 2. Performance of all patients with Tourette syndrome and healthy control children in the visually guided equivalence learning paradigm.

NAT denotes the number of the necessary trials in the acquisition phase of the paradigm. ALER shows the error ratios in the acquisition phase of the paradigm. Lower diagrams denote the error ratios in the retrieval (RER) and generalization (GER) parts of the test phase, respectively. In each panel, the first column (gray) shows the performance of all patients with Tourette syndrome, and the second column (white) denotes the performance of the control group. The lower margin of the boxes shows the 25th percentile; the line within the boxes marks the median; and the upper margin of the boxes indicates the 75th percentile. The error bars (whiskers) above and below the boxes indicate the 90th and 10th percentiles, respectively. The dots over and under the whiskers show the extreme outliers. The black stars indicate statistically significant differences (p < 0.05).

https://doi.org/10.1371/journal.pone.0234724.g002

The effect of medication on the performances of patients with Tourette syndrome with and without comorbidities

To examine the effects of medications on the performances in the applied associative learning test, we compared the performances of the unmedicated patients (TS, TS + ADHD, and TS + OCD/ASD) and their matched healthy controls, the unmedicated patients with Tourette syndrome and all patients with TS, and the medicated and unmedicated patients with Tourette syndrome.

Unmedicated pediatric patients with Tourette syndrome versus healthy control children.

In order to reduce the effect of multiple (twice in this case) application of the same data (first application was above in the comparison with the entire TS group), the statistical results were evaluated after Bonferroni correction at a significance level of 0.025. The median NAT was 78.5 (range: 42–202, n = 34) in all unmedicated patients and 60.5 (range: 46–124, n = 34) in the matched control group. The NAT values were significantly higher in patients with Tourette syndrome (Mann–Whitney rank test, U = 345, p = 0.004). The median ALER was 0.102 (range: 0–0.325, n = 34) in patients with Tourette syndrome and 0.086 (range: 0–0.186, n = 34) in the control group. The ALER values, similar to NAT values, were significant higher in patients with Tourette syndrome (Mann–Whitney rank test U = 392, p = 0.023). In the retrieval part of the test phase, there was no statistically significant difference (Mann–Whitney rank test U = 657, p = 0.330) between the TS group (median: 0.056, range: 0–0.333) and the control group (median: 0.083, range: 0–0.472). In the generalization part of the test phase, there was no statistically significant difference (Mann–Whitney rank test U = 734, p = 0.053) between the patients with Tourette syndrome (median: 0.083, range: 0–0.667) and the control group (median: 0.208, range: 0–0.917, Fig 3)

thumbnail
Fig 3. Performance of the unmedicated pediatric patients with Tourette syndrome versus that of healthy control children in the visually guided equivalence learning paradigm.

NAT denotes the number of the necessary trials in the acquisition phase of the paradigm. ALER shows the error ratios in the acquisition phase of the paradigm. Lower diagrams denote the error ratios in the retrieval (RER) and generalization (GER) parts of the test phase, respectively. In each panel, the first column (gray) shows the performance of all unmedicated patients with Tourette syndrome, and the second column (white) denotes the performance of the control group. The lower margin of the boxes shows the 25th percentile; the line within the boxes marks the median; and the upper margin of the boxes indicates the 75th percentile. The error bars (whiskers) above and below the boxes indicate the 90th and 10th percentiles, respectively. The dots over and under the whiskers show the extreme outliers. The black stars indicate statistically significant differences (p < 0.05).

https://doi.org/10.1371/journal.pone.0234724.g003

All pediatric patients with Tourette syndrome versus unmedicated patients with Tourette syndrome.

Comparing the performances of the whole patient group (TS, TS + ADHD, and TS + OCD/ASD) with the unmedicated patient group (TS, TS + ADHD, and TS + OCD/ASD), we did not find any significant differences. The median NAT was 79.0 (range: 42–202, n = 46) in the whole patient group and 78.5 (range: 42–202, n = 34) in the unmedicated patient group. There was no significant difference in the NAT between these groups (Mann–Whitney rank test U = 763, p = 0.857). The median ALER was 0.102 (range: 0–0.325, n = 34) in the whole patient group and 0.102 (range: 0–0.325, n = 34) in the unmedicated patient group. The ALER values, similar to the NAT values, did not significantly differ (Mann–Whitney rank test U = 786, p = 0.969). In the retrieval part of the test phase, the median RER was 0.056 in the whole patient group (range: 0–0.333, n = 46) and 0.056 (range: 0–0.333, n = 34) in the unmedicated patient group, and this difference was not statistically significant (Mann–Whitney rank test U = 774, p = 0.937). In the generalization part of the test phase, the median GER was 0.125 in the whole patient group (range: 0–0.667, n = 46) and 0.083 (range: 0–0.667, n = 34) in the unmedicated patient group and this difference was not statistically significant (Mann–Whitney rank test U = 742, p = 0.698).

Medicated versus unmedicated pediatric patients with Tourette syndrome.

The performance of the medicated patient group did not differ significantly from the performance of the unmedicated patient group. The median NAT was 79.0 (range: 68–101, n = 12) for the medicated patient group and 78.5 (range: 42–202, n = 34) for the unmedicated patient group. There was no statistically significant difference in the NAT between these groups (Mann–Whitney rank test U = 185, p = 0.643). The median ALER was 0.106 (range: 0.056–0.250, n = 12) in the medicated patient group and 0.102 (range: 0–0.325, n = 34) in the unmedicated patient group. The ALER values, similar to the NAT values, did not significantly differ (Mann–Whitney rank test U = 208, p = 0.920). In the retrieval part of the test phase, the median RER was 0.083 in the medicated patient group (range: 0–0.139, n = 12) and 0.056 (range: 0–0.333, n = 34) in the unmedicated patient group, and this difference was not statistically significant (Mann–Whitney U test U = 196, p = 0.840). In the generalization part of the test phase, the median GER was 0.208 in the medicated patient group (range: 0–0.667, n = 12) and 0.083 (range: 0–0.667, n = 34) in the unmedicated patient group, and the difference was not statistically significant (Mann–Whitney rank test U = 164, p = 0.319).

Comparison of the performances among the patients with TS, TS + ADHD, and TS + OCD/ASD

In the first step we have compared the performances in one multiple comparison of the three TS patient and the three control subgroups with Kruskal–Wallis ANOVA analysis. These results revealed significant differences among the six subgroups in NAT (χ2 (5, N = 92) = 14.1829, p = 0.0145) and ALER (χ2 (5, N = 92) = 11.7513, p = 0.0384) but not in RER (χ2 (5, N = 92) = 1.9133, p = 0.861) and GER (χ2 (5, N = 92) = 3.3317, p = 0.6490). In the next step we have compared the performances among the three TS patient subgroups. There were no significant differences in the performances of the three patient groups (TS, TS + ADHD, and TS + OCD/ASD with or without medication) for any of the investigated parameters. The results of the comparisons are shown in Table 2.

thumbnail
Table 2. The performances of the Tourette syndrome, Tourette syndrome and attention deficit hyperactivity disorder, and Tourette syndrome and obsessive compulsive disorder or autism spectrum disorder groups (with or without medication).

https://doi.org/10.1371/journal.pone.0234724.t002

After the subtraction of the performances of the medicated patients from the analysis, there were no significant differences among the TS, TS + ADHD, and TS + OCD/ASD groups (Table 3).

thumbnail
Table 3. The performances of the three unmedicated patient groups.

https://doi.org/10.1371/journal.pone.0234724.t003

To avoid the significant effect of the different performances of the three different control subgroups we have compared the performances of the control subgroups, too. We have found no significant differences in each of the investigated values among the control subgroups (Kruskal–Wallis ANOVA, NAT: χ2 (2, N = 46) = 3.7562, p = 0.153; ALER: χ2 (2, N = 46) = 3.5641, p = 0.168; RER: χ2 (2, N = 46) = 0.7136, p = 0.965; GER: χ2 (2, N = 46) = 0.16242, p = 0.922).

Performance of the three TS groups versus their matched healthy control groups

To determine whether the significant findings described above originated in a similar manner for patients with Tourette syndrome without comorbidities and for patients with Tourette syndrome and comorbidities (TS + ADHD or TS + OCD/ASD) we separately compared the data of these three subpopulations with their matched healthy control groups.

Children with Tourette syndrome without any comorbidities versus healthy control children.

We examined the difference between the performance of patients with Tourette syndrome and that of matched healthy controls. The median NAT was 79.0 (range: 52–130, n = 21) in the TS group and 60.0 (range: 46–124, n = 21) in the control group. The NAT was significantly higher in patients with Tourette syndrome (Mann–Whitney rank test U = 109, p = 0.005). The median ALER of patients with Tourette syndrome was 0.101 (range: 0.018–0.325, n = 21), and that of the healthy control group was 0.083 (range: 0–0.186, n = 21). The ALER values, similar to the NAT values, were higher in the TS group (Mann–Whitney rank test U = 142, p = 0.049). In the retrieval part of the test phase, the median RER in the TS group was 0.056, (range: 0–0.333, n = 21) and that in the matched healthy group was 0.083 (range: 0–0.361, n = 21). Although the RER was smaller in the Tourette syndrome group, this difference was not statistically significant (Mann–Whitney rank test U = 260, p = 0.327). In the generalization part of the test phase, the median GER was 0.083 (range: 0–0.667, n = 21) in the group of patients with Tourette syndrome and 0.167 (range: 0–0.917, n = 21) in the healthy control group. This difference was not statistically significant (Mann–Whitney rank test U = 270, p = 0.209, Fig 4).

thumbnail
Fig 4. Performance of the patients with Tourette syndrome without comorbidities versus that of matched healthy control children in the visually guided equivalence learning paradigm.

NAT denotes the number of the necessary trials in the acquisition phase of the paradigm. ALER shows the error ratios in the acquisition phase of the paradigm. Lower diagrams denote the error ratios in the retrieval (RER) and generalization (GER) parts of the test phase, respectively. In each panel, the first column (gray) shows the performance of the patients with Tourette syndrome without comorbidities, and the second column (white) denotes the performance of the control group. The lower margin of the boxes shows the 25th percentile; the line within the boxes marks the median; and the upper margin of the boxes indicates the 75th percentile. The error bars (whiskers) above and below the boxes indicate the 90th and 10th percentiles, respectively. The dots over and under the whiskers show the extreme outliers. The black stars indicate statistically significant differences (p < 0.05).

https://doi.org/10.1371/journal.pone.0234724.g004

Patients with TS + ADHD versus healthy controls.

These comparisons revealed the same tendencies as those in the TS without any comorbidities and TS+OCD/ASD groups. The NAT and ALER values were higher in the TS + ADHD than in the control group, while the RER and GER values were lower in patients with TS+ADHD, but these differences did not significantly differ from those values of the matched control children. The median NAT was 78.0 (range: 42–202, n = 15) in the TS + ADHD group and 75.0 (range: 45–97, n = 15; Mann–Whitney rank test U = 89, p = 0.340) in the matched healthy control group. The median ALER was 0.120 (range: 0.0–0.287, n = 21) in the TS + ADHD group and 0.105 (range: 0.056–0.143, n = 15, Welch’s test t(22,2) = -1.56, p = 0.138) in the control group. In the retrieval part of the test phase, the median RER was 0.056 (range: 0.028–0.222, n = 15) in the TS + ADHD group and 0.083 (range: 0.0–0.472, n = 15, Mann–Whitney rank test U = 120, p = 0.784) in the control group. In the generalization part of the test phase, the median GER was 0.167 (range: 0–0.667, n = 15) in the TS + ADHD group and 0.167 (range: 0–0.917, n = 15, Mann–Whitney rank test U = 140, p = 0.255) in the matched healthy control group (Fig 5).

thumbnail
Fig 5. Performance of patients with concomitant Tourette syndrome and attention deficit hyperactivity disorder patients versus that in matched healthy control children in the visually guided equivalence learning paradigm.

NAT denotes the number of the necessary trials in the acquisition phase of the paradigm. ALER shows the error ratios in the acquisition phase of the paradigm. Lower diagrams denote the error ratios in the retrieval (RER) and generalization (GER) parts of the test phase, respectively. In each panel, the first column (gray) shows the performance of the patients with Tourette syndrome (TS) and attention deficit hyperactivity disorder (ADHD), and the second column (white) denotes the performance of the control group. The lower margin of the boxes shows the 25th percentile; the line within the boxes marks the median; and the upper margin of the boxes indicates the 75th percentile. The error bars (whiskers) above and below the boxes indicate the 90th and 10th percentiles, respectively. The dots over and under the whiskers show the extreme outliers. The black stars indicate statistically significant differences (p < 0.05).

https://doi.org/10.1371/journal.pone.0234724.g005

Patients with TS + OCD/ASD versus healthy controls.

This comparison revealed the same significant differences as were demonstrated above by the patients with Tourette syndrome without any comorbidities. The NAT and ALER values were significantly higher in the TS + OCD/ASD group than in the control group, while the RER and GER values did not differ between the TS + OCD/ASD and control groups. The median NAT was 72.0 (range: 46–169, n = 10) in the TS + OCD/ASD group and 60.5 (range: 49–84, n = 10; independent samples t-test t(18) = -2.21, p = 0.041) in the matched healthy control group. The median ALER was 0.106 (range: 0.043–0.172, n = 10) in the TS + OCD/ASD group and 0.083 (range: 0.019–0.125, n = 10, independent samples t-test t(18) = -2.48, p = 0.023) in the control group. In the retrieval part of the test phase, the median RER was 0.097 (range: 0.028–0.222, n = 10) in the TS + OCD/ASD group and 0.083 (range: 0.027–0.250, n = 10, independent samples t-test t(18) = 0.335, p = 0.741) in the control group. In the generalization part of the test phase, the median GER was 0.208 (range: 0–0.583, n = 10) in the TS + OCD/ASD group and 0.208 (range: 0–0.750, n = 10, Mann–Whitney rank test U = 51.5, p = 0.939) in the matched healthy control group (Fig 6).

thumbnail
Fig 6. Performance of patients with concomitant Tourette syndrome and obsessive compulsive disorder or autism spectrum disorder versus that of matched healthy control children in the visually guided equivalence learning paradigm.

NAT denotes the number of the necessary trials in the acquisition phase of the paradigm. ALER shows the error ratios in the acquisition phase of the paradigm. Lower diagrams denote the error ratios in the retrieval (RER) and generalization (GER) parts of the test phase, respectively. In each panel, the first column (gray) shows the performance of the patients with Tourette syndrome (TS) and obsessive compulsive disorder (OCD) or autism spectrum disorder (ASD), and the second column (white) denotes the performance of the control group. The lower margin of the boxes shows the 25th percentile; the line within the boxes marks the median; and the upper margin of the boxes indicates the 75th percentile. The error bars (whiskers) above and below the boxes indicate the 90th and 10th percentiles, respectively. The dots over and under the whiskers show the extreme outliers. The black stars indicate statistically significant differences (p < 0.05).

https://doi.org/10.1371/journal.pone.0234724.g006

Discussion

The Rutgers Acquired Equivalence Test (face and fish test, [35]), which investigates visually guided associative learning in humans, has a well-defined neurological background. The acquisition phase, which primarily depends on the function of the basal ganglia [35, 50] tests the association between two different visual stimuli. The test phase, in which the previously learned associations (retrieval part) and new, but acquisition-based, predictable associations (generalization part) are evaluated, primarily depends on the hippocampi and the mediotemporal lobe [35, 50]. These cognitive functions were previously investigated in adult neurological and psychiatric patients which were shown to be related to dysfunction of the basal ganglia and the hippocampi (i.e., Parkinson’s disease [34, 35], Alzheimer's disease [51], and migraine without aura [53]). However, the present study is the first to describe the alteration of visual associative learning in a group of children with Tourette syndrome with and without comorbidities. This finding is interesting because only in rare cases have significant impairments in any cognitive functions been described in Tourette syndrome. Tourette syndrome is strongly related to dysfunction of the basal ganglia and the frontal associative cortex. Because of the involvement of the basal ganglia in the pathogenesis of Tourette syndrome, the acquisition phase, which mainly depends on the basal ganglia, was primarily affected in the associative learning test. Based on our results, all patients with Tourette syndrome made the associations with less effectiveness than healthy control children. However, the retrieval and generalization parts of the test phase, which primarily depend on the function of the hippocampi, were not negatively affected by Tourette syndrome. Because of the compensation of the weaker acquisition building, even better performances were found in these phases of the paradigm, although these differences were not statistically significant [36, 47].

Our results demonstrated that in the acquisition phase, the performance (NAT and ALER) of all patients (TS, TS + ADHD, and TS + OCD/ASD) was significantly weaker than in the sex, age, and IQ level-matched healthy control group. The question arises whether the alterations in equivalence learning in all patients with Tourette syndrome were primarily due to TS or its most common comorbidity, ADHD. In most cases, Tourette syndrome and ADHD, which seems to plays a major role, are jointly responsible for the alterations in cognitive functions [44, 5961]. We compared the performances of the three patient groups and found no significant difference among their performances. This finding does not support the predominant role of ADHD in the described alterations in the acquisition phase of the associative learning task. The comparison of each patient group with its matched healthy control group revealed significantly increased NAT or ALER values in patients with Tourette syndrome without any comorbidities and TS + OCD/ASD but not in patients with TS + ADHD. These results together could suggest that concomitant ADHD and TS was not primarily responsible for the visual acquisition learning deficits in patients with Tourette syndrome. This is in contrast with previous findings that ADHD is primarily responsible for the alteration of cognitive functions in patients with TS + ADHD [33, 37, 38, 43]. Therefore, the visually guided acquired equivalence learning, similar to stimulus-response or habit learning [24, 45], which is mediated by the dorsal frontostriatal pathways, is more attributable to Tourette syndrome than ADHD, despite ADHD symptoms affecting the dorsolateral frontostriatal circuits [62].

The volume of the hippocampi is significantly larger in patients with pure Tourette syndrome than that of their healthy counterparts [63], and no explicit memory (which is connected to the hippocampus) deficits were reported in children with Tourette syndrome [45, 47]. Our results are in line with these findings. The performance in the retrieval and generalization parts of the test phase, which are primarily related to the hippocampi was not worse in the entire group of patients with Tourette syndrome with and without comorbidities. Concerning the three investigated subpopulations of the patients with Tourette syndrome (TS without comorbidities, TS + ADHD, and TS + OCD/ASD), the RER and GER values did not differ from those of the matched healthy control children.

Another question is the possible influence of medication on the performance of patients with Tourette syndrome with or without comorbidities. Because of the relatively low number of cases in the comorbid groups, we could not perform a valid comparison between the performance of medicated and unmedicated TS + ADHD and TS + OCD/ASD patients. Thus, we used the entire TS population (TS without comorbidities, TS + ADHD, and TS + OCD/ASD) to get information about the possible role of medication. The performances in the acquisition phase of the associative learning task in unmedicated TS pediatric patients, similar to the entire TS population, were significantly weaker than those of the matched healthy control children. The comparison of the performances of the entire and the unmedicated TS patient groups revealed no differences. Similarly, we found no differences between the performances of the entire population of medicated and unmedicated pediatric patients with Tourette syndrome. These findings collectively suggest that medication had no or only a weak influence on our results.

In this study, we functionally confirmed the results of neuroimaging [1416, 23] and functional studies that the dorsal frontostriatal circuits are strongly affected in Tourette syndrome, and these circuits are critical to the acquisition process of visually guided associative learning [46, 47]. The hippocampus mediated recall of previously learned associations, and the building of new but acquisition-based, predictable associations were not altered in Tourette syndrome.

Supporting information

S1 Table. The data of the psychophysical performances of 46 TS patients and the 46 matched controls, which were used in the present study.

TS: Tourette syndrome, ADHD: attention deficit hyperactivity disorder, OCD/ASD: obsessive compulsive disorder or autism spectrum disorder, NAT: the number of the necessary trials in the acquisition phase of the paradigm, ALER: the error ratios in the acquisition phase of the paradigm, RER: the error ratios in the retrieval part of the test phase, and GER: the error ratio in the generalization part of the test phase.

https://doi.org/10.1371/journal.pone.0234724.s001

(XLSX)

Acknowledgments

The authors thank Emese Bognár, Kristóf Kollár, András Puszta, Xenia Katona, Nóra Cserháti, Nándor Görög and Dóra Dózsai for their help in conducting the investigation and data collection and all the participants for engaging in the research. The open access publication was founded by the University of Szeged Open Access Fund, Grant number: 4780.

References

  1. 1. Battle DE. Diagnostic and Statistical Manual of Mental Disorders (DSM). Codas. 2013;25(2):191–2. pmid:24413388
  2. 2. Robertson MM. The prevalence and epidemiology of Gilles de la Tourette syndrome. Part 1: the epidemiological and prevalence studies. J Psychosom Res. 2008;65(5):461–72. pmid:18940377
  3. 3. Robertson MM. A personal 35 year perspective on Gilles de la Tourette syndrome: prevalence, phenomenology, comorbidities, and coexistent psychopathologies. Lancet Psychiatry. 2015;2(1):68–87. pmid:26359614
  4. 4. Scharf JM, Miller LL, Gauvin CA, Alabiso J, Mathews CA, Ben-Shlomo Y. Population prevalence of Tourette syndrome: a systematic review and meta-analysis. Mov Disord. 2015;30(2):221–8. pmid:25487709
  5. 5. Leckman JF, Peterson BS, Anderson GM, Arnsten AF, Pauls DL, Cohen DJ. Pathogenesis of Tourette's syndrome. J Child Psychol Psychiatry. 1997;38(1):119–42. pmid:9232461
  6. 6. Pappert EJ, Goetz CG, Louis ED, Blasucci L, Leurgans S. Objective assessments of longitudinal outcome in Gilles de la Tourette's syndrome. Neurology. 2003;61(7):936–40. pmid:14557563
  7. 7. Eddy CM, Cavanna AE. Set-Shifting Deficits: A Possible Neurocognitive Endophenotype for Tourette Syndrome Without ADHD. J Atten Disord. 2017;21(10):824–34. pmid:25104787
  8. 8. Eddy CM, Rickards HE, Cavanna AE. Executive functions in uncomplicated Tourette syndrome. Psychiatry Res. 2012;200(1):46–8. pmid:22703721
  9. 9. Robertson MM. A personal 35 year perspective on Gilles de la Tourette syndrome: assessment, investigations, and management. Lancet Psychiatry. 2015;2(1):88–104. pmid:26359615
  10. 10. Lange F, Seer C, Muller-Vahl K, Kopp B. Cognitive flexibility and its electrophysiological correlates in Gilles de la Tourette syndrome. Dev Cogn Neurosci. 2017;27:78–90. pmid:28863370
  11. 11. Mink JW. Basal ganglia dysfunction in Tourette's syndrome: a new hypothesis. Pediatr Neurol. 2001;25(3):190–8. pmid:11587872
  12. 12. Osmon DC, Smerz JM. Neuropsychological evaluation in the diagnosis and treatment of Tourette's syndrome. Behav Modif. 2005;29(5):746–83. pmid:16046663
  13. 13. Makki MI, Behen M, Bhatt A, Wilson B, Chugani HT. Microstructural abnormalities of striatum and thalamus in children with Tourette syndrome. Mov Disord. 2008;23(16):2349–56. pmid:18759338
  14. 14. Muller-Vahl KR, Kaufmann J, Grosskreutz J, Dengler R, Emrich HM, Peschel T. Prefrontal and anterior cingulate cortex abnormalities in Tourette Syndrome: evidence from voxel-based morphometry and magnetization transfer imaging. BMC Neurosci. 2009;10:47. pmid:19435502
  15. 15. Peterson BS, Thomas P, Kane MJ, Scahill L, Zhang H, Bronen R, et al. Basal Ganglia volumes in patients with Gilles de la Tourette syndrome. Arch Gen Psychiatry. 2003;60(4):415–24. pmid:12695320
  16. 16. Plessen KJ, Bansal R, Peterson BS. Imaging evidence for anatomical disturbances and neuroplastic compensation in persons with Tourette syndrome. J Psychosom Res. 2009;67(6):559–73. pmid:19913660
  17. 17. Alexander GE, Crutcher MD, DeLong MR. Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions. Prog Brain Res. 1990;85:119–46. pmid:2094891
  18. 18. Alexander GE, DeLong MR, Strick PL. Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci. 1986;9:357–81. pmid:3085570
  19. 19. Da Cunha C, Boschen SL, Gomez AA, Ross EK, Gibson WS, Min HK, et al. Toward sophisticated basal ganglia neuromodulation: Review on basal ganglia deep brain stimulation. Neurosci Biobehav Rev. 2015;58:186–210. pmid:25684727
  20. 20. Groenewegen HJ, van den Heuvel OA, Cath DC, Voorn P, Veltman DJ. Does an imbalance between the dorsal and ventral striatopallidal systems play a role in Tourette's syndrome? A neuronal circuit approach. Brain Dev. 2003;25 Suppl 1:S3–s14.
  21. 21. Marsh R, Maia TV, Peterson BS. Functional disturbances within frontostriatal circuits across multiple childhood psychopathologies. Am J Psychiatry. 2009;166(6):664–74. pmid:19448188
  22. 22. Tremblay L, Worbe Y, Thobois S, Sgambato-Faure V, Feger J. Selective dysfunction of basal ganglia subterritories: From movement to behavioral disorders. Mov Disord. 2015;30(9):1155–70. pmid:25772380
  23. 23. Makki MI, Govindan RM, Wilson BJ, Behen ME, Chugani HT. Altered fronto-striato-thalamic connectivity in children with Tourette syndrome assessed with diffusion tensor MRI and probabilistic fiber tracking. J Child Neurol. 2009;24(6):669–78. pmid:19491113
  24. 24. Packard MG, Knowlton BJ. Learning and memory functions of the Basal Ganglia. Annu Rev Neurosci. 2002;25:563–93. pmid:12052921
  25. 25. Termine C, Luoni C, Fontolan S, Selvini C, Perego L, Pavone F, et al. Impact of co-morbid attention-deficit and hyperactivity disorder on cognitive function in male children with Tourette syndrome: A controlled study. Psychiatry Res. 2016;243:263–7. pmid:27423633
  26. 26. Crawford S, Channon S, Robertson MM. Tourette's syndrome: performance on tests of behavioural inhibition, working memory and gambling. J Child Psychol Psychiatry. 2005;46(12):1327–36. pmid:16313433
  27. 27. Jeter CB, Patel SS, Morris JS, Chuang AZ, Butler IJ, Sereno AB. Oculomotor executive function abnormalities with increased tic severity in Tourette syndrome. J Child Psychol Psychiatry. 2015;56(2):193–202. pmid:25040172
  28. 28. Yaniv A, Benaroya-Milshtein N, Steinberg T, Ruhrman D, Apter A, Lavidor M. Executive control development in Tourette syndrome and its role in tic reduction. Psychiatry Res. 2018;262:527–35. pmid:28965812
  29. 29. Burd L, Freeman RD, Klug MG, Kerbeshian J. Tourette Syndrome and learning disabilities. BMC Pediatr. 2005;5:34. pmid:16137334
  30. 30. Openneer TJC, Forde NJ, Akkermans SEA, Naaijen J, Buitelaar JK, Hoekstra PJ, et al. Executive function in children with Tourette syndrome and attention-deficit/hyperactivity disorder: Cross-disorder or unique impairments? Cortex. 2020;124:176–87. pmid:31901563
  31. 31. Hirschtritt ME, Lee PC, Pauls DL, Dion Y, Grados MA, Illmann C, et al. Lifetime prevalence, age of risk, and genetic relationships of comorbid psychiatric disorders in Tourette syndrome. JAMA Psychiatry. 2015;72(4):325–33. pmid:25671412
  32. 32. Dube WV, McIlvane WJ, Maguire RW, Mackay HA, Stoddard LT. Stimulus class formation and stimulus-reinforcer relations. J Exp Anal Behav. 1989;51(1):65–76. pmid:2921589
  33. 33. Morand-Beaulieu S, Leclerc JB, Valois P, Lavoie ME, O'Connor KP, Gauthier B. A Review of the Neuropsychological Dimensions of Tourette Syndrome. Brain Sci. 2017;7(8).
  34. 34. Myers CE, Hopkins RO, DeLuca J, Moore NB, Wolansky LJ, Sumner JM, et al. Learning and generalization deficits in patients with memory impairments due to anterior communicating artery aneurysm rupture or hypoxic brain injury. Neuropsychology. 2008;22(5):681–6. pmid:18763887
  35. 35. Myers CE, Shohamy D, Gluck MA, Grossman S, Kluger A, Ferris S, et al. Dissociating hippocampal versus basal ganglia contributions to learning and transfer. J Cogn Neurosci. 2003;15(2):185–93. pmid:12676056
  36. 36. Ullman MT, Pullman MY. A compensatory role for declarative memory in neurodevelopmental disorders. Neurosci Biobehav Rev. 2015;51:205–22. pmid:25597655
  37. 37. Harris EL, Schuerholz LJ, Singer HS, Reader MJ, Brown JE, Cox C, et al. Executive function in children with Tourette syndrome and/or attention deficit hyperactivity disorder. J Int Neuropsychol Soc. 1995;1(6):511–6. pmid:9375237
  38. 38. Mahone EM, Koth CW, Cutting L, Singer HS, Denckla MB. Executive function in fluency and recall measures among children with Tourette syndrome or ADHD. J Int Neuropsychol Soc. 2001;7(1):102–11. pmid:11253836
  39. 39. Channon S, Pratt P, Robertson MM. Executive function, memory, and learning in Tourette's syndrome. Neuropsychology. 2003;17(2):247–54. pmid:12803430
  40. 40. Palminteri S, Lebreton M, Worbe Y, Hartmann A, Lehericy S, Vidailhet M, et al. Dopamine-dependent reinforcement of motor skill learning: evidence from Gilles de la Tourette syndrome. Brain. 2011;134(Pt 8):2287–301. pmid:21727098
  41. 41. Palminteri S, Pessiglione M. Reinforcement learning and Tourette syndrome. Int Rev Neurobiol. 2013;112:131–53. pmid:24295620
  42. 42. Salvador A, Worbe Y, Delorme C, Coricelli G, Gaillard R, Robbins TW, et al. Specific effect of a dopamine partial agonist on counterfactual learning: evidence from Gilles de la Tourette syndrome. Sci Rep. 2017;7(1):6292. pmid:28740149
  43. 43. Shephard E, Jackson GM, Groom MJ. The effects of co-occurring ADHD symptoms on electrophysiological correlates of cognitive control in young people with Tourette syndrome. J Neuropsychol. 2016;10(2):223–38. pmid:25894525
  44. 44. Shephard E, Groom MJ, Jackson GM. Implicit sequence learning in young people with Tourette syndrome with and without co-occurring attention-deficit/hyperactivity disorder. J Neuropsychol. 2019;13(3):529–49. pmid:29972622
  45. 45. Goodman J, Marsh R, Peterson BS, Packard MG. Annual research review: The neurobehavioral development of multiple memory systems—implications for childhood and adolescent psychiatric disorders. J Child Psychol Psychiatry. 2014;55(6):582–610. pmid:24286520
  46. 46. Keri S, Szlobodnyik C, Benedek G, Janka Z, Gadoros J. Probabilistic classification learning in Tourette syndrome. Neuropsychologia. 2002;40(8):1356–62. pmid:11931939
  47. 47. Marsh R, Alexander GM, Packard MG, Zhu H, Wingard JC, Quackenbush G, et al. Habit learning in Tourette syndrome: a translational neuroscience approach to a developmental psychopathology. Arch Gen Psychiatry. 2004;61(12):1259–68. pmid:15583117
  48. 48. Takacs A, Kobor A, Chezan J, Elteto N, Tarnok Z, Nemeth D, et al. Is procedural memory enhanced in Tourette syndrome? Evidence from a sequence learning task. Cortex. 2018;100:84–94. pmid:28964503
  49. 49. Takacs A, Shilon Y, Janacsek K, Kobor A, Tremblay A, Nemeth D, et al. Procedural learning in Tourette syndrome, ADHD, and comorbid Tourette-ADHD: Evidence from a probabilistic sequence learning task. Brain Cogn. 2017;117:33–40. pmid:28710940
  50. 50. Moustafa AA, Myers CE, Gluck MA. A neurocomputational model of classical conditioning phenomena: a putative role for the hippocampal region in associative learning. Brain Res. 2009;1276:180–95. pmid:19379717
  51. 51. Bodi N, Csibri E, Myers CE, Gluck MA, Keri S. Associative learning, acquired equivalence, and flexible generalization of knowledge in mild Alzheimer disease. Cogn Behav Neurol. 2009;22(2):89–94. pmid:19506424
  52. 52. Keri S, Nagy O, Kelemen O, Myers CE, Gluck MA. Dissociation between medial temporal lobe and basal ganglia memory systems in schizophrenia. Schizophr Res. 2005;77(2–3):321–8. pmid:15893916
  53. 53. Oze A, Nagy A, Benedek G, Bodosi B, Keri S, Palinkas E, et al. Acquired equivalence and related memory processes in migraine without aura. Cephalalgia. 2017;37(6):532–40. pmid:27206960
  54. 54. Kim S, Greene DJ, Bihun EC, Koller JM, Hampton JM, Acevedo H, et al. Provisional Tic Disorder is not so transient. Sci Rep. 2019;9(1):3951. pmid:30850688
  55. 55. Ishihara S, Major IJA, Handaya MCT, Haruchiko H. H.V.W. Tests for color blindness. American Journal of Ophtalmology. 1918;1(6):457.
  56. 56. Rózsa S. Raven Progresszív Mátrixok: Kézikönyv. 1st ed. Budapest: OS Hungary Press; 2006.
  57. 57. Rózsa S, Oláh A. A pszichológiai mérés alapjai. Budapest: Bölcsész Konzorcium Press; 2006.
  58. 58. Martin AW, Wiechers JE. Raven's colored progressive matrices and the Wechsler intelligence scale for children. J Consult Psychol. 1954;18(2):143–4. pmid:13152251
  59. 59. Barkley RA. Attention-deficit/hyperactivity disorder, self-regulation, and time: toward a more comprehensive theory. J Dev Behav Pediatr. 1997;18(4):271–9. pmid:9276836
  60. 60. Brand N, Geenen R, Oudenhoven M, Lindenborn B, van der Ree A, Cohen-Kettenis P, et al. Brief report: cognitive functioning in children with Tourette's syndrome with and without comorbid ADHD. J Pediatr Psychol. 2002;27(2):203–8. pmid:11821503
  61. 61. Spencer T, Biederman J, Harding M, O'Donnell D, Wilens T, Faraone S, et al. Disentangling the overlap between Tourette's disorder and ADHD. J Child Psychol Psychiatry. 1998;39(7):1037–44. pmid:9804036
  62. 62. Denckla MB. Attention-deficit hyperactivity disorder (ADHD) comorbidity: a case for "pure" Tourette syndrome? J Child Neurol. 2006;21(8):701–3. pmid:16970871
  63. 63. Peterson BS, Choi HA, Hao X, Amat JA, Zhu H, Whiteman R, et al. Morphologic features of the amygdala and hippocampus in children and adults with Tourette syndrome. Arch Gen Psychiatry. 2007;64(11):1281–91. pmid:17984397