Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Executive functioning in adolescents and adults with Silver-Russell syndrome

  • Mélissa Burgevin ,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Writing – original draft, Writing – review & editing

    melissa.burgevin@univ-rennes2.fr (MB); agnes.lacroix@univ-rennes2.fr (AL)

    Affiliation Univ Rennes, LP3C (Laboratoire de Psychologie, Cognition, Comportement et Communication)–EA 1285, FHU GenOMedS, Rennes, France

  • Agnès Lacroix ,

    Roles Conceptualization, Funding acquisition, Supervision, Writing – review & editing

    melissa.burgevin@univ-rennes2.fr (MB); agnes.lacroix@univ-rennes2.fr (AL)

    Affiliation Univ Rennes, LP3C (Laboratoire de Psychologie, Cognition, Comportement et Communication)–EA 1285, FHU GenOMedS, Rennes, France

  • Fanny Ollivier,

    Roles Formal analysis, Writing – original draft, Writing – review & editing

    Affiliation Univ Angers, Nantes Université, LPPL, SFR CONFLUENCES, Angers, France

  • Karine Bourdet ,

    Contributed equally to this work with: Karine Bourdet, Régis Coutant, Bruno Donadille, Laurence Faivre, Sylvie Manouvrier-Hanu, Florence Petit, Christel Thauvin-Robinet, Annick Toutain, Irène Netchine

    Roles Investigation, Writing – review & editing

    Affiliation Service de Pédiatrie, CHRU Brest, Brest, France

  • Régis Coutant ,

    Contributed equally to this work with: Karine Bourdet, Régis Coutant, Bruno Donadille, Laurence Faivre, Sylvie Manouvrier-Hanu, Florence Petit, Christel Thauvin-Robinet, Annick Toutain, Irène Netchine

    Roles Investigation, Writing – review & editing

    Affiliation Service Endocrinologie Pédiatrique, CHU Angers, Angers, France

  • Bruno Donadille ,

    Contributed equally to this work with: Karine Bourdet, Régis Coutant, Bruno Donadille, Laurence Faivre, Sylvie Manouvrier-Hanu, Florence Petit, Christel Thauvin-Robinet, Annick Toutain, Irène Netchine

    Roles Investigation, Writing – review & editing

    Affiliation Endocrinologie, Service du Pr Christin-Maitre, Hôpital Saint Antoine, Sorbonne Université, Assistance Publique-Hôpitaux de Paris, Paris, France

  • Laurence Faivre ,

    Contributed equally to this work with: Karine Bourdet, Régis Coutant, Bruno Donadille, Laurence Faivre, Sylvie Manouvrier-Hanu, Florence Petit, Christel Thauvin-Robinet, Annick Toutain, Irène Netchine

    Roles Investigation, Writing – review & editing

    Affiliations INSERM–University of Bourgogne Franche-Comté, UMR 1231 GAD Team, Genetics of Developmental Disorders, FHU TRANSLAD, CHU Dijon Bourgogne, Dijon, France, CHU Dijon, Centre de Référence Maladies Rares Anomalies du Développement et Syndromes Malformatifs, Centre de Génétique, FHU TRANSLAD, CHU Dijon Bourgogne, Dijon, France

  • Sylvie Manouvrier-Hanu ,

    Contributed equally to this work with: Karine Bourdet, Régis Coutant, Bruno Donadille, Laurence Faivre, Sylvie Manouvrier-Hanu, Florence Petit, Christel Thauvin-Robinet, Annick Toutain, Irène Netchine

    Roles Investigation, Writing – review & editing

    Affiliations CHU Lille, Centre de Référence Maladies Rares Labellisé Pour les Anomalies du Développement Nord-Ouest, Clinique de Génétique, Lille, France, Univ Lille, EA7364 –RADEME–Maladies Rares du Développement Embryonnaire et du Métabolisme : du Phénotype au Génotype et à la Fonction, Lille, France

  • Florence Petit ,

    Contributed equally to this work with: Karine Bourdet, Régis Coutant, Bruno Donadille, Laurence Faivre, Sylvie Manouvrier-Hanu, Florence Petit, Christel Thauvin-Robinet, Annick Toutain, Irène Netchine

    Roles Investigation, Writing – review & editing

    Affiliation CHU Lille, Clinique de Génétique Guy Fontaine, Lille, France

  • Christel Thauvin-Robinet ,

    Contributed equally to this work with: Karine Bourdet, Régis Coutant, Bruno Donadille, Laurence Faivre, Sylvie Manouvrier-Hanu, Florence Petit, Christel Thauvin-Robinet, Annick Toutain, Irène Netchine

    Roles Investigation, Writing – review & editing

    Affiliations INSERM–University of Bourgogne Franche-Comté, UMR 1231 GAD Team, Genetics of Developmental Disorders, FHU TRANSLAD, CHU Dijon Bourgogne, Dijon, France, CHU Dijon, Centre de Référence Maladies Rares Anomalies du Développement et Syndromes Malformatifs, Centre de Génétique, FHU TRANSLAD, CHU Dijon Bourgogne, Dijon, France

  • Annick Toutain ,

    Contributed equally to this work with: Karine Bourdet, Régis Coutant, Bruno Donadille, Laurence Faivre, Sylvie Manouvrier-Hanu, Florence Petit, Christel Thauvin-Robinet, Annick Toutain, Irène Netchine

    Roles Investigation, Writing – review & editing

    Affiliation Service de Génétique, Centre Hospitalier Universitaire, UMR 1253, iBrain, Université de Tours, Inserm, FHU GenOMedS, Tours, France

  • Irène Netchine ,

    Contributed equally to this work with: Karine Bourdet, Régis Coutant, Bruno Donadille, Laurence Faivre, Sylvie Manouvrier-Hanu, Florence Petit, Christel Thauvin-Robinet, Annick Toutain, Irène Netchine

    Roles Investigation, Writing – review & editing

    Affiliation Sorbonne Université, INSERM UMR_S 938, Centre de Recherche Saint Antoine, APHP, Hôpital Armand Trousseau, Explorations Fonctionnelles Endocriniennes, Paris, France

  • Sylvie Odent

    Roles Conceptualization, Funding acquisition, Investigation, Supervision, Writing – review & editing

    Affiliation Service de Génétique Clinique, Centre Référence Anomalies du Développement CLAD Ouest, Univ Rennes, CNRS, INSERM, IGDR (Institut de Génétique et Développement de Rennes), UMR 6290 ERL 1305, FHU GenOMedS, Rennes, France

Abstract

Silver-Russell syndrome (SRS) is a rare imprinting disorder characterized by prenatal and postnatal growth retardation. The two principal causes of SRS are loss of methylation on chromosome 11p15 (11p15 LOM) and maternal uniparental disomy of chromosome 7 (UPD(7)mat). Knowledge of the neuropsychological profile of SRS remains sparse and incomplete even if several difficulties related to attention and learning have been reported both in the literature and by patients with SRS. These difficulties could be the result of troubles in different cognitive domains, but also of executive dysfunction. Nevertheless, executive functioning has never been investigated, even though executive functions play an essential role in psychological development, and are extensively involved in daily life. The present study explored the executive functioning of individuals with SRS due to UPD(7)mat or 11p15 LOM. A battery of executive tasks assessing cognitive flexibility, inhibitory control, and working memory, together with a task assessing sustained attention, was administered to 19 individuals with SRS (13–39 years) and 19 healthy controls. The Behavior Rating Inventory of Executive Function was also completed by the participants’ families. The results showed that participants with SRS had similar performance (z-scores) to our controls, in a context of normal intellectual efficiency. Group comparisons with Bayesian statistics showed a single difference between the 11p15 LOM and control groups: the completion time for part A of the Trail Making Test appeared to be longer in the 11p15 LOM group than in the control group. However, at the clinical level, several participants with SRS had clinically significant scores on various measures of EFs. Thus, the cognitive phenotype of SRS did not appear to be characterized by executive dysfunction, but individuals with SRS could be at high risk of developing executive dysfunction or attention-deficit/hyperactivity disorder. These results provide new insights into the neuropsychological profile of individuals with SRS.

Introduction

Executive functions (EFs)–also referred to as cognitive control or executive control in the literature–are traditionally defined as a set of high-level cognitive processes that engage, direct, or coordinate other cognitive processes [1]. EFs typically allow individuals to intentionally control and regulate their thoughts and actions to achieve a particular goal [2, 3]. They are important when adapting to the demands of the environment or new situations, and are elicited when routines, automatisms or overlearned cognitive skills no longer suffice for carrying out an action or activity [2, 4]. Although there is currently no real consensus about the definition, components, and model of EFs, there are nevertheless points of convergence [5]. Most studies acknowledge that EFs include, but are not limited to, three interrelated core skills: inhibitory control, cognitive flexibility or set shifting, and working memory or updating [2, 4, 6, 7]. The theoretical distinctions between working memory versus updating and set shifting versus cognitive flexibility are still debated in the literature [8, 9]. Inhibitory control refers to the ability to deliberately curb, suppress, or more generally control goal-irrelevant stimuli, and cognitive or behavioral responses [2]. Cognitive flexibility is the ability to appropriately adapt one’s behavior to a changing environment. This includes set shifting, namely the ability to switch between multiple tasks or mental sets [9]. Working memory refers to the ability to process, manipulate and update information during cognitive activities [10]. Several other cognitive processes are more or less consensually associated with EFs, including attention, planning/organization, initiation, self-regulation, reasoning and problem-solving [2, 11]. Some authors distinguish between hot and cool executive processes, depending on the situations in which they are engaged [12]. Hot processes support the use of EFs in motivational and affectively or emotionally significant tasks. By contrast, inhibitory control, cognitive flexibility, working memory, and planning are regarded as cool processes, used in affectively neutral contexts, in relatively abstract or decontextualized tasks [1]. In parallel with the maturing of prefrontal networks, EFs emerge in the first few months of life but only reach full maturity in adulthood [6]. Their development is therefore both early, dynamic and prolonged. EFs are relatively undifferentiated up to the age of 5 years [13]. After 6 years, they gradually separate into specialized and partially independent executive processes. According to Diamond’s hierarchical and integrative model, inhibitory control and working memory are the first processes to be differentiated [2]. These two components then allow for the gradual strengthening of cognitive flexibility. Finally, the development of these three basic skills allows higher-level components such as planning, reasoning and problem-solving to be differentiated. Several sociodemographic factors are thought to play a role in the development of EFs, including sex, educational attainment, parents’ education level, and culture [14, 15]. To date, there is no established consensus on the precise effects of these different factors. However, education level is known to influence cognitive and executive performance [1618] and is generally positively correlated with performance on executive tasks [1619].

The developmental particularities of EFs, as well as the vulnerability of frontosubcortical networks, constitute a risk factor for the occurrence of executive dysfunction. As a result, disturbances of EFs are present in many pathologies such as acquired lesions and acquired or genetic neurodevelopmental disorders [2027]. These executive disorders can have significant repercussions on the lives of patients and their families [28]. EFs are also known to play an important role in human development [29], particularly psychological development, achievement, and social integration [2]. It is therefore essential to assess EFs, particularly to understand neuropsychological phenotypes, not least in genetic syndromes [30].

Silver-Russell syndrome (SRS; OMIM #180860) is a rare imprinting disorder characterized by prenatal and postnatal growth retardation. Its prevalence at birth is estimated to be 1/15 866, with boys and girls equally affected [31, 32]. The two principal causes are maternal uniparental disomy of chromosome 7 (UPD(7)mat), which is identified in about 5–10% of cases, and, in 50% of individuals, loss of methylation on chromosome 11p15 (11p15 LOM), which contains imprinted fetal growth factors [33, 34]. However, it currently remains unknown for many patients, so the diagnosis of SRS is primarily based on clinical signs. The clinical diagnosis is currently based on the Netchine-Harbison clinical scoring system (NH-CSS), where patients have to meet at least four of the following six clinical criteria: 1) born small for gestational age, 2) postnatal growth retardation, 3) relative macrocephaly at birth, 4) prominent forehead at the ages 1–3 years; 5) body asymmetry and 6) feeding difficulties and/or low body mass during early childhood [35, 36]. A recently published study demonstrated that some of these criteria are no longer discriminatory diagnostic features in adulthood [37]. Molecular confirmation is therefore necessary for these patients. In addition to limited growth, individuals with SRS may have other clinical features, such as early puberty, genital anomalies and metabolic disorders [36]. Children may benefit from growth hormone (GH) treatment to improve their physical condition, and gonadotropin-releasing hormone analogue (GnRHa) treatment to slow down puberty in some cases. Genotype-phenotype studies show that patients with 11p15 LOM have a more severe phenotype than those with UPD(7)mat, but the latter exhibit more frequent neurocognitive and behavioral disorders [38, 39].

The neuropsychological profile of individuals with SRS is generally characterized by intellectual efficiency in the medium to the low normal range [40]. IQ seems to be significantly impaired when individuals with clinical SRS are compared with a control group or with typical siblings [41, 42]. The incidence of intellectual impairment in the clinical SRS also appears to be higher than in the general population [43, 44]. Genotypically, the IQ of patients with UPD(7)mat is significantly lower than the one of patients with 11p15 LOM [42, 45]. Developmental delays and cognitive difficulties have also been reported in several SRS cases, ranging from mild motor or language delays to more persistent and severe difficulties [39]. Children with SRS, particularly those with UPD(7)mat, may have learning difficulties, particularly in reading, writing, and mathematics [43, 46]. Children with UPD(7)mat are also at increased risk of developing autism spectrum disorders, verbal dyspraxia, and myoclonus-dystonia syndrome [35, 45, 47, 48]. However, although difficulties have been reported among patients with SRS, they have rarely been thoroughly investigated. For example, little interest has been given to EFs and attention in SRS so far, even though impulsivity and reduced attention/concentration, attention deficit disorder (ADD) or attention-deficit/hyperactivity disorder (ADHD) have been observed in some children with SRS [39, 46, 4951]. ADHD is characterized by executive and attentional impairments. A recent study relates that the majority of adults with 11p15 LOM reported daily difficulties, especially with attention/concentration and learning [40]. Potential co-morbidity with learning disabilities and/or ADHD was also suggested in anotherone [52]. Very recently, researchers found that total brain volume was unchanged in patients with SRS compared with a control group [42]. However, gray-matter volume in the frontal and temporal lobes and globus pallidus was reduced in patients with SRS, both those with UPD(7)mat and those with 11p15 LOM. These structural brain characteristics could be associated with specific cognitive peculiarities, especially in executive and attentional functions, for patients with SRS, even in the absence of impaired overall intellectual efficiency.

The international consensus on the diagnosis and management of SRS recommends neuropsychological assessments at different stages of development to identify potential problems and provide appropriate interventions [36]. Although several studies provide knowledge about the difficulties faced in SRS, they need to be supported and confirmed in individuals diagnosed according to the clinical criteria of the NH-CSS and confirmed by molecular diagnosis. Therefore, in light of the difficulties reported in SRS, and more specifically attentional difficulties, as well as the vulnerability of executive functions observed in different genetic syndromes, we chose to conduct an exploratory study to investigate executive and attentional functions in SRS. Our objective was to determine which abilities are preserved and which ones are impaired in SRS patients. The tested hypothesis was that, compared with control groups, the SRS group would perform more poorly on executive tasks (e.g., attention, inhibitory control) and report more difficulties in daily life.

Materials and methods

Design

We conducted this cross-sectional study as part of a larger research project on the life course and neuropsychological profile of adolescents and adults with SRS [40, 53]. This study involving human participants was reviewed and approved by the ethics committee of Rennes University Hospital, France (no. 15.123, 29 December 2015). It was also conducted in accordance with the Declaration of Helsinki. All participants (and their parents, in the case of adolescents) provided their written informed consent to participate in this study.

Participants

Nineteen individuals aged 13–39 years, who have been diagnosed with SRS in accordance with the NH-CSS, confirmed by molecular analysis, participated in this study [35]. This group included three participants with UPD(7)mat and 16 with 11p15 LOM. They were recruited between 2016 and 2018 in France via a call for participation in the study. This call was relayed to patients with SRS and their families by 1) the referral center at Trousseau Children’s Hospital in Paris, 2) geneticists and endocrinologists from various French hospitals and reference centers for developmental anomalies affiliated with the AnDDI-Rares disease healthcare network, FIRENDO rare endocrine diseases network and 3) two French patient organizations. Only patients with a clinical diagnosis of SRS confirmed by molecular analysis were included in this study. Indeed, although the NH-CSS assists in diagnosis in line with standards recommended by the international consensus [36], the accuracy of the clinical diagnosis may depend on the experience of the medical investigator [54].

Nineteen healthy volunteers were recruited to form a control group. The control group was matched for age, sex, and education level to the SRS group. Inclusion criteria for these participants were not having SRS, no history of psychiatric or neurodevelopmental disorders, no learning disabilities, or other neurological disorders as well as no GH or GnRHa treatment in their lifetime. Demographic and clinical characteristics of the SRS and control groups are summarized in Table 1. The total SRS group and control group did not differ in sociodemographic characteristics: sex (Fisher’s exact test, p = 1.000), age (U = 169, p = .745), education level (t(36) = 0.06, p = .956), parents’ education level (t(34) = 0.79, p = .435). The 11p15 LOM group did not differ either from the control group: sex (Fisher’s exact test, p = 1.000), age (U = 116.5, p = .241), education (t(33) = 0.65, p = .522), parents’ education level (t(31) = 0.90, p = .376).

thumbnail
Table 1. Sociodemographic characteristics of SRS and control groups.

https://doi.org/10.1371/journal.pone.0279745.t001

Measures

Participants’characteristics and demographic data.

The collected sociodemographic features included age, sex, education level and parents’ education level (see Table 1). Intellectual functioning was assessed by administering the French-language version of the Wechsler Intelligence Scale for Children, fourth (WISC-IV) or fifth edition (WISC-V), to adolescents aged 13–16 years, and the Wechsler Adult Intelligence Scale, fourth edition (WAIS-IV) to individuals aged 17 years or above [5557]. We calculated the Full-Scale Intellectual Quotient (FSIQ; M = 100, SD = 15), the Verbal Comprehension Index (VCI), the performance/nonverbal IQ (PIQ; the Perceptual Reasoning Index in WAIS-IV and WISC-IV, and the Fluid Reasoning Index in WISC-V), the Working Memory Index (WMI), and the Processing Speed Index (PSI).

The total SRS group and control group did not differ on FSIQ (t(36) = 1.34, p = .190), VCI (t(30.80) = 0.37, p = .717), PIQ (t(36) = 1.23, p = .228), WMI (U = 213, p = .349), PSI (t(36) = 1.07, p = .290) (see Table 2). The 11p15 LOM group did not differ from the control group (Full-Scale IQ, t(23.53) = 1.19, p = .245; VCI, t(33) = 0.93, p = .927; PIQ, t(33) = 1.22, p = .232; WMI, t(33) = 1.76, p = .088; PSI, t(33) = 1.10, p = .280). Intra-individual analyses were performed on part of the data in a previous study [40].

thumbnail
Table 2. Full-scale IQ and the four index scores of SRS and control groups.

https://doi.org/10.1371/journal.pone.0279745.t002

The Reliable Digit Span (RDS) was calculated for each group to ensure the performance validity on this neuropsychological assessment. The RDS was calculated by summing the longest forward and backward raw digit spans in which both trials were correctly produced on the Digit Span subtests of the Wechsler scales [58, 59]. For the SRS group, the average RDS performance was 8.11 (SD = 1.56, Range 5–11). Based on the previously established adult cut-off ≤ 7, 84.21% of the sample passed; at a cut-off ≤ 6, 89.97% of the sample passed which approaches a 90% pass rate recommended in the literature [58]. For the 11p15 LOM group (M = 8.19, SD = 1.49, Range 5–11), at the cut-off ≤ 7 and ≤ 6, 87.5% and 93.75% of the sample passed. For the UPD(7)mat group, the RDS average was 7.67 (SD = 2.31, Range 5–9). At the cut-off ≤ 7 and ≤ 6, 66.67% of the sample passed. For the control group (M = 9.63, SD = 2.03, Range 7–15), 100% of the sample passed at the cut-off ≤ 7 and ≤ 6.

Executive functions

EFs were tested using six cognitive tests: d2-R test, Digit span subtest, Trail Making Test (TMT), Stroop test, Verbal fluency test, and Modified Card-Sorting Test (MCST) [5557, 6065]. The Behavior Rating Inventory of Executive Function (BRIEF) questionnaires for children and adults were also used [6669].

The d2-R test, a speeded paper-and-pencil task, measures selective and sustained attention, concentration, and impulsivity. Participants were each given a sheet of paper with 14 rows of 57 characters. Each character was either the letters p or d, with 1–4 dashes above and/or below. Participants had to locate and cross out all the target characters (letter d with two dashes, either one above and one below, or both either above or below) as quickly as possible and without errors. To achieve this, they had to process each row within 20 seconds, and all the rows were processed in succession without interruption. This task took 4 minutes and 40 seconds in total. The raw scores of five parameters of the d2-R were analyzed: the total number of items processed (i.e., processing speed), the total number of responses minus total number of errors (i.e., sustained attention/concentration), percentage of error (i.e., accuracy), the omission errors, and the commission errors.

The Digit span subtest (WISC-IV, WISC-V or WAIS-IV) was used to measure verbal working memory. Series of numbers were presented verbally, and participants had to repeat the series of digits in the reverse order (Digit span backward). The series of numbers gradually increased if participants continued to answer correctly. We analyzed performances on the backward spans in this study.

The Trail Making Test (TMT) comes in two parts: A (TMT-A) and B (TMT-B). In Part A, participants were asked to link numbers from 1 to 25 in ascending order. In Part B, they had to link numbers (1–13) and letters (A-L) in alternating ascending and alphabetical order (1A, 2B, etc.). In both parts, participants had to link the numbers or letters and numbers as quickly as possible. Part A measures attention, visual scanning and psychomotor speed, while Part B assesses the ability to flexibly shift course during an activity. In this study, completion times (in seconds) for TMT-A and TMT-B were recorded. Cognitive flexibility was assessed by calculating the difference in completion time between Parts B and A of the TMT (B-A).

The Stroop test is an adapted version of the original Stroop test, assessing inhibitory control [63]. All three test conditions were administered. In the first condition (naming), participants had to name the color of 100 rectangles (red, green, blue) as quickly as possible. In the second condition (reading), they had to read as quickly as possible 100 names of color (red, green, blue) printed in black. In the last condition (interference), participants had to name the color of the ink in which 100 names of color were printed (e.g., saying red when the word green was printed in red ink). This condition requires automatic reading to be inhibited, and participants had to perform it as quickly as possible. Inhibitory processing was assessed by calculating the difference between the time taken to perform the trials in the interference condition and the time taken to perform them in the naming condition.

The Verbal fluency test, which measures the ability to generate words quickly, was used to assess spontaneous cognitive flexibility. Participants were asked to produce as many French words as possible in 120 seconds. They were asked to generate words starting with the letter p (phonemic fluency), and words belonging to the animal category (semantic fluency). For phonemic fluency, participants were instructed to avoid proper names, same-root names, and repetitions. For semantic fluency, they had two restrictions: same-root names and repetitions. Scores were calculated by subtracting incorrect responses and repeated words from the total number of responses.

The Modified Card-Sorting Test is a multicomponent task that specifically measures reactive flexibility, perseverative responding, and categorization. It is a simplified version of the Wisconsin Card Sorting Test, which contains two sets of 24 cards and no ambiguous ones [70]. Participants had to match each of the 48 cards to one of four target cards. Cards could be matched by color, form, or number of symbols. Participants were free to choose the initial sorting category. Then, they had to guess the sorting principle solely based on the examiner’s feedback (“yes” or “no”). In this study, we used an adapted version of the MCST: after six correct responses, the sorting principle was changed without prior warning, unlike the initial version (“Now the rules have changed”). The number of categories completed, total errors and perseverative errors were counted.

The parent form of the French version of the BRIEF was used to assess adolescents’ EFs in everyday life [67]. The BRIEF for children and adolescents aged 5–18 years includes 86 behavioral items. For each item, the parent indicates the frequency of the behavior on a 3-point Likert scale (Never, Sometimes, Often). The BRIEF consists of eight clinical subscales that allow three indices to be calculated: the Behavioral Regulation Index (BRI), encompassing the Inhibit, Shift and Emotional control subscales; the Metacognition Index (MI), which includes the Initiate, Working memory, Plan/Organize, Organization of materials and Monitor subscales; and the Global Executive Composite (GEC), the sum of all the clinical subscales. For adults, we used the informant-report forms of the French version of the BRIEF for adults aged 18–90 years (BRIEF-A) [69]. The BRIEF-A is composed of 75 items that measure various aspects of executive functioning. Nine clinical subscales and three indices to be calculated: the BRI, which includes the Inhibit, Shift, Emotional control, and Self-monitor subscales; the MI, containing the Initiate, Working memory, Plan/Organization, Task monitor, Organization of materials subscales; and the GEC. In this study, we considered the BRI, MI and GEC T-scores (M = 50, SD = 10) and the Inhibit, Shift, Working memory and Plan/Organize subscales T-scores for adolescents and adults. T-scores above 65 were considered clinically significant.

Procedure

A neuropsychological assessment was conducted by a psychologist. All participants were tested individually in their own homes. Before the assessment, a semi-structured interview was conducted to collect sociodemographic characteristics and medical data for the SRS group. Participants first completed the d2-R test, followed by the Wechsler Intelligence Scale (including Digit span subtest), TMT, Stroop test, Verbal fluency test, and finally the MCST. The assessment lasted 3 hours on average, with many breaks, depending on the needs of each participant.

Statistical analyses

Statistical analyses were performed using JASP (version 0.16.4, Intel) [71]. Descriptive statistics were used to characterize samples. The normality of distribution was assessed with the Shapiro-Wilk normality test and confirmed by an inspection of the Q-Q plot. Levene’s test was conducted to assess the equality of variances. For sociodemographic and intellectual data, we used either independent t-tests or Welch’s t-tests to compare continuous variables with a normal distribution. Mann-Whitney U-tests were used for continuous variables with non-normal distributions. Fisher’s exact test was used for categorical variables. For intellectual scores, a Bonferroni correction was applied to reduce the chances of obtaining false-positive results (Type I errors). The Bonferroni correction was p < 0.01 for the Full-Scale IQ and the four index scores (VCI, PIQ, WMI, PSI).

For EF scores, z-scores of UPD(7)mat subjects and z-scores of the 11p15 LOM group were calculated according to the mean and standard deviation of the control groups. Group comparisons were performed to determine the differences between SRS and control groups. Due to the small sample size of the UPD(7)mat group (N = 3), comparisons were made only between 11p15 LOM and control groups. To this end, we used the Bayesian Mann-Whitney U-tests framework proposed by Jeffreys [72]. Bayes factors (BF10) were calculated to quantify the relative probability of the hypothesis (H1, the model including the effect of interest) and the null (H0, the same model without this effect). By convention, a BF of 1–3 is considered negligible evidence for H1, 3–10 indicates moderate evidence, 10–30 is strong, 30–100 is very strong, and a BF > 100 is extreme evidence. Alternatively, a BF of 0.33–1 is considered weak to negligible evidence in favor of H0, 0.1–0.33 is moderate evidence, and < 0.1 is strong evidence [72, 73]. A Cauchy distribution with a scale r = (0.707) as a default choice for the prior distribution of effect size was used [74]. Dataset and codebook have been deposited in Open Science Framework with the identifier: https://doi.org/10.17605/osf.io/32zjt (https://osf.io/32zjt/).

Results

Table 3 provides an overview of the performance of the 11p15 LOM group compared with the control group, showing the z-scores for the 11p15 LOM group’s performance on each task, calculated according to the mean and standard deviation of the control group.

thumbnail
Table 3. Z-scores of participants with 11p15 LOM group calculated for each executive function task based on the mean and standard deviation of the control group.

https://doi.org/10.1371/journal.pone.0279745.t003

Overall, results show that the 11p15 LOM group performances are lower than the one of the control group, even if high interindividual variability exists. In particular, several individuals (n = 6) had clinically significant scores on the d2-R, the TMT, and the working memory subscale of the BRIEF/BRIEF-A questionnaire. The majority of individuals with clinical scores were adults with 11p15 LOM. Clinically significant scores were also observed for participants with UPD(7)mat (see Table 4).

thumbnail
Table 4. Z-scores of participants with UPD(7)mat group calculated for each executive function task based on the mean and standard deviation of the control group.

https://doi.org/10.1371/journal.pone.0279745.t004

Comparison between 11p15 LOM and control groups

Because of the non-normal distribution of the data, Bayesian Mann-Whitney U-tests were used to test the null and the alternative hypothesis. The null hypothesis postulated that there was no difference in EF scores between the 11p15 group and the control group. On account of the nature of the data, we had two one-sided alternative hypotheses: 1) the 11p15 LOM group had smaller scores on executive tasks than the control group (BF+0), and 2) the 11p15 LOM group had higher scores on executive tasks than the control group (BF-0). Indeed, depending on the nature of the data (e.g., response times of TMT), lower performance corresponded to higher scores. The results are shown in Table 5.

thumbnail
Table 5. Comparison of executive function scores between 11p15 LOM and control groups.

https://doi.org/10.1371/journal.pone.0279745.t005

Comparing groups (11p15 LOM vs. controls) in completion times for TMT-A, a Bayesian Mann-Whitney U-test yielded a Bayes factor of BF-0 = 5.02 (moderate evidence), indicating that H1 is 5.02 times more likely to occur than the null hypothesis (H0). In other words, the 11p15 LOM group was 5.02 times more likely to be slower than the control group in completion times for TMT-A. The 11p15 LOM group was 2.97 times more likely to commit errors of commission compared to the control group (BF-0 = 2.97). However, this was considered “negligible” evidence for the alternative hypothesis (1 < BF < 3). Conversely, the Bayesian statistics showed moderate evidence in favor of the null hypothesis (no difference between the 11p15 group and the control group) for interference time of the Stroop test, total errors and perseverative errors of the MCST, and GEC, BRI, Inhibit, and Shift subscales of the BRIEF/BRIEF-A questionnaire (0.1 < BF < 0.33).

Discussion

Previous studies have shown that individuals with SRS can have several difficulties related to attention and learning [39, 40, 43, 46, 4952]. These difficulties may result from troubles in different cognitive domains and/or executive dysfunction. However, executive functioning has never been investigated, even though executive functions play an essential role in psychological and social development. Their dysfunction can have many repercussions in daily life. The present study was designed to establish the executive functioning of individuals with SRS due to 11p15 LOM or UPD(7)mat. Our aim was to determine which EFs were preserved and which ones were impaired in our SRS group, compared with the control group. Participants with SRS were expected to perform more poorly on executive tasks compared to a matched control group.

In contrast with this hypothesis, using Bayesian statistics, we showed that participants with SRS, specifically those with 11p15 LOM, showed similar performances to the control group. Only one difference has been found: the time to complete part A of the TMT appeared to be longer in the 11p15 LOM group compared to the control group. Therefore, the cognitive profile of individuals with SRS did not appear to be characterized by executive dysfunction. Nevertheless, we observed considerable inter-individual heterogeneity in SRS groups. Eight participants with SRS especially had clinically significant scores on at least three different EFs tasks. Two of the eight had been diagnosed with ADD/ADHD as children. These results may support the executive and attention difficulties observed in previous studies of individuals with clinical SRS. Indeed, as early as 1954, Russell reported cases of children showing signs of hyperactivity [75]. Subsequently, other researchers have reported attention/concentration and impulsivity difficulties [46], hyperactivity [39], and ADD/ADHD [4951] have been observed in a few children with SRS. Thus, individuals with SRS could be at elevated risk of developing learning disabilities [76], or another neurodevelopmental disorder such as autism spectrum disorder [45] or ADD/ADHD.

On the other hand, the majority of individuals with clinical scores were adults with 11p15 LOM. This observation could be explained by random recruitment, but it could also be explained by other factors. Indeed, in some genetic syndromes such as 22q11.2 deletion syndrome [77], cognitive, behavioral and psychiatric phenotypes emerge across age. In the SRS, the cognitive profile could evolve with age and/or the presence of metabolic comorbidities. A high prevalence of metabolic disorders has also been reported in individuals with LOM 11p15 [78]. Individuals with SRS tend to develop Type 2 diabetes mellitus relatively early. In our group, two adults had Type 2 diabetes mellitus, while three others presented a risk of prediabetes, with insulin resistance or high fasting blood glucose level [40]. Type 2 diabetes mellitus may be associated with impaired cognitive function [79, 80]. It might be interesting to perform a longitudinal follow-up of individuals with SRS to better understand the executive functioning of participants and the potential impact of metabolic disorders on their cognitive profile.

In this study, some limitations need to be considered. The first limitation was the small number of participants with SRS (16 participants with 11p15 LOM and 3 with UPD(7)mat) and participants without SRS (N = 19). This problem is well-known in the field of rare diseases, the usual statistical tests and metrics being more appropriate for common diseases. Due to the rarity of the UPD(7)mat, our sample size here was much smaller and statistical comparisons between this group and the others were not appropriate. Therefore, statistical comparisons were only conducted between the 11p15 LOM and control groups. Future studies with larger sample sizes, particularly with more participants with UPD(7)mat, could confirm and generalize our results. Larger samples will also allow statistical comparisons between SRS groups (11p15 LOM vs. UPD(7)mat) needed to better understand phenotype-genotype relationships. The second limitation of this study is the existence of a potential representativeness bias. Indeed, our samples were composed of small groups of participants with SRS who volunteered to participate. The risk is that they are not representative of the general population with SRS. Indeed, we may have an over-representation of participants with or without difficulties in our study. For example, participants who volunteered for our study may have more difficulties than their peers and may seek support through study participation. Conversely, they may also have fewer difficulties and thus be more willing to participate in this study than other SRS patients. The third limitation was that this exploratory study had a cross-sectional design. A longitudinal study would provide a better understanding of the development of participants’ executive functions. This would include typical or atypical development, evolution, and especially unusual decline with age or associated diseases. Our methodology also had limitations, but can still guide future research. Thus, although our research design included a large number of executive tasks, not all modalities could be assessed and other tasks might also be more relevant. For example, while some authors consider the Digit span subtest to have an updating component, other tests may be more relevant to assess it, such as the n-Back task [81, 82]. Future studies could also investigate visuospatial working memory using the Corsi block-tapping test, attention in both auditory and visuospatial modalities with the Test of Everyday Attention, planning with the Tower of London, and motor inhibitory control with the Go/No-Go task [8386]. Nevertheless, these highly structured paper-and-pencil tests are also open to criticism [87]. A more ecological and multifactorial assessment might be preferable, such as the Behavioural Assessment of the Dysexecutive Syndrome (BADS) [88]. Further studies remain mandatory to better understand the executive functioning of individuals with SRS and could lead to a better understanding of the syndrome and its cognitive profile. Such studies could also provide professionals with the tools to give more tailored support to individuals with SRS.

In summary, this first exploratory study investigates executive functioning in individuals with SRS, including adolescents and adults with 11p15 LOM or UPD(7)mat. The cognitive phenotype of SRS did not appear to be characterized by executive dysfunction. On the contrary, the overall the performance on executive tasks was similar between 11p15 LOM and control groups. Nevertheless, at the clinical level, several participants with SRS had clinically significant scores on several measures of EFs. Thus, individuals with SRS could be at high risk of developing executive dysfunction, or ADD/ADHD. Further studies remain necessary to confirm our findings. Future research should also investigate other cognitive domains which could explain difficulties reported in prior literature and by patients with SRS. Such studies have the potential to shed light on the profile of SRS and guide neuropsychological assessments in clinical practice.

Acknowledgments

The authors thank the participants and their families for their participation, and the patient organizations for their contributions (“Association Française des Familles touchées par le Syndrome de Silver-Russell et des personnes nées Petites pour l’Age Gestationnel et leurs amis” and the “Association Grandir”).

References

  1. 1. Zelazo PD. Executive Function and Psychopathology: A Neurodevelopmental Perspective. Annu Rev Clin Psychol. 2020;16: 431–454. pmid:32075434
  2. 2. Diamond A. Executive Functions. Annu Rev Psychol. 2013;64: 135–168. pmid:23020641
  3. 3. Luria AR. Higher cortical functions in man. New York: Springer US; 1966.
  4. 4. Miyake A, Friedman NP, Emerson MJ, Witzki AH, Howerter A, Wager TD. The Unity and Diversity of Executive Functions and Their Contributions to Complex “Frontal Lobe” Tasks: A Latent Variable Analysis. Cognit Psychol. 2000;41: 49–100. pmid:10945922
  5. 5. Baggetta P, Alexander PA. Conceptualization and Operationalization of Executive Function: Executive Function. Mind Brain Educ. 2016;10: 10–33.
  6. 6. Best JR, Miller PH. A Developmental Perspective on Executive Function: Development of Executive Functions. Child Dev. 2010;81: 1641–1660. pmid:21077853
  7. 7. Lehto JE, Juujärvi P, Kooistra L, Pulkkinen L. Dimensions of executive functioning: Evidence from children. Br J Dev Psychol. 2003;21: 59–80.
  8. 8. Guerra A, Hazin I, Guerra Y, Roulin J-L, Le Gall D, Roy A. Developmental Profile of Executive Functioning in School-Age Children From Northeast Brazil. Front Psychol. 2021;11: 596075. pmid:33536970
  9. 9. Morra S, Panesi S, Traverso L, Usai MC. Which tasks measure what? Reflections on executive function development and a commentary on Podjarny, Kamawar, and Andrews (2017). J Exp Child Psychol. 2018;167: 246–258. pmid:29197781
  10. 10. Baddeley A. Working Memory: Theories, Models, and Controversies. Annu Rev Psychol. 2012;63: 1–29. pmid:21961947
  11. 11. Anderson P. Assessment and Development of Executive Function (EF) During Childhood. Child Neuropsychol. 2002;8: 71–82. pmid:12638061
  12. 12. Zelazo PD, Müller U. Executive Function in Typical and Atypical Development. In: Goswami U, editor. Blackwell Handbook of Childhood Cognitive Development. Malden, MA, USA: Blackwell Publishers Ltd; 2002. pp. 445–469. https://doi.org/10.1002/9780470996652.ch20
  13. 13. Lee K, Bull R, Ho RMH. Developmental Changes in Executive Functioning. Child Dev. 2013;84: 1933–1953. pmid:23550969
  14. 14. Er-Rafiqi M, Roukoz C, Le Gall D, Roy A. Les fonctions exécutives chez l’enfant: développement, influences culturelles et perspectives cliniques. Rev Neuropsychol. 2017;9: 27.
  15. 15. Johnson SB, Riis JL, Noble KG. State of the Art Review: Poverty and the Developing Brain. Pediatrics. 2016;137: e20153075. pmid:26952506
  16. 16. Mattioli F, Stampatori C, Bellomi F, Scarpazza C, Galli P, Guarneri C, et al. Assessing executive function with the D-KEFS sorting test: normative data for a sample of the Italian adult population. Neurol Sci. 2014;35: 1895–1902. pmid:24998015
  17. 17. Tombaugh T. Trail Making Test A and B: Normative data stratified by age and education. Arch Clin Neuropsychol. 2004;19: 203–214. pmid:15010086
  18. 18. Yassuda MS, Diniz BSO, Flaks MK, Viola LF, Pereira FS, Nunes PV, et al. Neuropsychological Profile of Brazilian Older Adults with Heterogeneous Educational Backgrounds. Arch Clin Neuropsychol. 2009;24: 71–79. pmid:19041220
  19. 19. Campanholo KR, Boa INF, Hodroj FC da SA, Guerra GRB, Miotto EC, Lucia MCS de. Impact of sociodemographic variables on executive functions. Dement Neuropsychol. 2017;11: 62–68. pmid:29213495
  20. 20. Araujo GC, Antonini TN, Anderson V, Vannatta KA, Salley CG, Bigler ED, et al. Profiles of Executive Function Across Children with Distinct Brain Disorders: Traumatic Brain Injury, Stroke, and Brain Tumor. J Int Neuropsychol Soc. 2017;23: 529–538. pmid:28502261
  21. 21. McDonald BC, Flashman LA, Saykin AJ. Executive dysfunction following traumatic brain injury: Neural substrates and treatment strategies. McAllister TW, editor. NeuroRehabilitation. 2002;17: 333–344. https://doi.org/10.3233/NRE-2002-17407
  22. 22. Brosnan M, Demetre J, Hamill S, Robson K, Shepherd H, Cody G. Executive functioning in adults and children with developmental dyslexia. Neuropsychologia. 2002;40: 2144–2155. pmid:12208010
  23. 23. Craig F, Margari F, Legrottaglie AR, Palumbi R, de Giambattista C, Margari LA. A review of executive function deficits in autism spectrum disorder and attention-deficit/hyperactivity disorder. Neuropsychiatr Dis Treat. 2016; 1191–1202. pmid:27274255
  24. 24. Demetriou EA, Lampit A, Quintana DS, Naismith SL, Song YJC, Pye JE, et al. Autism spectrum disorders: a meta-analysis of executive function. Mol Psychiatry. 2018;23: 1198–1204. pmid:28439105
  25. 25. Beaussart M-L, Barbarot S, Mauger C, Roy A. Systematic Review and Meta-analysis of Executive Functions in Preschool and School-Age Children With Neurofibromatosis Type 1. J Int Neuropsychol Soc. 2018;24: 977–994. pmid:30375317
  26. 26. Christ SE, Huijbregts SCJ, de Sonneville LMJ, White DA. Executive function in early-treated phenylketonuria: Profile and underlying mechanisms. Mol Genet Metab. 2010;99: S22–S32. pmid:20123466
  27. 27. Rowe J, Lavender A, Turk V. Cognitive executive function in Down’s syndrome. Br J Clin Psychol. 2006;45: 5–17. pmid:16480563
  28. 28. Roy A. Approche neuropsychologique des fonctions exécutives de l’enfant: état des lieux et éléments de prospective. Rev Neuropsychol. 2015;7: 245.
  29. 29. Carlson SM, Zelazo PD, Faja S. Executive Function. In: Zelazo PD, editor. The Oxford Handbook of Developmental Psychology, Vol 1. Oxford University Press; 2013. pp. 705–743. https://doi.org/10.1093/oxfordhb/9780199958450.013.0025
  30. 30. Toplak ME, West RF, Stanovich KE. Practitioner Review: Do performance-based measures and ratings of executive function assess the same construct?: Performance-based and rating measures of EF. J Child Psychol Psychiatry. 2013;54: 131–143. pmid:23057693
  31. 31. Yakoreva M, Kahre T, Žordania R, Reinson K, Teek R, Tillmann V, et al. A retrospective analysis of the prevalence of imprinting disorders in Estonia from 1998 to 2016. Eur J Hum Genet. 2019;27: 1649–1658. pmid:31186545
  32. 32. Wakeling EL. Silver–Russell syndrome. Arch Dis Child. 2011;96: 1156–1161. pmid:21349887
  33. 33. Netchine I, Rossignol S, Dufourg M-A, Azzi S, Rousseau A, Perin L, et al. 11p15 Imprinting Center Region 1 Loss of Methylation Is a Common and Specific Cause of Typical Russell-Silver Syndrome: Clinical Scoring System and Epigenetic-Phenotypic Correlations. J Clin Endocrinol Metab. 2007;92: 3148–3154. pmid:17504900
  34. 34. Gicquel C, Rossignol S, Cabrol S, Houang M, Steunou V, Barbu V, et al. Epimutation of the telomeric imprinting center region on chromosome 11p15 in Silver-Russell syndrome. Nat Genet. 2005;37: 1003–1007. pmid:16086014
  35. 35. Azzi S, Salem J, Thibaud N, Chantot-Bastaraud S, Lieber E, Netchine I, et al. A prospective study validating a clinical scoring system and demonstrating phenotypical-genotypical correlations in Silver-Russell syndrome. J Med Genet. 2015;52: 446–453. pmid:25951829
  36. 36. Wakeling EL, Brioude F, Lokulo-Sodipe O, O’Connell SM, Salem J, Bliek J, et al. Diagnosis and management of Silver–Russell syndrome: first international consensus statement. Nat Rev Endocrinol. 2017;13: 105–124. pmid:27585961
  37. 37. Lokulo-Sodipe O, Ballard L, Child J, Inskip HM, Byrne CD, Ishida M, et al. Phenotype of genetically confirmed Silver-Russell syndrome beyond childhood. J Med Genet. 2020;57: 683–691. pmid:32054688
  38. 38. Bruce S, Hannula-Jouppi K, Peltonen J, Kere J, Lipsanen-Nyman M. Clinically Distinct Epigenetic Subgroups in Silver-Russell Syndrome: The Degree of H19 Hypomethylation Associates with Phenotype Severity and Genital and Skeletal Anomalies. J Clin Endocrinol Metab. 2009;94: 579–587. pmid:19017756
  39. 39. Wakeling EL, Amero SA, Alders M, Bliek J, Forsythe E, Kumar S, et al. Epigenotype–phenotype correlations in Silver–Russell syndrome. J Med Genet. 2010;47: 760–768. pmid:20685669
  40. 40. Burgevin M, Lacroix A, Brown G, Mikaty M, Coutinho V, Netchine I, et al. Intellectual functioning in Silver-Russell syndrome: First study in adults. Appl Neuropsychol Adult. 2021;28: 391–402. pmid:31390893
  41. 41. Noeker M, Wollmann HA. Cognitive development in Silver-Russell syndrome: a sibling-controlled study. Dev Med Child Neurol. 2007;46: 340–346.
  42. 42. Patti G, De Mori L, Tortora D, Severino M, Calevo M, Russo S, et al. Cognitive Profiles and Brain Volume Are Affected in Patients with Silver–Russell Syndrome. J Clin Endocrinol Metab. 2020;105: e1478–e1488. pmid:31665337
  43. 43. Lai KY, Skuse D, Stanhope R, Hindmarsh P. Cognitive abilities associated with the Silver-Russell syndrome. Arch Dis Child. 1994;71: 490–496. pmid:7726606
  44. 44. Sieńko M, Petriczko E, Biczysko-Mokosa A, Horodnicka-Józwa A, Wojtasik N, Zajączek S, et al. Ocena zdolności intelektualnych u dzieci z zespołem Silver–Russell [The Appraisal of Intellect in Children with Silver-Russell Syndrome]. Endokrynol Pediatryczna. 2010;9: 53–64.
  45. 45. Lane C, Robinson L, Freeth M. Autistic traits and cognitive abilities associated with two molecular causes of Silver-Russell syndrome. J Abnorm Psychol. 2020;129: 312–319. pmid:31599634
  46. 46. Garcia PF, Salvador KK, Moraes TFD, Feniman MR, Crenitte PAP. Processamento auditivo, leitura e escrita na síndrome de Silver-Russell: relato de caso [Auditory processing, reading and writing in Silver-Russell syndrome: a case report]. Rev Soc Bras Fonoaudiol. 2012;17: 101–105.
  47. 47. Feuk L, Kalervo A, Lipsanen-Nyman M, Skaug J, Nakabayashi K, Finucane B, et al. Absence of a Paternally Inherited FOXP2 Gene in Developmental Verbal Dyspraxia. Am J Hum Genet. 2006;79: 965–972. pmid:17033973
  48. 48. Augustine EF, Blackburn J, Pellegrino JE, Miller R, Mink JW. Myoclonus-dystonia syndrome associated with Russell Silver syndrome. Mov Disord. 2013;28: 841–842. pmid:23703955
  49. 49. Brown LA, Rupps R, Peñaherrera MS, Robinson WP, Patel MS, Eydoux P, et al. A cryptic familial rearrangement of 11p15.5, involving both imprinting centers, in a family with a history of short stature. Am J Med Genet A. 2014;164: 1587–1594. pmid:24668696
  50. 50. Karher K, Banda I. Behavioral problems in Silver–Russell syndrome–Case report. Eur Psychiatry. 2017;41: S445.
  51. 51. Schönherr N, Meyer E, Roos A, Schmidt A, Wollmann HA, Eggermann T. The centromeric 11p15 imprinting centre is also involved in Silver-Russell syndrome. J Med Genet. 2007;44: 59–63. pmid:16963484
  52. 52. Bogdanow A, Menasse-Palmer L, Lesser I, Levy P, Marion R. Association between Russell-Silver Syndrome (RSS) and Attention Deficit Disorder (ADD)/Attention Deficit disorder with Hyperactivity (ADHD) and/or Learning Disabilities (LD): Report of 16 cases. Am J Hum Genet. 1995;57: 84.
  53. 53. Burgevin M, Lacroix A, Bourdet K, Coutant R, Donadille B, Faivre L, et al. Quality of life and mental health of adolescents and adults with Silver-Russell syndrome. Eur J Med Genet. 2022;65: 104482. pmid:35304302
  54. 54. Eggermann T, Begemann M, Binder G, Spengler S. Silver-Russell syndrome: genetic basis and molecular genetic testing. Orphanet J Rare Dis. 2010;5: 5–19. pmid:20573229
  55. 55. Wechsler D. Échelle d’intelligence de Wechsler pour enfants et adolescents, 5ème édition—WISC-V. Pearson ECPA; 2016.
  56. 56. Wechsler D. Échelle d’intelligence de Wechsler pour adultes, 4ème édition—WAIS-IV. Editions du Centre de Psychologie Appliquée (ECPA); 2011.
  57. 57. Wechsler D. Échelle d’intelligence de Wechsler pour enfants et adolescents, 4ème édition—WISC-IV. Editions du Centre de Psychologie Appliquée (ECPA); 2005.
  58. 58. Schroeder RW, Twumasi-Ankrah P, Baade LE, Marshall PS. Reliable Digit Span: A Systematic Review and Cross-Validation Study. Assessment. 2012;19: 21–30. pmid:22156721
  59. 59. Greiffenstein MF, Baker WJ, Gola T. Validation of malingered amnesia measures with a large clinical sample. Psychol Assess. 1994;6: 218–224.
  60. 60. Brickenkamp R, Liepman D, Schmidt L. d2-R: Test d’attention concentrée révisé. Hogrefe France; 2015.
  61. 61. Reitan RM. Validity of the Trail Making Test as an Indicator of Organic Brain Damage. Percept Mot Skills. 1958;8: 271–276.
  62. 62. Godefroy O, GREFEX. Fonctions exécutives et pathologies neurologiques et psychiatriques. Évaluation en pratique clinique. Louvain-la-Neuve: De Boeck Supérieur; 2008.
  63. 63. Stroop JR. Studies of interference in serial verbal reactions. J Exp Psychol. 1935;18: 643–662.
  64. 64. Cardebat D, Doyon B, Puel M, Goulet P, Joanette Y. Evocation lexicale formelle et sémantique chez des sujets normaux. Performances et dynamiques de production en fonction du sexe, de l’âge, et du niveau d’étude [Formal and semantic lexical evocation in normal subjects. Performance and dynamics of production as a function of sex, age and educational level]. Acta Neurol Belg. 1990;90: 207–217.
  65. 65. Nelson HE. A Modified Card Sorting Test Sensitive to Frontal Lobe Defects. Cortex. 1976;12: 313–324. pmid:1009768
  66. 66. Gioia GA, Isquith PK, Guy SC, Kenworthy L. Behavior Rating Inventory of Executive Function: BRIEF. Psychological Assessment Resources; 2000.
  67. 67. Roy A, Fournet N, Roulin J-L, Le Gall D. BRIEF-inventaire d’évaluation comportementale des fonctions executives, adaptation française [Behavior rating inventory of executive function]. Hogrefe France; 2013.
  68. 68. Roth RM, Isquith PK, Gioia GA. Behavior Rating Inventory of Executive Function-Adult Version (BRIEF-A). Psychological Assessment Resources; 2005.
  69. 69. Roy A, Besnard J, Lancelot C, Le Gall D, Fournet N. BRIEF-A Inventaire d’Evaluation Comportementale des Fonctions Exécutives–Version Adulte–Adaptation Française [Behavior Rating Inventory of Executive Function-Adult Version (BRIEF-A)-French version]. Hogrefe France; 2015.
  70. 70. Grant DA, Berg E. A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. J Exp Psychol. 1948;38: 404–411. pmid:18874598
  71. 71. JASP Team. JASP (Version 0.16.4, Intel) [Computer software]. 2022.
  72. 72. Jeffreys H. Theory of probability. 3rd ed. Oxford Uk: Oxford University Press; 1961.
  73. 73. Wagenmakers E-J, Love J, Marsman M, Jamil T, Ly A, Verhagen J, et al. Bayesian inference for psychology. Part II: Example applications with JASP. Psychon Bull Rev. 2018;25: 58–76. pmid:28685272
  74. 74. Rouder JN, Speckman PL, Sun D, Morey RD, Iverson G. Bayesian t tests for accepting and rejecting the null hypothesis. Psychon Bull Rev. 2009;16: 225–237. pmid:19293088
  75. 75. Russell A. A syndrome of intra-uterine dwarfism recognizable at birth with cranio-facial dysostosis, disproportionately short arms, and other anomalies (5 examples). Proc R Soc Med. 1954;47: 1040–1044. pmid:13237189
  76. 76. Saal HM, Harbison MD, Netchine I. Silver-Russell Syndrome. In: Adam MP, Ardinger HH, Pagon RA, Wallace SE, Bean LJH, Stephens K, et al., editors. GeneReviews®. 2019. Available: http://www.ncbi.nlm.nih.gov/books/NBK1324/
  77. 77. Swillen A, McDonald-McGinn D. Developmental trajectories in 22q11.2 deletion syndrome. Am J Med Genet C Semin Med Genet. 2015;169: 172–181. pmid:25989227
  78. 78. Takenouchi T, Awazu M, Eggermann T, Kosaki K. Adult phenotype of Russell-Silver syndrome: A molecular support for Barker-Brenner’s theory: Adults with Russell-Silver syndrome. Congenit Anom. 2015;55: 167–169. pmid:25639378
  79. 79. McCrimmon RJ, Ryan CM, Frier BM. Diabetes and cognitive dysfunction. The Lancet. 2012;379: 2291–2299. pmid:22683129
  80. 80. Roy S, Kim N, Desai A, Komaragiri M, Jassil N, Khan M, et al. Cognitive function and control of type 2 diabetes mellitus in young adults. North Am J Med Sci. 2015;7: 220. pmid:26110134
  81. 81. Chai WJ, Abd Hamid AI, Abdullah JM. Working Memory From the Psychological and Neurosciences Perspectives: A Review. Front Psychol. 2018;9: 401. pmid:29636715
  82. 82. Braver TS, Cohen JD, Nystrom LE, Jonides J, Smith EE, Noll DC. A Parametric Study of Prefrontal Cortex Involvement in Human Working Memory. NeuroImage. 1997;5: 49–62. pmid:9038284
  83. 83. Corsi PM. Human memory and the medial temporal region of the brain. Diss Abstr Int. 1973;34: 891.
  84. 84. Milner B. Interhemispheric differences in the localization of psychological processes in man. Br Med Bull. 1971;27: 272–277. pmid:4937273
  85. 85. Robertson IH, Ward T, Ridgeway V, Nimmo-Smith IJSA. The test of everyday attention (TEA). Thames Valley Test Company; 1994.
  86. 86. Shallice T. Specific impairments of planning. Philos Trans R Soc Lond B Biol Sci. 1982;298: 199–209. pmid:6125971
  87. 87. Norris G, Tate RL. The Behavioural Assessment of the Dysexecutive Syndrome (BADS): Ecological, Concurrent and Construct Validity. Neuropsychol Rehabil. 2000;10: 33–45.
  88. 88. Wilson BA, Alderman N, Burgess PW, Emslie H, Evans J. Behavioural assessment of the dysexecutive syndrome. Thames Valley Test Company; 1996.