To assess the cognitive and behavioral aspects of executive functioning (EF) and learning skills in extremely preterm (EPT) children compared with term control children aged 10 to 15 years.
A total of 132 of 134 (98% of all eligible survivors) EPT children born at the 2 Swedish regional tertiary care centers from 1992 to 1998 (mean age = 12 years, mean birth weight = 718 g, and mean gestational age = 24.4 weeks) and 103 matched term controls were assessed. General intelligence was assessed using the Wechsler Intelligence Scale for Children (WISC-III-R), and cognitive aspects of EF were analyzed using EF-sensitive subscales of the WISC-III-R and Tower test of the Delis-Kaplan Executive Function Scale (D-KEFS). Behaviors related to EF and learning skills were assessed using the Five to Fifteen questionnaire, which is a validated parent and teacher instrument. Academic performance in school was assessed by teachers’ responses on Achenbach’s Teachers Report Form. Analyses performed included multivariate analyses of covariance (ANCOVA and MANCOVA) and logistic regression analyses.
The EPT children displayed significant deficits in cognitive aspects of EF compared with the controls, exhibiting decreases on the order of 0.9 SD to 1.2 SD for tasks of verbal conceptual reasoning, verbal and non-verbal working memory, processing speed and planning ability (P <0.001 for all). After excluding the children with major neurosensory impairment (NSI) or a Full Scale intelligence quotient (FSIQ) of < 70, significant differences were observed on all tests. Compared with controls, parents and teachers of EPT children reported significantly more EF-related behavioral problems. MANCOVA of teacher-reported learning skills in children with FSIQ >70 and without major NSI revealed no interactions, but significant main effects were observed for the behavioral composite executive function score, group status (EPT vs control) and FSIQ, for which all effect sizes were medium to large. The corresponding findings of MANCOVA of the parent-reported learning skills were very similar. According to the teachers’ ratings, the EPT children were less well adjusted to the school environment.
EPT children born in the 1990s who received active perinatal care are at an increased risk of executive dysfunction, even after excluding children with significant neurodevelopmental disabilities. Even mild to moderate executive dysfunctions has a significant impact on learning skills. These findings suggest the need for timely interventions that address specific cognitive vulnerabilities and executive dysfunctions.
Citation: Farooqi A, Adamsson M, Serenius F, Hägglöf B (2016) Executive Functioning and Learning Skills of Adolescent Children Born at Fewer than 26 Weeks of Gestation. PLoS ONE 11(3): e0151819. https://doi.org/10.1371/journal.pone.0151819
Editor: Frederic Dick, Birkbeck College, UNITED KINGDOM
Received: June 14, 2015; Accepted: March 6, 2016; Published: March 21, 2016
Copyright: © 2016 Farooqi et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper.
Funding: The work was was funded by the ALF - Vasterbotten, jointly funded by Umea univesrity and Vastebotten county council, Sweden, grant no. ALF -VLL 67971 (agreement concerning reasearch and education of doctors), and Jerringfonden. The funders had no role in study design, data collection and analysis, or decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Active perinatal care and advances made in the intensive care of extremely preterm infants (EPT, ≤ 25 gestational weeks) have markedly improved survival and lowered the gestational age of viability [1–3]. While over the past two decades the prevalence of severe neurodevelopmental disabilities has remained relatively stable [4,5], there is growing concern that many school-aged children who are born extremely premature with overall intelligence within the normal range have an increased risk of mild to moderate neurocognitive deficits, such as motor impairments, academic underachievement, and behavioral problems . These “low severity/high prevalence” dysfunctions  may occur in more than 40% of EPT children , but long-term outcome studies in the early adolescence of children born EPT are rare [9–11], especially for infants born after active perinatal care.
There is evidence of impairment in executive functioning (EF) in EPT children of elementary or middle school age [12–18]. EF has been considered to be of the crucial processes related to academic and behavioral problems in preterm or EPT children [19–24]. A commonly used definition of EF refers to interrelated neurocognitive processes that are important for purposeful, goal-directed behavior . There is an ongoing debate on whether EF is a unitary construct or whether it is a set of different functions. In a developmental perspective, three major components of EF have been described, namely inhibition, working memory and shifting . EF gradually develops during childhood and adolescence. The ability to inhibit and control cognitive, behavioral and emotional stimuli and processes is considered by some as fundamental for EF. Working memory is the ability to maintain and interpret information over the short term, and shifting involves the ability to shift between mental states, rules, or tasks, generating different solutions for a problem, and developing strategies to reach a goal .
The aim of this study was threefold: 1) to examine the nature, frequency and severity of impairments in executive functions and learning skills in EPT children (mean age of 12 years) who were born at 25 weeks of gestation or fewer in the 1990s and received active perinatal care; 2) to assess whether differences in EF and learning skills are present among EPT children without major neurosensory impairment (NSI) and with a full-scale intelligence quotient (FSIQ) of above -2 SD; and 3) to evaluate the relationships of EF with learning skills and academic attainment. We hypothesized that EPT children have impairments in EF and that mild to moderate deficits have a significant impact on learning skills.
Participants and procedure for recruitment
The study population included survivors among infants born at 23–25 weeks of gestation at the university hospitals of Uppsala and Umea in Sweden between January 1992 and December 1998. These two University hospitals are perinatal referral centers in the northern region of Sweden, with neonatal intensive care units serving the Uppsala region and the northern region of Sweden. During the study period, a total of 261 infants were born at 23–25 weeks of gestation. Of these 261 infants, 213 were born alive at the University hospitals of Umeå and Uppsala. Of these 213, 140 survived to be discharged home. All EPT (23–25 weeks) infants born during the study period were given life support at birth. There were no delivery room deaths, and the survival to discharge home was 66% in this cohort . The short-term outcomes of this cohort have been published previously in a few reports [3,28]. The identification of EPT subjects and other methodological details have been presented elsewhere  and will be briefly repeated here. Of the 140 infants who survived after being discharged home, 6 (4.5%) died in the post-neonatal period, with all deaths occurring in the first year of life. In total, 134 infants were identified at 10 to 15 years of age. All of these individuals were eligible for our study. Two children/families refused to participate. At a mean age of 12 years (range 10.1–15.9 years), 132 of 134 survivors (98%) were available for assessment.
Written informed consent was obtained from the caretakers. In cases involving two caretakers, which were commonly encountered, both caretakers had to give their written consent for their child’s participation in the study. An information letter was sent to the children along with a letter to the caretakers asking for their permission to participate in the study. Once the EPT and control families consented to participate in the study, they were contacted by the research coordinator, who explained the assessment and filled out questionnaires. With the parents’ permission, questionnaires were sent to the child's class teacher along with a letter with the relevant instructions for filling out the questionnaires. Questionnaires from all respondents were returned to the study coordinator at the University of Umeå. Two reminders were sent to non-respondents, and when possible, an approach was also made by telephone. Missing data from the returned questionnaires were followed up on in the same way.
The control group was recruited from the national Swedish birth register by selecting a term child of normal birth weight born at the same hospital as and at the closest time (± 7 days) to an EPT child. Six matched control participants were identified for each EPT child, and the parents of the first child on the list were approached. If participation was declined, then the parents of the second child were then approached, and if necessary, additional parents were approached until a control participant agreed to participate or until the pool of 6 children was depleted. The recruitment of controls was a difficult process, which is why only 103 (78%) control children were recruited as opposed to one control for each EPT child as initially planned. The control group was approached and examined in a manner identical to that of the index group.
This study was approved by the Ethical Review Board of Umeå (ERB), SE 90187, Sweden. Umeå ERB is one of six institutional review boards in Sweden. According to the ethical practice and rules of the ERB system in Sweden, the following documents were approved before initiation of the study: the information letters to the parents, children and teachers, the consent forms and research plan, all questionnaires used in the study, the CVs of the researchers and approval certificates from the heads of the clinical departments and from heads of the University clinics (Institute of Clinical Sciences, Department of Pediatrics and Department of Child and Adolescent Psychiatry, Umeå, Sweden). All consent forms are kept together at the University Hospital of Umeå (Umeå University) under the code key of the study.
The subjects were seen for a half-day session by trained psychologists. These assessors were unaware of the neonatal courses of the children.
EF is a multidimensional construct involving elements that are cognitive and behavioral in nature. Cognitive elements of EF were assessed by a battery of tests sensitive to specific executive functions [30,31]. In addition, parents and the teachers of participants filled out the questionnaires regarding the behaviors related to EF and learning skills [32,33], and teachers filled out an additional questionnaire (Achenbach’s Teacher Report Form (TRF)) to assess the child’s adaptive functioning, including academic performance .
The Wechsler Intelligence Scale for Children (WISC-III-R), Swedish edition (Wechsler 1999) , was used to assess general intelligence. The 13 core subsets were administered and combined to determine the FSIQ.
Cognitive assessment of EF
We selected 6 core subtests from the WISC-III-R  that have been shown to be related to EF, namely Similarities, Digit span, Block design, Picture arrangement, Coding, and Arithmetic. These subtests adequately assess the 3 fundamental cognitive aspects of EF: inhibition, working memory and shifting strategy . We briefly describe these 3 cognitive aspects of EF according to the model proposed by Best and Miller  as follows.
Inhibition refers to the ability to resist impulses to engage in extraneous behavior. Children with difficulties in inhibition have impaired impulse control and often initiate tasks without listening to instructions (e.g., Attention Deficit /Hyperactivity (ADHD) children)). They typically score poorly on the similarities subtest (31)
Working memory relates to the ability to actively retain information in the mind during the time that it takes to simultaneously implement a complex cognitive task. The Coding, Arithmetic and Digit span subtests  capture these executive abilities
Shifting refers to the ability to initiate a goal-directed behavior, i.e., the production of ideas and the shaping of strategies. The child initiates an activity or several activities to achieve a target goal, and flexibility is required to effectively change and adapt to reach the goal. This flexibility requires good planning skills. The Block design and Picture arrangement subtests  assess the cognitive ability of shifting.
WISC-III-R subtests assessing cognitive aspects of EF
The Similarities subtest assesses verbal conceptual reasoning, which refers to the ability to identify the concept(s) linking words or themes. In this test, the participant is presented with a series of word pairs (e.g., wheel/ball, telephone/radio, or ice/steam), and she or he must identify and explain the common link between each word pair. Each response is scored 2-1-0 according to the quality of the response.
The Digit span subtest assesses verbal memory, which is the ability to store and process verbal information (auditory memory). It has 2 parts: forward digit span, in which the participant is required to repeat verbatim a given series of numbers, and backward digit span, in which the child is asked to repeat a sequence of numbers in the reverse direction. The number sequences increase from 2 to 9 digits for each sequence. The test is stopped when the child fails both trials of a sequence length.
The Coding subtest is a measure of processing speed that assesses concentration, working memory and visual motor coordination. It requires good eye-hand coordination. In this test, the child transcribes a digit-symbol code. The task is time-limited, with bonuses given for speed.
The Arithmetic subtest assesses the ability to focus attention on a task, short-term memory, the ability to perform simple calculations, and freedom from distraction.
The Block design subtest assesses spatial conceptualization, perceptual organizational ability, and nonverbal reasoning skills. The child is asked to create specific 2-dimensional geometric designs using colored blocks (cubes). This test consists of 12 designs, each with an increasing number of geometric cubes with increasing difficulty, and it is discontinued after 2 failures. Each design has a time limit and bonus points.
The Picture arrangement subtest assesses visual reasoning and logical thinking and involves the identification of a sequence of steps necessary to attain a specific goal. It consists of 14 scenarios in which the child is presented with a set of colorful pictures in a mixed-up order that requires rearrangement into a logical story.
Tower test of Delis-Kaplan Executive Function Scale (D-KEFS)
The D-KEFS Tower test  requires multiple fundamental cognitive skills and higher-level executive functions. Key fundamental abilities measured by this test include visual attention and visual spatial skills. Executive functions assessed by this test include the following:
Spatial planning, or the ability to mentally visualize the outcome of making 2 or moves before they are made;
Rule learning, or the ability to acquire heuristic strategies for building towers using the fewest numbers of moves possible (e.g., the ability to learn the best method for clearing a small disk off of a peg to place a bigger disk on the peg);
Inhibition, or the ability to refrain from impulsive behavior and to use trial and error to formulate spatial plans or to learn effective problem-solving strategies; and
Establishing and maintaining cognitive set, or the capacity to learn the instructional rules to perform a task and to apply those rules consistently while solving each problem.
The overall performance on all the above-mentioned tests for the cognitive components of EF (Similarities, Block design, Picture arrangement, Arithmetic, Coding, and D-KEFS Tower test) was judged according to the age-standard scores, with a mean of 10 (SD: 3).
Behaviors related to EF
To assess the behavioral parameters related to EF, we used the following parts of the parent and teacher Five to Fifteen (FTF) questionnaire [32,33] that assess the attention, hyperactivity/impulsivity, hypoactivity, and planning/organizing subdomains as well as the working memory domain: 1) Attention (9 items), which assesses the ability to pay attention and to concentrate on various tasks and activities; 2) Hyperactivity/impulsivity (9 items), which assesses the tendency to become too active and includes terms such as ‘fidgets with hands or feet’ and ‘often interrupts or intrudes on others’; 3) Hypoactivity (4 items), which refers to the tendency to become too passive and includes terms such as ‘difficulty getting started’ and ‘seems slow, inert or lacking energy’; 3) Planning/organizing (3 items), which assesses items related to the ability to plan and organize and includes terms such as ‘difficulty understanding consequences of own actions’, ‘difficulty planning and preparing for tasks’ and ‘difficulty completing sequential tasks’; and 4) Working memory (11 items), which contains statements mainly pertaining to short-term memory. All items of the EF subdomains for the attention, impulsivity/hyperactivity, hypoactivity, planning/organizing and working memory domains of the parent and teacher FTF were collapsed into a primary Executive Function Composite Score (EFCS) domain.
The learning skills domain of the teacher and parent FTF  assesses responses to 29 items related to the child’s learning ability in school subjects, such as math, reading and writing, as well as responses to items related to daily learning ability and coping in learning. The learning skills domain is further organized into 4 subdomains: reading/writing (8 items), math (5 items), general learning (6 items) and coping in learning (10 items). All FTF items are scored as 0, 1 or 2, representing ‘does not apply’ (0), ‘applies sometimes/to some extent’ (1), or ‘definitely applies’ (2). For each domain or subdomain, a mean score of 0–2 was calculated. We converted mean domain/subdomain scores of the parent FTF to z scores (SDSs, standard deviation scores) in relation to the scores for the Swedish age- and gender-specific reference population. Swedish reference normative values for calculating z scores for teacher FTF scales were not available; therefore, we computed z scores for teacher FTF scales relative to the mean scores for control subjects of the same gender. Impairments in individual components/domains of EF and learning skills were defined in terms of SDs that were 2 SD (> 95th percentile) greater than the normative mean in the parent FTF or 2 SD above the mean z scores for the controls in the teacher FTF, corresponding to clinically significant difficulties.
Adaptive functioning in school (teacher report).
Assessments of academic performance and adaptive functioning at school were based on the TRF described by Achenbach . Teachers provided responses to the following 5 items on adaptive functioning that measured the child’s performance in academic subjects and 4 adaptive characteristics: ‘How hard is she or he working?’; ‘How appropriately is she or he behaving?’; ‘How much is she or he learning daily?’; and ‘How happy is the pupil?’
Sociodemographic characteristics, including variables such as the parents’ education level, the family’s disposable income and family structure, were assessed by the Nordic Health and Family Questionnaire . The composite social risk index included maternal education (0 for high school or above and 1 for 9 or fewer years of schooling), family structure (0 for a 2-parent family and 1 for a single-parent family) and family income (0 for high and 1 for low income). The methods used for identification and characterization of NSI, major disability and chronic conditions (NSI and medical or psychiatric illness) in the survivors have been previously described [29,36]. Major NSI was defined as 1 or more of the following: moderate or disabling cerebral palsy (CP); severe visual impairment, including visual acuity < 20/200 without glasses in the best eye or registration at low-vision centers; severe auditory impairment in both ears that could not be corrected with a hearing aid; and hearing loss corrected partially or fully with a hearing aid or an implant. Chronic conditions were defined as NSI and medical or psychiatric illnesses with a duration of 12 months or longer.
Data were collected on standardized forms and encoded for computerized analysis using Windows SPSS 22.0 (SPSS, Chicago, IL). The assessment data for each EI child were examined before they were combined with the data set from 2 previous main studies [3,28] for analysis. Chi-square or Fisher’s exact test for dichotomous outcomes and unpaired t-tests for continuous variables were used. Univariate analysis of covariance (ANCOVA) was performed to examine differences between the groups in 1) cognitive components of EF (Similarities, Block design, Picture arrangement, Arithmetic, Coding, and Tower test, and Tower test), 2) the 5 individual domains of behaviors related to EF, 3) adaptive functioning in school, and 4) academic performance. The independent variables in all ANCOVAs were group status (EPT versus control) and gender. Composite social risk score and the mother’s country of birth were entered as covariates. We also performed multivariate analyses of covariance (MANCOVA) to test differences in learning skills between the EPT and control children with FSIQ greater than > 70 (≥ 2 SD above the mean for the normal population according to WISC-III) (31). The independent variables were group status (EPT vs control) and gender, and the outcome variables were each of the 4 subdomains of the learning skills (i.e., reading and writing, math, general learning, and coping in learning) in the parent and teacher FTF. The covariates included in the model were the EFCS, the composite social risk index and FSIQ. MANCOVAs of parent- and teacher-reported learning skills were carried out separately. The effect size (ES) is given by the partial eta-squared statistic, which describes the proportion of total variability attributable to a factor or covariate (the proportion that if multiplied by 100, is the percentage of total variability due to group differences). All significant MANCOVA and ANCOVA effects were interpreted using Cohen’s criteria for ES, where effects are deemed small, medium and large if they account for 1–5.8%, 5.9–13.8% and > 13.8% of variance, respectively . Multivariate logistic regression (MVLR) analyses were carried out to examine differences in the categorical outcomes between the groups after making adjustments for important explanatory variables, namely sex, composite social risk, and the mother’s country of origin. P-values < 0.05 were considered significant.
The mean age of assessment for EPT children was 12 (SD: 1.7; range: 10.1–15.6) years, and it was 12.1 (SD: 1.9; range: 10.3–15.9) years for controls. Sociodemographic characteristics collected at the time of the present assessment were similar in the two groups, except that the percentage of mothers of EPT children with an education ≤ 9 years was significantly greater compared with the control group (14% vs 4%, P = 0.04) (Table 1). The EPT children had a mean (SD) birth weight of 718 g (129) and gestational age of 24.4 (0.7) weeks. Fifty-one EPT children (38.6%) had bronchopulmonary dysplasia (BPD); 22 (16.7%) had severe (stage ≥ 3) retinopathy of prematurity; and 9 (6.8%) had grade III-IV intraventricular hemorrhage, periventricular leukomalacia or hydrocephalus with shunt. At the mean age of 12 years, 22 EPT children compared to none in the control group (χ2 = 18.9, P < 0.001) had one or more NSI. The corresponding rates of major NSI were 12.9% vs 0 (χ2 = 14.3, P < 0.001). The rates of one or more chronic conditions, including NSI or another medical or psychiatric condition, were 53% vs 18.4% (χ2 = 29.4, P < 0.001). Twenty EPT children had a diagnosed psychiatric condition according to DSM-IV compared with 2 in the control group (χ2 = 12.2, P = 0.001). The 2 most common psychiatric diagnoses were ADHD (n = 11 (8.3%)) and autism spectrum disorder (n = 9 (6.8%)).
Cognitive assessment of EF
The EPT children scored significantly lower than the controls on all cognitive parameters of EF, including verbal conceptual reasoning (Similarities, t 226 = -6.7, P < 0.001), verbal working memory (Digit Span, t 224 = -7.4, P < 0.001), attention and visual motor integration (Coding, t 224 = -8.2, P < 0.001), working memory and reasoning ability (Arithmetic, t 226 = -9.0, P 0 < .001), spatial conceptualization (Block design, t 224 = -10.2, P < 0.001), processing speed, visual reasoning (Picture arrangement t 223 = -6.9, P < 0.001), and planning ability (Tower test, t 224 = -6.8, P < 0.001) (Table 2). The EPT cohort performed well below the controls; however, the majority of the children were within the normal range. ANCOVAs revealed that significant differences persisted in all cognitive measures of EF between EPT and control subjects when adjustments were made for social risk factors (composite social risk index), the mother’s country of origin and gender. These statistical conclusions did not change when the analyses were carried out in the children with an FSIQ greater than 70 and without major NSIs. However, the magnitude of difference between the groups was narrowed in all cognitive parameters of EF (range 0.66 SD to 1.2 SD) (Table 2). Although social risk was associated with the number of cognitive components of EF, it had a small effect (4–5%) compared to group status, i.e., being EPT (16–31%), in the total population and a medium to large effects (10%–28%) in the children without major NSI and FSIQ > 70 (Table 2). MVLR revealed that EPT children compared to controls had significantly greater clinically significant deficits in all the cognitive areas sensitive to EF when adjustments were made for social risk, gender and the mother’s country of birth (Table 3). When MVLR was carried out on a subgroup of EPT and control children with FSIQ > 70 and without major NSIs, the rates of clinically significant problems (≤ 2 SD) remained significantly higher in 4 areas of EF, including processing speed, non-verbal memory (Coding, 8% vs 2%, AOR, 5.5,P = 0.03), working memory, reasoning ability, attention and distractibility (Arithmetic, 13% vs 2%, AOR, 7.9, P = 0.008), spatial conceptualization (Block Design, 14% vs 0, P < 0.001), and planning ability (Tower test, 7% vs 0%, P = 0.007) (Table 3).
Behavioral parameters related to EF by group and by evaluation source
A high level of reliability was noted in the analyses of behaviors related to EF, working memory, and learning skill domains, as well as in the subdomain scores in teacher and parent FTF. Cronbach’s alpha for the domain scores (items) in the teacher and parent FTF, respectively, were 0.96 and 0.95 for the executive function domain, 0.96 and 0.97 for the learning skills domains, and 0.93 and 0.94 for the memory domain. The correlations between the subdomain scores from teacher and parent FTF ranged from r = 0.52–0.81 and r = 42–0.78, respectively. Most of the subdomain scores of the teacher and parent FTF moderately correlated with one another, with r values between 0.34 and 0.82 (all rs, P < 0.001). The correlations between the scores for the cognitive aspects of EF (Similarities, Digit span, Block design, Picture arrangement, Coding, Arithmetic and Tower test) and the executive function composite score (EFCS) from the parent and teacher FTF ranged from r = 0.40–0.48 and from r = 0.45–0.55, respectively (all rs P <0.001), indicating moderate correlations between the cognitive aspects of EF and behaviorally defined EF.
Behavioral parameters related to EF.
The mean raw EFCS scores were significantly higher in EPT children compared with the controls, indicating an increased risk for executive dysfunctions (t = 6.7, P < 0.001 for parent FTF and t = 4.74, P < 0.001 for the teacher FTF). Compared to the controls and according to both the parent and teacher reports, EPT children had significantly higher mean scores for all 5 individual behavior subdomains related to EF indicating an increased risk for problems with these behaviors (Table 4). The ANCOVA revealed that the significant differences persisted between the EPT and control groups after adjusting for social risk factors (composite social risk index), gender and maternal country of birth (Nordic vs non-Nordic). Although the magnitude of the difference between the groups decreased, the statistical conclusion was not altered when ANCOVA was carried out in a subgroup of EPT and control children with FSIQ > 70 and without major NSIs (Table 2), indicating the persistence of a higher risk for behavioral problems related to EF in EPT children. Social risk was associated with a number of behaviors related to FTF; however, they represented small effects (4% to 5%). Compared with those of controls, parents and teachers of EPT children were more likely to rate their child as scoring in the clinical range (> 2 SD) for a number of individual subdomains of behaviors related to EF (Table 4). The teacher-reported rates of clinically significant problems among total and NSI-free EPT children with FSIQ > 70, respectively, were for attention, 26% (AOR 5.6, P < 0.001) and 18% (AOR 4.2, P = 0.007); for hypoactivity, 20% (AOR 5.0, P = 0.002) and 16% (AOR 6.3,P = 0.005); for planning and organizing, 26% (OR 8.6, P < 0.001) and 16% (OR 6.7, P = 0.004); and for working memory, 27% (AOR 9.6, P < 0.001) and 16% (AOR 9.9,P = 0.003) (Table 4). Conversely, teachers did not rate EPT children as significantly different in hyperactivity/impulsivity behaviors related to EF.
Adaptive functioning in school
On the TRF scale that assessed academic performance in children with FSIQ > 70 and without major NSI, EPT children had significantly poorer scores than control participants (mean difference, -0.67, t 190 = -7.2, P < 0.001) (Table 5). ANCOVA revealed that the group status (prematurity) had a large effect, accounting for 21% of the variance, indicating that prematurity was strongly associated with poor academic performance. None of the other covariates were associated with the academic performance of either EPT or control children. Furthermore, the EPT children had significantly poorer scores than the control children with respect to TRF ratings of total adaptive function, which was computed by summing ratings for 4 adaptive characteristics (t 190 = -5.5, mean diff, -2.94, P < 0.001) (Table 5). In the domain of ‘how satisfied and happy a child is’ the two groups were not rated differently. There were no significant interactions between gender and group regarding these variables.
We compared EPT children and controls (EPT 98; control, 99) with FSIQ > 70 regarding the four subdomains of learning skills. According to both parent and teacher FTF, the EPT cohort had significantly higher scores in all subdomains of learning skills, indicating an increased risk of learning problems in reading/writing, math, general learning and coping in learning (Table 6). ANCOVA revealed that significant differences persisted between the two groups when adjustments were made for composite social risk, gender and mothers’ country of birth (Nordic vs non-Nordic). Group status (prematurity) had a medium to large effect (range, 10% to 24% in teacher FTF and 6% to 23% in parent FTF) (Table 5). As shown in Table 6, according to teacher FTF, the EPT cohort with FSIQ >70 and without major NSIs was at a significantly increased risk of having clinically significant problems in math (37% vs 6%, AOR, 8.8, P < 0.001), reading/writing (17% vs 6%, AOR 3.6, P = 0.012), general learning (15% vs 1%, AOR 18.2, P = 0.006) and coping in learning (25% vs 5%, AOR 6.3, P < 0.001). Parents rated learning problems similarly, but the proportion of EPT children with clinically significant problems in all 4 learning skills domains was lower than that in the teacher reports. The most prevalent learning problem was in math according to both teacher and parent reports. In a separate analysis carried out in children with FSIQ > 85 and without major NSI, the EPT children still had clinically significant problems in math (16% vs 2%; AOR, 7.9, P < 0.001).
MANCOVA effects by teacher report (FTF)
The 2 (group status) x 2 (gender) MANCOVA of 4 teacher FTF learning scales revealed significant multivariate effects of EFCS ([Wilks λ = 0.41], F4,176 = 64.0, P < 0.001, ES = 59%); group status (prematurity vs control) ([Wilks λ] = 0.90, F4,176 = 5.1, P = 0.001, ES,10%); and FSIQ ([Wilks λ = 0.93], F4,176 = 3.4, P = 0.01, ES = 7%).
MANCOVA effects by parent report (FTF)
As with the teacher report, MANCOVA of the parent FTF learning scales revealed similar effects of EFCS ([Wilks λ] = 0.47, F4,179 = 50.1, P < 0.001, ES,53%); group status (prematurity vs control) ([Wilks λ] = 0.95, F4,179 = 4.5, P = 0.003, ES 7%); and FSIQ ([Wilks λ] = 0.89, F4,179 = 5.3, P < 0.001, ES,11%). No interactions emerged in the MANCOVA of parent and teacher reports. These analyses indicated that in the study of children without significant NSI and a normal or low to normal IQ, executive dysfunctions had a strong association with learning problems in school, and these effects were mediated independently beyond the FSIQ.
In this study, relying on measures that assessed cognitive faculties sensitive to EF and relying on teachers and parents’ behavioral ratings related to EF, the EPT children in their early adolescence had a significantly increased risk for problems in measures of executive function, even those without significant NSI and with a normal or low-normal overall intelligence.
Our study focused on the cognitive assessment of EF, including verbal conceptual reasoning, spatial conceptualization, working memory, attention, planning and organizational ability. The EPT children exhibited impairments in all of these EF measures. The magnitude of mean differences between the EPT children and controls averaged to 1.1 SD for cognitive parameters (0.9–1.16 SD) in the total population. However, the group means of EPT children were generally within the normal or low normal range, and the proportion of EPT children who exhibited clinically significant impairments in the cognitive parameters of EF was relatively small (13–27%). When the children with major NSI and FSIQ < 70 were excluded, a significantly higher number of EPT children with clinically significant impairments remained, selectively in the cognitive areas sensitive to EF, such as spatial conceptualization, working memory, attention, processing speed, and planning ability. Similar to the findings from other studies [12,16,20], our data indicate that deficits over a wide range of EF that have been reported in cohorts of very preterm newborns at elementary and middle school age [12–19] persist into adolescence. It is important to identify in early childhood the cognitive deficits sensitive to EF, as research has shown that mild to moderate deficits in EF have a significant impact on learning skills and scholastic attainment [10,19,20,23,24]. Impairments in EF translate into behavioral difficulties in school and at home as reported by parents and teachers [12,16,18,39]. In our EPT cohort, both parents’ and teachers’ ratings displayed a significantly increased risk for behavioral problems related to EF. A significantly higher proportion of EPT children compared with controls displayed clinically significant difficulties in attention, hypoactivity, planning/organizing and working memory. Conversely, parents but not teachers reported increased rates of clinically significant hyperactivity/impulsive behavior in the EPT group compared to controls, a finding similar to those in other studies [18,39–41]. This result is not surprising, as each rater can provide important and different information on a child’s behavior because perceptions and interpretations of behavior vary and may be valid reflections of the child’s behavior in different contexts [42–44]. As in other research [12,18,20], our findings suggest that EPT children without significant NSI and with FSIQ in the normal range have an increased risk for mild to moderate problems in behaviors related to EF. This outcome affects learning skills and academic attainment (see later discussion). It is concerning that the children who exhibit mild or moderate problems are less likely to arouse parental or teacher concerns, to be referred for assessment and to receive specialist assistance at the appropriate time.
The overall findings in our study were robust, and they were not affected when adjusting for important socioeconomic variables, gender, and maternal ethnicity. Likewise, statistical conclusions were largely unaltered when children with major NSI and FSIQ < 70 were excluded from the analyses. The correlational (univariate) analyses (data not shown) revealed that gestational age and birth weight were weakly correlated with EF parameters, both behavioral and cognitive, indicating that other factors must affect the outcomes. It is noteworthy that the cognitive deficits exhibited by our EPT cohort were not specific to EF. When compared with the control group, EPT children had deficits in nonexecutive skills, such as general knowledge (information subtest, mean difference, -2.5; 95% CI: -3.3 to -1.8), vocabulary (vocabulary subtest: -2.1; 95% CI: -2.8 to -1.3), and visual reasoning (picture completion subtest: mean difference: -2.4; 95% CI -3.3 to -1.6). Thus, commensurate with other studies [6,7,13,16,40,45,46], EPT children were at an increased risk for impairment across a range of cognitive faculties, not only those that were sensitive to EF. The cognitive and educational problems in EPT children are thought to be associated with several risk factors, such as brain injury (periventricular leukomalacia) , disruptions in the cortical development in the absence of concomitant biomedical risk , nutritional problems, metabolic complications in the neonatal period and environmental stresses . It is not clearly understood whether executive dysfunctions in EI children are a primary deficit or secondary to deficits in the other cognitive domains, and this knowledge gap may be better resolved with neuroimaging studies.
We did not control for IQ in analysis of the group differences in the cognitive aspects of EF or in the behaviors related to EF. However, we did control for IQ in multivariate analyses of learning skills in the children with FSIQ >70 and in those without major NSI. An important limitation of analyses of IQ-adjusted scores is that the demands of specific measures such as executive functions may be similar in some of the subsets contributing to IQ. In addition, it has been argued that controlling for IQ when assessing group differences in scores for EF measures and motor ability removes the very same variance that one is interested in studying, resulting in decreased power for detecting group differences . Thus, using IQ as a matching variable or covariate may produce overcorrected, anomalous, and counterintuitive findings regarding neurocognitive functions .
We examined the differences in learning skills between EPT and control children with FSIQ > 70 and without major NSIs. In the multivariate models, we controlled for important variables, such as EFCS, FSIQ, gender, social risk factors, and mothers’ country of birth. Although group status and FSIQ were independently related to an increased risk for learning problems, EFCS, which is a composite measure of behaviors related to EF, had a much stronger effect explaining 53% and 59% of the variance according to teacher and parent reports, respectively. Based on these findings, we can reasonably conclude that 1) mild to moderate problems in the behaviors related to EF have a negative impact on learning skills and 2) these large effects are mediated beyond IQ. The most prevalent difficulty was observed in math, according to teacher reports (37%) and parent reports (17%), in EPT children with FSIQ > 70. Even in a subgroup of children with normal IQs of > 85, these rates were 16% vs 2% (AOR 7.9, 95% CI 1, 4–42, 9, P < 0.001) according to teacher ratings. This finding is consistent across studies that have shown that problems in math are independent of FSIQ [23,43,46,52–54]. Few studies have identified EF as a set of skills for achievement in math in extremely or very preterm children [17,20,55,56]. As discussed earlier, in the EPT cohort, even children with intelligence in the normal or lower normal range and without major NSI had increased risk for deficits in spatial conceptualization, planning/organizing and verbal/spatial memory. These are the cognitive areas that have been linked to domain general predictors of math difficulty in preterm children [17,20,24]. In an attempt to specify the area of deficit in math skills, very few studies have suggested an association with one of the domain-specific predictors of math skills, namely basic numerical processing [57–60]. However, the results are conflicting . More research is needed to examine the role of specific predictors, particularly in combination with general predictors in relation to mathematical skills.
There are some limitations of this study that affect the generalizability of our findings. First, our study is not population-based, and it reflects the practices of 2 perinatal referral centers that have had consistent policies of active perinatal care since the beginning of the 1990s . However, 82% of all EPT children born alive in the 2 northern regions during the study period were born at these 2 centers, indicating a very high degree of centralization [3,28]. Second, the use of other specific tests of EF would have added substantial information. However, we had to make a selection of methods, and we assumed that the addition of behavioral correlates to EF would further strengthen the study. Our data supports this assumption by demonstrating significant correlations between the cognitive aspects of EF and behaviorally defined EF. Third, the parents and teachers were not blinded to the group status when answering the FTF and TRF. However, the psychometric properties of these questionnaires have been shown to be good .
The important strengths of this study are the very high rate of follow-up (98% of all survivors), the use of a relevant control group, and the acquisition of information on the study children’s daily functioning from both parents and teachers. A further strength of the study is that we used a valid instrument focusing on behavioral problems related to EF and learning skills. The FTF questionnaire has been in use for almost a decade in Scandinavian countries for both clinical and research applications. The parts of the FTF that assess fine motor skills, EF, perception and language correlate significantly with the corresponding NEPSY domain scores (A developmental neuropsychological assessment) . The parent FTF has also shown fairly good validity against the WISC-III developmental test .
Adolescent children born at the limit of viability have an increased risk of impairments in their executive functions and behaviors related to them. Deficits in EF remain, even in children with low normal or normal intelligence and without major NSIs, which partly explains their lower scholastic attainment and deficient learning skills. Neuroimaging techniques will make it possible to identify the underlying executive processes in EPT children. This approach may allow for exploring the interventions needed for the development of compensatory functional circuitry. Knowledge of the course of neuropsychological impairments, including EF in early childhood and beyond, is crucial in identifying the need for intervention strategies. Another important implication of studies similar to ours is that there is an urgent need to convey this information to stakeholders, i.e., parents, caretakers and teachers, so that children requiring referrals, diagnostic procedures and interventions are picked up early in the course. Thus, a long-drawn negative developmental cascade on learning may be moderated or prevented.
We sincerely thank the children, their families and their teachers, who did an incredible job completing many forms with enduring patience and generously giving up their valuable time for interviews and examinations. We appreciate the dedicated work of our research nurse Margareta Backman (Umea) and project coordinator Nighat Farooqi (Umea).
Conceived and designed the experiments: AF MA FS BH. Analyzed the data: AF MA FS BH. Contributed reagents/materials/analysis tools: AF BH FS. Wrote the paper: AF FS BH.
- 1. The EXPRESS Group, Fellman V, Hellström-Westas L, Norman M, Westgren M. One-year survival of extremely preterm infants after active perinatal care in Sweden. JAMA. 2009;301: 2225–2233. pmid:19491184
- 2. Stoll BJ, Hansen NI, Bell EF, Shankaran S, Laptook AR, Walsh MC, et al. Neonatal outcomes of extremely preterm infants from the NICHD Neonatal Research Network. Pediatr. 2010;126: 443–456.
- 3. Serenius F, Ewald U, Farooqi A, Holmgren PA, Håkansson S, Sedin G. Short-term outcome after active perinatal management at 23–25 weeks of gestation. A study from two Swedish tertiary care centres. Part 2: Infant survival. Acta Paediatr. 2004;93: 1081–1089. pmid:15456200
- 4. Serenius F, Källén K, Blennow M, Ewald U, Fellman V, Holmström G, et al. Neurodevelopmental outcome in extremely preterm infants at 2.5 years after active perinatal care in Sweden. JAMA. 2013;309: 1810–1820. pmid:23632725
- 5. Moore T, Hennessy EM, Myles J, Johnson SJ, Draper ES, Costeloe KL, et al. Neurological and developmental outcome in extremely preterm children born in England in 1995 and 2006: the EPICure studies. BMJ. 2012;345: e7961. pmid:23212880
- 6. Anderson PJ, Doyle LW. Cognitive and educational deficits in children born extremely preterm. Semin Perinatol. 2008;32: 51–58. pmid:18249240
- 7. Aylward GP. Neurodevelopmental outcomes of infants born prematurely. J Dev Behav Pediatr. 2005;26: 427–440. pmid:16344661
- 8. Johnson S, Hollis C, Kochhar P, Hennessy E, Wolke D, Marlow N. Psychiatric disorders in extremely preterm children: longitudinal finding at age 11 years in the EPICure study. J Am Acad Child Adolesc Psychiatry. 2010;49: 453–463. pmid:20431465
- 9. Johnson S, Fawke J, Hennessy E, Rowell V, Thomas S, Wolke D, et al. Neurodevelopmental disability through 11 years of age in children born before 26 weeks of gestation. Pediatrics. 2009;124: e249–e257. pmid:19651566
- 10. Johnson S, Hennessy E, Smith R, Trikic R, Wolke D, Marlow N. Academic attainment and special educational needs in extremely preterm children at 11 years of age: the EPICure study. Arch Dis Child Fetal Neonatal Ed. 2009;94: F283–F289. pmid:19282336
- 11. Hutchinson EA, De Luca CR, Doyle LW, Roberts G, Anderson PJ, Victorian Infant Collaborative Study Group. School-age outcomes of extremely preterm or extremely low birth weight children. Pediatrics. 2013;131: e1053–61. pmid:23509167
- 12. Luu TM, Ment L, Allan W, Schneider K, Vohr BR. Executive and memory function in adolescents born very preterm. Pediatrics. 2011;127: e639–e646. pmid:21300680
- 13. Böhm B, Katz-Salamon M, Institute K, Smedler AC, Lagercrantz H, Forssberg H. Developmental risks and protective factors for influencing cognitive outcome at 5 1/2 years of age in very-low-birthweight children. Dev Med Child Neurol. 2002;44: 508–516. pmid:12206615
- 14. Marlow N, Hennessy EM, Bracewell MA, Wolke D, EPICure Study Group. Motor and executive function at 6 years of age after extremely preterm birth. Pediatr. 2007;120: 793–804.
- 15. Mulder H, Pitchford NJ, Hagger MS, Marlow N. Development of executive function and attention in preterm children: a systematic review. Dev Neuropsychol. 2009;34: 393–421. pmid:20183707
- 16. Anderson PJ, Doyle LW, Victorian Infant Collaborative Study Group. Executive functioning in school-aged children who were born very preterm or with extremely low birth weight in the 1990s. Pediatr. 2004;114: 50–57.
- 17. Aarnoudse-Moens CS, Duivenvoorden HJ, Weisglas-Kuperus N, Van Goudoever JB, Oosterlaan J. The profile of executive function in very preterm children at 4 to 12 years. Dev Med Child Neurol. 2012;54: 247–253. pmid:22126188
- 18. Farooqi A, Hägglöf B, Serenius F. Behaviours related to executive functions and learning skills at 11 years of age after extremely preterm birth: a Swedish national prospective follow-up study. Acta Paediatr. 2013;102: 625–634. pmid:23458380
- 19. Litt J, Taylor HG, Klein N, Hack M. Learning disabilities in children with very low birthweight: prevalence, neuropsychological correlates, and educational interventions. J Learn Disabil. 2005;38: 130–141. pmid:15813595
- 20. Litt JS, Gerry Taylor H, Margevicius S, Schluchter M, Andreias L, Hack M. Academic achievement of adolescents born with extremely low birth weight. Acta Paediatr. 2012;101: 1240–1245. pmid:22812699
- 21. Locascio G, Mahone EM, Eason SH, Cutting LE. Executive dysfunction among children with reading comprehension deficits. J Learn Disabil. 2010;43: 441–454. pmid:20375294
- 22. Mulder H, Pitchford NJ, Marlow N. Processing speed and working memory underlie academic attainment in very preterm children. Arch Dis Child Fetal Neonatal Ed. 2010;95: F267–F272. pmid:20488865
- 23. Simms V, Cragg L, Gilmore C, Marlow N, Johnson S. Mathematics difficulties in children born very preterm: current research and future directions. Arch Dis Child Fetal Neonatal Ed. 2013;98: F457–FF46. pmid:23759519
- 24. Aarnoudse-Moens CSH, Weisglas-Kuperus N, Duivenvoorden HJ, van Goudoever JB, Oosterlaan J. Executive function and IQ predict mathematical and attention problems in very preterm children. PLOS ONE. 2013;8: e55994. pmid:23390558
- 25. Gioia G, Isquith P, Guy S. Assessment of executive functions in children with neurological impairment. In: Simeonsson R, Rosenthal S, editors. Psychological and developmental assessment: children with disabilities and chronic conditions. New York, NY: The Guilford Press; 2001. pp. 317–356.
- 26. Best JR, Miller PH. A developmental perspective on executive function. Child Dev. 2010; 81: 1641–1660.
- 27. Miyake A, Friedman NP, Emerson MJ, Witzki AH, Howerter A, Wager TD. The unity and diversity of executive functions and their contributions to complex "frontal lobe" tasks: A latent variable analysis. Cogn Psychol. 2000;41: 49–100. pmid:10945922
- 28. Serenius F, Ewald U, Farooqi A, Holmgren P, Håkansson S, Sedin G. Short-term outcome after active perinatal management at 23–25 weeks of gestation. A study from two Swedish perinatal centres. Part 3: Neonatal morbidity. Acta Paediatr. 2004;93: 1090–1097. pmid:15456201
- 29. Holsti A, Adamsson M, Hägglöf B, Serenius F, Farooqi A. Neurodevelopmental disabilities at 10–15 years of age in children born at < 26 weeks`gestation after active perinatal care. Submitted.
- 30. Delis CD, Kapklan E, Kramer JH. Delis-Kaplan executive function system. San Antonio, TX: Psychological Corporation; 2001.
- 31. Wechsler D. The Wechsler intelligence scale for children (Swedish version). 3rd ed. Stockholm, Sweden: Psykologiförlaget; 1999.
- 32. Kadesjö B, Janols LO, Korkman M, Mickelsson K, Strand G, Trillingsgaard A, et al. The FTF (five to fifteen): the development of a parent questionnaire for the assessment of ADHD and comorbid conditions. Eur Child Adolesc Psychiatry. 2004;13;Suppl 3: 3–13. pmid:15692877
- 33. The questionnaire: English version. Eur Child Adolesc Psychiatry. [Suppl 3] 13:III/50–III/51 (2004)
- 34. Achenbach TM. Manual for the teachers report form and 1991 profile. Burlington, VT: Department of Psychiatry, University of Vermont; 1991.
- 35. Berntsson L. Health and well-being of children in the five Nordic countries in 1984 and 1996. Doctoral Thesis. Nordic School of Public Health; 2000.
- 36. Holsti A, Adamsson M, Hägglöf B, Farooqi A, Serenius F. Chronic conditions, Functional Limitations, and Special Health Care Needs of 10–15 years of Age in children born at <26 weeks’ of gestation after receiving active perinatal care in the 1990s; Submitted.
- 37. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. New York, NY: Academic Press; 1988.
- 38. Marsál K, Persson P, Larsen T, Lilja H, Selbing A, Sultan B. Intrauterine growth curves based on ultrasonically estimated foetal weights. Acta Paediatr. 1996;85: 843–848. pmid:8819552
- 39. Mulder H, Pitchford NJ, Marlow N. Inattentive behaviour is associated with poor working memory and slow processing speed in very pre-term children in middle childhood. Br J Educ Psychol. 2011;81: 147–160. pmid:21391967
- 40. Anderson P, Doyle LW, Victorian Infant Collaborative Study Group. Neurobehavioral outcomes of school-age children born extremely low birth weight or very preterm in the 1990s. JAMA. 2003;289: 3264–3272. pmid:12824207
- 41. Shum D, Neulinger K, Ocallaghan M, Mohay H. Attentional problems in children born very preterm or with extremely low birth weight at 7–9 years. Arch Clin Neuropsychol. 2008;23: 103–112. pmid:17900856
- 42. Kohen DE, Brooks-Gunn J, McCormick M, Graber JA. Concordance of maternal and teacher ratings of school and behavior problems in children of varying birth weights. J Dev Behav Pediatr. 1997;18: 295–303. pmid:9349972
- 43. Goodman R. The strengths and difficulties questionnaire: A research note. J Child Psychol Psychiatry. 1997;38: 581–586. pmid:9255702
- 44. Crijnen AA, Achenbach TM, Verhulst FC. Problems reported by parents of children in multiple cultures: the child behavior checklist syndrome constructs. Am J Psychiatry. 1999;156: 569–574. pmid:10200736
- 45. Taylor HG, Klein N, Minich NM, Hack M. Middle-school-age outcomes in children with very low birthweight. Child Dev. 2000;71: 1495–1511. pmid:11194251
- 46. Johnson S, Wolke D, Hennessy E, Marlow N. Educational outcomes in extremely preterm children: neuropsychological correlates and predictors of attainment. Dev Neuropsychol. 2011;36: 74–95. pmid:21253992
- 47. Inder TE, Huppi PS, Warfield S, Kikinis R, Zientara GP, Barnes PD, et al. Periventricular white matter injury in the premature infant is followed by reduced cerebral cortical gray matter volume at term. Ann Neurol. 1999;46: 755–760. pmid:10553993
- 48. McKinstry RC, Miller JH, Snyder AZ, Mathur A, Schefft GL, Almli CR, et al. A prospective, longitudinal diffusion tensor imaging study of brain injury in newborns. Neurol. 2002;59: 824–833.
- 49. Hüppi PS, Warfield S, Kikinis R, Barnes PD, Zientara GP, Jolesz FA, et al. Quantitative magnetic resonance imaging of brain development in premature and mature newborns. Ann Neurol. 1998;43: 224–235. pmid:9485064
- 50. Taylor HG, Burant CJ, Holding PA, Klein N, Hack M. Sources of variability in sequelae of very low birth weight. Child Neuropsychol. 2002;8: 163–178. pmid:12759832
- 51. Dennis M, Francis DJ, Cirino PT, Schachar R, Barnes MA, Fletcher JM. Why IQ is not a covariate in cognitive studies of neurodevelopmental disorders.J Int Neuropsychol Soc. 2009;15: 331–343. pmid:19402919
- 52. Taylor HG, Hack M, Klein N, Schatschneider C. Achievement in children with birth weights less than 750 grams with normal cognitive abilities: evidence for specific learning disabilities. J Pediatr Psychol. 1995;20: 703–719. pmid:8558373
- 53. Botting N, Powls A, Cooke RW, Marlow N. Cognitive and educational outcome of very-low-birthweight children in early adolescence. Dev Med Child Neurol. 1998;40: 652–660. pmid:9851233
- 54. Pritchard VE, Clark CA, Liberty K, Champion PR, Wilson K, Woodward LJ. Early school-based learning difficulties in children born very preterm. Early Hum Dev. 2009;85: 215–224. pmid:19022593
- 55. Taylor HG, Espy KA, Anderson PJ. Mathematics deficiencies in children with very low birth weight or very preterm birth. Dev Disabil Res Rev. 2009;15: 52–59. pmid:19213016
- 56. LeFevre J-A, Fast L, Skwarchuk S-L, Smith-Chant BL, Bisanz J, Kamawar D, et al. Pathways to mathematics: longitudinal predictors of performance. Child Dev. 2010;81: 1753–1767. pmid:21077862
- 57. Isaacs EB, Edmonds CJ, Lucas A, Gadian DG. Calculation difficulties in children of very lowbirth weight: a neural correlate. Brain. 2001;124: 1701–1707. pmid:11522573
- 58. Rubinsten O, Henik A. Developmental dyscalculia: heterogeneity might not mean different mechanisms. Trends Cog Sci. 2009;13: 92–99.
- 59. Pritchard VE, Clark CA, Liberty K, Champion PR, Wilson K, Woodward LJ. Early school-based learning difficulties in children born very preterm. Early Hum Dev. 2009;85: 215–224. pmid:19022593
- 60. Simms V, Gilmore C, Cragg L, Marlow N, Wolke D, Johnson S. Mathematics difficulties in extremely preterm children: evidence of a specific deficit in basic mathematics processing. Pediatr Res. 2013;73: 236–244. pmid:23165451
- 61. Guarini A, Sansavini A, Giovanelli G, Alessandroni R, Faldella G, Ansari D, et al. Basic numerical processes in preterms. World J Pediatr. 2006;2: 102–108.
- 62. Håkansson S, Farooqi A, Holmgren PA, Serenius F, Högberg U. Proactive management promotes outcome in extremely preterm infants: a population-based comparison of two perinatal management strategies. Pediatr. 2004;114: 58–64.
- 63. Korkman M, Jaakkola M, Ahlroth A, Pesonen AE, Turunen MM. Screening of developmental disorders in five-year-olds using the FTF (Five to Fifteen) questionnaire: a validation study. Eur Child Adolesc Psychiatry. 2004;13;Suppl 3: 31–38. pmid:15692878
- 64. Trillingsgaard A, Damm D, Sommer S, Jepsen JR, Ostergaard O, Frydenberg M, et al. Developmental profiles on the basis of the FTF (five to fifteen) questionnaire. Clinical validity and utility of the FTF in a child psychiatric sample. Eur Child Adolesc Psychiatry. 2004;13;Suppl 3: 39–49. pmid:15692879