http://orcid.org/0000-0003-2733-3588
Figures
Abstract
Objective
To validate and test a German version of the revised Parent Report of Children's Abilities questionnaire (PARCA-R).
Methods
Multicentre cross-sectional study. Parents of infants born <32 gestational weeks, completed the PARCA-R within three weeks before the follow-up assessment of their child at age two years. Infants were assessed using the Mental Development Index (MDI) of the Bayley Scales of Infant Development 2nd edition (BSID-II). Pearson correlation between the Parent Report Composite (PRC) of the PARCA-R and MDI was tested. The optimal PRC cut-off for predicting moderate-to-severe mental delay, defined as MDI<70, was identified through the receiver operating characteristic (ROC) curve.
Results
PARCA-R and BSID-II data were collected from 154 consecutive infants [51% girls, mean (SD) gestational age 29.0 (2.0) weeks, birth weight 1174 (345) grams] at 23.2 (1.6) months of corrected age. The PRC score [70.5 (31.1)] correlated with the MDI [92.2 (17.3); R = 0.54; p < 0.0001]. The optimal PRC cut-off for identifying mental delay was 44 with 0.81 (0.54–0.96) sensitivity (95%-CI), 0.81 (0.74–0.87) specificity, area under the ROC curve of 0.840 (0.729–0.952).
Citation: Picotti E, Bechtel N, Latal B, Borradori-Tolsa C, Bickle-Graz M, Grunt S, et al. (2020) Performance of the German version of the PARCA-R questionnaire as a developmental screening tool in two-year-old very preterm infants. PLoS ONE 15(9): e0236289. https://doi.org/10.1371/journal.pone.0236289
Editor: Girish Chandra Bhatt, All India Institute of Medical Sciences, Bhopal, INDIA
Received: February 20, 2020; Accepted: July 1, 2020; Published: September 3, 2020
Copyright: © 2020 Picotti et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The entire dataset is not freely available because of ethical restrictions [the dataset was created by linking national register data and study data (KEK-ZH-Nr. 2012-0278, Ethical Committee of the Zurich University Children’s Hospital and Ethical Committee of the Canton Zurich] and confidentiality issues (parents of participants must be asked for authorization to transfer data). However, minimal fully anonymized data set necessary to replicate the study findings are available as supporting information (S1 Minimal fully anonymized data set).
Funding: EP was was supported by the Anna Müller Grocholski Foundation (https://neu2017.amg-stiftung.ch). GN was supported by the Swiss National Science Foundation (grant: PZOOP3_161146; http://www.snf.ch). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Infants born very preterm (VPT) are a high-risk population for a wide range of neurodevelopmental comorbidities spanning cognitive to motor function and behavioural problems [1]. Early recognition of neurodevelopmental delay through longitudinal follow-up programs is essential for reducing long-term sequelae and promptly introducing supportive interventions [2, 3]. Since 2000, Switzerland has been systematically evaluating the neurodevelopmental achievements of children born VPT by means of standardized face-to-face examinations in accordance with the national recommendation [4]. This practice is also carried out in other countries [5–7]. These gold standard but expensive and time-consuming examinations are performed by trained examiners in each of the 16 specialized centres of the Swiss Neonatal Network and Follow-up Group when VPT children turn 2 and 5 years old. However, 20% of children born at < 30 weeks of gestation and up to 50% of those with gestational age 30 to 31 weeks do not regularly attend the follow up visit (Swiss Neonatal Network ©, data available upon request to the corresponding author). Parental questionnaires may provide a reliable and valid alternative for the assessment of children with an increased risk of developmental problems, such as preterm born babies [8]. These cost-effective and time-saving methods for the investigation of developmental outcomes in domains such as language [9], behavioural [10] and motor [11] function and quality of life [12] may help to increase follow-up rates [13, 14]. However, most of these scales are validated only in English language versions. The Parent Report of Children’s Abilities, a parental questionnaire originally developed in the UK [15], was revised and standardized in the UK (PARCA-R) [16] to assess cognitive and language development in preterm born infants aged 24 months [17, 18]. Furthermore, sex- and age-normative data from the test have been recently published making this the only standardized parent completed tool for assessing child development at this age [19]. The questionnaire provides a high test-retest reliability and correlates well with the Mental Development Index (MDI) of the Bayley Scales of Infant Development 2nd (BSID-II) [17, 18] and with the Bayley Scales of Infant and Toddler Development 3rd edition [20, 21], as validated with the Dutch version [22]. Except for a validated Italian version of this tool [23], the questionnaire is not available in any other Swiss national languages. The purpose of the present study was to investigate the performance of a German version of the PARCA-R questionnaire as a reliable and valid developmental screening instrument in the German speaking population of VPT born infants at two years of corrected age in Switzerland.
Methods
Study design and population
This was a multicentre cross-sectional study performed at three Swiss tertiary paediatric centres (Basel, Bern & Zurich). Two-year old infants born before 32 weeks of gestational age between 2010 and 2012 were enrolled for a routine neurodevelopmental follow-up examination at the corrected age of 2 years. Children with congenital malformations or syndromes affecting neurodevelopment, and whose parents did not speak German, were excluded. Neonatal baseline characteristics were extracted from the Swiss Neonatal Network and Follow-up Group’s prospective registry of preterm born infants, and defined as previously described [24]. Socioeconomic status was estimated by a validated 12-point score based on maternal education (score 1–6) and paternal occupation (score 1–6), the higher the score the lower the socioeconomic status [25].
Procedure
The parents of the eligible infants were contacted by telephone by the local follow-up centre that organises the routine neurodevelopmental follow-up assessment at the corrected age of 2 years of their offspring. The parents were asked to complete the German version of the PARCA-R in the three weeks prior to the planned examination, which was sent per mail or given to them directly at their visit to the follow-up centre and completed before the Bayley assessment. Approval to conduct this study was granted by the Ethical Committee of the Zurich University Children’s Hospital and by the Ethical Committee of the Canton Zurich (KEK-ZH-Nr. 2012–0278). Written informed consent to the research and the publication of the results was obtained from the parents of each infant.
Neurodevelopmental measurements at 2 years of corrected age
Parental questionnaire.
The Parent Report of Children’s Abilities-Revised (PARCA-R) is a standardized assessment of non-verbal cognitive and language development for children aged 24–27 months.
The Parent Report of Children’s Abilities-Revised (PARCA-R) is a standardized assessment of non-verbal cognitive and language development for children aged 24–27 months, which typically takes less than 15 minutes for parents (or primary caregivers). No expertise is needed to complete the questionnaire except for a good knowledge of the language used and that the care-giver who completes the PARCA-R has enough time spent with the infant.
Prior to the standardization of the PARCA-R, raw scores for three scales and two sub-scales were computed. These include a ‘non-verbal cognition’ (range 0 to 34) scale with 34 items on non-verbal cognitive skills, two language development subscales, i.e. ‘vocabulary’ (range 0 to 100), and a ‘sentence complexity’ subscale (range 0 to 24), corresponding to the short-form version of the MacArthur Communicative Development Inventories [9]. The sum of the scores of two last subscales produces the “language skills” composite score (range 0–124) which, added to the “non-verbal cognition” score, results in the Parent Report Composite Score (PRC), with values from 0 to 158. In this study, the investigators, who were unaware of the findings of the neurodevelopmental examination, computed all scores according to the instructions from the original survey [16] (all PARCA-R resources are freely available at www.parca-r.info).
The translation of the German Version of the PARCA-R comprised the following steps. The PARCA-R questionnaire was translated from the original English version into German [26] and then translated back to English to ensure the accuracy of the translation by two independent translators who were native speakers of the target language and fluent in the source language (both the English and German version of the questionnaire are freely available from www.parca-r.info). The consistency between the second translation and the original version was analysed and in case of discrepancies, a wording revision of the target version was performed. The pre-final version was reviewed and analysed for cultural characteristics and proofread by members of the Swiss Follow-up Group to get feedback from clinical experts in the field.
Neurodevelopmental examination.
The routine neurodevelopmental follow-up examination at the corrected age of 2 years was performed by experienced child neurologists or developmental paediatricians employed at one of the three follow-up centres participating in the study. The examination consisted of a structured neurological assessment and a developmental assessment using the Bayley Scales of Infant Development, 2nd edition (BSID-II) [27]. In this test, the Mental (MDI) and a Psychomotor Developmental Index (PDI) yield age-standardized scores between 49 to 150, with a normative mean (SD) of 100 (15). Infants who were so severely impaired that a structured testing with the BSID-II could not be performed were assigned a Mental Development Index (MDI) and psychomotor development index (PDI) of 49. Vision and hearing were assessed either by direct examination or by caregiver report. Cerebral palsy (CP) was defined [28] and graded [29] according to previously published standards.
Statistical analysis
Because of the lack of definitive criteria for the determination of the required sample size for psychometric validation studies, a minimum sample size of 100 participants was targeted for the present study, based on previously published general recommendations [30, 31]. Baseline characteristics and follow-up data between participants and non-participants were compared using the independent Student's t‐, Mann–Whitney U and χ2 tests as appropriate. Descriptive statistics were used for the findings of the PARCA-R and BSID-II. The MDI of the BSID-II was used as the gold standard to assess the concurrent validity of the PRC of the German version of the PARCA-R, and the Pearson correlation coefficient was computed to assess the relationship between these two scores. Two receiver operating characteristic curves (ROC) were plotted to explore diagnostic accuracy of PRC scores to predict an MDI < 70, i.e. < 2 SD below the normative mean, which defines moderate-to-severe mental delay, and an MDI < 85, i.e. < 1 SD below the mean considered as mild mental delay. The accuracy of the PRC in detecting MDI < 70 and < 85 was measured by computing the area under the ROC. The cut-off points of the PRC with the best predictive performance for an MDI < 70 and < 85 were selected using the Youden's index and sensitivity, specificity, positive predictive and negative predictive values, and their 95% CI were calculated for the corresponding PRC values. The internal consistency of the non-verbal cognition and sentence complexity subscales of the PARCA-R was estimated by means of Cronbach's alpha. The significance threshold was defined as p< 0.05, and testing was two‐sided. Analyses were performed using SPSS v.25.0 (IBM Corp., Armonk, NY, USA).
Results
Study population
Between 2010 and 2012, 765 of 1085 very preterm infants admitted to the neonatal intensive care units of the three participant centres met the eligibility criteria for the study (Fig 1). Of the 554 infants who attended the 2 year follow-up examination, 154 were included in the study as they had both PARCA-R and BSID-II data (51% girls, mean (SD) gestational age 29.0 (2.0) weeks, birth weight 1174 (345) grams). Neonatal and socio-demographic baseline characteristics of the study infants were similar to those of the remaining eligible non-participant infants, except participants had a lower birth weight than non-participants (S1 Table).
Neurodevelopmental measurements at 2 years of corrected age
Neurodevelopmental assessment of the study infants was performed at a mean (SD) corrected age of 23.2 (1.6) months. The mean (SD) time between completion of the PARCA_R and MDI was 2.7 (8.7) days. The PRC and MDI scores were normally distributed while the scores of the PARCA-R subscales were skewed. The mean (SD) PRC of the study participants was 70.5 (31.1), and the mean MDI 92.2 (17.5), while 31% (N = 48) and 10% (N = 16) had a MDI < 85 and < 70, respectively. Table 1 summarizes the values of the PARCA-R of the study infants, and lists the whole set of findings of the clinical neurodevelopmental examination of the study infants compared to the remaining eligible non-participating infants who were assessed at 2 years of corrected age. No difference in the neurodevelopmental outcome at follow-up was observed between participants and non-participants. The Cronbach's alpha values of the non-verbal cognition and language scales of the PARCA-R were 0.81 and 0.80 respectively.
Concurrent validity of the German Version of the PARCA-R questionnaire with the BSID-II at 2 years of corrected age
The PRC significantly correlated with the MDI with a Pearson coefficient of 0.54 (p < 0.001) (S2 Table). The correlation between the scores of the PARCA-R regarding the language skills and the MDI (R range 0.53 to 0.54, p > 0.001) was higher than the correlation between the PARCA-r score of non-verbal cognition and the MDI (R = 0.35, p > 0.001).
Diagnostic utility of the German Version of the PARCA-R questionnaire.
The area (95% CI) under the ROC of the PRC to predict a MDI < 70 (Fig 2) was 0.840 (0.729 to 0.952), and a MDI < 85 (S1 Fig) was 0.774 (0.691 to 0.858) (both p < 0.001). According to the Youden index, the cut-off scores of PRC with the best predictive performance to identify children with MDI < 70 was 44 (i.e. values < 44). With this cut-off, 13 of the 16 infants with MDI < 70 (sensitivity 0.81) were correctly identified as positive, and 112 of 140 infants with MDI ≥ 70 (specificity 0.81) were correctly identified as negative (S2 Fig shows a scatter plot of PRC and MDI values of the 154 study participants). Nineteen per cent of children with a PRC score ≥ 43, i.e. with a normal PARCA-R result, had an MDI < 70, and were thus measured falsely as having no developmental problems, while 20% of children with a PRC value <44, i.e. with abnormal screening result, had an MDI > 70, thus obtaining a false positive. The optimum cut-off PRC value to identify a MDI < 85 was 63. The predictive values (95%-CI) for the prediction of MDI < 70 and < 85 with the two correspondent cut-offs are listed in Table 2.
♣ denotes the cut-off score 44 of the Parent Report Composite (PARCA-R) with the best predictive values for identifying infants with a Mental Development Index < 70 (i.e. with mental delay).
Discussion
This multicentre cross-sectional study provides data on the validity of the German version of the PARCA-R questionnaire as a screening tool identifying delays in cognitive and language development of VPT children at the corrected age of 2 years. The reported optimal cut-off score of the PRC (scores <44) to predict a moderate-to-severe cognitive delay, as defined by a MDI more than 2 SD below the normative mean, was the same as reported in the original British validation study by Johnson and associates [18]. However, the cut-off score provided had slightly lower predictive values in comparison to the UK study. The slightly lower age of the study infant at follow-up in comparison with the UK validation might be partially responsible for the difference in the calculated predictive values. As previously described in other validation studies of the existing English [17, 18, 20], Dutch [22] and Italian [23] versions, all subscales and composite scores of the present study correlated moderately with the BSID-II MDI scores with the exception of the non-verbal cognition subscale, which correlated weakly with the MDI. This might be caused by a lack of linearity in the relation between the two types of values, especially in the low range, and by the low variation of the non-verbal cognition subscale. The language score contributes more to the PRC than the non-verbal score accounting for 124 points out of 158 in the total PRC score.
While the level of accuracy of the PRC cut-off in screening infants with a severe-to-moderate mental delay (i.e. 44) reached a good level, the accuracy of the PRC cut-off with the best predictive performance for mild delay in the mental development (i.e. 64) was classified as fair. Considering that a neurodevelopmental screening tool should allow the recognition of even infants with mild mental delay, efforts should be done in future to further improve the diagnostic utility of the present German version of PARCA-R.
The study findings support the use of this German version of the PARCA-R (freely available from www.parca-r.info) in the clinical setting and are in agreement with those of previous studies [8, 9, 11, 12, 32], showing that parent reports on the offspring’s developmental performances (including the already available validated PARCA-r versions [14, 17–20, 22, 23]) can be considered as a useful screening tool that provides valid and reliable information. By means of the present instrument, infants who have undergone positive screening for moderate to severe mental retardation are identified as being at high developmental risk and should be referred to the follow-up referral centre for a thorough investigation using a clinical examination and a development test.
A strength of this study is the use of a gold standard for the assessment of the mental development of the population studied, the BSID-II [27] which was the developmental test used clinically at the time of the study. In 2012, the Bayley Scales of Infant and Toddler Development, 3rd edition (Bayley-III), was integrated as the new standard in the Follow-up program of VPT infants in Switzerland. As such, this German version of the PARCA-R requires validation against newer editions of the Bayley Scales. Previous studies comparing the English version of the PARCA-R and Bayley-III in other countries have shown that this has good concurrent validity and diagnostic utility [20, 21]. Another strength of the study is the standardized linguistic validation of the German Version of the PARCA-R that included analysis of consistency with the original questionnaire version, analysis for cultural characteristics, and proofreading by clinical experts in the field of child development.
A study limitation is the moderate size of the sample. However, the population studied can be considered as representative of the whole cohort of eligible infants born during the study period and for the group of infants who attended the follow-up examination in terms of both baseline and follow-up characteristics. It is important also to be aware that there are some linguistic differences among the European German-speaking countries. However, the fact that the study participants were only recruited in Switzerland represents a minor limitation. While in the geographic region of the study, the main acquired spoken language of the population is Swiss-German, the official written language form learned at school is standard High German. Additionally, recruitment took place in three urban areas (Bale, Bern, Zurich) with a high rate of German native speakers and the current version of the PARCA-r was specifically designed to be suitable not only for Swiss German speakers, but also for standard high German native speakers coming from regions outside of Switzerland. The third limitation is the fact that families from the lowest socioeconomic status are underrepresented in the present study. With respect to this point, the authors recognize that while proxy questionnaires represent a potential low-cost and time-saving alternative to examiner administered developmental tests, further investigation is still needed to assess whether intellectual and cultural factors could influence the way in which parents from different socio-economic and ethnic backgrounds report their children’s skills. However, Johnson and colleagues have previously shown that accuracy of parent report using the PARCA-R was not affected by socio-demographic factors [17].
As the PARCA-R is designed to assess infants’ non-verbal cognition and language skills, it is not pertinent to define the lack of information on achievements in other domains, such as motor and behavioural development, as a study limitation. Nevertheless, it is still worth highlighting the fact that this screening tool does not allow for a global developmental screening of preterm born infants. There are some questionnaires that screen motor development at two years of age, however only a few of them were demonstrated to validly and reliably screen developmental deficits [32] and their availability in multiple validated language versions is limited [33]. There are other questionnaires that focus on the behavioural development at late infancy and early childhood, and are well described in the literature [10]. Since the areas of interest of infant development of these questionnaires fit with the objectives of a structured follow-up for newborns with high neurodevelopmental risk [6], their systematic use should be encouraged in settings where the implementation of follow-up examinations is hampered by lack of hospital resources or parental compliance. These instruments could also be used to systematically monitor developmental outcomes of the growing population of moderately and late premature babies. The PARCA-R is now standardized and produces norm-referenced standard scores (mean 100; SD 15) for cognitive and language development but these are only available for use in the UK population [16, 19]. Future studies could consider obtaining normative data to standardize the German version of the PARCA-R.
In conclusion, in the present sample of VPT children, the German version of the PARCA-R showed good correlation with the results of the BSID-II. The derived PRC cut-off score <44 provides optimal discriminatory power to identify moderate to severe mental delay at 2 years of corrected age. This practical and cost-efficient parental questionnaire may be an alternative for first-line cognitive screening in this high-risk population when direct testing is not possible.
Supporting information
S1 Appendix. Members of the Swiss Neonatal Network & Follow-Up Group.
https://doi.org/10.1371/journal.pone.0236289.s001
(PDF)
S1 Table. Neonatal and socio-demographic baseline characteristics of the study participants and of non-participants eligible infants (total n = 765).
SD, standard deviation; IQR, interquartile range; *, birth weight below 10. percentile; **, above Bell’s stage 2.
https://doi.org/10.1371/journal.pone.0236289.s002
(PDF)
S2 Table. Pearson correlation between PARCA-R and Bayley’s scales of infant development.
N = 153; R, Pearson R coefficient.
https://doi.org/10.1371/journal.pone.0236289.s003
(PDF)
S1 Fig. Receiver operating characteristics curve of prediction of Mental Development Index (Bayley’s scales of infant development) < 85 from Parent Report Composite score (PARCA-r).
♣ denotes the cut-off score 63 of the Parent Report Composite (PARCA-r) with the best predictive values for identifying infants with a Mental Development Index < 85.
https://doi.org/10.1371/journal.pone.0236289.s004
(TIF)
S2 Fig. Scatter plot of Parent Report Composite and Mental Development Index scores of the 154 study participants.
PRC, Parent Report Composite (PARCA-r); MDI, Mental Development Index, Norm (SD), 100 (15), (Bayley’s scales of infant development, 2nd Edition). Vertical line, PRC cut-off score of 44; horizontal line, MDI cut-off score of 70 for defining mental delay.
https://doi.org/10.1371/journal.pone.0236289.s005
(TIF)
S1 Dataset. Minimal fully anonymized data set necessary to replicate the study findings.
https://doi.org/10.1371/journal.pone.0236289.s006
(XLSX)
Acknowledgments
We particularly thank the parents who have contributed greatly to this project by consenting to the enrolment of their preterm infant.
The Swiss Neonatal Network and Follow-up Group includes the following local investigators (listed in alphabetical order of study site): Aarau: Cantonal Hospital Aarau, Children's Clinic, Department of Neonatology (Ph. Meyer, C. Anderegg), Department of Neuropaediatrics (A. Capone Mori, D. Kaeppeli); Basel: University Children's Hospital Basel, Department of Neonatology (S. Schulzke), Department of Neuropaediatrics and Developmental Medicine (P. Weber, M. Brotzmann); Bellinzona: San Giovanni Hospital, Department of Pediatrics (G.P. Ramelli, B. Simonetti Goeggel); Berne: University Hospital Berne, Department of Neonatology (M. Nelle), Department of Pediatrics (B. Wagner), Department of Neuropaediatrics (M. Steinlin, S. Grunt); Biel: Development and Pediatric Neurorehabilitation Center (R. Hassink); Chur: Children's Hospital Chur, Department of Neonatology (T. Riedel), Department of Neuropaediatrics (E. Keller, Ch. Killer); Fribourg: Cantonal Hospital Fribourg, Department of Neuropaediatrics (K. Fuhrer); Lausanne: University Hospital (CHUV), Department of Neonatology (J.-F. Tolsa, M. Roth-Kleiner), Department of Child Development (M. Bickle-Graz); Geneva: Department of child and adolescent, University Hospital, Neonatology Units (R. E. Pfister), Division of Development and Growth (P. S. Huppi, C. Borradori-Tolsa); Lucerne: Children's Hospital of Lucerne, Neonatal and Paediatric Intensive Care Unit (M. Stocker), Department of Neuropaediatrics (T. Schmitt-Mechelke, F. Bauder); Lugano: Regional Hospital Lugano, Department of Paediatrics (V. Pezzoli); Muensterlingen: Cantonal Hospital Muensterlingen, Department of Paediatrics (B. Erkert, A. Mueller); Neuchatel: Cantonal Hospital Neuchatel, Department of Paediatrics (M. Ecoffey); St. Gallen: Cantonal Hospital St. Gallen, Department of Neonatology (A. Malzacher), Children's Hospital St. Gallen, Neonatal and Paediatric Intensive Care Unit (J. P. Micallef), Department of Child Development (A. Lang-Dullenkopf); Winterthur: Cantonal Hospital Winterthur, Department of Neonatology (L. Hegi), Social Paediatrics Centre (M. von Rhein); Zurich: University Hospital Zurich (USZ), Department of Neonatology (D. Bassler, R. Arlettaz), University Children's Hospital Zurich, Department of Neonatology (V. Bernet) and Child Development Centre (B. Latal, G. Natalucci). Follow-up Coordinator: Giancarlo.Natalucci@usz.ch.
References
- 1. Saigal S, Doyle LW. An overview of mortality and sequelae of preterm birth from infancy to adulthood. Lancet. 2008;371:261–9. pmid:18207020
- 2. Spittle A, Orton J, Anderson PJ, Boyd R, Doyle LW. Early developmental intervention programmes provided post hospital discharge to prevent motor and cognitive impairment in preterm infants. Cochrane Database Syst Rev. 2015;(11):Cd005495. Epub 2015/11/26. pmid:26597166.
- 3. Johnson S. Cognitive and behavioural outcomes following very preterm birth. Semin Fetal Neonatal Med. 2007;12(5):363–73. Epub 2007/07/13. pmid:17625996.
- 4. Adams M, Borradori-Tolsa C, Bickle-Graz M, Grunt S, Weber P, Capone Mori A, et al. Follow-up assessment of high-risk newborns in Switzerland. Pediatrica. 2014;25(5):6–10.
- 5. Wang CJ, McGlynn EA, Brook RH, Leonard CH, Piecuch RE, Hsueh SI, et al. Quality-of-care indicators for the neurodevelopmental follow-up of very low birth weight children: results of an expert panel process. Pediatrics. 2006;117(6):2080–92. Epub 2006/06/03. pmid:16740851.
- 6. Doyle LW, Anderson PJ, Battin M, Bowen JR, Brown N, Callanan C, et al. Long term follow up of high risk children: who, why and how? BMC pediatrics. 2014;14:279. Epub 2014/11/18. pmid:25399544; PubMed Central PMCID: PMC4289257.
- 7.
NICE National Institute for Health and Care Excellence. Developmental follow-up of children and young people born preterm: London: National Institute for Health and Care Excellence (UK); 2017 [cited 2017 2017 Aug 9]. Available from: https://www.nice.org.uk/guidance/ng72.
- 8. Johnson S, Marlow N. Developmental screen or developmental testing? Early Hum Dev. 2006;82(3):173–83. Epub 2006/03/01. S0378-3782(06)00034-X [pii] pmid:16504424.
- 9. Fenson L, Pethick S, Renda C, Cox J, Dale P, Reznick J. Short-form versions of the MacArthur Communicative Development Inventories. Appl Psycholinguist. 2000;21:95–115.
- 10. Bagner DM, Rodriguez GM, Blake CA, Linares D, Carter AS. Assessment of behavioral and emotional problems in infancy: a systematic review. Clin Child Fam Psychol Rev. 2012;15(2):113–28. Epub 2012/01/21. pmid:22262040; PubMed Central PMCID: PMC4476378.
- 11. Morris C, Kurinczuk JJ, Fitzpatrick R, Rosenbaum PL. Who best to make the assessment? Professionals' and families' classifications of gross motor function in cerebral palsy are highly consistent. Arch Dis Child. 2006;91(8):675–9. Epub 2006/04/28. pmid:16638783; PubMed Central PMCID: PMC2083065.
- 12. Raat H, Mohangoo AD, Grootenhuis MA. Pediatric health-related quality of life questionnaires in clinical trials. Current opinion in allergy and clinical immunology. 2006;6(3):180–5. Epub 2006/05/04. pmid:16670511.
- 13. Johnson S, Seaton SE, Manktelow BN, Smith LK, Field D, Draper ES, et al. Telephone interviews and online questionnaires can be used to improve neurodevelopmental follow-up rates. BMC research notes. 2014;7:219. Epub 2014/04/11. pmid:24716630; PubMed Central PMCID: PMC3983863.
- 14. Martin AJ, Darlow BA, Salt A, Hague W, Sebastian L, Mann K, et al. Identification of infants with major cognitive delay using parental report. Dev Med Child Neurol. 2012;54(3):254–9. Epub 2011/12/23. pmid:22188172.
- 15. Saudino K, Dale P, Oliver B, Petrill SA, Richardson V, Rutter M, et al. The validity of parent-based assessment of the cognitive abilities of the 2-year-olds. Br J Dev Psychol. 1998;16:349–63.
- 16.
Johnson S, Bountziouka V, Linsell L, Brocklehurst P, Marlow N, Wolke D, et al. Parent Report of Children’s Abilities–Revised (PARCA-R). Technical and Interpretive Manual. Leicester: University of Leicester; 2019.
- 17. Johnson S, Marlow N, Wolke D, Davidson L, Marston L, O'Hare A, et al. Validation of a parent report measure of cognitive development in very preterm infants. Dev Med Child Neurol. 2004;46(6):389–97. Epub 2004/06/04. pmid:15174530.
- 18. Johnson S, Wolke D, Marlow N. Developmental assessment of preterm infants at 2 years: validity of parent reports. Dev Med Child Neurol. 2008;50(1):58–62. Epub 2008/01/05. DMCN02010 [pii] pmid:18173632.
- 19. Johnson S, Bountziouka V, Brocklehurst P, Linsell L, Marlow N, Wolke D, et al. Standardisation of the Parent Report of Children's Abilities-Revised (PARCA-R): a norm-referenced assessment of cognitive and language development at age 2 years. The Lancet Child & adolescent health. 2019. Epub 2019/08/14. pmid:31402196.
- 20. Martin AJ, Darlow BA, Salt A, Hague W, Sebastian L, McNeill N, et al. Performance of the Parent Report of Children's Abilities-Revised (PARCA-R) versus the Bayley Scales of Infant Development III. Arch Dis Child. 2013;98(12):955–8. Epub 2013/09/14. pmid:24030249.
- 21. Blaggan S, Guy A, Boyle EM, Spata E, Manktelow BN, Wolke D, et al. A parent questionnaire for developmental screening in infants born late and moderately preterm. Pediatrics. 2014;134(1):e55–62. Epub 2014/07/02. pmid:24982100.
- 22. Vanhaesebrouck S, Theyskens C, Vanhole C, Allegaert K, Naulaers G, de Zegher F, et al. Cognitive assessment of very low birth weight infants using the Dutch version of the PARCA-R parent questionnaire. Early Hum Dev. 2014;90(12):897–900. Epub 2014/12/03. pmid:25463839.
- 23. Cuttini M, Ferrante P, Mirante N, Chiandotto V, Fertz M, Dall'Oglio AM, et al. Cognitive assessment of very preterm infants at 2-year corrected age: performance of the Italian version of the PARCA-R parent questionnaire. Early Hum Dev. 2012;88(3):159–63. Epub 2011/08/25. pmid:21862246.
- 24. Schlapbach LJ, Adams M, Proietti E, Aebischer M, Grunt S, Borradori-Tolsa C, et al. Outcome at two years of age in a Swiss national cohort of extremely preterm infants born between 2000 and 2008. BMC pediatrics. 2012;12:198. Epub 2013/01/01. pmid:23272671; PubMed Central PMCID: PMC3546845.
- 25. Largo RH, Pfister D, Molinari L, Kundu S, Lipp A, Duc G. Significance of prenatal, perinatal and postnatal factors in the development of AGA preterm infants at five to seven years. Developmental medicine and child neurology. 1989;31:440–56. pmid:2680687
- 26. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. Journal of clinical epidemiology. 1993;46(12):1417–32. Epub 1993/12/01. pmid:8263569.
- 27.
Bayley N. Bayley Scales of Infant Development. 2nd edition. San Antonio (TX): The Psychological Corporation; 1993.
- 28. Rosenbaum P, Paneth N, Leviton A, Goldstein M, Bax M, Damiano D, et al. A report: the definition and classification of cerebral palsy April 2006. Dev Med Child Neurol Suppl. 2007;109:8–14 Erratum in: Dev Med Child Neurol. 2007 49(6) 480. pmid:17370477
- 29. Palisano R, Rosenbaum P, Walter S, Russell D, Wood E, Galuppi B. Development and reliability of a system to classify gross motor function in children with cerebral palsy. Dev Med Child Neurol. 1997;39(4):214–23. pmid:9183258.
- 30.
Altman DG. Practical statistics for medical research. London: Chapman and Hall; 1997.
- 31. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. Journal of clinical epidemiology. 2007;60(1):34–42. Epub 2006/12/13. pmid:17161752.
- 32. Brown T, Lane H. Comparing a parent-report and a performance-based measure of children's motor skill abilities: are they associated? Occupational therapy in health care. 2014;28(4):371–81. Epub 2014/07/23. pmid:25050830.
- 33.
Squires J, Twombly E, Bricker D, Potter L. The ASQ-3 user's guide (3rd ed.). Baltimore, MD: Brookes; 2009.