http://orcid.org/0000-0003-2000-9742
Figures
Abstract
Most studies rely on cross-sectional retrospective reports from adult samples to collect information about adverse childhood experiences (ACEs) to examine relationships with adult outcomes. The problems associated with these reports have long been debated, with only a few studies determining their reliability and validity and fewer still reaching consensus on the matter. This paper uses repeat prospective and retrospective reports of adverse childhood experiences from two respondent sources in the South African Birth to Twenty Plus (Bt20+) cohort to explore agreement and concordance in the prospective reporting of ACEs by caregivers and respective children as adolescents and then as young adults. The findings demonstrate little overall agreement between prospective and retrospective accounts of childhood experiences, with 80% of kappa values below the moderate agreement cutoff (k = .41). The highest levels of agreement were found between prospective and retrospective reporting on parental and household death (kappas ranging from .519 to .944). Comparisons between prospective caregiver reports and retrospective young adult reports yielded high concordance rates on sexual and physical abuse and exposure to intimate partner violence (91.0%, 87.7% and 80.2%, respectively). The prevalence of reported ACEs varied with the age of the respondent, with adolescents reporting much higher rates of exposure to violence, physical and sexual abuse than are reported retrospectively or by caregivers. This variation may partly reflect actual changes in circumstances with maturation, but may be influenced by developmental stage and issues of memory, cognition and emotional state more than has been considered in previous analyses. More research, across disciplines, is needed to understand these processes and their effect on recall. Long-term prospective studies are critical for this purpose. In conclusion, methodological research that uses a range of information sources to establish the reliability and validity of both retrospective and prospective reports ‒ recognizing that the two approaches may fundamentally answer different questions ‒ should be encouraged.
Citation: Naicker SN, Norris SA, Mabaso M, Richter LM (2017) An analysis of retrospective and repeat prospective reports of adverse childhood experiences from the South African Birth to Twenty Plus cohort. PLoS ONE 12(7): e0181522. https://doi.org/10.1371/journal.pone.0181522
Editor: Soraya Seedat, Stellenbosch University, SOUTH AFRICA
Received: October 28, 2016; Accepted: July 3, 2017; Published: July 26, 2017
Copyright: © 2017 Naicker et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The Bt20 study is funded by the Wellcome Trust (UK), the Medical Research Council of South Africa, the Human Sciences Research Council, the University of the Witwatersrand and supported by the DST-NRF Centre of Excellence in Human Development at the University of the Witwatersrand, Johannesburg.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Made familiar by the Centers for Disease Control and Prevention (CDC) and Kaiser Permanente’s Adverse Childhood Experiences (ACE) study [1], retrospective adult reports of childhood experiences of abuse, neglect and household dysfunction have been linked to a range of adverse social and health outcomes in later life [2–21], studied predominantly in high-income countries. Growing evidence from around the world suggests that ACEs tend to cluster together [11, 17, 22, 23]; for example, that childhood sexual abuse often occurs in the presence of other ACEs [1], and that the risk for adverse outcomes increases in a strong and graded manner as the number of ACEs increase [22, 24]. The ACE score, the total number of ACEs to which an individual reports having been exposed before the age of 18, enables one to examine the cumulative impacts of ACEs on later life outcomes.
In recent years a number of South African studies have assessed the impact of childhood adversity on health and wellbeing [25, 26], including one longitudinal prospective study of cumulative adverse childhood experiences [27]. The associations between exposure to adverse childhood experiences and negative outcomes follows a pattern similar to other countries. Since the inception of its democracy more than 20 years ago, South Africa has transitioned rapidly from a setting characterized by poverty, underdeveloped infrastructure and limited resources. Yet high levels of inequality and unemployment, along with a generalized HIV epidemic adding another dimension to the experience of adversity [10, 16, 25], present conditions where exposure to multiple and concurrent adverse childhood experiences is prevalent around the country [27].
The few long-term studies that have been conducted in low- or middle-income countries (LMICs) tend to examine associations between retrospectively reported single childhood adversities and outcomes. In countries that participated in the Global School-based Student Health survey in 2003/2004, specifically Namibia, Swaziland, Uganda, Zambia and Zimbabwe, associations were found between 12-month retrospective reports of exposure to physical and sexual violence with mental health, suicide ideation, substance use, multiple sex partners and a history of sexually transmitted infection among 13-15-year-olds [28]. Other studies have linked reports of early adversity to personality and current major depressive disorders in Togo [29]; a range of sexual risk behaviours, alcohol and drug use, and intimate partner violence in South Africa, Tanzania and Zimbabwe [16]; and elevated likelihood of adult substance use disorders in Nigeria [13]. In South Africa, exposures to adverse experiences in early life have been associated with a number of poor adolescent and adult outcomes, including HIV risk [10], methamphetamine use [12], psychological distress [30], the perpetration of both non-partner and partner rape [26], and increased risk of psychiatric disorder [17].
There are some prospective studies linking exposure to adverse childhood experiences to social and health outcomes such as psychological, behavioural, and academic problems in adolescence [31]; HIV risk behaviour at age 14 [32]; obesity and type 2 diabetes [33]; mental health [34]; premature mortality [35]; chronic pain [36]; and age-related disease [37]. Most often this prospective data comes in the form of school records, which are frequently incomplete and focus on a small set of ACE variables, or historical court and child protection service records which are typically available when cases are extreme [38, 39]. There are far fewer prospective studies of adverse childhood experiences than it may appear since multiple publications using prospective data is often from a single study, as with the 1958 British birth cohort [32, 33, 35, 36, 40]. We could find no prospective or quasi-prospective studies on adverse childhood experiences and later life outcomes located in LMICs. In their 2012 meta-analysis, Varese and colleagues [41] found eight prospective studies linking childhood adversities to psychosis from the Netherlands (3), the United Kingdom (2), Finland (1), Germany (1) and Australia (1).
The reliance on retrospective recall raises questions about the extent to which reports are valid (accurate), reliable (consistent) and free from bias relevant to the hypothesis at hand. Additional methodological challenges include the possibility of confounding factors accounting for both early adverse experiences and later outcomes examined. Validity of reports depends on a number of factors, such as memory, cognitive function at the time the event occurred, and subsequent life experiences that may change a person’s outlook [42–44]. For instance, people who experience adverse health and social outcomes in later life may be more likely to recall and/or report having experienced adverse experiences during childhood [19]. Inconsistencies affecting the reliability of retrospective responses can occur for a number of reasons. Apart from deficits in memory due to a lapse in time, repression of memories may result from stressful events experienced [45]. Recall is also altered by subsequent events, whether experiences at the time or later were discussed with others or overheard, and if help or treatment was sought. Rothman and Greenland [46] propose that some of these factors might lead to misclassification of exposed individuals as unexposed, leading to a downward bias of the association between ACEs and various outcomes, a finding also reported by others [4, 47]. In contrast, the dilemma of false-positives or over-reporting is virtually impossible to establish [48].
Some research has been conducted to ascertain the reliability and validity of retrospective ACE reports. In terms of validity, it has been found that even where childhood sexual abuse has been documented, retrospective recall, even in young adulthood, can be low [49, 50]. The validity of retrospective reports is difficult to confirm [51], but establishing reliability over time of retrospectively reported adverse childhood experiences is a more manageable task. This has been done by examining the reliability of reports using a test-retest paradigm where the same respondents are questioned on two occasions [52–63]; assessing reliability using two separate measures of adversity [64, 65]; and looking at the concordance or corroboration between two different report sources [66]. A further limitation is that most studies examine the reliability of reports on only one or two adverse experiences. Fewer studies assess reliability over time of a range of childhood experiences [61].
Studies comparing the prevalence of reported adverse childhood experiences using historical prospective data such as court records and retrospective reports have found substantial under-reporting in the former [67]. Few direct comparisons of prospective and retrospective data on childhood adversities and their consequences in a single sample have been conducted. In four studies comparing documented records of child sexual and physical abuse and neglect [68–70] and child hospitalization [71] significant associations between childhood adversity and negative outcomes were found when retrospective self-reports, but not prospective documented records, were analysed.
The aim of this analysis is to use the opportunity afforded by the Birth to Twenty Plus (Bt20+) data over 22 years to explore levels of agreement and concordance in prospective reporting of ACEs from children and caregivers at different time points with retrospective reports in young adulthood.
Methods
Study design and participants
Ethics clearance was obtained from the Witwatersrand University Committee for Research on Human Subjects (protocol number: M140726). The Bt20+ study began as Birth to Ten, a birth cohort study in Soweto-Johannesburg with the objective of tracking a group of urban children in South Africa at a time of very significant political, social, demographic and health transitions, born as they were just weeks after Nelson Mandela’s release from prison. Extended to Bt20+, the sample consists of all singleton children born to mothers who were residents of Soweto-Johannesburg in the 7-week enrolment window and who remained in the area up until the child reached 6 months of age. The Bt20+ cohort is now 26 years old, and includes the third generation of children born to the original cohort. A detailed description of the study, its birth cohort and participants is published elsewhere [72]. The sample analysed in this paper comprises 1595 participants who were surveyed at the 21-22-year data collection point, when they provided retrospective data on adverse childhood experiences, and prospectively throughout the cohort study. Prospective reports of ACEs from parents and children were recorded at six time points across childhood and adolescence. Written informed consent was obtained from parents and guardians of all children included in the study on behalf of parents and their children. Informed assent, and later consent at the appropriate age, was obtained from children for their participation in the cohort. Since a child may not be raised by a biological parent for a number of reasons, the term caregiver will be used to refer to the primary caregiver of the child.
Measures
Adverse childhood experiences
Bt20+ collected data on a wide range of topics including variables related to adverse childhood experiences, initially from caregivers and subsequently from the Bt20+ respondents themselves. These variables include exposure to crime and violence, experiences of emotional, sexual and physical violence, poverty, family dysfunction and more. Adverse childhood experiences are defined in this study, in the same way as in the original ACE study: as physical abuse, sexual abuse, emotional abuse, physical or emotional neglect, and household dysfunction in the form of experience of divorce or parental separation, exposure to intimate partner violence (IPV), experience of living with a chronically ill or disabled individual or an individual with substance abuse problems, parental death, household legal trouble, and chronic household unemployment.
Table 1 shows the child’s age at which these variables were assessed. At Bt20+ child age five, seven and 11 years the caregiver was asked a number of ACE questions relating to her child. Between 11 and 18 years of age, the child responded to a number of ACE questions. The caregiver and adolescent reports are regarded as prospective reports of ACEs. At the 22 year data collection wave, a retrospective report on adverse experiences during the first 18 years of life was obtained from Bt20+ respondents through a set of questions modelled on the CDC/Kaiser Permanente ACE questionnaire. S1 Text lists the ACEs-related survey questions used throughout the study.
In sum, three accounts of ACEs are examined and compared: caregiver reports about the child’s environment and experiences at the time; young adolescent reports about their own environment and experiences at the time, and young adult retrospective reports about their environment and experiences in the first 18 years of life. Prospective caregiver reports and prospective adolescent reports are individually compared to retrospective young adult reports. Combining the caregiver and adolescent self-reports a prospective report across childhood is also compared to young adult retrospective reports about the same period.
Analysis
Descriptive statistics were used to summarize caregiver and adolescent reports of exposure to ACEs at different time points as well as the prevalence of reported ACEs. Cohen’s kappa was calculated to compare item agreements between prospective caregiver and adolescent reports of ACEs with retrospective young adult reports of ACEs. Kappa examines agreement adjusting for chance and has been used in several other studies of the reliability of reports of childhood experiences [52, 61, 73, 74]. We followed Landis & Koch’s [75] classification on the strength of agreement. The percentage of item agreement between both time points, or concordance rate, was also calculated as suggested by de Mast [76] to overcome Kappa values that may be affected by the number of ‘yes’ responses that are due to rare events or very common events resulting in artificially low kappa values. S1 Dataset contains the minimal data used in the analysis.
Results
Fig 1 shows the prevalence of reported experience of ACEs by caregivers about children’s lives up to age 11 years. Blank spaces indicate that questions on this ACE were not asked at a particular age. A combined caregiver report is calculated as the prevalence of ever reporting an ACE in the 6-year period between 5 and 11 years. Divorce/separation, household substance abuse, serious illness or disability in the household, death in the household and exposure to violence and crime were reported at roughly the same rates when children were 5, 7 and 11 years old. Chronic unemployment was the most frequently reported ACE at all time points, increasing to 81.9% when the caregiver reports at child age 11 years. Combined time points show that about 82% of children younger than 11 were living in a household that reported chronic unemployment at least once.
Fig 2 looks at the average prevalence of ACEs reported by adolescents prospectively between the ages of 11 and 18. During their teenage years, young people are more likely to report the death of a parent, as well as increased exposures to violence, including sexual and physical abuse. Reports of physical abuse increase from 19.0% at 11 years to 44.4% at 15 years, decreasing to 22.1% at 18 years. Reports of sexual abuse by adolescents quadrupled from 9.3% at 15 years to 40.6% at 18 years. The combined adolescent report shows that 48.6% of adolescents report exposure to physical abuse at least once during the 11–18 year period.
Young adult retrospective reports of ACEs occurring before they turned 18 are shown in Fig 3. Divorce/separation and chronic unemployment in household are the most frequently reported ACEs at 44.9% and 43.5%, respectively. Retrospectively reported physical abuse is much lower ‒ at 7.8% ‒ compared to combined adolescent reporting of physical abuse at 48.6%.
Fig 4 below shows the prevalence of reported ACEs by source ‒ caregiver, adolescent or young adult ‒ and time point ‒ prospective or retrospective. Across sources there is consistency in the reporting of exposure to violence and family instability, namely divorce/separation and child separation from parents. Adolescent prospective reports of physical and sexual abuse, exposure to IPV and more general exposure to violence are much more prominent than prospective caregiver reports or retrospective young adult reports. Caregivers report a substantial social and material burden on the household in the early years of the child’s life, with high levels of chronic unemployment, household death, illness/disability and substance abuse.
Comparing young adult retrospective reports to caregiver and adolescent prospective reports about adverse experiences in childhood
Comparisons are made to determine the levels of agreement between prospective caregiver reports about childhood and prospective adolescent self-reports with retrospective reports by young adults. Levels of agreement between combined prospective caregiver and adolescent reports of ACEs compared to retrospective young adult reports of ACEs were also examined using Cohen’s kappa (Table 2). The concordance rates reflect total agreement on an ACE whether reported present or absent at both time points or by both sources.
Across both combined caregiver and adolescent prospective reporting and separated caregiver and adolescent prospective reporting compared to retrospective young adult reporting there is significant agreement at moderate levels on parental death and household death (ranging from k = .51 p < .0001 to near perfect agreement at k = .94, p < .0001). There are fair levels of agreement for divorce/separation in each of the three comparisons, ranging from k = .22 to .34, p < .0001. Significant but slight levels of agreement are found for other ACEs across the comparisons.
Fig 5 illustrates the concordance rates by ACE when comparisons between accounts are seen side by side. For ACEs such as parental death, household substance abuse, household legal trouble, exposure to violence, emotional abuse/neglect, chronic unemployment, and divorce/separation the concordance between the three reports remains relatively consistent. The highest concordance rate (97.4%) is found between prospective adolescent reports and retrospective young adult reports on household death. High concordance is also seen between prospective caregiver reports and retrospective young adult reports on sexual and physical abuse and exposure to IPV (91.0%, 87.7% and 80.2%, respectively).
To understand how respondent source may play a role in reporting of ACEs, kappa values and concordance rates were calculated for ACEs that were reported on at the same time point for both caregiver and adolescent (at child age 11). Table 3 shows the levels of agreement for caregiver reported ACEs at age 11 and adolescent reported ACEs at year 11.
Despite very low kappa values, concordance rates for reported divorce/separation and child separation are high at 83.2% and 85.1%, respectively, with both the caregiver and the adolescent reporting low levels of divorce/separation and prolonged child separation. In comparison, concordance on chronic unemployment in the household is low at 18.7%. About 4.8% of adolescents report chronic unemployment in the household compared to 80.1% of caregivers at the same time.
Discussion
The aim of this study was to explore the levels of agreement between three accounts of reporting on ACEs ‒ prospective caregiver reports on the period between 5 and 11 years in a child’s life, prospective adolescent reports on the period between 11 and 18 years and retrospective young adult reports of experiences before the age of 18 years. In summary, we found that there was little overall agreement between combined or separate prospective accounts and retrospective accounts of childhood experiences, with a few exceptions that are described below.
The prevalence of reported ACEs
Overall the prevalence of individual reported ACEs was fairly high, naturally increasing by age ‒‒ older children were more likely to report an ACE—with high rates of poverty reflected in the pervasiveness of unemployment at a rate of 81.9% at its highest, a finding echoed by an analysis of the prevalence of ACEs among children in a nationally representative US sample [77]. In addition to the economic hardship, the authors report high rates of exposure to violence and divorce or separation, similar to the current study’s findings. At a national level, 46% of children in the US [77] and 46.4% of participants in an English sample [78] report at least one ACE, compared to 92% in retrospective reporting and 98.9% in prospective reporting in this study. In other developing countries, similar high prevalence rates of reported ACEs are found. A retrospective study of young people in Russia estimated that 84.6% of respondents reported at least one ACE [79], and in a Brazilian birth cohort, 85% of adolescents reported at least a single ACE [80].
Depending on the type and measure of ACEs used, the timing of measurement and source, studies assessing the consistency of reporting of ACEs over time have found divergent results [51, 52, 54, 81]. There are substantial differences in the prevalence of reported ACEs across the three accounts assessed in this study. There are fairly consistent rates of reported ACEs across the three time points within the prospective caregiver reports, with less consistency in the prevalence of ACEs reported over the adolescent period. The prevalence of ACEs in adolescent reports tends to increase substantially around the 15-year period, particularly reports of physical and sexual abuse, and then decrease after the 18-year period. The prevalence of retrospectively reported ACEs by young adults is similar to that of prospective caregiver reports, particularly with regard to ACEs in the home environment such as chronic illness/disability, substance abuse, legal trouble, divorce/separation, and chronic unemployment in the household, and even extending to their own experiences of physical and sexual abuse.
Adolescents prospectively report much higher rates of exposure to violence, physical and sexual abuse than are reported retrospectively or by caregivers. As they enter secondary school and their environment expands to include peers, the range of experiences open to adolescents is greater which may explain these increases. In the adolescent reporting period, non-consensual petting and/or oral sex, in addition to penetration, are explicitly included in the operational definition of sexual abuse. As a developmental period, adolescence is also characterized by some level of egocentrism, perhaps making them acutely conscious of the events in their own lives and with a heightened perception of the severity of experiences. Research also suggests that memory is generally enhanced in adolescence and early adulthood [82], leaving adolescents less likely to forget negative experiences [83].
Levels of agreement across time
Overall, a combined prospective account of ACEs showed only slight levels of agreement with retrospective young adult reports. Seventy five percent of kappa values fell within the slight agreement range, 8% had fair agreement, and 17% had moderate agreement. When comparing prospective caregiver reports to retrospective young adult reports, 83% of kappa values represented slight agreement and 17% fair agreement. Prospective adolescent reports, compared to retrospective young adult reports, yielded 73% slight agreement; 9% fair, moderate and near perfect agreement, respectively. In all comparisons, the highest levels of agreement were found on household death and parental death. Yancura and colleagues found similar results noting that specific events such as deaths in the family and parental separation tended to have higher kappa values than other experiences [61]. The lowest levels of agreement are found in comparisons between prospective caregiver reports of ACEs and retrospective young adult reports of ACEs. One possible reason for this is that caregiver prospective reporting covered early to middle childhood, ending when the child was 11 years of age; the years of adolescence following this period are likely to include a larger range of experiences and greater opportunity for ACEs to occur.
Concordance rates of the different ACEs across the three comparisons mirrored agreement levels with the exceptions of physical and sexual abuse and exposure to IPV in the comparison between prospective caregiver reports and retrospective young adult reports. This could be as a result of the differences in the prevalence of reported physical and sexual abuse and exposure to IPV that increase in adolescence but is not retrospectively reported on in young adulthood. Despite the low kappa values, these high levels of concordance could be due to low endorsement rates or the rarity of the event compared to other ACEs. The concordance rates for each ACE when prospective caregiver and prospective adolescent reports are compared to retrospective young adult reports, separately and combined, are fairly consistent. This suggests that the nature of the ACE will influence how it is reported, over and above timing and source issues. Apart from a few individual ACEs ‒ sexual abuse, physical abuse and exposure to IPV in the prospective caregiver report and illness/disability and household death in the prospective adolescent report ‒ the prospective accounts, separately or combined, do not appear to be highly concordant with the retrospective young adult account. This finding might have been anticipated, given that a study examining retrospective reports of childhood abuse just three years apart ‒ at 18 and 21 years old ‒ found substantial unreliability between reports [84].
Levels of agreement across source
Comparing prospective caregiver reports over the first 11 years of a child’s life to retrospective self-reports in young adulthood is precarious in that the period of adolescence is unaccounted for. What may appear to be over-reporting in retrospective reports may simply represent events experienced during the adolescent period. But caregiver reports on the experiences in the early years of a child’s life are also useful in understanding the impact of the early environment on later life, regardless of later recall, when confounding factors can be controlled for. In the first 11 years of the child’s life caregivers report a large burden of care at the household level with high levels of substance abuse, legal trouble, chronic unemployment, chronic illness and disability, and family death. Children and adolescents may not always be aware of the level of adversity or the subsequent strain put on caregivers. In this analysis there were overall low levels of agreement between the different ACEs reported prospectively by caregivers when compared to young adults’ retrospective reports, with the exception of physical and sexual abuse and exposure to IPV which showed high levels of concordance. A study on prospective mother reports and retrospective adolescent reports found similar results of moderate agreement when looking at physical abuse [85].
When comparing levels of agreement and concordance rates on the ACEs that were reported at age 11 by both the caregiver and the adolescent, the results similarly have low kappa values. There is high concordance between caregiver and child on divorce/separation and child separation. Both caregiver and child more or less agree on relatively low levels (absence) of divorce/separation in the home, and the presence of prolonged child separation. Findings in this study suggest that there is some concordance on specific ACEs whether or not they are reported as present or absent. One study found that, when comparing mother and offspring accounts of a range of adverse experiences, the two accounts tended to correspond when the adversity was absent [66]. The lowest concordance is found on chronic unemployment with adolescents reporting much lower levels of chronic unemployment in the household than caregivers at the same time. This raises issues around the type of ACEs different sources are able to report on; younger adolescents may be unaware of financial issues and the socio-economic status of the household in early childhood. Still, little research has been conducted on parents’, particularly mothers’, ability to provide a reliable account of their children’s experiences in childhood. For a number of reasons parents may intentionally or unintentionally minimize adverse events in a child’s life [86]. A study looking at mother and offspring retrospective reports of a range of childhood adversities found that mothers tend to under-report the frequency and severity of adverse events in their offspring’s childhood [66]. In a similar study, Henry and colleagues found overall low levels of agreement between prospective mother reports collected in a birth cohort and retrospective reports collected when the respondents were 18 [87]. Agreement was higher for more objective experiences such as residential moves, but much lower for psychosocial and family processes. In a study with a larger gap between reports, Offer and colleagues compared adolescent self-reports and retrospective reports at approximate age 48 and found significant differences between what adults remember about adolescence and what was reported in adolescence [88].
Overall the findings in this study suggest unreliability when prospective reports from longitudinal data are compared to retrospective reports. While concluding that retrospective reports in adult life of adverse experiences in childhood are sufficiently valid, a review of the evidence cautions that the recall of experiences that are open to a wide degree of interpretation and rely substantially on judgment are less satisfactorily reported than those that are linked to serious abuse, neglect and conflict [51]. Issues around the design of assessments used to elicit information about sensitive childhood experiences also affect the reliability of reports. In two studies that assessed childhood abuse using different measures, fairly high rates of agreement were found [64, 65]; and through examining longitudinal data on 46 childhood experiences, Yancura and Aldwin conclude that retrospective reports may be reliable subject to well-designed assessments [61]. Examining the prospective prevalence of different reported ACEs across a number of time points shows variation in the experiences of children. It is difficult to know to what extent this variation reflects actual changes in circumstances or perceptions at different time periods. Prospective reporting may very much depend on current state or mood and retrospective reporting on disposition and life outcomes. Whether an experience becomes part of an individual’s life story, to be reported on retrospectively, depends on a number of factors both at the time of the experience and in the years following it. Research suggests that these life stories are not shaped until the post-adolescent years [89], and may not be stable until middle age [90]. Another view is that retrospective and prospective approaches address fundamentally different questions. While a prospective design examines what proportion of children exposed to adverse experiences go on to develop negative outcomes, a retrospective design assesses what proportion of individuals presenting negative outcomes report exposure to adverse childhood experiences [68]. With this in mind, it is less an issue of which design is more valid or reliable, but which is better suited to the particular inquiry.
Study limitations
One limitation in the data is that questions probing adverse childhood experiences throughout the study were not phrased in exactly the same way at every wave of data collection. The ability to analyse agreement between sources of reporting was also limited given that there was overlap with caregiver and adolescent reports of ACEs on only a few variables at the 11 year time point.
Conclusion
As family structures change and new environments are open to children, their experiences and their understanding of these experiences are altered. Well-designed assessments of prospective and retrospective childhood experiences help to closely capture an account of what children experience over a given period. But our individual awareness, understanding and state during and after life events play a large role in what is recalled or reported. Alluding to a quote by Offer and colleagues [88], retrospective reports may be considered “existential reconstructions” of childhood, subject to a life story that fluctuates over the life course. The challenge is to identify which account of a life story has bearing on future outcomes, and to appreciate that the level of validity and reliability of an account depends, to some extent, on the purpose of inquiry.
Overall, South African children are exposed to a large number of different ACEs throughout childhood. Their retrospective recall of these experiences in young adulthood differs substantially from what is reported prospectively. In addition to more research on the reliability and validity of different reporting methods, multidisciplinary research is needed to explore how processes of memory formation and stress responses to physical and socioemotional context, particularly in the adolescent brain, affect the perception and recall of experiences located in childhood. Both prospective and retrospective accounts of adverse childhood experiences should be understood within these parameters, and used to answer research questions appropriate to their function. Retrospective reports may be valuable in eliciting information about experiences that remain with us after certain periods of time while prospective reports may be critical for understanding the mechanisms that determine health and wellbeing outcomes based on contemporaneous experiences, regardless of later recall.
Supporting information
S1 Text. Survey questions used for data collection.
https://doi.org/10.1371/journal.pone.0181522.s001
(PDF)
Acknowledgments
The Bt20+ study is funded by the Wellcome Trust (UK), the Medical Research Council of South Africa, the Human Sciences Research Council, the University of the Witwatersrand and supported by the DST-NRF Centre of Excellence in Human Development at the University of the Witwatersrand, Johannesburg.
References
- 1. Felitti VJ, Anda RF, Nordenberg D, Williamson DF, Spitz AM, Edwards V, et al. Relationship of Childhood Abuse and Household Dysfunction to Many of the Leading Causes of Death in Adults: The Adverse Childhood Experiences (ACE) Study. American Journal of Preventive Medicine. 1998;14(4):245–58. pmid:9635069
- 2. Anda RF, Tietjen G, Schulman E, Felitti VJ, Croft JB. Adverse childhood experiences and frequent headaches in adults. Headache. 2010;50:1473–81. pmid:20958295
- 3. Anda RF, Whitfield CL, Felitti VJ, Chapman D, Edwards VJ, Dube SR, et al. Adverse childhood experiences, alcoholic parents, and later risk of alcoholism and depression. Psychiatric Services. 2002;53(8):1001–9. pmid:12161676
- 4. Banyard VL, Williams LM, Siegel JA. The long-term mental health consequences of child sexual abuse: An exploratory study of the impact of multiple traumas in a sample of women. Journal of Traumatic Stress. 2001;14(4):697–715. pmid:11776418
- 5. Brown DW, Anda RF, Felitti VJ, Edwards VJ, Malarcher A, Croft JB, et al. Adverse childhood experiences are associated with the risk of lung cancer: a prospective cohort study. BMC Public Health. 2010;10(20). pmid:20085623
- 6. Dong M, Dube SR, Felitti VJ, Giles WH, Anda RF. Adverse childhood experiences and self-reported liver disease: new insights into the causal pathway. Archives of Internal Medicine. 2003;163(16):1949–56. pmid:12963569
- 7. Elstad JI. Childhood adversities and health variations among middle-aged men: A retrospective lifecourse study. European Journal of Public Health. 2005;15(1):51–8. pmid:15788804
- 8. Ford ES, Anda RF, Edwards VJ, Perry GS, Zhao G, Li C, et al. Adverse childhood experiences and smoking status in five states. Preventive Medicine. 2011;53(3):188–93. pmid:21726575
- 9. Hillis SD, Anda RF, Felitti VJ, Nordenberg D, Marchbanks PA. Adverse childhood experiences and sexually transmitted diseases in men and women: a retrospective study. Pediatrics. 2000;106(1):E11. pmid:10878180
- 10. Heusser S, Elkonin D. Childhood sexual abuse and HIV sexual-risk behaviour among men who have sex with men in South Africa. South African Journal of Psychology. 2013;44(1):83–96.
- 11. Kessler RC, McLaughlin KA, Green JG, Gruber MJ, Sampson NA, Zaslavsky AM, et al. Childhood adversities and adult psychopathology in the WHO World Mental Health Surveys. The British Journal of Psychiatry. 2010;197:378–85. pmid:21037215
- 12. Meade CS, Watt MH, Sikkema KJ, Deng LX, Ranby KW, Skinner D, et al. Methamhetamine use is associated with childhood sexual abuse and HIV sexual risk behaviors among patrons of alcohol-serving venues in Cape Town, South Africa. Drug Alcohol Depend. 2012;126(1–2):232–9. pmid:22717338
- 13. Oladeji BD, Makanjuola VA, Gureje O. Family-related adverse childhood experiences as risk factors for psychiatric disorders in Nigeria. The British Journal of Psychiatry. 2010;196:186–91. pmid:20194539
- 14. Ramiro LS, Madrid B, Brown DW. Adverse childhood experiences (ACE) and health-risk behaviors among adults in a developing country setting. Child Abuse & Neglect. 2010;34(11):842–55.
- 15. Reuchlein B, Henn L, Brian T, Schier K, Hardt J. Childhood adversities and adult headache in Poland and Germany. PlosOne. 2016;11(2):e0148162.
- 16. Richter L, Komárek A, Desmond C, Celentano D, Morin S, Sweat M, et al. Reported Physical and Sexual Abuse in Childhood and Adult HIV Risk Behaviour in Three African Countries: Findings from Project Accept (HPTN-043). AIDS and Behavior. 2013;18(2):381–9.
- 17. Slopen N, Williams DR, Seedat S, Moomal H, Herman A, Stein DJ. Adversities in childhood and adult psychopathology in the South Africa Stress and Health Study: associations with first-onset DSM-IV disorders. Social Science & Medicine. 2010;71(10):1847–18554.
- 18. Stein DJ, Chiu WT, Hwang I, Kessler RC, Sampson NA, Alonso J, et al. Cross-national analysis of the associations between traumatic events and suicidal behavior: findings from the WHO World Mental Health Surveys. PlosOne. 2010;5(5):e10574.
- 19. Whitaker RC, Dearth-Weslet T, Gooze RA, Becker BD, Gallagher KC, McEwen BS. Adverse childhood experiences, dispositional mindfulness, and adult health. Preventive Medicine. 2014;67:147–53. pmid:25084563
- 20. Wise LA, Zierler S, Krieger N, Harlow BL. Adult onset of major depressive disorder in relation to early life violent victimisation: a case-control study. The Lancet. 2001;358(9285):881–7.
- 21. Bruffaerts R, Demyttenaere K, Borges G, Haro JM, Chiu WT, Hwang I, et al. Childhood adversities as risk factors for onset and persistence of suicidal behaviour. The British Journal of Psychiatry. 2010;197(1):20–7. pmid:20592429
- 22. Dong M, Anda RF, Felitti VJ, Dube SR, Williamson DF, Thompson TJ, et al. The interrelatedness of multiple forms of childhood abuse, neglect, and household dysfunction. Child Abuse & Neglect. 2004;28(7):771–84.
- 23. Radford L, Corral S, Bradley C, Fisher HL. The prevalence and impact of child maltreatment and other types of victimization in the UK: findings from a population survey of caregivers, children and young people and young adults. Child Abuse & Neglect. 2013;37:801–13.
- 24. Kabiru C, Beguy D, Crichton J, Ezeh AC. Self-reported drunkenness among adolescents in four sub-Saharan African countries: associations with adverse childhood experiences. Child and Adolescent Psychiatry and Mental Health. 2010;4(17). pmid:20569490
- 25. Jewkes RK, Dunkle K, Nduna M, Jama PN, Puren A. Associations between childhood adversity and depression, substance abuse and HIV and HSV2 incident infections in rural South African youth. Child Abuse & Neglect. 2010;34(11):833–41.
- 26. Jewkes R, Dunkle K, Koss MP, Levin JB, Nduna M, Jama N, et al. Rape perpetration by young, rural South African men: prevalence, patterns and risk factors. Social Science & Medicine. 2006;63:2949–61.
- 27. Cluver L, Orkin M, Boyes ME, Sherr L. Child and Adolescent Suicide Attempts, Suicidal Behavior, and Adverse Childhood Experiences in South Africa: A Prospective Study. Journal of Adolescent Health.57(1):52–9. pmid:25936843
- 28. Brown DW, Riley L, Butchart A, Meddings DR, Kann L, Phinney Harvey A. Exposure to physical and sexual violence and adverse health behaviours in African children: results from the Global School-based Student Health Survey. Bull World Health Organ. 2009;87:447–55. pmid:19565123
- 29. Kounou KB, Bui E, Dassa KS, Hinton D, Fischer L, Djassoa G, et al. Childhood trauma, personality disorder symptoms and current major depressive disorder in Togo. Soc Psychiatry Psychiatr Epidemiol. 2012;48(1095). pmid:23224674
- 30. Williams SL, Williams DR, Stein DJ, Seedat S, Jackson PB, Moomal H. Multiple traumatic events and psychological distress: the South Africa Stess and Health Study. J Trauma Stress. 2007;20(5):845–55. pmid:17955545
- 31. Lansford JE, Dodge KA, Pettit GS, Bates JE, Crozier J, Kaplow J. A 12-year prospective study of the long-term effects of early child physical maltreatment on psychological, behavioral, and academic problems in adolescence. Arch Pediatr Adolesc Med. 2002;156:824–30. pmid:12144375
- 32. Jones DJ, Runyan DK, Lewis T, Litrownik AJ, Black MM, Wiley T, et al. Trajectories of childhood sexual abuse and eary adolescent HIV/AIDS risk behaviors: the role of other maltreatment, witnessed violence, and child gender. Journal of Clinical Child & Adolescent Psychology. 2010;39(5):667–80.
- 33. Thomas C, Hypponen E, Power C. Obesity and Type 2 Diabetes Risk in Midadult Life: The Role of Childhood Adversity. Pediatrics. 2008;121(5):e1240–e9. pmid:18450866
- 34. Schilling EA, Aseltine RHJ, Gore S. Adverse childhood experiences and mental health in young adults: A longitudinal survey. BMC Public Health. 2007;7(30). pmid:17343754
- 35. Kelly-Irving M, Lepage B, Dedieu D, Bartley M, Blane D, Grosclaude P, et al. Adverse childhood experiences and premature all-cause mortality. European Journal of Epidemiology. 2013;28:721–34. pmid:23887883
- 36. Jones GT, Power C, Macfarlane GJ. Adverse events in childhood and chronic widespread pain in adult life: Results from the 1958 British Birth Cohort Study. Pain. 2009;143:92–6. pmid:19304391
- 37. Danese A, Moffitt TE, Harrington H, Milne BJ, Polanczyk G, Pariante CM, et al. Adverse childhood experiences and adult risk factors for age-related disease. Arch Pediatr Adolesc Med. 2009;163(2):1135–43.
- 38. Kauhanen L, Leino J, Lakka H-M, Lynch JW, Kauhanen J. Adverse Childhood Experiences and Risk of Binge Drinking and Drunkenness in Middle-Aged Finnish Men. Advances in Preventive Medicine. 2011;2011:1–12.
- 39. Horwitz AV, Widom CS, McLaughlin J, White HR. The Impact of Childhood Abuse and Neglect on Adult Mental Health: A Prospective Study. Journal of Health and Social Behavior. 2001;42(2):184. pmid:11467252
- 40. Clark C, Cladwell T, Power C, Stansfeld SA. Does the influence of childhood adversity on psychopathology persist across the lifecourse? A 45-year prospective epidemiologic study. Annals of Epidemiology. 2010;20(5):385–94. pmid:20382340
- 41. Varese F, Smeets F, Drukker M, Lieverse R, Lataster T, Viechtbauer W, et al. Childhood adversities increase the risk of psychosis: A meta-analysis of pateint-control, prospective and cross-sectional chort studies. Schizophrenia Bulletin. 2012;38(4):661–71. pmid:22461484
- 42. White HR, Widom CS, Chen P-H. Congruence between adolescents' self-reports and their adult retrospective reports regarding parental discipling practices during their adolescence. Psychological Reports. 2007;101:1079–94. pmid:18361122
- 43. Lewis M. Memory and Psychoanalysis: A New Look at Infantile Amnesia and Transference. Journal of the American Academy of Child & Adolescent Psychiatry. 1995;34(4):405–17.
- 44. Pillemer DB, White SH. Childhood Events Recalled by Children and Adults. Behavior. 1989;21:297–340.
- 45. Bremner JD. Does stress damage the brain? Biological Psychiatry. 1999;45(7):797–805. pmid:10202566
- 46.
Rothman KJ, Greenland S. Modern epidemiology. Philadelphia, PA: Lippincott-Raven Publications; 1998.
- 47. Williams LM. Recovered memories of abuse in women with documented child sexual victimization histories. Journal of Traumatic Stress. 1995;8(4):649–73. pmid:8564277
- 48. Rich CL. Accuracy of adults' reports of abuse in childhood. American Journal of Psychiatry. 1990;147(10):1389–90. pmid:2400019
- 49. Williams LM. Recall of childhood trauma: A prospective study of women's memories of child sexual abuse. Journal of Consulting and Clinical Psychology. 1994;62(6):1167–76. pmid:7860814
- 50. Widom CS, Morris S. Accuracy of adult recollections of childhood victimization Part II: Childhood sexual abuse. Psychological Assessment. 1997;9(1):34–46.
- 51. Hardt J, Rutter M. Validity of adult retrospective reports of adverse childhood experiences: review of the evidence. J Child Psychol & Psychiat. 2004;45(2):260–73.
- 52. Dube SR, Williamson DF, Thompson T, Felitti VJ, Anda RF. Assessing the reliability of retrospective reports of adverse childhood experiences among adult HMO members attending a primary care clinic. Child Abuse & Neglect. 2004;28(7):729–37.
- 53. Dill DL, Chu JA, Grob MC, Eisen SV. The reliability of abuse history reports: A comparison of two inquiry formats. Comprehensive Psychiatry. 1991;32(2):297–312.
- 54. Friedrich WN, Talley NJ, Panser L, Fett S, Zinsmeister AR. Concordance of Reports of Childhood Abuse by Adults. Child Maltreatment. 1997;2(2):164–71.
- 55. Fry RP, Rozewicz LM, Crisp AH. Interviewing for sexual abuse: reliability and effect of interviewer gender. Child Abuse & Neglect. 1996;20(8):725–9.
- 56. Kooiman CG, Ouwehand AW, ter Kuile MM. The Sexual and Physical Abuse Questionnaire (SPAQ). A screening instrument for adults to assess past and current experiences of abuse. Child Abuse & Neglect. 2002;26(9):939–53.
- 57. Leserman J, Drossman DA, Li Z. The reliability and validity of a sexual and physical abuse history questionnaire in female patients with gastrointestinal disorders. Behav Med. 1995;21(3):141–50. pmid:8789650
- 58. Martin J, Anderson J, Romans S, Mullen P, O'Shea M. Asking about child sexual abuse: methodological implications of a two stage survey. Child Abuse & Neglect. 1993;17(3):383–92.
- 59. Meyer IH, Muenzenmaier K, Cancienne J, Struening E. Reliability and validity of a measure of sexual and physical abuse histories among women with serious mental illness. Child Abuse & Neglect. 1996;20(3):213–9.
- 60. Mills K, Teesson M, Darke S, Ross J. Reliability of self-reported trauma exposure among people with heroin dependence: a longitudinal investigation. J Trauma Stress. 2007;20(3):313–23. pmid:17598137
- 61. Yancura LA, Aldwin CM. Stability and change in retrospective reports of childhood experiences over a 5-year period: findings from the Davis Longitudinal Study. Psychol Aging. 2009;24(3):715–21. pmid:19739927
- 62. Fergusson DM, Horwood LJ, Boden JM. Structural equation modeling of repeated retrospective reports of childhood maltreatment. International Journal of Methods in Psychiatric Research. 2011;20(2):93–104. pmid:21495111
- 63. Pinto R, Correia L, Maia Â. Assessing the Reliability of Retrospective Reports of Adverse Childhood Experiences among Adolescents with Documented Childhood Maltreatment. Journal of Family Violence. 2014;29(4):431–8.
- 64. Lipschitz DS, Bernstein DP, Winegar RK, Southwick SM. Hospitalized adolescents' reports of sexual and physical abuse: a comparison of two self-report measures. J Trauma Stress. 1999;12(4):641–54. pmid:10646182
- 65. DiLillo D, Fortier MA, Hayes SA, Trask E, Perry AR, Messman-Moore T, et al. Retrospective assessment of childhood sexual and physical abuse: A comparison of scales and behaviorally specific approaches. Assessment. 2006;13(3):297–312. pmid:16880281
- 66. Fisher HL, Bunn A, Jacobs C, Moran P, Bifulco A. Concordance between mother and offspring retrospective reports of childhood adversity. Child Abuse & Neglect. 2011;35(2):117–22.
- 67. Everson MD, Smith JB, Hussey JM, English D, Litrownik AJ, Dubowitz H, et al. Concordance between adolescent reports of childhood abuse and child protective service determinations in an at-risk sample of young adolescents. Child Maltreatment. 2008;13(1):14–26. pmid:18174345
- 68. Widom CS, Weiler BL, Cottler LB. Childhood victimization and drug abuse: A comparison of prospective and retrospective findings. Journal of Consulting and Clinical Psychology. 1999;67(6):867–80. pmid:10596509
- 69. Raphael KG, Widom CS, Lange G. Childhood victimization and pain in adulthood: a prospective investigation. Pain. 2001;92(1–2):283–93. pmid:11323150
- 70. Swahn MH, Whitaker DJ, Pippen CB, Leeb RT, Teplin LA, Abram KM, et al. Concordance between self-reported maltreatment and court records of abuse or neglect among high-risk youths. American Journal of Public Health. 2006;96(10):1849–53. pmid:17008582
- 71. McBeth J, Macfarlane GJ, Benjamin S, Morris S, Silman AJ. Associations between adverse events in childhood and chronic widespread pain in adulthood: Are they explained by differential recall? Journal of Rhematology. 1999;28:2305–9.
- 72. Richter L, Norris S, Pettifor J, Yach D, Cameron N. Cohort Profile: Mandela's children: The 1990 Birth to Twenty Study in South Africa. International Journal of Epidemiology. 2007;36(3):504–11. pmid:17355979
- 73. Finlay-Jones R, Scott R, Duncan-Jones P, Byrne D, Henderson S. The reliability of reports of early separations. Aust N Z J Psychiatry. 1981;15(1):27–31. pmid:6942830
- 74. Hardt J, Sidor A, Bracko M, Egle UT. Reliability of retrospective assessments of childhood experiences in Germany. J Nerv Ment Dis. 2006;194(9):676–83. pmid:16971819
- 75. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74. pmid:843571
- 76. De Mast J. Agreement and Kappa-Type Indices. The American Statistician. 2007;61(2):148–53.
- 77.
Sacks V, Murphey D, Moore K. Adverse Childhood experiences: National and state-level prevalence. Bethesda, MD: Child Trends. Research Brief Publication #2014–28. 2014.
- 78. Hughes K, Lowey H, Quigg Z, Bellis MA. Relationships between adverse childhood experiences and adult mental well-being: results from an English national household survey. BMC Public Health. 2016;16(1):222.
- 79.
World Health Organization. Survey on the prevalence of adverse childhood experiences among young people in the Russian Federation. Denmark: WHO, Regional Office for Europe. 2014.
- 80. Soares AL, Howe LD, Matijasevich A, Wehrmeister FC, Menezes AM, Goncalves H. Adverse childhood experiences: Prevalence and related factors in adolescents of a Brazilian birth cohort. Child Abuse & Neglect. 2016;51:21–30.
- 81. Reuben A, Moffitt TE, Caspi A, Belsky DW, Harrington H, Schroeder F, et al. Lest we forget: comparing retrospective and prospective assessments of adverse childhood experiences in the prediction of adult health. Journal of Child Psychology and Psychiatry. 2016;57(10):1103–12. pmid:27647050
- 82. Janssen SM, Murre JM. Reminiscence bump in autobiographical memory: unexplained by novelty, emotionality, valence, or importance of personal events. The Quarterly Journal of Experimental Psychology. 2008;61(12):1847–60. pmid:19031155
- 83. Fuhrmann D, Knoll LJ, Blakemore S-J. Adolescence as a sensitive period of brain development. Trends in Cognitive Science. 2015;19(10):558–66.
- 84. Fergusson DM, Horwood LJ, Woodward LJ. The stability of child abuse reports: a longitudinal study of the reporting behaviour of young adults. Psychological Medicine. 2000;30(3):529–44. pmid:10883709
- 85. Tajima EA, Herrenkohi TI, Huang B, Whitney SD. Measuring child maltreatment: A comparison of prospective parent reports and retrospective adolescent reports. American Journal of Orthopsychiatry. 2004;74(4):424–36. pmid:15554804
- 86. Bifulco A, Brown GW, Lillie A, Jarvis J. Memories of childhood neglect and abuse: Corroboration in a series of sisters. Journal of Child Psychology and Psychiatry. 1997;38(3):365–74. pmid:9232482
- 87. Henry B, Moffitt TE, Caspi A, Langley J, Silva PA. On the “remembrance of things past:” A longitudinal evaluation of the retrospective method. Psychological Assessment. 1994;6:92–101.
- 88. Offer D, Kaiz M, Howard KI, Bennet ES. The altering of reported experiences. Journal of the American Academy of Child & Adolescent Psychiatry. 2000;39(6):735–42.
- 89. Habermas T, Bluck S. Getting a life: The emergence of the life story in adolescence. Psychological Bulletin. 2000;126(5):748–69. pmid:10989622
- 90. Widom CS, Raphael KG, DuMont KA. The case for prospective longitudinal studies in child maltreatment research: Commentary on Dude, Williamson, Thompson, Felittii, and Anda (2004). Child Abuse & Neglect. 2004;28:715–22.