Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Reliability and Validity of an Interviewer-Administered Adaptation of the Youth Self-Report for Mental Health Screening of Vulnerable Young People in Ethiopia

Abstract

Objective

Evaluate the reliability and validity of the Youth Self-Report (YSR) as a screening tool for mental health problems among young people vulnerable to HIV in Ethiopia.

Design

A cross-sectional assessment of young people currently receiving social services.

Methods

Young people age 15–18 participated in a study where a translated and adapted version of the YSR was administered by trained nurses, followed by an assessment by Ethiopian psychiatrists. Internal reliability of YSR syndrome scales were assessed using Chronbach's alpha. Test-retest reliability was assessed through repeating the YSR one month later. To assess validity, analysis of the sensitivity and specificity of the YSR compared to the psychiatrist assessment was conducted.

Results

Across the eight syndrome scales, the YSR best measured the diagnosis of anxiety/depression and social problems among young women, and attention problems among young men. Among individual YSR syndrome scales, internal reliability ranged from unacceptable (Chronback’s alpha = 0.11, rule-breaking behavior among young women) to good (α≥0.71, anxiety/depression among young women). Anxiety/depression scores of ≥8.5 among young women also had good sensitivity (0.833) and specificity (0.754) to predict a true diagnosis. The YSR syndrome scales for social problems among young women and attention problems among young men also had fair consistency and validity measurements. Most YSR scores had significant positive correlations between baseline and post-one month administration. Measures of reliability and validity for most other YSR syndrome scales were fair to poor.

Conclusions

The adapted, personally administered, Amharic version of the YSR has sufficient reliability and validity in identifying young vulnerable women with anxiety/depression and/or social problems, and young men with attention problems; which were the most common mental health disorders observed by psychiatrists among the migrant populations in this study. Further assessment of the applicability of the YSR among vulnerable young people for less common disorders in Ethiopia is needed.

Introduction

HIV prevalence among young people in Ethiopia age 15 to 24 is 0.3%, with young women more vulnerable to infection than young men (0.5% female, 0.1% male). Risk of infection is higher among young people living in urban settings, including Addis Ababa (1.7% female, 0.2% male) [1]. Many young people migrate to Addis Ababa from rural areas to seek employment, and many of these migrant workers are female and have little or no education [23]. Many young female migrate to urban areas to escape early marriage, earn very low income as domestic workers, and are at increased risk of early sexual initiation and victimization to sexual violence [4]. Some young male migrants have no stable residence, employment, or family support system—are often classified as “street boys” as a result—and are also susceptible to sexual abuse [57].

Living in difficult situations such as abusive domestic employment or in street environments have been found to contribute to mental health disorders among young people. Some reports have previously described linkages between social and environmental factors and sexual abuse among young people in Ethiopia, and are often associated with negative psychosocial outcomes [811]. The overall prevalence of depression among adults 18 and older in Ethiopia is estimated to be 9.1%, [12] with limited information on population-based prevalence of other mental health disorders.

There is mixed evidence on how HIV-related clinical outcomes are affected by mental health disorders, although global studies show good evidence that adverse mental health conditions—especially depression—reduce antiretroviral adherence [13,14]. In Ethiopia, previous studies have investigated mental health disorders in maternal and child health contexts and settings [15,16], quality of life among HIV and tuberculosis co-infected patients [17,18], and behavioral and emotional disorders among children on antiretroviral therapy [19]. These studies found associations with mental health disorders and adverse health impacts, including childhood malnutrition and tuberculosis co-infection. The impact of targeted mental health interventions on HIV-related outcomes worldwide [14] and in Ethiopia, however, remains limited.

Towards improving the evaluation of mental health interventions for young people vulnerable to HIV in Ethiopia, a necessary initial step is to develop or adapt assessment tools by which mental health status might be measured. Review of the medical literature reveals limited systematic scale development efforts in Ethiopia, and prior documented efforts have focused mainly on validation of depression scales [20,21]. There are limited or no documented efforts to validate a scale for mental health assessment among young people specifically. The aim of this study was to select and adapt such a tool for use in Ethiopia, and assess the reliability and validity among a sample of vulnerable young people receiving social services.

Methods

Study population

This study was conducted among vulnerable young people receiving social services in Addis Ababa by USAID’s HIVCore Project. Young women were recruited through the Population Council’s PEPFAR-supported Biruh Tesfa project, which provides support and addresses HIV risk for migrant girls who have come to Addis Ababa for work. Services provided by Biruh Tesfa include basic education, life skills training, and mental and physical health referrals. Young men were recruited through Retrak, a non-governmental organization which primarily works to empower street boys to obtain more stable social living environments, health care, shelter, and support.

To be eligible for this study, all participants were required to be registered recipients of services from Biruh Tesfa or Retrak within the past 3 months, age 15 to 18, and able to provide informed consent. While Biruh Tesfa and Retrak provide services to both older and younger people outside of the 15 to 19 age range, the minimum age of this study was 15 due to ethical and consent considerations. A maximum age of 18 was set, as the final screening tool selected for this study was designed for people age 18 or younger.

Measures

Selection, background, structure, and adaptation of the Youth Self Report (YSR).

To initially identify and select a mental health screening tool for adaptation, a committee of psychiatrists, psychologists, public health professionals, service providers, and social science researchers was convened in Addis Ababa, Ethiopia. Screening tools previously validated outside of Ethiopia were reviewed and discussed, including the Symptom Assessment 45 Questionnaire [22,23], the Symptom Checklist 90 [24], the Strengths and Difficulties Questionnaire [25], and the Achenbach System of Empirical Based Assessment (ASEBA) [26]. The committee considered the applicability of these tools in Ethiopia based on the following criteria: guidance available for administration, scoring, and results interpretation; ease of administration; applicability of the tool for the target age group; and adequate coverage range of mental health conditions, including anxiety and depression. Upon review of the above, the committee selected the ASEBA Youth Self-Report (YSR) form for administration.

The YSR is a widely used self-administered questionnaire for the assessment of emotional and behavioral issues among young people age 11 to 18 years. Previous studies have established the YSR as having generally good internal consistency and test-retest reliability [26], with variable cross-informant agreement across societies [27]. Other studies have assessed the content validity of YSR scales with generally strong historical results [26], including more recent assessments assessing the YSR as a measure of depression [28], suicidality [29], and anxiety and affective problems [30,31]. The YSR has frequently been the subject of assessments of criterion validity, sometimes as a primary instrument of evaluation [32,33], but the YSR is also frequently utilized as a comparison tool in validation studies assessing newer original or adapted scales [3441].

Geographic application of the YSR has been broad-based, including recent worldwide reports of YSR use in North America [42,43], South America [44], Europe [45,46], Asia [4749], Australia [50], Middle East and North Africa [51,52], and sub-Saharan Africa [53]. However, studies objectively assessing the development, reliability, and validity of the YSR in developing countries are more limited [54, 55].

In this study, a total of 105 items from the YSR questionnaire were used to assess the validity and reliability of scores for eight syndrome scales (anxious/depressed, withdrawn/depressed, somatic complaints, social problems, thought problems, attention problems, rule-breaking behavior, and aggressive behavior), an internalizing problem scale (combining scores from anxious/depressed, withdrawn/depressed, and somatic complaints), and an externalizing problem scale (combining scores from rule breaking behavior and aggressive behavior). YSR items are framed as statements about a life experience within the past 6 months, whereupon respondents provide a response of “not true” (scored as 0), “somewhat or sometimes true” (1), or “very true or often true” (2). Additionally, scales designed to approximate diagnoses from the Diagnostic and Statistical Manual of Mental Disorders, 4th Edition (DSM-IV) [56] were scored for affective problems, anxiety problems, somatic problems, attention deficit/hyperactivity problems, oppositional defiant problems, and conduct problems. All scales and scores were defined and calculated according to ASEBA guidelines [26,57].

Initial adaptation of phrasing and content of some YSR items, and forward translation of the YSR questionnaire from English to Amharic, was conducted by a psychologist, whereupon the Amharic version was reviewed by the study advisory committee comprised of the lead study psychologist (Bahir Dar University), a psychometrician (Addis Ababa University), an independent psychiatrist (Amanuel Mental Health Hospital), service providers from Biruh Tesfa and Retrak, and research officers from the study implementers (HIVCore/Population Council). After discussion and modification, the Amharic was then back-translated to English by a professional translator. Both Amharic and back-translated English versions were again reviewed by the study advisory committee, until the Amharic version was pilot tested, further modified, and then finalized.

Psychiatric assessment.

After the participants completed the Amharic version of the YSR, two Ethiopian licensed junior psychiatrists trained at Addis Ababa University (blinded from the YSR results) conducted clinical assessments of participants. For this study, the psychiatrists recorded confidential examination notes, and then recorded if the respondents had a clinical diagnosis equivalent to any of the eight syndrome scales scored by the YSR (anxious/depressed, withdrawn/depressed, somatic complaints, social problems, thought problems, attention problems, rule-breaking behavior, and/or aggressive behavior). This was recorded categorically as “yes” (diagnosed) or “no” (not diagnosed). The psychiatrists were trained in accordance with international standards and in cooperation with international partners [58,59]. Study participants who were diagnosed by the psychiatrists were given appropriate referrals in accordance with the World Health Organization’s evidence-based mental health Gap Action Programme (mhGAP) guidelines for diagnosis and treatment [60]. Study procedures.

Given low expected levels of literacy among the target population, the questionnaire was modified to be administered by trained and experienced nurses. At baseline, young men receiving services from the Retrak project and young women involved in the Biruh Tesfah project were approached and invited by the study team using a convenience sampling based on the eligibility criteria. After obtaining informed consent from participants, the YSR was administered and then immediately followed by the psychiatrist assessment. Participants were then invited to repeat both assessments after a period of one month.

Data analysis

YSR questionnaires and psychiatrist forms were entered into an electronic database, checked for accuracy, and analyzed using IBM SPSS Statistics 21.0 (Armonk, NY: IBM Corp.). Median YSR scores were computed according to guidelines in the ASEBA manual [26].

Handling of missing data.

Given that the YSR was administrated to participants by trained counselors and clinical nurses in this study, missing data levels were minimal (0.20% of all values). No single YSR item had more than 3.0% (4/134) of case data missing, and no participant had more than 3 of 105 (2.9%) total YSR items missing. Of all participants, 17.2% (23/134)—25.4% of 67 young women and 9.0% of 67 young men—had at least one of the 105 items missing. Within the YSR subscales, however, no more than 4.5% (6/134) of participants had missing data, with the highest at 7.5% (5/67) among young women and 1.5% (1/67) among young men.

For the analysis of internal reliability, missing values were not replaced. For the analysis of test-retest reliability and criterion validity of YSR scores, to maintain optimal sample size and variability in the samples respondents were assumed to not have a “not true” response and items with missing values were given a value of 0. The analysis was repeated without replacement of missing values (not presented in this manuscript) and results were similar and yielded the same conclusions and interpretation.

Reliability.

Internal consistency of the responses on each of the YSR scales was assessed with Cronbach’s alpha coefficients. Differences in coefficients between young women and men were tested for statistical significance [61,62].

Test-retest reliability was assessed through comparison of scores among participants who were administrated the YSR at both baseline and one month later. Scores on YSR scales were assessed for distribution, and differences between baseline and follow-up medians were tested using the Wilcoxon signed-rank test. To measure correlations between baseline and one-month follow-up scores, Pearson’s product-moment correlation coefficients were calculated.

Validity.

Criterion validity was assessed by analyzing the concurrence between the baseline (first interview) YSR scores and the psychiatric assessments. Scores of participants who were reported by psychiatrists to have a mental disorder in line with the YSR syndrome scales were compared to scores of participants who did not. Measures of central tendency (median and mean) and the underlying distribution of the data were assessed, and the Mann-Whitney U test was used to determine significant differences. A receiver operating characteristic (ROC) analysis was conducted to determine “area under the curve” (AUC) values, which measure the degree to which the YSR scores predict the binary measurement of the psychiatric diagnosis (participant has a mental health problem, does not have a problem).

For scores disaggregated by sex (female participants in Biruh Tesfa, and male participants in Retrak) that were found to be meaningfully (P<0.05) or marginally (P<0.12) statistically associated with psychiatric assessments, the sensitivity and specificity of the selected YSR syndrome scores were evaluated.

Ethical review

This study was reviewed and approved by the Ethiopia Ministry of Science and Technology National Research Ethics Review Committee (NRERC) and the Population Council Institutional Review Board. All study participants gave written informed consent. Participants age 15 to 17 were living in migrant situations requiring them to make serious daily life decisions on their own, and many were not living with a parent or guardian. Based on their independent living status signified by enrolment in Biruh Tesfa and Retrak projects, all participants age 15 to 17 were classified as emancipated minors, and provided written informed consent on their own behalf. The ethics committees approved the classification of the study population as emancipated minors on this basis, and fully reviewed and approved the consent procedures and forms. The data used for this study were anonymized and not linked to personal information in project or other records.

Results

A total of 134 young people were administered the adapted YSR, including 67 young men enrolled in the Retrak project and 67 young women in Biruh Tesfa (Table 1). The mean age of both participant groups was 15.7 years. The majority of participants were of Oromo (40.3%) or Amhara (26.1%) ethnicity, with substantial differences between young men and women in Welayta (23.9 versus 3.0%) and Gurage (3.0% versus 11.9%) enrollment. Young men in the study were most likely to report earning money through daily labor activities (79.1%), while almost all the young women worked as housemaids (97%). Most of the respondents were not currently in school (data not shown).

thumbnail
Table 1. Basic characteristics of participants assessed by the YSR.

https://doi.org/10.1371/journal.pone.0147267.t001

Reliability

Consistency on most individual YSR syndrome scales for both young men and women ranged from unacceptable (α<0.5) to poor (α≥0.5 and α<0.6) (Table 2). The YSR showed acceptable (α≥0.6 and α<0.7) to good (α≥0.7) internal consistency with the anxious/depressed (α = 0.628 young men; α = 0.710 young women) and withdrawn/depressed (α = 0.549 men; α = 0.624 women) scales. The YSR also showed much better internal consistency for young men than women for the rule-breaking (α = 0.57 versus α = 0.115, P = 0.007) and aggressive (α = 0.693 versus α = 0.409, P = 0.014) behavior scales. This was reflected in significantly different broad externalizing scale scores (α = 0.750 versus α = 0.428, P = 0.002), while internalizing scale scores showed good internal consistency for both young men (α = 0.767) and women (α = 0.812). Results were similar in the DSM-oriented scales, where internal consistency was stronger for both young men and women in the affective problems scale (α = 0.721 and α = 0.683); while differing significantly in the somatic problems (0.477 versus α = 0.000, P = 0.025), oppositional defiant problems (α = 0.707 versus α = 0.267, P = 0.003), and conduct problems (α = 0.600 versus α = 0.059, P = 0.002) scales.

thumbnail
Table 2. Internal consistency of the YSR among young men and women in Ethiopia.

https://doi.org/10.1371/journal.pone.0147267.t002

After one month, 50 of the 67 young male participants (74.6%) and 61 of the 67 female participants (91.0%) were re-administered the YSR. Across nearly all the syndrome, broad band, and DSM-oriented scales; scores were significantly lower one month later (Table 3). The one-month scores, however, mostly remained positively and significantly correlated with the baseline YSR scores.

thumbnail
Table 3. Comparison and correlations of YSR scores between baseline and 1-month follow-up measurements.

https://doi.org/10.1371/journal.pone.0147267.t003

Validity

Table 4 compares the baseline YSR median syndrome scores between participants who did, and did not, receive a confirmatory psychiatric diagnosis, and reports the results of the corresponding ROC analyses. Psychiatric diagnoses were most strongly associated with higher median scores and predictive ROC curves for the anxious/depressed scale for young women (P = 0.003; AUC = 0.846, P = 0.005), the social problem scale for young women (P = 0.004; AUC = 0.774, P = 0.004), and the attention problems scale for young men (P = 0.100; AUC = 0.850, P = 0.094).

thumbnail
Table 4. Comparison of YSR syndrome scales by confirmatory psychiatric diagnosis; scoring and ROC AUC values.

https://doi.org/10.1371/journal.pone.0147267.t004

For these three syndrome scales, Table 5 shows the predictive sensitivity and specificity of selected scores. For anxiety/depression scores, the optimal female score of ≥ 8.5 has a sensitivity of 0.833 and specificity of 0.754, while a total—or combined male and female—score of ≥ 6.5 was less predictive with 0.750 sensitivity and 0.631 specificity. The social problems score for young women of ≥ 3.5 had a sensitivity of 0.727 and specificity of 0.679, while the same score for men was more sensitive (0.818) but much less specific (0.536). Only young men were diagnosed with attention problems and the scale score of ≥ 3.5 was very accurate with a sensitivity of 1.000, but much less specific at 0.600.

thumbnail
Table 5. Sensitivity and specificity for diagnosis of anxious/depression problems, social problems, and attention and rule-breaking problems.

https://doi.org/10.1371/journal.pone.0147267.t005

Discussion

This study adapted an interviewer-administered Amharic version of the YSR, and findings indicate that the YSR has sufficient reliability and validity in identifying young vulnerable women with two of the eight syndrome scales (anxiety/depression and/or social problems), and young men with one of the syndrome scales (attention problems), in Addis Ababa, Ethiopia. This study did not measure acceptable reliability and validity for the remainder of the eight YSR syndrome scales. The YSR syndrome scale scores observed in this study for anxiety/depression and social problems reflected the most common manifestations of these problems observed among young men and women by psychiatrists within the study population. The effectiveness of the YSR for identifying depression problems, particularly, is also consistent with other studies that have tested the YSR in other settings [28,29,33].

Analysis in this study may have been affected by the smaller sample sizes, in part due to low prevalences of some of the disorders that were assessed by the YSR. Internal consistencies as measured by Cronbach’s alpha were lower than expected. While the literature conveys that alphas of ≥ 0.70 reflect ideal internal consistency [63,64,65], this study only measured α ≥ 0.70 on one individual syndrome scale (young women, anxious/depressed) and only measured α ≥ 0.60 in three cases (young women, withdrawn/depressed; and young men, anxious/depressed and aggressive behavior). The broad band scores of reflecting internalizing and externalizing items showed good internal consistency, although this is expected for most scales with larger numbers of items [66]. Reliability and validity of the YSR for measuring somatic problems among young men, and especially for defiant/aggressive problems among young girls, were poor. This is probably the result of low prevalences of these disorders in the study populations.

This study’s assessment of test-retest reliability was limited in that the one-month retest was biased by what may have been an intervention effect. A full assessment of intervention impact will be conducted under a separate study. The participants’ involvement in Retrak and Biruh Tesfa programming was ongoing during this study, which may have influenced the improvements in participant mental health status as shown in Table 3. Another limitation was that the psychiatrist assessments for this study were not based on a standardized and/or validated clinical tool and categorized the diagnoses according to the YSR domains, and thus there may have been some incorporation bias in diagnoses or syndrome classification as a result.

Despite these limitations, the YSR scores in this study highlighted plausible disorders among the young women who were mostly domestic workers (depression and social problems) and young men who were predominantly street-based laborers (attention problems). The results also correlated well with disorders observed by study psychiatrists. As a result, the study advisory committee determined that the YSR could be used in Ethiopia to indicate these gender-specific disorders. At the same time, YSR scores may differ in meaning or interpretation between young men and women, as shown by differences by sex in sensitivity and specificity between similar scores.

Results from this study and a separate needs assessment were used to inform the intervention development, of which implementation and analysis is currently ongoing. Further assessment is needed to refine and verify these results, as well as determine whether administration of the full 105-item YSR is efficient and necessary with young migrant populations, or if a brief version of the YSR may be adapted. Efforts to continue to identify the mental health needs and intervention needs for vulnerable young people in Ethiopia are encouraged.

Data Availability Statement

Ethical and legal restrictions make data unsuitable for public deposition. Contact dataaccess@popcouncil.org to request an anonymized dataset.

We are unable to provide the YSR tool used by this study as a supplemental file due to legal restrictions. More information and a copy of the YSR questionnaire is available at www.aseba.org.

Acknowledgments

We would like to thank members of the expert committee who assisted authors in selection and adaptation of the study screening tool, reviewed the data from the validation study component, and agreed on interpretation of the syndrome scores for diagnoses: Moges Ayehu Admassu (Amanuel Hospital), Ruth Tessera (Mekele University), Benyam Worku Dubale (Jimma University), Rahel Tesfye (Organization for Prevention, Rehabilitation and Integration of Female Street Children), and Ayenachew Kerie (Population Council). We would also like to thank the beneficiaries from Biruh Tesfa and Retrak for their participation in this study, the clinical nurses on the data collection team, Zelalem Belay for assisting with recruitment follow-up, and Getachew Melaku for assistance with tool translation. We appreciate the careful reviews and guidance from the HIVCore management team at USAID/Washington, Sarah Sandison and Glenn Post; and from Renee Demarco and Tsegaye Tilahun at USAID/ Ethiopia. The authors also thank Julie Pulerwitz (Population Council Washington) for reviewing the manuscript and providing comments, and Annabel Erulkar (Population Council, Ethiopia) for providing overall guidance to the study.

Author Contributions

Conceived and designed the experiments: SK NJ. Performed the experiments: GM LK JS NJ. Analyzed the data: KH SG. Wrote the paper: SG.

References

  1. 1. Central Statistical Agency [Ethiopia] and ICF International. 2012. Ethiopia Demographic and Health Survey 2011. Addis Ababa, Ethiopia and Calverton, Maryland, USA: Central Statistical Agency and ICF International.
  2. 2. Erulkar A, Ferede A. Social exclusion and early or unwanted sexual initiation among poor urban females in Ethiopia. Int Perspect Sex Reprod Health. 2009 Dec;35(4):186–93. pmid:20123652
  3. 3. Erulkar A. & Ab Mekbib T. 2007. Invisible and vulnerable: Adolescent domestic workers in Addis Ababa, Ethiopia. Vulnerable Child Youth Stud, 2(3): 246–256.
  4. 4. Annabel S Erulkar, Tekle-Ab Mekbib, Negussie Simie, and Tsehai Gulema (2006) Migration and Vulnerability among Adolescents in Slum Areas of Addis Ababa, Ethiopia. J Youth Stud, 9(3):361–374.
  5. 5. Tadele G. ‘Unrecognized victims’: Sexual abuse against male street children in Merkato area, Addis Ababa. Ethiop J Health Dev. 2009;23(3):174–182.
  6. 6. Hagos S., Haile Mariam D. Assessment of HIV/AIDS related risks among Men Having Sex with Men (MSM) in Addis Ababa, Ethiopia. J Public Health Policy. 2009 Sep;30(3):269–79. pmid:19806068
  7. 7. Lalor KJ. Street children: a comparative perspective. Child Abuse Negl. 1999 Aug;23(8):759–70. pmid:10477236
  8. 8. Ashenafi Y, Kebede D, Desta M, Alem A. Socio-demographic correlates of mental and behavioural disorders of children in southern Ethiopia. East Afr Med J. 2000 Oct;77(10):565–9. pmid:12862128
  9. 9. Wondie Y, Zemene W, Reschke K, Schröder H. Early marriage, rape, child prostitution, and related factors determining the psychosocial effects severity of child sexual abuse in Ethiopia. J Child Sex Abus. 2011 May;20(3):305–21. pmid:21660816
  10. 10. Jemal J. The child sexual abuse epidemic in Addis Ababa: some reflections on reported incidents, psychosocial consequences and implications. Ethiop J Health Sci. 2012 Mar;22(1):59–66. pmid:22984332
  11. 11. Ashenafi Y, Kebede D, Desta M, Alem A. Socio-demographic correlates of mental and behavioural disorders of children in southern Ethiopia. East Afr Med J. 2000 Oct;77(10):565–9. pmid:12862128
  12. 12. Hailemariam S, Tessema F, Asefa M, Tadesse H, Tenkolu G. The prevalence of depression and associated factors in Ethiopia: findings from the National Health Survey. Int J Ment Health Syst. 2012 Oct 25;6(1):23. pmid:23098320
  13. 13. Nakimuli-Mpungu E, Bass JK, Alexandre P, Mills EJ, Musisi S, Ram M, Katabira E, Nachega JB. Depression, alcohol use and adherence to antiretroviral therapy in sub-Saharan Africa: a systematic review. AIDS Behav. 2012 Nov;16(8):2101–18. pmid:22116638
  14. 14. Mayston R, Kinyanda E, Chishinga N, Prince M, Patel V. Mental disorder and the outcome of HIV/AIDS in low-income and middle-income countries: a systematic review. AIDS. 2012 Dec;26 Suppl 2:S117–35. pmid:23303434
  15. 15. Hanlon C, Medhin G, Alem A, Araya M, Abdulahi A, Tomlinson M, Hughes M, Patel V, Dewey M, Prince M. Sociocultural practices in Ethiopia: association with onset and persistence of postnatal common mental disorders. Br J Psychiatry. 2010 Dec;197(6):468–75. pmid:21119153
  16. 16. Nguyen PH, Saha KK, Ali D, Menon P, Manohar S, Mai LT, Rawat R, Ruel MT. Maternal mental health is associated with child undernutrition and illness in Bangladesh, Vietnam and Ethiopia. Public Health Nutr. 2013 May 3:1–10. [Epub ahead of print]
  17. 17. Deribew A, Tesfaye M, Hailmichael Y, Apers L, Abebe G, Duchateau L, Colebunders R. Common mental disorders in TB/HIV co-infected patients in Ethiopia. BMC Infect Dis. 2010 Jul 9;10:201. pmid:20618942
  18. 18. Deribew A, Deribe K, Reda AA, Tesfaye M, Hailmichael Y, Maja T, Colebunders R. Change in quality of life: a follow up study among patients with HIV infection with and without TB in Ethiopia. BMC Public Health. 2013 Apr 29;13:408. pmid:23627925
  19. 19. Tadesse AW, Berhane Tsehay Y, Girma Belaineh B, Alemu YB. Behavioral and emotional problems among children aged 6–14 years on highly active antiretroviral therapy in Addis Ababa: a cross-sectional study. AIDS Care. 2012;24(11):1359–67. Epub 2012 Feb 1. pmid:22296227
  20. 20. Gelaye B, Williams MA, Lemma S, Deyessa N, Bahretibeb Y, Shibre T, et al. Validity of the patient health questionnaire-9 for depression screening and diagnosis in East Africa. Psychiatry Res. 2013 Aug 22. pii: S0165-1781(13)00390-9. [Epub ahead of print]
  21. 21. Reda AA. Reliability and validity of the Ethiopian version of the hospital anxiety and depression scale (HADS) in HIV infected patients. PLoS One. 2011 Jan 25;6(1):e16049. pmid:21283565
  22. 22. Davison MK, Bershadsky B, Bieber J, Silversmith D, Maruish ME, Kane RL (1997). Development of a brief, multidimensional, selfreport instrument for treatment outcomes assessment in psychiatric settings: Preliminary findings. Assessment. 1997; 4:259–276. pmid:26613775
  23. 23. Maruish ME, Bershadsky B, Goldstein L. Reliability and validity of the SA-45: further evidence from a primary care setting. Assessment. 1998 Dec;5(4):407–19. pmid:9835664
  24. 24. Derogatis LR, Unger R. (2010) Symptom Checklist-90-Revised. In: Corsini Encyclopedia of Psychology. 1–2.
  25. 25. Goodman R. The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry. 1997 Jul;38(5):581–6. pmid:9255702
  26. 26. Achenbach TM, Rescorla LA. Manual for the ASEBA school-age forms & profiles. Burlington: Research Centre for Children, Youth and Families, University of Vermont; 2001.
  27. 27. Rescorla LA, Ginzburg S, Achenbach TM, Ivanova MY, Almqvist F, Begovac I, et al. Cross-informant agreement between parent-reported and adolescent self-reported problems in 25 societies. J Clin Child Adolesc Psychol. 2013;42(2):262–73. Epub 2012 Sep 25. pmid:23009025
  28. 28. Dingle K, Alati R, Williams GM, Najman JM, Bor W, Clavarino A. The ability of YSR DSM-oriented depression scales to predict DSM-IV depression in young adults: a longitudinal study. J Affect Disord. 2010 Feb;121(1–2):45–51. Epub 2009 Jun 7. pmid:19505728
  29. 29. Ivarsson T, Gillberg C, Arvidsson T, Broberg AG. The Youth Self-Report (YSR) and the Depression Self-Rating Scale (DSRS) as measures of depression and suicidality among adolescents. Eur Child Adolesc Psychiatry. 2002 Feb;11(1):31–7. pmid:11942426
  30. 30. van Lang ND, Ferdinand RF, Oldehinkel AJ, Ormel J, Verhulst FC. Concurrent validity of the DSM-IV scales Affective Problems and Anxiety Problems of the Youth Self-Report. Behav Res Ther. 2005 Nov;43(11):1485–94. Epub 2005 Jan 28. pmid:16159590
  31. 31. Ferdinand RF. Validity of the CBCL/YSR DSM-IV scales Anxiety Problems and Affective Problems. J Anxiety Disord. 2008;22(1):126–34. Epub 2007 Feb 3. pmid:17321103
  32. 32. Ebesutani C, Bernstein A, Martinez JI, Chorpita BF, Weisz JR. The youth self report: applicability and validity across younger and older youths. J Clin Child Adolesc Psychol. 2011;40(2):338–46. pmid:21391029
  33. 33. Thrane LE, Whitbeck LB, Hoyt DR, Shelley MC. Comparing three measures of depressive symptoms among American Indian adolescents. Am Indian Alsk Native Ment Health Res. 2004 Nov 5;11(3):20–42. pmid:15536587
  34. 34. Janssens A, Deboutte D. Screening for psychopathology in child welfare: the Strengths and Difficulties Questionnaire (SDQ) compared with the Achenbach System of Empirically Based Assessment (ASEBA). Eur Child Adolesc Psychiatry. 2009 Nov;18(11):691–700. Epub 2009 May 22. pmid:19462154
  35. 35. Roberts RM, Shute R. Living With a Craniofacial Condition: Development of the Craniofacial Experiences Questionnaire (CFEQ) for Adolescents and Their Parents. Cleft Palate Craniofac J. 2011 Nov;48(6):727–35. Epub 2011 Feb 10. pmid:21309651
  36. 36. Weitkamp K, Romer G, Rosenthal S, Wiegand-Grefe S, Daniels J. The German version of the "Screen for Child Anxiety Related Emotional Disorders" (SCARED): parent- and self report in a clinical sample. Prax Kinderpsychol Kinderpsychiatr. 2011;60(10):820–34. pmid:22324184
  37. 37. Steinhausen HC, Peloso M, Metzke CW. Performance of the adolescent obsessive-compulsive scale in a community survey. J Anxiety Disord. 2009 Mar;23(2):218–22. Epub 2008 Jul 22. pmid:18723315
  38. 38. Chorpita BF, Reise S, Weisz JR, Grubbs K, Becker KD, Krull JL; Research Network on Youth Mental Health. Evaluation of the Brief Problem Checklist: child and caregiver interviews to measure clinical progress. J Consult Clin Psychol. 2010 Aug;78(4):526–36. pmid:20658809
  39. 39. Ridge NW, Warren JS, Burlingame GM, Wells MG, Tumblin KM. Reliability and validity of the youth outcome questionnaire self-report. J Clin Psychol. 2009 Oct;65(10):1115–26. pmid:19693961
  40. 40. Henriksen J, Nielsen PF, Bilenberg N. New Danish standardization of the Child Behaviour Checklist. Dan Med J. 2012 Jul;59(7):A4462. pmid:22759842
  41. 41. Chung YC, Kang NI, Im YJ, Kim SW, Cho IH, Lee YM, Kwon JS. Validation of the Korean version of the Eppendorf Schizophrenia Inventory as a screening measure to detect adolescents at ultra-high risk for psychosis. Early Interv Psychiatry. 2013 Feb;7(1):71–9. Epub 2012 Jun 5. pmid:22672468
  42. 42. Laukkanen E, Rissanen ML, Tolmunen T, Kylmä J, Hintikka J. Adolescent self-cutting elsewhere than on the arms reveals more serious psychiatric symptoms. Eur Child Adolesc Psychiatry. 2013 Aug;22(8):501–10. Epub 2013 Feb 20. pmid:23423221
  43. 43. Byck GR, Bolland J, Dick D, Ashbeck AW, Mustanski BS. Prevalence of mental health disorders among low-income African American adolescents. Soc Psychiatry Psychiatr Epidemiol. 2013 Oct;48(10):1555–67. Epub 2013 Feb 6. pmid:23385803
  44. 44. Bares C, Andrade F, Delva J, Grogan-Kaylor A, Kamata A. Differential item functioning due to gender between depression and anxiety items among Chilean adolescents. Int J Soc Psychiatry. 2012 Jul;58(4):386–92. Epub 2011 May 31. pmid:21628359
  45. 45. Georgsdottir I, Haraldsson A, Dagbjartsson A. Behavior and well-being of extremely low birth weight teenagers in Iceland. Early Hum Dev. 2013 Sep 14. pii: S0378-3782(13)00214-4. [Epub ahead of print]
  46. 46. Miettunen J, Murray GK, Jones PB, Mäki P, Ebeling H, Taanila A, Joukamaa M, Savolainen J, Törmänen S, Järvelin MR, Veijola J, Moilanen I. Longitudinal associations between childhood and adulthood externalizing and internalizing psychopathology and adolescent substance use. Psychol Med. 2013 Sep 13:1–12. [Epub ahead of print]
  47. 47. Louthrenoo O, Oberdorfer P, Sirisanthana V. Psychosocial Functioning in Adolescents with Perinatal HIV Infection Receiving Highly Active Antiretroviral Therapy. J Int Assoc Provid AIDS Care. 2013 May 30. [Epub ahead of print]
  48. 48. Muthupalaniappen L, Omar J, Omar K, Iryani T, Hamid SN. Emotional and behavioral problems among adolescent smokers and their help-seeking behavior. Southeast Asian J Trop Med Public Health. 2012 Sep;43(5):1273–9. pmid:23431837
  49. 49. Zhou Z, Xiong H, Jia R, Yang G, Guo T, Meng Z, Huang G, Zhang Y. The risk behaviors and mental health of detained adolescents: a controlled, prospective longitudinal study. PLoS One. 2012;7(5):e37199. Epub 2012 May 18. pmid:22629367
  50. 50. Mills R, Scott J, Alati R, O'Callaghan M, Najman JM, Strathearn L. Child maltreatment and adolescent mental health problems in a large birth cohort. Child Abuse Negl. 2013 May;37(5):292–302. Epub 2013 Feb 4. pmid:23380430
  51. 51. Schwalbe CS, Gearing RE, Mackenzie MJ, Brewer KB, Ibrahim RW. The impact of length of placement on self-reported mental health problems in detained Jordanian youth. Int J Law Psychiatry. 2013 Mar-Apr;36(2):107–12. Epub 2013 Feb 12. pmid:23415371
  52. 52. Petot D, Rescorla L, Petot JM. Agreement between parent- and self-reports of Algerian adolescents' behavioral and emotional problems. J Adolesc. 2011 Oct;34(5):977–86. Epub 2010 Dec 15. pmid:21163517
  53. 53. Okello J, Nakimuli-Mpungu E, Musisi S, Broekaert E, Derluyn I. War-related trauma exposure and multiple risk behaviors among school-going adolescents in Northern Uganda: The mediating role of depression symptoms.
  54. 54. Bordin IA, Rocha MM, Paula CS, Teixeira MC, Achenbach TM, Rescorla LA, Silvares EF. Child Behavior Checklist (CBCL),Youth Self-Report (YSR) and Teacher's Report Form(TRF): an overview of the development of the original and Brazilian versions. Cad Saude Publica. 2013 Jan;29(1):13–28. pmid:23370021
  55. 55. Izutsu T, Tsutsumi A, Islam A, Firoz AH, Wakai S, Kurita H. Reliability and validity of the Youth Self-Report, Bangladesh version.
  56. 56. American Psychiatric Association, ed. Diagnostic and statistical manual of mental disorders: DSM-IV-TR®. American Psychiatric Pub, 2000.
  57. 57. Achenbach TM, Dumenci L, Rescorla LA. DSM-oriented and empirically based approaches to constructing scales from the same item pools. J Clin Child Adolesc Psychol. 2003 Sep;32(3):328–40. pmid:12881022
  58. 58. Federal Democratic Republic of Ethiopia, Ministry of Health (2012) National Mental Health Strategy (2012/13–2015/16). Addis Ababa: Federal Democratic Republic of Ethiopia, Ministry of Health.
  59. 59. Fricchione GL, Borba CP, Alem A, Shibre T, Carney JR, Henderson DC. Capacity building in global mental health: professional training. Harv Rev Psychiatry. 2012 Jan-Feb;20(1):47–57. pmid:22335182
  60. 60. World Health Organization, Mental Health Gap Action Programme (2010) mhGAP intervention guide for mental, neurological and substance use disorders in non-specialized health settings. Geneva: World Health Organization.
  61. 61. Feldt LS, Woodruff DJ, Salih FA. Statistical inference for coefficient alpha. Applied Psychological Measurement. 1987;11(1):93–103.
  62. 62. Lautenschlager GJ, Meade AW. AlphaTest: A windows program for tests of hypotheses about coefficient alpha. Applied Psychological Measurement. 2008;32:502–503.
  63. 63. Nunnally J, Bernstein L. Psychometric theory. New York: McGraw-Hill Higher, Inc; 1994.
  64. 64. Bland J, Altman D. Cronbach's alpha. BMJ. 1997;314:275.
  65. 65. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ 2011;2:53–55.
  66. 66. Cortina JM. What is coefficient alpha? An examination of theory and applications. J Appl Psychol. 1993;78:98–104.