The ability of specific behaviour-change interventions to reduce HIV infection in young people remains questionable. Since January 1999, an adolescent sexual and reproductive health (SRH) intervention has been implemented in ten randomly chosen intervention communities in rural Tanzania, within a community randomised trial (see below; NCT00248469). The intervention consisted of teacher-led, peer-assisted in-school education, youth-friendly health services, community activities, and youth condom promotion and distribution. Process evaluation in 1999–2002 showed high intervention quality and coverage. A 2001/2 intervention impact evaluation showed no impact on the primary outcomes of HIV seroincidence and herpes simplex virus type 2 (HSV-2) seroprevalence but found substantial improvements in SRH knowledge, reported attitudes, and some reported sexual behaviours. It was postulated that the impact on “upstream” knowledge, attitude, and reported behaviour outcomes seen at the 3-year follow-up would, in the longer term, lead to a reduction in HIV and HSV-2 infection rates and other biological outcomes. A further impact evaluation survey in 2007/8 (~9 years post-intervention) tested this hypothesis.
Methods and Findings
This is a cross-sectional survey (June 2007 through July 2008) of 13,814 young people aged 15–30 y who had attended trial schools during the first phase of the MEMA kwa Vijana intervention trial (1999–2002). Prevalences of the primary outcomes HIV and HSV-2 were 1.8% and 25.9% in males and 4.0% and 41.4% in females, respectively. The intervention did not significantly reduce risk of HIV (males adjusted prevalence ratio [aPR] 0.91, 95%CI 0.50–1.65; females aPR 1.07, 95%CI 0.68–1.67) or HSV-2 (males aPR 0.94, 95%CI 0.77–1.15; females aPR 0.96, 95%CI 0.87–1.06). The intervention was associated with a reduction in the proportion of males reporting more than four sexual partners in their lifetime (aPR 0.87, 95%CI 0.78–0.97) and an increase in reported condom use at last sex with a non-regular partner among females (aPR 1.34, 95%CI 1.07–1.69). There was a clear and consistent beneficial impact on knowledge, but no significant impact on reported attitudes to sexual risk, reported pregnancies, or other reported sexual behaviours. The study population was likely to have been, on average, at lower risk of HIV and other sexually transmitted infections compared to other rural populations, as only youth who had reached year five of primary school were eligible.
SRH knowledge can be improved and retained long-term, but this intervention had only a limited effect on reported behaviour and no significant effect on HIV/STI prevalence. Youth interventions integrated within intensive, community-wide risk reduction programmes may be more successful and should be evaluated.
Please see later in the article for the Editors' Summary
Citation: Doyle AM, Ross DA, Maganja K, Baisley K, Masesa C, et al. (2010) Long-Term Biological and Behavioural Impact of an Adolescent Sexual Health Intervention in Tanzania: Follow-up Survey of the Community-Based MEMA kwa Vijana Trial. PLoS Med 7(6): e1000287. doi:10.1371/journal.pmed.1000287
Academic Editor: Phillipa J. Hay, University of Western Sydney, Australia
Received: December 10, 2009; Accepted: April 22, 2010; Published: June 8, 2010
Copyright: © 2010 Doyle et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: UK Department for International Development, Irish Aid, European Commission, UK Medical Research Council, UNAID. The funders of the study had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: aPR, adjusted prevalence ratio; IQR, interquartile range; [A]SRH, [adolescent] sexual and reproductive health; STI, sexually transmitted infection
Every year, about 2.5 million people become infected with the human immunodeficiency virus (HIV), the virus that causes AIDS. HIV is most often spread through unprotected sex with an infected partner, so individuals can reduce their risk of HIV infection by abstaining from sex, by delaying first sex, by having few partners, and by always using a condom. And, because nearly half of new HIV infections occur among youths (15- to 24-year-olds), programs targeted at adolescents that encourage these protective behaviors could have a substantial impact on the HIV epidemic. One such program is the MEMA kwa Vijana (“Good things for young people”) program in rural Tanzania. This program includes in-school sexual and reproductive health (SRH) education for pupils in their last three years of primary education (12- to 15-year-olds) that provides them with the knowledge and skills needed to delay sexual debut and to reduce sexual risk taking. Between 1999 and 2002, the program was trialed in ten randomly chosen rural communities in the Mwanza Region of Tanzania; ten similar communities that did not receive the intervention acted as controls. Since 2004, the program has been scaled up to cover more communities.
Why Was This Study Done?
Although the quality and coverage of the MEMA kwa Vijana program was good, a 2001/2002 evaluation found no evidence that the intervention had reduced the incidence of HIV (the proportion of the young people in the trial who became HIV positive during the follow-up period) or the prevalence (the proportion of the young people in the trial who were HIV positive at the end of the follow-up period) of herpes simplex virus 2 (HSV-2, another sexually transmitted virus). However, the evaluation found improvements in SRH knowledge, in reported sexual attitudes, and in some reported sexual behaviors. Evaluations of other HIV prevention programs in other developing countries have also failed to provide strong evidence that such programs decrease the risk of HIV infection or other biological outcomes such as the frequency of other sexually transmitted infections or pregnancies, even when SRH knowledge improves. One possibility is that it takes some time for improved SRH knowledge to be reflected in true changes in sexual behavior and in HIV prevalence. In this follow-up study, therefore, researchers investigate the long-term impact of the MEMA kwa Vijana program on HIV and HSV-2 prevalence and ask whether the improvement in knowledge, reported attitudes and sexual risk behaviours seen at the 3-year follow up has persisted.
What Did the Researchers Do and Find?
In 2007/8, the researchers surveyed nearly 14,000 young people who had attended the trial schools between 1999 and 2002. Each participant had their HIV and HSV-2 status determined and answered questions (for example, “can HIV be caught by sexual intercourse (making love) with someone,” and “if a girl accepts a gift from a boy, must she agree to have sexual intercourse (make love) with him?”) to provide three composite sexual knowledge scores and one composite attitude score. 1.8% of the male and 4.0% of the female participants were HIV positive; 25.9% and 41.4% of the male and female participants, respectively, were HSV-2 positive. The prevalences were similar among the young people whose trial communities had been randomly allocated to receive the MEMA kwa Vijana Program and those whose communities had not received it, indicating that the MEMA kwa Vijana intervention program had not reduced the risk of HIV or HSV-2. The intervention program was associated, however, with a reduction in the proportion of men reporting more than four sexual partners in their lifetime and with an increase in reported condom use at last sex with a non-regular partner among women. Finally, although the intervention had still increased SRH knowledge, it now had had no impact on reported attitudes to sexual risk, reported pregnancies, or other reported risky sexual behaviors beyond what might have happened due to chance.
What Do These Findings Mean?
These findings indicate that, in the MEMA kwa Vijana trial, SRH knowledge improved and that this improved knowledge was retained for many years. Disappointingly, however, this intervention program had only a limited effect on reported sexual behaviors and no effect on HIV and HSV-2 prevalence at the 9-year follow-up. Although these findings may not be generalizable to other adolescent populations, they suggest that intervention programs that target only adolescents might not be particularly effective. Young people might find it hard to put their improved skills and knowledge into action when challenged, for example, by widespread community attitudes such as acceptance of older male–younger female relationships. Thus, the researchers suggest that the integration of youth HIV prevention programs within risk reduction programs that tackle sexual norms and expectations in all age groups might be a more successful approach and should be evaluated.
Please access these Web sites via the online version of this summary at http://dx.doi.org/10.1371/journal.pmed.1000287.
- This study is further discussed in a PLoS Medicine Perspective by Rachel Jewkes
- More information about the MEMA kwa Vijana program is available at their Web site
- Information is available from the Programme for Research and Capacity Building in Sexual and Reproductive Health and HIV in Developing Countries on recent and ongoing research on HIV infection and other STIs
- Information is available from the World Health Organization on HIV and on the health of young people
- Information on HIV is available from UNAIDS
- Information on HIV in children and adolescents is available from UNICEF
- Information on HIV prevention interventions in the education sector is available from UNESCO
- Information on HIV infection and AIDS is available from the US National Institute of Allergy and Infectious Diseases
- The US Centers for Disease Control and Prevention provide information on HIV/AIDS and on HIV/AIDS among youth (in English and Spanish)
- HIV InSitehas comprehensive information on all aspects of HIV/AIDS, including links to information on the prevention of HIV/AIDS
- Information is available from Avert, an international AIDS charity, on many aspects of HIV/AIDS, including information on HIV and AIDS prevention and AIDS and sex education (in English and Spanish)
In 2007, 45% of new HIV infections worldwide were among youth (15–24 y) , and several studies have demonstrated high rates of other sexually transmitted infections (STIs) and pregnancy in this age group ,. Effective HIV prevention interventions focusing on adolescents should therefore have a substantial impact on the HIV epidemic. Behavioural interventions – and male circumcision , are advocated as the most effective HIV control strategies. However, despite a very wide range of different approaches and specific interventions that might be used to try to induce behaviour change, empirical evidence on the efficacy of behavioural interventions to prevent HIV is weak and contradictory –. While most programme evaluations in developing countries have shown an improvement in knowledge, reported communication about sexual matters, and attitudes, at least in the short-term about one-third of programme evaluations showed no changes in reported sexual behaviours, and many other studies found reported sexual behaviour change in only some subgroups ,.
Few previous trials to assess the efficacy of behavioural interventions have measured biomedical endpoints ,–,. The inclusion of such outcomes is critically important (1) because of the limited validity of reported sexual behaviour, particularly in young people –; (2) because of the potential for social desirability bias; and (3) because reductions in HIV, STI, and pregnancy are usually the ultimate objectives for these interventions.
We report results of a long-term (>8 y) community-randomised trial to evaluate the impact of the MEMA kwa Vijana (“Good Things for Young People”) intervention in rural Tanzania on the prevalence of HIV, other STIs, and pregnancy, and on sexual health knowledge, attitudes, and reported sexual behaviour (Figure 1).
The design of the trial  and intervention , and the results of the 2001/2 impact evaluation  are described in detail elsewhere. In summary, the trial was conducted in 20 distinct rural communities in Mwanza Region, Tanzania (Figure 2). The study communities were grouped into three risk strata using data from a prior population-based survey . Restricted randomisation was used to balance HIV and Chlamydia trachomatis prevalence between the two trial arms . Ten communities (58 primary schools, 18 health facilities) were randomised to receive the intervention from 1999 onwards; the other ten (63 primary schools, 21 health facilities) were comparison communities.
The intervention was based on the principles of social learning theory, and its main aims were to reduce the incidence of HIV/STI and unintended pregnancies by providing young people with the knowledge and skills to enable them to delay sexual debut, reduce sexual risk-taking (including reducing numbers of sexual partners and promoting condom use), and increase their appropriate use of sexual health services (e.g., STI treatment, family planning). To encourage sustainability and replicability, the intervention was delivered through existing structures and supervision systems by government workers, trained and supported by eight staff members from the African Medical and Research Foundation (AMREF).
This adolescent sexual and reproductive health (ASRH) intervention had four components : (1) a participatory, teacher-led, peer-assisted, in-school programme, comprising an average of 12 forty-minute school sessions per year, in primary school years 5–7 (Box 1); (2) the provision of youth-friendly health services with quarterly supervision; (3) community-based condom promotion and distribution by and for youth, which was introduced in early 2000 in response to a process evaluation that found that young people had difficulty accessing condoms; and (4) limited community-wide activities including an initial mobilisation week in each community and annual youth health weeks.
Box 1. Topics Covered during the MEMA kwa Vijana In-School, Teacher-Led Peer-Assisted Sessions (approximately 12 forty-minute sessions per school year)
- What is reproductive health and why is it important?
- Leaving childhood: Puberty
- What are HIV and AIDS?
- The facts about AIDS
- The facts about sexually transmitted diseases
- Girls and Boys have equal abilities
- Misconceptions about sex
- Refusing temptations
- Saying No to sex
- Sexually Transmitted Diseases: Going to the clinic
- Review of last years' learning
- How HIV infection causes AIDS
- How Sexually Transmitted Diseases are spread
- The relationship between HIV and Sexually Transmitted Diseases
- Reproductive organs and their functions
- Pregnancy and menstruation
- Respecting other people's decisions
- Recognising and avoiding temptations
- Protecting yourselves: What are condoms?
- Review of previous years' learning
- How to avoid HIV infection and AIDS
- Sexually Transmitted Diseases and their consequences
- Making good decisions
- Practising saying ‘No’
- Being faithful
- Achieving your future expectations
- Planning for your future
- Protecting yourself: Correct use of condoms & the truth about condoms
Source: Teachers' guides accessible at http://www.memakwavijana.org.
Surveys in the trial communities between 1999 and 2001 showed that sexual health programmes in the comparison communities were very limited. Results of internal , and external evaluations by international and national experts – conducted in 1999–2002 found that the multi-component intervention was implemented well and achieved high coverage.
The first two intervention components have continued in the intervention communities since 2002 and were started in the comparison communities between May 2005 and July 2007 as part of the scale-up and operations research component of the MEMA kwa Vijana Programme ,.
The impact of the intervention was evaluated in 2001/2, approximately three years after recruitment, in 7,040 (73%) out of a cohort of 9,645 adolescents recruited into that phase of the trial (Figure 1). The 2001/2 impact evaluation showed that the intervention had resulted in substantial and statistically significant improvements in knowledge and reported attitudes, with adjusted relative risks ranging from 1.3 to 1.8 . Amongst males, the intervention had also delayed reported sexual debut, reduced the reported number of sexual partners in the past 12 months, and increased reported condom use. Females reported an increase in first use of condoms during the 3-year follow-up period . The results suggested that the impact of the intervention on knowledge, reported attitudes, and reported behaviours was greater in males than females, and in those who had received more years of the in-school component of the intervention. However, there was no consistent impact of the intervention on biological indicators of HIV, other STIs, and pregnancy rates. It was postulated that the duration of follow-up (3 years) may have been too short to see the impact of improvement in young men's risk-taking on biological outcomes in young women, due to the difference in the average age of sexual partners . Also, exposure of more school years of adolescents to the intervention may have been needed to effect a significant change in the norms of young people as a whole. Furthermore, by the time of the 2001/2 survey, 40% of the evaluation cohort had only received 1 year of the in-school intervention, and the highest risk group (year 6 at recruitment) had had the least exposure to the in-school intervention. This paper reports the findings of a long-term evaluation carried out to evaluate this hypothesis.
The trial protocol received ethical and research clearance from the Tanzanian Medical Research Coordinating Committee and the Ethics Committee of the London School of Hygiene & Tropical Medicine. Signed informed consent was obtained from each participant on the day of the survey round. Additional written consent from parents was obtained for participants under the age of 18 y.
Between June 2007 and July 2008, a cross-sectional survey was conducted in the 20 MEMA kwa Vijana trial communities to evaluate the long-term impact of the intervention. By then, nine consecutive school year groups had participated in the in-school component of the intervention and the health services intervention had also been in place for 8–9 y. As no external evaluations of the coverage and quality of the intervention had taken place since 2002, the long-term evaluation survey was restricted to young people who had attended at least one of school years 5–7 in the trial communities within the period 1999–2002 inclusive. Primary outcomes were HIV seroprevalence and HSV-2 seroprevalence. Secondary biological, knowledge, reported attitude, and reported behaviour outcomes were similar but not always identical to those used in the 2001/2 evaluation. Each of the attitudinal and knowledge outcomes were based on the answers to three questions (Table 1) .
Between June 2007 and May 2008 a household census in the 20 trial communities identified potentially eligible young people and invited them to attend the survey at a central location in the village two or three days later. Some additional young people who had not specifically been invited by the census interviewers but who heard about the survey and thought that they might be eligible also attended. At the survey, detailed checks identified those who had attended years 5, 6, and/or 7 in a trial school between 1999 and 2002. Eligible attendees who gave informed consent were interviewed about their knowledge, reported attitudes, and reported sexual behaviour. Blood and urine specimens were collected. A clinician asked about STI symptoms (males and females) and examined males for signs of STIs. HIV counselling and testing was offered using parallel HIV rapid tests (SD Bioline HIV-1/2 3.0 [Standard Diagnostics] and Determine HIV1/2 [Abbott Laboratories]). In order to include additional eligible young people, all 20 trial communities, nearby secondary schools, and major migration points within the Lake Zone of Tanzania were revisited in June and July 2008.
Sera were tested for HIV-1 and HIV-2 in parallel, using third-generation Murex HIV 1.2.0 ELISA (Abbott-Murex, Dartford, UK) and third-generation Vironostika HIV UNIFORM II plus O (Biomeriux, Boxtel, Netherlands). Sera with discordant ELISA results were retested up to two more times on both ELISAs. Persistently discordant samples were tested for p24 antigen using Bio-Rad Genetic System HIV1 Ag EIA (Bio-Rad, Lacoquette, France), and p24-negative samples were tested with Inno-Lia HIV1/2 score Assay (Inno-Genetics NV, Gent, Belgium). INNO-LIA-indeterminate specimens were classified as negative.
Sera were tested for antibodies to HSV-2 using KALON HSV Type 2 IgG ELISA (KALON Biologicals, Guildford, UK) following the manufacturer's instructions. KALON ELISA-indeterminate samples were retested. Persistently indeterminate specimens were classified as negative. Lifetime exposure to syphilis was examined using the Serodia Treponema pallidum particle agglutination (TPPA) test (Fujirebio, Japan). Those positive on TPPA were further tested for active syphilis using the Immutrep carbon antigen rapid plasma reagin (RPR) test (Omega Diagnostics, Hillfoot, UK).
Urine specimens were tested for Chlamydia trachomatis (CT) and Neisseria gonorrhoeae (NG) by Amplicor PCR (Roche Diagnostics, Branchburg, USA) according to the manufacturer's instructions. PCR-positive samples were retested up to twice and classified using a “two out of three strategy.” NG samples that remained positive on repeated Amplicor PCR testing were confirmed with an in-house 16S rDNA PCR using primers NG01: 5′-GACGGCAGCACAGGGAAGCTTGCTTCTCGG-3′ and NG03M: 5′-TCGGCCGCCGATATTGGCAA-3′ ,. Only samples with positive 16S PCR results were reported as positive for NG.
Allocation to the arm of the trial for the primary analysis was based on the community where a young person had first attended one of school years 5–7 in a trial school between 1999 and 2002. Prior to the survey, it was estimated that 14,520 (363 males and females, respectively, in each community) might be found, based on the estimated number of eligible young people who might still be living in trial communities and would agree to participate. Prevalence and incidence estimates from previous studies in Mwanza Region were used to predict an HIV seroprevalence and HSV-2 seroprevalence of, respectively, 2% and 25% in males and 5% and 35% in females ,,. With ten communities per arm and assuming a between-community coefficient of variation of 0.2, 14,520 participants would provide 85% power to detect a 50% reduction in HIV prevalence in males and 79% power to detect a 35% reduction in females. The power to detect a 25% reduction in HSV-2 prevalence would be 77% for males and 80% for females.
The data were analysed as described for stratified cluster-randomised trials in Hayes and Moulton . The number of individuals differed slightly for each analysis because of missing results. Impact was measured using prevalence ratios. The unadjusted prevalence ratio was calculated as the ratio of the geometric mean prevalence for the ten communities in each arm or the ratio of arithmetic mean prevalences if an outcome had zero cases in at least one community. The 95% confidence interval (CI) for the prevalence ratio was calculated using a stratified t-test with 14 degrees of freedom, with variance estimated from the residual mean square from a two-way analysis of variance (ANOVA) of community log-prevalence on stratum and study arm.
Adjusted prevalence ratios (aPRs) were calculated using logistic regression to adjust for individual level covariates. The regression model included terms for the adjustment factors (age group, stratum, and ethnic group [Sukuma/non-Sukuma]), but not study arm. For each community, the fitted model was used to compute the ratio of observed to expected events (O/E). The adjusted prevalence ratio was obtained as the ratio of the geometric mean of these O/E estimates for the two study arms, and variances and CIs were obtained from an ANOVA of log(O/E) on stratum and study arm.
Overall 72,087 (95%) of an estimated 75,715 households in the survey areas were visited during the census. 449,298 individuals were reported to be living in the visited households. At the census, 16,747 young people were invited to attend the survey; 13,281 (79%) of these actually attended along with an additional 2,426 young people (Figure 3).
At the survey, 88% (13,814/15,707) of attendees met the eligibility criteria and were enrolled; 7,083 (51%) from intervention and 6,731 (49%) from comparison communities (Figure 3). Preliminary estimates based on data from the cohort recruitment survey in 1998 suggested that there would be an average of 720 men and 720 women from each community who had, between 1999 and 2002, completed at least one of the final three years of primary school in that community. We were able to survey an average of 365 males and 326 females in the 2007/8 survey.
Participants' median age was 22 y for males (interquartile range [IQR] 20–24 y) and 21 years for females (IQR 19–23 y) (Table 2). The majority of participants (80%) were from the Sukuma ethnic group and over 80% were Christian. Relatively few (10%–20%) had higher than primary level education. Over half of females and one third of males were married, and 92% reported ever having had sex. Males were on average 2.4 y older and females 4 y younger than their most recent sexual partner. 41% of males were circumcised on clinical inspection. 75% of participants opted to know and therefore received their HIV result.
Two-thirds of participants had had the opportunity to receive 3 y of the in-school intervention. A high proportion (91%) of both males and females from the intervention communities stated that they had attended at least one MEMA kwa Vijana session while in primary school. On average, participants had last been exposed to the in-school intervention 5.4 y prior to the survey. Of the original MEMA kwa Vijana trial cohort identified in 1998, 3,808 (40%) were interviewed during the 2007/8 survey (Figure 1).
Correct knowledge and desirable reported attitudes were higher in intervention communities. There was evidence of an association for each outcome (adjusted prevalence ratio [aPR] from 1.11–1.31 for males and 1.11–1.24 for females), except for the “attitudes to sex” in females (Table 3).
The median reported age at sexual debut was 18 and 17 y in males, and 17 y in females in the intervention and comparison communities, respectively (Table 2). Overall, 37% of males in intervention communities reported >4 lifetime sexual partners compared to 44% males in the comparison communities (aPR 0.87, 95%CI 0.78–0.97), but similar prevalences by trial arm were seen for other measures of reported partner change and concurrency (Table 3). There was little evidence of an increase in reported condom or modern contraceptive use among men in the intervention communities, but stronger evidence that reported condom use with the most recent non-regular partner was higher among females in intervention communities (aPR 1.34, 95%CI 1.07–1.69) (Table 3).
Genital ulcers were reported less frequently by both sexes in the intervention communities (males aPR 0.76, 95%CI 0.59–−0.99; females aPR 0.69, 95%CI 0.47–1.01) (Table 4). In respondents who reported having STI symptoms within the last 12 mo, there was no significant difference by trial arm in reported use of health facilities for their most recent STI symptoms. There was no evidence of differences between arms in the outcomes related to pregnancy (Table 4).
The prevalence of the primary trial outcomes, HIV and HSV-2, in the comparison communities were similar to those predicted at 1.7% and 26.7%, respectively, in males, and 4.2% and 42.5%, respectively, in females (Table 4). Figure 4 shows HIV and HSV-2 prevalence by age, sex, and trial arm. There was no significant difference in prevalence by trial arm either for HIV (males aPR 0.91, 95%CI 0.50–1.65; females aPR 1.07, 95%CI 0.68–1.67) or for HSV-2 (males aPR 0.94, 95%CI 0.77–1.15; females aPR 0.96, 95%CI 0.87–1.06). Similarly, prevalences of the secondary biological outcomes—syphilis, chlamydia, and gonorrhoea—were similar in the two arms (Table 4).
The trial results demonstrate that the MEMA kwa Vijana intervention led to a sustained improvement in young people's sexual and reproductive health (SRH) knowledge and some reported sexual behaviours. The lack of any significant impact on the prevalence of HIV and other STIs either after 3 years or after more than 8 years of interventions being in place, indicates that skills-based, in-school education, linked to more youth-friendly health services and limited supportive community activities, while important in improving young people's knowledge of how to reduce their sexual risk, may not be sufficient to reduce HIV incidence and other biological outcomes among young people in this setting.
The 2007/8 survey was carried out in communities in which nine consecutive cohorts of young people had been exposed to the MEMA kwa Vijana intervention, thus increasing the chances for the interventions to have influenced community norms among young people. The inclusion of young people from six of these year groups in the survey (those who had been in years 5–7 between 1999 and 2002 when the interventions were known to have been implemented with high coverage and fidelity) increased the chances that both male and female sexual partners could have been exposed to the intervention. 67% of the young people interviewed in the intervention communities in the 2007/8 survey had had a chance of being exposed to the full 3 years of the in-school component of the intervention, compared with only 26% during the 2001/2 survey.
The intervention was associated with higher levels of SRH knowledge, although the relative risk was not as strong as that observed in 2001/2 (Table 5). An increase in knowledge was observed in both trial arms between 2001/2 and 2007/8. Improvements in HIV knowledge in the comparison communities may have resulted from exposure to national media campaigns, including recent campaigns encouraging voluntary counselling and testing for HIV, exposure to HIV information at antenatal care or marriage preparation, and the roll-out of antiretroviral treatment. The increases in knowledge about pregnancy prevention and STIs may be due to the older age of the respondents and their personal experiences with pregnancy and/or STIs. Improvements in knowledge in the young people in the comparison communities will have decreased the chances of finding differences in knowledge by trial arm, making it even more impressive that such differences were still observed an average of 5.4 y after the young people had left primary school.
In both surveys, the proportion of young people answering all three attitudinal questions desirably was <30% in both sexes and both trial arms. These questions focused mainly on gender norms, suggesting that the intervention did not have a major impact on such norms.
In terms of sexual behaviour, strong evidence of intervention impact was seen only on the number of sexual partners among males, and condom use among sexually active females with their last non-regular partner. Overall, the intervention appears to have had less impact on reported sexual behaviour in the 2007/8 survey than in the 2001/2 survey. One potential explanation may be that the length of time since exposure to the in-school intervention led to an attenuation of intervention effect. Another is that when young people are older and/or have left primary school their sexual behaviour is more influenced by community norms. Alternatively, as the young people interviewed in 2007/8 were older and exposed to the intervention many years previously, responses may have been more honest and less subject to differential reporting bias by trial arm.
The lack of impact, in either direction, on biological outcomes an average of 8.9 y after the start of the intervention tends to contradict the frequently held belief that positive changes in knowledge, reported attitudes, and reported behaviours will eventually lead to a reduction in HIV, STIs, and unwanted pregnancies. A direct comparison between overall prevalences in the various survey rounds is not appropriate because the ages of the young people included differed, the median ages in the 1998, 2001/02, and 2007/08 surveys being 15, 18, and 22 y, respectively.
One explanation for the lack of impact could have been weaknesses in the design or implementation of the intervention itself. However, external evaluations of the intervention design and materials concluded that it was theoretically sound and of high quality. Also, internal and external process evaluations conducted between 1999 and 2002 demonstrated that the interventions were delivered to a high standard and that coverage was high.
The rural communities included in the trial were geographically separated from each other. Migration in the area is usually to larger towns, often to seek work, or to neighbouring villages, such as when a woman gets married. It was, therefore, unlikely that there was significant spill-over of the intervention into the comparison communities. Qualitative data collected in 1999–2002 and more recently in 2007/8 suggest that there was little other governmental or non-governmental organisation SRH intervention activity in the trial communities. Similarly, between 1999 and 2005 there was only a minimal amount of SRH education included in the national curriculum for primary schools in the comparison communities . It is unlikely that the introduction of interventions into primary schools and health facilities in comparison communities between 2005 and 2007 had any important effect on the sexual and reproductive health of survey respondents who had all left primary school by that time.
Three other African ,, studies have measured the impact of ASRH interventions on biological outcomes and generally their findings have not been promising. This present study is a valuable complement to these three studies. The MEMA kwa Vijana trial evaluated the long-term impact of an intervention that had been subjected to careful, theory-based design and pilot testing, and for which process evaluations had shown that it had been implemented with high coverage and good fidelity . The cluster randomised trial design means that significant differences in the outcomes between trial arms were likely due to the intervention effects. This study is unique in having such a long follow-up period and as such should have been able to detect change in behaviours resulting from exposure of consecutive cohorts of young people, such as changes within age-mixed relationships.
The evaluation of the trial had several limitations. The study population was likely to have been, on average, at lower risk of HIV and other STIs compared to other rural populations for two main reasons. First, it was restricted to young people who had reached at least year 5 of primary school. A preliminary, population-based survey in the trial communities showed that HIV was more prevalent in 15- to 19-y-olds who had never been to school or who had left school before school year 5 . Second, despite repeat visits to the trial communities and tracing of young people to major migration points and local secondary schools, we are likely to have missed many of those attending secondary school outside the trial communities, those who migrated outside the study area for employment or marriage, and mobile groups such as fishermen, miners, or traders. As elsewhere, studies in the Mwanza Region have shown that mobile young people are at increased risk of HIV and other STIs . On the other hand, the study population might have been more amenable to behaviour change because of their better education. Although it would have been ideal to measure HIV incidence as a primary outcome in the 2007/8 survey, this was not possible as no baseline data were available on several of the school year-groups included.
Exposure to the MEMA kwa Vijana intervention did not increase risk-taking among youth, and significant differences in ASRH knowledge persisted in the 2007/8 survey when the young people had last been exposed to the in-school intervention an average of 5.4 y previously. The results of this trial show that such skills-based sexual health education interventions and youth-friendly health services can make a valuable contribution towards the UN General Assembly Special Session on HIV/AIDS goal  of increasing young people's access to the information, skills, and services they need to reduce their vulnerability to HIV. However, these results imply that such interventions, on their own, will not be sufficient to reduce HIV and other STIs among young people in sub-Saharan Africa. Qualitative work carried out in the trial communities in 1999–2002 found that many young people were not always in a position to use the knowledge and skills obtained through MEMA kwa Vijana ,,. Peer pressure to be sexually active, and widespread attitudes and practices in the broader community such as negative attitudes to condoms, material exchange for sex, and older male–younger female relationships, may have posed too great a challenge for youth who wanted to reduce their risk behaviours. This suggests that additional interventions are needed to address broader sexual norms and expectations. Efforts to design, implement, and rigorously evaluate behaviour change interventions among adults as well as young people, with strong support from political leaders, are urgently needed.
Protocol for the long term evaluation of the MEMA kwa Vijana intervention.
(3.76 MB PDF)
(0.09 MB PDF)
The MEMA kwa Vijana Trial was a collaboration between the London School of Hygiene & Tropical Medicine (LSHTM), the Tanzanian National Institute for Medical Research (NIMR), the African Medical and Research Foundation (AMREF), and the Ministries of Health and Social Welfare and of Education and Vocational Training of the Government of Tanzania. It was supported by grants from the European Commission, the UK Department for International Development, and Irish Aid, with additional funding support from the Medical Research Council of Great Britain and The United Nations Joint Programme on HIV/AIDS (UNAIDS).
We thank the entire intervention, survey, data, laboratory, social science, and administrative staff in Mwanza and in London during the first phase of the trial, in particular, A. Anemona, R. Balira, B. Cleophas-Mazige, D. Everett, A. Gavyole, H. Grosskurth, D. Mabey, M. Makokha, F. Mosha, J. Parry, F. Terris-Prestholt, J. Todd, and D. Wight.
Similarly, we thank the entire data, laboratory, administrative, and communications staff of the Long-term Evaluation phase of the trial. In particular, Celia Barberousse, Habby Bugalama, Catherine Bunga, Claire Cooke, Sekela David, Mathias Herman, Alphonce Isangu, Jacqueline Jackson, Msegena James, Angelina Kayabu, Privatus Kihanga, Mr Komba, Deogratius Lekariro, Paschal Maganga, Michael Mahande, George Makungwi, John Marijani, Joseph Massawe, Yesse Mazanda, Erick Mgina, Mbango Mhamba, Leocardia Mmari, Julius Mngara, Domenica Morona, Fabian Msakwa, Evarist Msaky, Ntunga Saul Ntunga, George Ogweno, Innocent Rwegasha, Frederick Sangawe, and Stephen Simbila in Mwanza. We also thank Sheena Mc Cormack, who provided valuable input during the design stage of the long-term evaluation survey, Annabelle South, who coordinated the communications aspects of the trial, and Frankie Liew and Lucy Bradshaw, who provided administrative support in London.
We are grateful to the members of the trial's Steering and Scientific Advisory Committees, which were co-chaired by the Director of Preventive Services in the Tanzanian Ministry of Health, and the Director of Basic Education in the Ministry of Education and Culture, and to the members of the Data and Safety Monitoring Committee: Peter Smith, Andrew Kitua, and Helen Weiss (before she became the trial statistician). We thank the Tanzanian Ministry of Health and Ministry of Education, National AIDS Control Programme, and Medical Research Co-ordinating Committee, and the Ethics Committee of the LSHTM, for permission to carry out and publish the results of this study. We are also grateful to the Regional Medical and Education Officers of Mwanza and the National Directors of NIMR and AMREF for their support.
This report is dedicated to the young people of Mwanza Region who participated in the study, and the teachers, health workers, and community members who implemented the interventions.
ICMJE criteria for authorship read and met: AMD DAR KM KB CM AA MMP AINO HAW SK DWJ JC RJH. Agree with the manuscript's results and conclusions: AMD DAR KM KB CM AA MMP AINO HAW SK DWJ JC RJH. Designed the experiments/the study: AMD DAR MMP AINO DWJ JC RJH. Analyzed the data: AMD. Collected data/did experiments for the study: KM AA SK. Wrote the first draft of the paper: AMD DAR. Contributed to the writing of the paper: AMD DAR KM KB CM AA MMP AINO HAW SK DWJ JC RJH. Co-led the design and coordinated the Long-term Evaluation Phase of the trial in Mwanza (2006–2008): AMD. Was a PI and contributed to all aspects of the trial throughout (1997–2008) and lead PI for the Long-Term Evaluation Phase: DAR. In charge of data management (2006 to mid-2008) and contributed to the analysis: KB. In charge of data management (mid-2008 to 2009): CM. Co-supervised the laboratory work: AA. Led the qualitative social research that contributed to intervention design and the interpretation of the trial findings, played a leading role in the design and implementation of some First Phase surveys, and advised on the design and interpretation of the Long-term Evaluation: MLP. Designed the intervention which the paper evaluates: AINO. Advised on the analysis: HAW. Advised on the data collection (2007–2008) and interpretation of the trial results: SK. Advised on protocol development, training and supervision of fieldwork and analysis; and was co-PI on the Long-term Evaluation Phase of the trial: DWJ. Co-supervised the laboratory work and was co-Investigator on the trial's First Phase and co-PI on the Long-Term Evaluation Phase: JC. Was PI of the original cluster randomised trial within which this long-term follow-up survey was embedded; led the design of the trial and contributed to all aspects of the trial including the data analysis: RJH.
- 1. UNAIDS (2008) Report on the global HIV/AIDS epidemic 2008. Geneva: UNAIDS (UNAIDS/08.25E/JC1510E UNAIDS/08.25E/JC1510E). 362 p.
- 2. Temmerman M (1994) Sexually transmitted diseases and reproductive health. Sex Transm Dis 21: S55–58.
- 3. Obasi AI, Balira R, Todd J, Ross DA, Changalucha J, et al. (2001) Prevalence of HIV and Chlamydia trachomatis infection in 15-19-year olds in rural Tanzania. Trop Med Int Health 6: 517–525.
- 4. Pequegnat W, Stover E (2000) Behavioral prevention is today's AIDS vaccine! AIDS 14: Suppl 2S1–7.
- 5. UNICEF (2002) Young people and HIV/AIDS: Opportunity in crisis. New York: UNICEF.
- 6. UNAIDS (2007) Practical Guidelines for Intensifying HIV Prevention: Towards Universal Access. Geneva: UNAIDS (UNAIDS/07.07E/JC1274E UNAIDS/07.07E/JC1274E). 68 p.
- 7. WHOUNAIDS (2007) New data on male circumcision and HIV prevention: policy and programme implications: WHO/UNAIDS Technical Consultation, Male Circumcision and HIV Prevention: Research Implications for Policy and Programming, Montreux, 6–7 March 2007:conclusions and recommendations. Geneva: World Health Organization. 10 p.
- 8. Weiss HA, Halperin D, Bailey RC, Hayes RJ, Schmid G, et al. (2008) Male circumcision for HIV prevention: from evidence to action? AIDS 22: 567–574.
- 9. Henderson M, Wight D, Raab GM, Abraham C, Parkes A, et al. (2007) Impact of a theoretically based sex education programme (SHARE) delivered by teachers on NHS registered conceptions and terminations: final results of cluster randomised trial. BMJ 334: 133.
- 10. DiCenso A, Guyatt G, Willan A, Griffith L (2002) Interventions to reduce unintended pregnancies among adolescents: systematic review of randomised controlled trials. BMJ 324: 1426–1430.
- 11. Gallant M, Maticka-Tyndale E (2004) School-based HIV prevention programmes for African youth. Soc Sci Med 58: 1337–1351.
- 12. Pronyk PM, Hargreaves JR, Kim JC, Morison LA, Phetla G, et al. (2006) Effect of a structural intervention for the prevention of intimate-partner violence and HIV in rural South Africa: a cluster randomised trial. Lancet 368: 1973–1983.
- 13. Jewkes R, Nduna M, Levin J, Jama N, Dunkle K, et al. (2008) Impact of stepping stones on incidence of HIV and HSV-2 and sexual behaviour in rural South Africa: cluster randomised controlled trial. BMJ 337: a506.
- 14. Stephenson J, Strange V, Allen E, Copas A, Johnson A, et al. (2008) The long-term effects of a peer-led sex education programme (RIPPLE): a cluster randomised trial in schools in England. PLoS Med 5: e224. doi:10.1371/journal.pmed.0050224.
- 15. Kirby D, Obasi A, Laris BA (2006) The effectiveness of sex education and HIV education interventions in schools in developing countries. In: Ross DA, Dick B, Ferguson J, editors. 938. : 103–150. Preventing HIV/AIDS in Young People: a systematic review of the evidence from developing countries. WHO Tech Rep Ser.
- 16. Cowan FM, Pascoe SJ, Langhaug LF, Dirawo J, Chidiya S, et al. (2008) The Regai Dzive Shiri Project: a cluster randomised controlled trial to determine the effectiveness of a multi-component community-based HIV prevention intervention for rural youth in Zimbabwe–study design and baseline results. Trop Med Int Health 13: 1235–1244.
- 17. Catania JA, Gibson DR, Chitwood DD, Coates TJ (1990) Methodological problems in AIDS behavioral research: influences on measurement error and participation bias in studies of sexual behavior. Psychol Bull 108: 339–362.
- 18. McFarlane M, St Lawrence JS (1999) Adolescents' recall of sexual behavior: consistency of self-report and effect of variations in recall duration. J Adolesc Health 25: 199–206.
- 19. Wight D, West P (1999) Poor recall, misunderstandings and embarrassment: interpreting discrepancies in young men's reported heterosexual behaviour. Cult Health Sex 1: 55–78.
- 20. Plummer ML, Ross DA, Wight D, Changalucha J, Mshana G, et al. (2004) “A bit more truthful”: the validity of adolescent sexual behaviour data collected in rural northern Tanzania using five methods. Sex Transm Infect 80: Suppl2ii49–ii56.
- 21. Hayes RJ, Changalucha J, Ross DA, Gavyole A, Todd J, et al. (2005) The MEMA kwa Vijana project: design of a community randomised trial of an innovative adolescent sexual health intervention in rural Tanzania. Contemp Clin Trials 26: 430–442.
- 22. Obasi AI, Cleophas B, Ross DA, Chima KL, Mmassy G, et al. (2006) Rationale and design of the MEMA kwa Vijana adolescent sexual and reproductive health intervention in Mwanza Region, Tanzania. AIDS Care 18: 311–322.
- 23. Ross DA, Changalucha J, Obasi AI, Todd J, Plummer ML, et al. (2007) Biological and behavioural impact of an adolescent sexual health intervention in Tanzania: a community-randomized trial. AIDS 21: 1943–1955.
- 24. Plummer ML, Wight D, Obasi AIN, Wamoyi J, Mshana G, et al. (2007) A process evaluation of a school-based adolescent sexual health intervention in rural Tanzania: the MEMA kwa Vijana programme. Health Educ Res 22: 500–512.
- 25. Guyon A, Lugoe WL, Ferguson J (2000) Evaluation report of HIV/AIDS peer education in the MEMA kwa Vijana project, Mwanza, Tanzania. AMREF, NIMR and LSHTM Collaborative Research Projects. (Unpublished report).
- 26. Kirby D (2001) The Mema kwa Vijana Curriculum: A Review. Santa Cruz, California: ETR Associates. 8 p. (Unpublished report).
- 27. Lugoe WL (2001) Evaluation of Teacher-training sessions for MkV teacher led component. Dar es Salaam: Faculty of Education, University of Dar es Salaam. (Unpublished report).
- 28. Renju J, Nyalali K (2008) Scaling up ASRH education through widespread teacher training: training evaluation report. National Institute for Medical Research, Mwanza, Tanzania and Liverpool School of Tropical Medicine, UK. 24. (www.memakwavijana.org).
- 29. Renju J, Nyalali K (2008) Scaling up Youth Friendly health services through widespread health worker training; training evaluation report. National Institute for Medical Research, Mwanza, Tanzania and Liverpool School of Tropical Medicine, UK. 40. (www.memakwavijana.org).
- 30. Boerma JT, Urassa M, Nnko S, Ng'weshemi J, Isingo R, et al. (2002) Sociodemographic context of the AIDS epidemic in a rural area in Tanzania with a focus on people's mobility and marriage. Sex Transm Infect 78: Suppl 1i97–105.
- 31. Rossau R, Heyndrickx L, Van Heuverswyn H (1988) Nucleotide sequence of a 16S ribosomal RNA gene from Neisseria gonorrhoeae. Nucleic Acids Res 16: 6227.
- 32. Roymans R, Onland G, Jansz A, Quint W, Boel E (1999) Evaluation of an in-house polymerase chain reaction for detection of Neisseria gonorrhoeae in urogenital samples. J Clin Pathol 52: 411–414.
- 33. Grosskurth H, Mosha F, Todd J, Mwijarubi E, Klokke A, et al. (1995) Impact of improved treatment of sexually transmitted diseases on HIV infection in rural Tanzania: randomised controlled trial. Lancet 346: 530–536.
- 34. del Mar Pujades Rodriguez M, Obasi A, Mosha F, Todd J, Brown D, et al. (2002) Herpes simplex virus type 2 infection increases HIV incidence: a prospective study in rural Tanzania. AIDS 16: 451–462.
- 35. Hayes RJ, Moulton LH (2009) Cluster Randomised Trials. CRC Press, Boca Raton, USA.
- 36. Makokha M (2008) What MEMA kwa Vijana has to offer the education sector AIDS response in Tanzania: A comparative review. National Institute for Medical Research, Medical Research Council, UK and Liverpool School of Tropical Medicine, UK. 69. (www.memakwavijana.org).
- 37. Mwita W, White R, Chilongani J, Orroth K, Zaba B, et al. (2002) The association between population mobility and HIV prevalence in rural villages in Mwanza region, Tanzania. Trans R Soc Trop Med Hyg 96: 363–364.
- 38. United Nations (2001) UNGASS Goals. Declaration of commitment on HIV/AIDS. New York, United Nations, 2001.
- 39. Wight D, Plummer ML, Mshana G, Wamoyi J, Shigongo ZS, et al. (2006) Contradictory sexual norms and expectations for young people in rural Northern Tanzania. Soc Sci Med 62: 987–997.
- 40. Plummer ML, Wight D, Wamoyi J, Mshana G, Hayes RJ, et al. (2006) Farming with your hoe in a sack: condom attitudes, access, and use in rural Tanzania. Stud Fam Plann 37: 29–40.