Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Economic Evaluations of Adult Male Circumcision for Prevention of Heterosexual Acquisition of HIV in Men in Sub-Saharan Africa: A Systematic Review

  • Olalekan A. Uthman ,

    uthlekan@yahoo.com

    Affiliation The West Midlands Health Technology Assessment Collaboration (WMHTAC), Department of Public Health, Epidemiology & Biostatistics, University of Birmingham, Birmingham, United Kingdom

  • Taiwo Aderemi Popoola,

    Affiliation Research and Evaluation, Center for Evidence-Based Global Health, Birmingham, United Kingdom

  • Mubashir M. B. Uthman,

    Affiliation Department of Community Health and Epidemiology, University of Ilorin, Ilorin, Kwara State, Nigeria

  • Olatunde Aremu

    Affiliation Department of Public Health Sciences, Division of Social Medicine, Karolinska Institutet, Stockholm, Sweden

Economic Evaluations of Adult Male Circumcision for Prevention of Heterosexual Acquisition of HIV in Men in Sub-Saharan Africa: A Systematic Review

  • Olalekan A. Uthman, 
  • Taiwo Aderemi Popoola, 
  • Mubashir M. B. Uthman, 
  • Olatunde Aremu
PLOS
x

Abstract

Background

There is conclusive evidence from observational data and three randomized controlled trials that circumcised men have a significantly lower risk of becoming infected with the human immunodeficiency virus (HIV). The aim of this study was to systematically review economic evaluations on adult male circumcision (AMC) for prevention of heterosexual acquisition of HIV in men.

Methods and Findings

Studies were identified from the following bibliographic databases: MEDLINE (Ovid), EMBASE (Ovid), Cochrane Library (Wiley's internet version), NHS EED and DARE Office of Health Economics HEED. The searches were conducted in November 2009. The Drummond 10-point checklist was used for methodological critique of the economic evaluations. Cost data were inflated and converted to 2008 US dollars (US$). Of 264 identified papers, only five met the inclusion criteria and were included in the review. The studies were published between 2006 and 2009. Most of the studies were carried out from the perspective of government healthcare payer. The time horizon ranged from 10 to 20 years. All studies reported that AMC is cost-effective. The reported cost per HIV infection averted ranged from US$174 to US$2808. The key driver of the cost-effectiveness models was circumcision efficacy.

Conclusions

All published economic evaluations offered the same conclusion that AMC is cost-effective and potentially cost-saving for prevention of heterosexual acquisition of HIV in men. On these grounds, AMC may be seen as a promising new form of strategy for prevention of HIV and should be implemented in conjunction with other evidence-based prevention methods.

Introduction

Male circumcision is one of the oldest and most common surgical procedures worldwide. It may be undertaken for religious, cultural, social and medical reasons. There is conclusive evidence from observational data [1], [2], [3], [4], [5], [6] and three randomized controlled trials [7], [8], [9] that circumcised men have a significantly lower risk of becoming infected with the human immunodeficiency virus (HIV). Several reviews have been reported on the effectiveness of adult male circumcision (AMC) for prevention of heterosexual acquisition of HIV in men [10], [11], [12], [13], [14], [15], [16], [17], [18], [19], [20]. While the literature has focused on the effectiveness alone, we argue that there has not been commensurate interest in economic evaluations. Economic evaluation provides a useful framework to assist policy makers in allocating resources across competing needs. HIV/AIDS is a considerable burden on society resources, and prevention provides a cost-beneficial solution to address these consequences [21]. Sub-Saharan Africa is more heavily affected by Human immunodeficiency virus (HIV) and acquired immunodeficiency syndrome (AIDS) than any other region of the world [22]. Estimated 22.5 million people were living with HIV at the end of 2007 and approximately 1.7 million additional people were infected with HIV during that year [22]. In just the past year, the AIDS epidemic in Africa had claimed the lives of estimated 1.6 million people in this region. More than 11 million children have been orphaned by AIDS [22].

To our knowledge, no systematic review of the peer-reviewed economic evaluations literature on AMC for prevention of heterosexual acquisition of HIV in men has been published to date. A goal of systematic review is to provide the clinician, researcher or policy makers with a balanced appraisal of the totality of the evidence in an area by reading one review, contrary to a multitude of individual studies. This allows for a more objective appraisal of the evidence, which may lead to resolution of uncertainty and disagreement. Therefore, the objectives of this systematic review were to identify published economic evaluations on AMC for prevention of heterosexual acquisition of HIV in men and to identify areas that merit further study.

Methods

Eligibility Criteria

Inclusion and exclusion criteria applied for economic searches are summarised below:

  • Study design: cost-effectiveness analysis, cost-utility analysis, or cost-benefit analysis
  • Population: adult male in sub-Saharan Africa
  • Intervention: adult male circumcision (AMC)
  • Comparator: no AMC

Information Sources and Search strategy

A comprehensive search for literature on the cost-effectiveness of AMC versus no AMC for prevention of heterosexual acquisition of HIV in men was conducted. Studies were identified from the following bibliographic databases: MEDLINE (Ovid), EMBASE (Ovid), Cochrane Library (Wiley's internet version), NHS EED and DARE Office of Health Economics HEED. The searches were conducted in November 2009. Searches were not limited by date and there were no language restrictions. Search keywords included male circumcision, circumcision, and adult male circumcision. These keywords were combined with an economic study filter based on the Centre for Review Disseminations model [23], [24]. We also checked the reference lists of all studies identified by the above methods.

Study Selection

One reviewer applied the inclusion and exclusion criteria. These were checked by a second reviewer. Disagreements were resolved by discussion.

Data Collection Process and Data Items

For each identified study that met the selection criteria, the following data were extracted country, study design, population, intervention, comparator, perspective, model type, primary outcome, discount rate, time horizon, and price year on to an Excel spreadsheet. The main characteristics, quality assessment (see below) and results of included economic evaluations were tabulated. One review author extracted data and the second author checked the extracted data.

Quality Assessment

Identified economic evaluations were also assessed against the Drummond 10-point checklist [25]. The checklist was developed to assess/critique the quality of an economic evaluation. Drummond checklists consider the following: description of interventions; study design; identification, measurement and valuation of costs and consequences; discounting; a clear results with sensitivity and uncertainty analysis; and discussion of results in the context of policy relevance and existing literature.

Summary Measures

For the primary outcome, the preferred measures were cost per HIV infection averted (HIA), and incremental cost-effectiveness ratio (cost per quality adjusted life years (QALY) gained and cost per disability adjusted life years (DALY) averted). Net cost saving was also considered.

In order to make different cost data comparable, the cost data were inflated to 2008 prices using the prices inflation index [26]. For those studies that did not report price year, the year the study was published was used for inflation of cost data. This review was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) [27], [28].

Results

Study Selection

The search of electronic databases produced a total of 264 citations (Figure 1). After adjusting for duplicates 205 remained. Of these, 190 studies were discarded because after reviewing the abstracts it appeared that these papers clearly did not meet the inclusion criteria. The full text of the remaining 15 citations was examined in more detail. Ten studies were discarded for the following reasons: cost-analysis (n = 3) [29], [30], [31], neonatal circumcision (n = 3) [32], [33], [34], correspondence (n = 2) [35], [36], and population based on high-income country (n = 2) [37], [38]. Five studies [39], [40], [41], [42], [43] met the inclusion criteria and were included in the systematic review.

Study Characteristics

Table 1 shows the characteristics of the included studies. The studies were published between 2006 and 2009. Studies population was from Uganda [40], South Africa [39], Mozambique [42], and Botswana [43]. Auvert et al 2008 [41] included data from the following 16 countries in sub-Saharan Africa: Botswana, Burundi, Central African Republic, Kenya's Nyanza province, Lesotho, Liberia, Malawi, Mozambique, Namibia, Rwanda, South Africa, Swaziland, Tanzania, Uganda, Zambia and Zimbabwe. All studies [39], [40], [41], [42], [43] were cost-effectiveness analyses and primary outcome was cost per HIV infection averted (HIA). Most studies were carried out from the perspective of government healthcare payer. All studies [39], [40], [41], [42], [43] compared cost-effectiveness of adult male circumcision (AMC) versus no AMC. The model types included epidemiologic [39], [41], [43], stochastic [40], and costing model [42]. Four studies used 3% discount rate [39], [41], [42], [43]. One study did not report discount rate [40]. The time horizon ranged from 10 to 20 years.

Validity Assessment

Details of the quality of assessments can be found in Table 2.

1. Was a well-defined question posed in answerable form?

Three studies [39], [40], [41] had clearly defined questions, i.e., to assess the cost-effectiveness of AMC in prevention of HIV. Two studies did not state their research question clearly [42],[43].

2. Was a comprehensive description of the competing alternatives given?

All studies [39], [40], [41], [42], [43] described competing alternatives, AMC versus no AMC.

3. Was the effectiveness of the programmes or services established?

Evidence of effectiveness came from the observational studies or from the trial results [7], [8], [9]. Kahn et al 2006 [39] defined effectiveness as the number of HIA, which was estimated by dynamically projecting over 20 years the reduction in HIV incidence observed in the Orange Farm [7](OF, Gauteng Province, South Africa). Auvert et al 2008 [41] and Fieno et al 2008 [42] also used evidence of effectiveness from OF trial [7]. Bollinger et al 2009 [43] used evidence from three trials [7], [8], [9]. Gray et al 2007 [40] effectiveness parameters were based on an observational study in a rural population of Rakai District, south-western Uganda. Gray et al 2007 [40] assumed that circumcision might reduce the incidence of HIV incidence rate ratios (IRR) varying from 0.3 to 0.6. Efficacy, the reduced incidence of HIV afforded by circumcision, was estimated from 1-IRR.

4. Were all the important and relevant costs and consequences for each alternative identified?

All studies [39], [40], [41], [42], [43] considered cost of AMC. Except for Gray et al 2007 [40], studies [39], [41], [42], [43] considered lifetime medical cost of treating HIV. Only one study included complications associated with AMC in the cost-effectiveness model [39].

5. Were costs and consequences measured accurately in appropriate physical units?

Most studies estimated cost of AMC and lifetime medical treatment of HIV from published studies. Number of HIV infections averted was the primary outcome in all studies. Fieno et al 2008 [42] also valued outcome in DALYs averted. Most studies extrapolated the number of HIV infection averted beyond the trials period.

6. Were costs and consequences valued credibly?

Kahn et al. 2006 [39] cost of performing an AMC was based on the estimate from the OF RCT [7]. Kahn et al. 2006 [39] assumed zero additional training and physical infrastructure development costs in connection with high levels of circumcision coverage. The cost per AMC was varied by ±50% to reflect these potential efficiencies or inefficiencies of scale-up. The cost of adverse events was included and standardized for 1,000 individuals. The lifetime cost of HIV treatment was based on Cleary et al. [44] data from pilot clinics (in South Africa) for a prospective disease state model. Cleary and colleagues [44] estimated a lifetime discounted cost of US$11,948 with antiretroviral therapy (ART) and US$3,793 without ART. However, Kahn et al. 2006 [39] used US$8,000 as the base case value, implying 50% access to ongoing ART, and explored a wide range from US $4,000 to US$12,000.

Gray et al 2007 [40] used the estimated cost per surgery in the Rakai trial [45] (US$69) to estimate the cost per HIA over a period of 10 years. Auvert et al 2008 [41] explored a public cost scenario assuming the use of government health infrastructures only and a private cost scenario assuming reliance on private health care providers only. Program costs were composed of initial and annual costs. In the public cost scenario, initial costs were per circumcision facility (for medical equipment and certification) and for training circumcisers. Annual costs included the oversight and promotion of AMC, the salaries of full-time circumcisers, surgical staff and counsellors, the direct non-salary cost of each AMC (i.e., surgical supplies), facility overhead (i.e., operating costs) and program overhead. In the private cost scenario, all facility-level costs were included in the price per AMC paid to providers. No initial costs were included because these providers were already equipped to perform AMC. The price of each AMC covered salaries of circumcisers, other health staff, counselling, surgical supplies, follow-up, treatment of adverse events and operating costs. In addition to direct provider payments, Auvert et al 2008 [41] also assumed annual program overhead costs of 10% to cover the public promotion of AMC. In order to estimate costs and savings from HIV treatment, Auvert et al 2008 [41] assumed that 30% of HIV-infected individuals eligible for antiretroviral treatment were receiving it. The averted cost of medical treatment for HIV over time was a function of the number of HIV infections averted each year and the rate of disease progression, combined with associated medical costs.

Fieno et al 2008 [41] reported detail breakdown of AMC costing model estimates under different scenarios. The costing model was broken down into seven cost inputs: personnel (salaries and training), surgical equipment and supplies, bandages and cleaning supplies, monitoring and evaluation (M & E), administration, rural coverage, and adverse events due to the surgery. Fieno et al 2008 [41] assumed the value of medical care per HIV infection was to be the cost of two years of anti-retroviral therapy (ART) (US$500) in Mozambique or US$1000. Bollinger et al 2009 [43] used unit cost of an uncomplicated AMC of US$48 in the public sector as provided by Botswana national strategy. In addition, Bollinger et al 2009 [43] also developed three other unit costs: (1) a neonatal circumcision unit cost of US$38 (assumed to be 20% lower than the adult cost, due to lower complication rates and lower costs for commodities), (2) private provider unit costs for both adult and neonatal circumcisions of US$60 and US$48 (assumed to be 5% higher than the relevant public sector costs)., and (3) user fees of US$1 for public sector and US$25 for private providers were assumed.

Kahn et al. 2006 [39] defined effectiveness as the number of HIV infections prevented per 1,000 newly circumcised men over a specified number of years. The effectiveness was calculated as the product of the number of HIV susceptible, the HIV incidence rate, the protective effect of AMC (adjusted for risk compensation), the projection period (in years), and an epidemic multiplier. Kahn et al. 2006 [39] estimated net DALYs by subtracting the increase in DALYs due to adverse events from the reduction in DALYs due to HIA. The reduction in DALYs from HIV was calculated by multiplying HIA by previously reported discounted DALY changes with ART (ten DALYs) and without (21 DALYs), assuming 50% on ART. Gray et al 2007 [40] calculated the number of HIV infections potentially averted by each surgery from the total number of incident cases expected in the population in the absence of a circumcision program minus the number of incident cases estimated with varying circumcision efficacies. Auvert et al 2008 [41] estimated effects of AMC on HIV as a function of time and parameters were based on published studies. Fieno et al 2008 [41] assumed the number of DALYs per HIV/AIDS mortality to be 15.5 years. The benefits of AMC were estimated from the Kahn et al. 2006 [39] cost-effectiveness model. Bollinger et al 2009 [43] calculated number of AMC that are required in order to avert one HIV infection by dividing the increase in the number of AMC performed by the number of HIA over the relevant time period.

7. Were costs and consequences adjusted for differential timing?

Most studies [39], [41], [42], [43] discounted cost accrued beyond 1 year. Kahn et al 2006 [39] was the only study that reported that future benefit was discounted.

8. Was an incremental analysis of costs and consequences of alternatives performed?

All studies [39], [40], [41], [42], [43] calculated program cost per HIA. Fieno et al 2008 [42] also calculated the cost of one DALY saved from HIV infection averted.

9. Was allowance made for uncertainty in the estimates of costs and consequences?

Except for Fieno et al 2008 [42], studies reported at least one form of sensitivity analyses. Gray et al 2007 [40] explored the effect of variation program coverage and circumcision efficacy on the cost per HIA. Kahn et al 2006 [39] conducted sensitivity analyses to examine the effects of all input uncertainty and program coverage using one-way, three-way and multivariate (using Monte Carlo simulations) sensitivity analyses. Auvert et al 2008 [41] explored a public cost scenario assuming the use of government health infrastructures only and a private cost scenario assuming reliance on the private health care providers only. In addition, Auvert et al 2008 [41] also considered the effect of different time horizon and program coverage on cost per HIA. Bollinger et al 2009 [43] examined the effects in variation in program effectiveness, discount rate, and lifetime cost of ART on the cost per HIA.

10. Did the presentation and discussion of study results include all issues of concern to users?

Most of the studies discussed issue of availability, affordability, and sustainability of their findings.

Outcome Measures

Table 1 also shows the estimated cost per HIA from the five studies. Gray et al 2007 [40] reported that the cost per HIA over 10 years could range from US$2808 with 60% circumcision efficacy, to US$4173 with 40% circumcision efficacy. Kahn et al. 2006 [39] estimated the cost per HIA over 20 years at US$193. Kahn et al. 2006 [39] also reported that the cost-effectiveness model was sensitive to the cost of AMC, cost of averted HIV treatment, the protective effect of AMC, and HIV prevalence. With an HIV prevalence of 8.4%, the cost of per HIA increased nearly 3-fold to US$588. Cost-effectiveness improves by less than US10$ when AMC intervention coverage is 50% of full coverage. Auvert et al 2008 [41] found that the estimated costs per HIA over 10 and 20 years were US$351 (US$271 to US$473) and US$174 (US$138 to US$232) respectively. Fieno et al 2008 [41] estimated the cost per HIA over 20 years at US$390. Bollinger et al 2009 [43] estimated the cost per HIA with 60% circumcision efficacy at US$642. However, the cost-effectiveness model was sensitive to AMC effectiveness. At 75% and 30% circumcision efficacy, the costs per HIA were US$508 and US$1313 respectively.

The reported cost savings varied across the studies. Kahn et al. 2006 [39] found that after adjustment for averted lifetime HIV medical costs, the net saving was US$2573 per AMC. Auvert et al 2008 [41] found that the estimated net savings over 20 years were US$2.4 billion (95% percentile interval 1.5 to 3.5). Fieno et al 2008 [41] reported that the saving from the AMC in terms of medical costs alone would accrue over 20 years to US$234.0 million. Bollinger et al 2009 [43] estimated net savings over 17 years with 60% circumcision efficacy at US$10,616. Only study reported cost per DALYs averted [41]. Fieno et al 2008 [41] reported that cost was US$7.8 per DALY.

Discussion

Main Findings

This systematic review of economic evaluations of adult male circumcision (AMC) for prevention of heterosexual acquisition of HIV in men provides compelling evidence that AMC is within the range of what is generally regarded as cost-effective, even cost-saving, intervention. The reported cost per HIA ranged from US$174 in Auvert et al 2008 [41] to as much as US$2808 in Gray et al 2007 [40]. The key driver of cost-effectiveness models was circumcision efficacy. Except for Gray et al 2007 [40], studies used evidence of effectiveness from OF trial [7]. Thus, possible explanation for the high cost per HIA reported by Gray et al 2007 [40] in comparison to other studies could be due to the fact that the model effectiveness data was based on observational study. However, these findings are comparable with other prevention and treatment strategies in developing countries in terms of economic criteria. Recent reviews of HIV prevention cost-effectiveness suggest a range of $10 to more than $10,000 per HIA [46], [47], [48]. Commercial sex worker interventions and mass-media campaign cost just over US$50 per HIA. Second-generation female condom cost US$985 per HIA. Blood safety measures cost US$41–246 per HIA. Diagnosis and treatment of sexually transmitted infections cost US$250 per HIA. Voluntary testing and counselling cost S$264–367 per HIA; and intervention for reducing mother-to-child transmission cost US$84–714 per HIA.

Study Strengths and Limitations

The strengths of this study are that, to our knowledge, it provides the most comprehensive review to date of economic evaluations of male circumcision for prevention of heterosexual acquisition of HIV in men in sub-Saharan; and it is the first review in this area to critique the quality of modelling approaches used in the economic evaluations. The search process was elaborate and to our knowledge no other studies were available for review. In addition, we used a standard checklist to appraise the quality of economic evaluations. The reporting of this review conforms to PRISMA guideline [27], [28].

There are number of limitations associated with these studies. Most of these studies did not considered complications associated with AMC in their cost-effectiveness models. It has been reported that high complication rates challenge the implementation of male circumcision for HIV prevention in Africa [49]. Another important limitation of these studies, except for Kahn et al 2006 [39], most of the authors did not considered multivariate sensitivity analysis. The uncertainty in the evidence base needs to be reflected in the model. To simultaneously assess the implications of uncertainty in all elements of evidence, probabilistic analysis should be used to establish the decision uncertainty associated with each public health intervention being compared [50], [51]. This informs decision-makers about the probability of each strategy being the most cost-effective conditional on the value that the decision maker places on a unit of health gain. Such methods can also be used to provide an opportunity to apply value of information (VOI) methods to inform priority setting in research [52], [53], [54]. Generalizability of the findings is also an important limitation. Most of the studies were based on OF trial [7]. The OF trial [7] was conducted in a single country and used prevailing or local prices to calculate costs. Economic evaluation carried out alongside a randomised controlled trial may differ significantly from usual practice or care [55]. We recommend that future economic evaluations address these limitations and be guided in part by the checklists available for assessing economic evaluations. Economic evaluation provides a useful framework to assist policy makers in allocating resources across competing needs. HIV/AIDS is a considerable burden on society resources, and prevention provides a cost-beneficial solution to address these consequences. To better inform the decision-making process, researchers must continue to produce high-quality, methodological, comparable and scientifically credible economic evaluations.

All published economic evaluations offered the same conclusion that AMC is cost-effective and potentially cost-saving for prevention of heterosexual acquisition of HIV in men. On these grounds, AMC may be seen as a promising new form of strategy for prevention of HIV. However, we believed like others that AMC should never replace other known methods of HIV prevention. AMC should be considered as part of a comprehensive HIV prevention package, such as, promoting delay in the onset of sexual relations, abstinence from penetrative sex and reduction in the number of sexual partners; providing and promoting the correct and consistent use of male and female condoms; providing HIV testing and counselling services; and providing services for the treatment of sexual transmitted infections.

Acknowledgments

The authors thank the editor and two anonymous reviewers for critical review of an earlier version of the manuscript.

Author Contributions

Analyzed the data: OU TAP MMU OA. Contributed reagents/materials/analysis tools: OU TAP MMU OA. Wrote the paper: OU TAP MMU OA.

References

  1. 1. Baeten JM, Richardson BA, Lavreys L, Rakwar JP, Mandaliya K, et al. (2005) Female-to-male infectivity of HIV-1 among circumcised and uncircumcised Kenyan men. J Infect Dis 191: 546–553.JM BaetenBA RichardsonL. LavreysJP RakwarK. Mandaliya2005Female-to-male infectivity of HIV-1 among circumcised and uncircumcised Kenyan men.J Infect Dis191546553
  2. 2. Drain PK, Halperin DT, Hughes JP, Klausner JD, Bailey RC (2006) Male circumcision, religion, and infectious diseases: an ecologic analysis of 118 developing countries. BMC Infect Dis 6: 172.PK DrainDT HalperinJP HughesJD KlausnerRC Bailey2006Male circumcision, religion, and infectious diseases: an ecologic analysis of 118 developing countries.BMC Infect Dis6172
  3. 3. Halperin DT, Bailey RC (1999) Male circumcision and HIV infection: 10 years and counting. Lancet 354: 1813–1815.DT HalperinRC Bailey1999Male circumcision and HIV infection: 10 years and counting.Lancet35418131815
  4. 4. Moses S, Bradley JE, Nagelkerke NJ, Ronald AR, Ndinya-Achola JO, et al. (1990) Geographical patterns of male circumcision practices in Africa: association with HIV seroprevalence. Int J Epidemiol 19: 693–697.S. MosesJE BradleyNJ NagelkerkeAR RonaldJO Ndinya-Achola1990Geographical patterns of male circumcision practices in Africa: association with HIV seroprevalence.Int J Epidemiol19693697
  5. 5. Quinn TC, Wawer MJ, Sewankambo N, Serwadda D, Li C, et al. (2000) Viral load and heterosexual transmission of human immunodeficiency virus type 1. Rakai Project Study Group. N Engl J Med 342: 921–929.TC QuinnMJ WawerN. SewankamboD. SerwaddaC. Li2000Viral load and heterosexual transmission of human immunodeficiency virus type 1. Rakai Project Study Group.N Engl J Med342921929
  6. 6. Reynolds SJ, Shepherd ME, Risbud AR, Gangakhedkar RR, Brookmeyer RS, et al. (2004) Male circumcision and risk of HIV-1 and other sexually transmitted infections in India. Lancet 363: 1039–1040.SJ ReynoldsME ShepherdAR RisbudRR GangakhedkarRS Brookmeyer2004Male circumcision and risk of HIV-1 and other sexually transmitted infections in India.Lancet36310391040
  7. 7. Auvert B, Taljaard D, Lagarde E, Sobngwi-Tambekou J, Sitta R, et al. (2005) Randomized, controlled intervention trial of male circumcision for reduction of HIV infection risk: the ANRS 1265 Trial. PLoS Med 2: e298.B. AuvertD. TaljaardE. LagardeJ. Sobngwi-TambekouR. Sitta2005Randomized, controlled intervention trial of male circumcision for reduction of HIV infection risk: the ANRS 1265 Trial.PLoS Med2e298
  8. 8. Bailey RC, Moses S, Parker CB, Agot K, Maclean I, et al. (2007) Male circumcision for HIV prevention in young men in Kisumu, Kenya: a randomised controlled trial. Lancet 369: 643–656.RC BaileyS. MosesCB ParkerK. AgotI. Maclean2007Male circumcision for HIV prevention in young men in Kisumu, Kenya: a randomised controlled trial.Lancet369643656
  9. 9. Gray RH, Kigozi G, Serwadda D, Makumbi F, Watya S, et al. (2007) Male circumcision for HIV prevention in men in Rakai, Uganda: a randomised trial. Lancet 369: 657–666.RH GrayG. KigoziD. SerwaddaF. MakumbiS. Watya2007Male circumcision for HIV prevention in men in Rakai, Uganda: a randomised trial.Lancet369657666
  10. 10. Bailey RC, Plummer FA, Moses S (2001) Male circumcision and HIV prevention: current knowledge and future research directions. Lancet Infect Dis 1: 223–231.RC BaileyFA PlummerS. Moses2001Male circumcision and HIV prevention: current knowledge and future research directions.Lancet Infect Dis1223231
  11. 11. Millett GA, Flores SA, Marks G, Reed JB, Herbst JH (2008) Circumcision status and risk of HIV and sexually transmitted infections among men who have sex with men: a meta-analysis. JAMA 300: 1674–1684.GA MillettSA FloresG. MarksJB ReedJH Herbst2008Circumcision status and risk of HIV and sexually transmitted infections among men who have sex with men: a meta-analysis.JAMA30016741684
  12. 12. Mills E, Cooper C, Anema A, Guyatt G (2008) Male circumcision for the prevention of heterosexually acquired HIV infection: a meta-analysis of randomized trials involving 11,050 men. HIV Med 9: 332–335.E. MillsC. CooperA. AnemaG. Guyatt2008Male circumcision for the prevention of heterosexually acquired HIV infection: a meta-analysis of randomized trials involving 11,050 men.HIV Med9332335
  13. 13. Moses S, Plummer FA, Bradley JE, Ndinya-Achola JO, Nagelkerke NJ, et al. (1994) The association between lack of male circumcision and risk for HIV infection: a review of the epidemiological data. Sex Transm Dis 21: 201–210.S. MosesFA PlummerJE BradleyJO Ndinya-AcholaNJ Nagelkerke1994The association between lack of male circumcision and risk for HIV infection: a review of the epidemiological data.Sex Transm Dis21201210
  14. 14. O'Farrell N, Egger M (2000) Circumcision in men and the prevention of HIV infection: a ‘meta-analysis’ revisited. Int J STD AIDS 11: 137–142.N. O'FarrellM. Egger2000Circumcision in men and the prevention of HIV infection: a ‘meta-analysis’ revisited.Int J STD AIDS11137142
  15. 15. Siegfried N, Muller M, Deeks J, Volmink J, Egger M, et al. (2005) HIV and male circumcision–a systematic review with assessment of the quality of studies. Lancet Infect Dis 5: 165–173.N. SiegfriedM. MullerJ. DeeksJ. VolminkM. Egger2005HIV and male circumcision–a systematic review with assessment of the quality of studies.Lancet Infect Dis5165173
  16. 16. Siegfried N, Muller M, Deeks JJ, Volmink J (2009) Male circumcision for prevention of heterosexual acquisition of HIV in men. Cochrane Database Syst Rev. CD003362.N. SiegfriedM. MullerJJ DeeksJ. Volmink2009Male circumcision for prevention of heterosexual acquisition of HIV in men.Cochrane Database Syst Rev.CD003362
  17. 17. Siegfried N, Muller M, Volmink J, Deeks J, Egger M, et al. (2003) Male circumcision for prevention of heterosexual acquisition of HIV in men. Cochrane Database Syst Rev. CD003362.N. SiegfriedM. MullerJ. VolminkJ. DeeksM. Egger2003Male circumcision for prevention of heterosexual acquisition of HIV in men.Cochrane Database Syst Rev.CD003362
  18. 18. Van Howe RS (1999) Circumcision and HIV infection: review of the literature and meta-analysis. Int J STD AIDS 10: 8–16.RS Van Howe1999Circumcision and HIV infection: review of the literature and meta-analysis.Int J STD AIDS10816
  19. 19. Weiss HA, Halperin D, Bailey RC, Hayes RJ, Schmid G, et al. (2008) Male circumcision for HIV prevention: from evidence to action? Aids 22: 567–574.HA WeissD. HalperinRC BaileyRJ HayesG. Schmid2008Male circumcision for HIV prevention: from evidence to action?Aids22567574
  20. 20. Weiss HA, Quigley MA, Hayes RJ (2000) Male circumcision and risk of HIV infection in sub-Saharan Africa: a systematic review and meta-analysis. Aids 14: 2361–2370.HA WeissMA QuigleyRJ Hayes2000Male circumcision and risk of HIV infection in sub-Saharan Africa: a systematic review and meta-analysis.Aids1423612370
  21. 21. Bertozzi SM, Padian NS, Wegbreit J, DeMaria LM, Feldman B, et al. (2006) HIV/AIDS Prevention and Treatment. In: Jamison DT, Breman JG, Measham AR, Alleyne G, Claeson M,, et al., editors. Disease control priorities in developing countries. New York; Washington, DC: Oxford University Press; World Bank. pp. 331–370.SM BertozziNS PadianJ. WegbreitLM DeMariaB. Feldman2006HIV/AIDS Prevention and Treatment.DT JamisonJG BremanAR MeashamG. AlleyneM, ClaesonDisease control priorities in developing countriesNew York; Washington, DCOxford University Press; World Bank331370
  22. 22. UNAIDS (2008) 2007 Report on the global AIDS epidemic. Geneva: Joint United Nations Programme on HIV/AIDS. UNAIDS20082007 Report on the global AIDS epidemic.GenevaJoint United Nations Programme on HIV/AIDS
  23. 23. McKinlay RJ, Wilczynski NL, Haynes RB (2006) Optimal search strategies for detecting cost and economic studies in EMBASE. BMC Health Serv Res 6: 67.RJ McKinlayNL WilczynskiRB Haynes2006Optimal search strategies for detecting cost and economic studies in EMBASE.BMC Health Serv Res667
  24. 24. Royle P, Waugh N (2003) Literature searching for clinical and cost-effectiveness studies used in health technology assessment reports carried out for the National Institute for Clinical Excellence appraisal system. Health Technol Assess 7: iii, ix–x, 1–51.P. RoyleN. Waugh2003Literature searching for clinical and cost-effectiveness studies used in health technology assessment reports carried out for the National Institute for Clinical Excellence appraisal system.Health Technol Assess7iii, ixx, 1–51
  25. 25. Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL (2005) Methods for the economic evaluation of health care programmes. New York: Oxford University Press. MF DrummondMJ SculpherGW TorranceBJ O'BrienGL Stoddart2005Methods for the economic evaluation of health care programmes.New YorkOxford University Press
  26. 26. Bureau of Labor Statistics (BLS) Overview of BLS Statistics on Inflation and Prices. United States of Department of Labor. Bureau of Labor Statistics (BLS) Overview of BLS Statistics on Inflation and Prices. United States of Department of Labor.
  27. 27. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, et al. (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med 6: e1000100.A. LiberatiDG AltmanJ. TetzlaffC. MulrowPC Gotzsche2009The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration.PLoS Med6e1000100
  28. 28. Moher D, Liberati A, Tetzlaff J, Altman DG (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6: e1000097.D. MoherA. LiberatiJ. TetzlaffDG Altman2009Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement.PLoS Med6e1000097
  29. 29. Jayanthi VR, Burns JE, Koff SA (1999) Postneonatal circumcision with local anesthesia: a cost-effective alternative. Journal of Urology 161(4): 1301–1303.VR JayanthiJE BurnsSA Koff1999Postneonatal circumcision with local anesthesia: a cost-effective alternative.Journal of Urology161(4)13011303
  30. 30. McAllister RG, Travis JW, Bollinger D, Rutiser C, Sundar V (2008) The cost to circumcise Africa. International Journal of Men's Health 7(3): 307–316.RG McAllisterJW TravisD. BollingerC. RutiserV. Sundar2008The cost to circumcise Africa.International Journal of Men's Health7(3)307316
  31. 31. Raja V, Sharma DM, Lipp A, Webb RJ (2007) Adult circumcision under local anaesthesia: patient satisfaction and cost analysis. Journal of One Day Surgery 17: V. RajaDM SharmaA. LippRJ Webb2007Adult circumcision under local anaesthesia: patient satisfaction and cost analysis.Journal of One Day Surgery17
  32. 32. Ganiats TG, Humphrey JB, Taras HL, Kaplan RM (1991) Routine neonatal circumcision: a cost-utility analysis. Med Decis Making 11: 282–293.TG GaniatsJB HumphreyHL TarasRM Kaplan1991Routine neonatal circumcision: a cost-utility analysis.Med Decis Making11282293
  33. 33. Schoen EJ, Colby CJ, To TT (2006) Cost analysis of neonatal circumcision in a large health maintenance organization. Journal of Urology 175(3): 1111–1115.EJ SchoenCJ ColbyTT To2006Cost analysis of neonatal circumcision in a large health maintenance organization.Journal of Urology175(3)11111115
  34. 34. Van Howe RS (2004) A cost-utility analysis of neonatal circumcision. Medical Decision Making 24: 584–601.RS Van Howe2004A cost-utility analysis of neonatal circumcision.Medical Decision Making24584601
  35. 35. Moses S, Bailey RC, Ronald AR (1998) Male circumcision: assessment of health benefits and risks. Sex Transm Infect 74: 368–373.S. MosesRC BaileyAR Ronald1998Male circumcision: assessment of health benefits and risks.Sex Transm Infect74368373
  36. 36. Wamai RG, Weiss HA, Hankins C, Agot K, Karim QA, et al. (2008) Male circumcision is an efficacious, lasting and cost-effective strategy for combating HIV in high-prevalence AIDS epidemics. Future HIV Therapy 2: 399–405.RG WamaiHA WeissC. HankinsK. AgotQA Karim2008Male circumcision is an efficacious, lasting and cost-effective strategy for combating HIV in high-prevalence AIDS epidemics.Future HIV Therapy2399405
  37. 37. Anderson J, Wilson D, Templeton DJ, Grulich A, Carter R, et al. (2009) Cost-effectiveness of adult circumcision in a resource-rich setting for HIV prevention among men who have sex with men. J Infect Dis 200: 1803–1812.J. AndersonD. WilsonDJ TempletonA. GrulichR. Carter2009Cost-effectiveness of adult circumcision in a resource-rich setting for HIV prevention among men who have sex with men.J Infect Dis20018031812
  38. 38. Cohen DA, Wu SY, Farley TA (2004) Comparing the cost-effectiveness of HIV prevention interventions. Journal of Acquired Immune Deficiency Syndromes 37(3): 1404–1414.DA CohenSY WuTA Farley2004Comparing the cost-effectiveness of HIV prevention interventions.Journal of Acquired Immune Deficiency Syndromes37(3)14041414
  39. 39. Kahn JG, Marseille E, Auvert B (2006) Cost-effectiveness of male circumcision for HIV prevention in a South African setting. PLoS Medicine 3(12): 2349–2358.JG KahnE. MarseilleB. Auvert2006Cost-effectiveness of male circumcision for HIV prevention in a South African setting.PLoS Medicine3(12)23492358
  40. 40. Gray RH, Li X, Kigozi G, Serwadda D, Nalugoda F, et al. (2007) The impact of male circumcision on HIV incidence and cost per infection prevented: a stochastic simulation model from Rakai, Uganda. Aids 21(7): 845–850.RH GrayX. LiG. KigoziD. SerwaddaF. Nalugoda2007The impact of male circumcision on HIV incidence and cost per infection prevented: a stochastic simulation model from Rakai, Uganda.Aids21(7)845850
  41. 41. Auvert B, Marseille E, Korenromp EL, Lloyd-Smith J, Sitta R, et al. (2008) Estimating the resources needed and savings anticipated from roll-out of adult male circumcision in sub-Saharan Africa. Plos One 3(8): B. AuvertE. MarseilleEL KorenrompJ. Lloyd-SmithR. Sitta2008Estimating the resources needed and savings anticipated from roll-out of adult male circumcision in sub-Saharan Africa.Plos One3(8)
  42. 42. Fieno JV (2008) Costing adult male circumcision in high HIV prevalence, low circumcision rate countries. Aids Care 20(5): 515–520.JV Fieno2008Costing adult male circumcision in high HIV prevalence, low circumcision rate countries.Aids Care20(5)515520
  43. 43. Bollinger LA, Stover J, Musuka G, Fidzani B, Moeti T, et al. (2009) The cost and impact of male circumcision on HIV/AIDS in Botswana. J Int AIDS Soc 12: 7.LA BollingerJ. StoverG. MusukaB. FidzaniT. Moeti2009The cost and impact of male circumcision on HIV/AIDS in Botswana.J Int AIDS Soc127
  44. 44. Cleary SM, McIntyre D, Boulle AM (2006) The cost-effectiveness of antiretroviral treatment in Khayelitsha, South Africa–a primary data analysis. Cost Eff Resour Alloc 4: 20.SM ClearyD. McIntyreAM Boulle2006The cost-effectiveness of antiretroviral treatment in Khayelitsha, South Africa–a primary data analysis.Cost Eff Resour Alloc420
  45. 45. Gray RH, Kiwanuka N, Quinn TC, Sewankambo NK, Serwadda D, et al. (2000) Male circumcision and HIV acquisition and transmission: cohort studies in Rakai, Uganda. Rakai Project Team. Aids 14: 2371–2381.RH GrayN. KiwanukaTC QuinnNK SewankamboD. Serwadda2000Male circumcision and HIV acquisition and transmission: cohort studies in Rakai, Uganda. Rakai Project Team.Aids1423712381
  46. 46. Galárraga O, Colchero MA, Wamai RG, Bertozzi SM (2009) HIV prevention cost-effectiveness: a systematic review. BMC Public Health 9: suppl 1s5.O. GalárragaMA ColcheroRG WamaiSM Bertozzi2009HIV prevention cost-effectiveness: a systematic review.BMC Public Health9suppl 1s5
  47. 47. Hogan DR, Baltussen R, Hayashi C, Lauer JA, Salomon JA (2005) Cost effectiveness analysis of strategies to combat HIV/AIDS in developing countries. BMJ 331: 1431–1437.DR HoganR. BaltussenC. HayashiJA LauerJA Salomon2005Cost effectiveness analysis of strategies to combat HIV/AIDS in developing countries.BMJ33114311437
  48. 48. Walker D (2003) Cost and cost-effectiveness of HIV/AIDS prevention strategies in developing countries: is there an evidence base? Health Policy Plan 18: 4–17.D. Walker2003Cost and cost-effectiveness of HIV/AIDS prevention strategies in developing countries: is there an evidence base?Health Policy Plan18417
  49. 49. Kim HH, Goldstein M (2009) High complication rates challenge the implementation of male circumcision for HIV prevention in Africa. Nat Clin Pract Urol 6: 64–65.HH KimM. Goldstein2009High complication rates challenge the implementation of male circumcision for HIV prevention in Africa.Nat Clin Pract Urol66465
  50. 50. Briggs AH, Goeree R, Blackhouse G, O'Brien BJ (2002) Probabilistic analysis of cost-effectiveness models: choosing between treatment strategies for gastroesophageal reflux disease. Med Decis Making 22: 290–308.AH BriggsR. GoereeG. BlackhouseBJ O'Brien2002Probabilistic analysis of cost-effectiveness models: choosing between treatment strategies for gastroesophageal reflux disease.Med Decis Making22290308
  51. 51. Doubilet P, Begg CB, Weinstein MC, Braun P, McNeil BJ (1985) Probabilistic sensitivity analysis using Monte Carlo simulation. A practical approach. Med Decis Making 5: 157–177.P. DoubiletCB BeggMC WeinsteinP. BraunBJ McNeil1985Probabilistic sensitivity analysis using Monte Carlo simulation. A practical approach.Med Decis Making5157177
  52. 52. Claxton K (1999) The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. J Health Econ 18: 341–364.K. Claxton1999The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies.J Health Econ18341364
  53. 53. Claxton K, Ginnelly L, Sculpher M, Philips Z, Palmer S (2004) A pilot study on the use of decision theory and value of information analysis as part of the NHS Health Technology Assessment programme. Health Technol Assess 8: 1–103, iii.K. ClaxtonL. GinnellyM. SculpherZ. PhilipsS. Palmer2004A pilot study on the use of decision theory and value of information analysis as part of the NHS Health Technology Assessment programme.Health Technol Assess81103, iii
  54. 54. Claxton K, Sculpher M, Drummond M (2002) A rational framework for decision making by the National Institute For Clinical Excellence (NICE). Lancet 360: 711–715.K. ClaxtonM. SculpherM. Drummond2002A rational framework for decision making by the National Institute For Clinical Excellence (NICE).Lancet360711715
  55. 55. UNAIDS (2005) Resource needs for an expanded response to AIDS in low and middle income countries–“Making the money work”: The three “ones” in action. Discussion paper 9. Geneva: UNAIDS. UNAIDS2005Resource needs for an expanded response to AIDS in low and middle income countries–“Making the money work”: The three “ones” in action.Discussion paper 9GenevaUNAIDS