Figures
Citation: Ghys PD, Williams BG, Over M, Hallett TB, Godfrey-Faussett P (2018) Epidemiological metrics and benchmarks for a transition in the HIV epidemic. PLoS Med 15(10): e1002678. https://doi.org/10.1371/journal.pmed.1002678
Published: October 25, 2018
Copyright: © 2018 Ghys et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Abbreviations: ART, antiretroviral therapy; IMR, incidence:mortality ratio; IPR, incidence:prevalence ratio; PEPFAR, President’s Emergency Plan for AIDS Relief; PLHIV, people living with HIV; PMTCT, prevention of mother-to-child transmission; py, person-years; SDG, Sustainable Development Goal
Provenance: Not commissioned; externally peer reviewed.
Introduction
The goal of ‘Ending the AIDS epidemic as a public health threat by 2030’ has been reflected in the Sustainable Development Goals (SDGs), and similar language has been adapted for other diseases and conditions [1]. Between 2010 and 2017, the number of AIDS-related deaths has declined by 34%, and the number of new HIV infections has declined by 18% [2]. Although these declines constitute important achievements, progress has been slower than envisaged, which is likely due to a combination of suboptimal or inappropriate policies, lack of funding, limited or misdirected implementation of available strategies and tools, or other obstacles. Metrics and corresponding target values or benchmarks that demonstrate progress in the AIDS response and its effect on the AIDS epidemic are useful as the world heads towards that goal.
‘Ending the AIDS epidemic’ has not been defined in scientific terms, and it can be seen as a global aspiration in a distant future. Elimination of all new infections does not appear possible in the short and medium term with the tools available today. Metrics that signal medium-term progress and can be applied in countries, subnational entities, and population groups may be particularly valuable, as they can allow for local accountability and target-driven programme management. Achieving a certain benchmark would then herald the gradual reduction in the HIV burden in that community and could help lay the groundwork for a push to end the epidemic. The benchmarks for the metrics discussed in this paper should not be seen as indicative of tipping points, as those are unlikely to exist in the real world for an infection with a long incubation period and with survival being extended by antiretroviral treatment. Rather, they can be seen as important achievements in the management of epidemics.
Metrics for tracking progress towards the end of the epidemic as a public health threat should relate to both technical and popular interpretations of the concept of a ‘public health threat’. HIV threatens affected populations in several ways. First, and most importantly, HIV causes sickness and death, which together contribute to a country’s burden of disease. Second, people living with HIV (PLHIV) and key populations at high risk of infection may be stigmatised, which may constitute an obstacle to effective implementation and warrants ongoing monitoring. Third, the epidemic reduces the size and the productivity of a country’s work force, imposing an indirect economic burden on the affected country. Finally, managing HIV demands health spending by patients, governments, private insurers, and funders, and, in the worst-affected lower-income countries, this fiscal burden can exceed all other health spending, with part of the cost borne by donor countries. Ending the epidemic as a public health threat depends on reducing mortality and incidence by expanding treatment and prevention services.
Here we discuss various HIV epidemic transition metrics that can be used to measure progress in reducing the public health threat of HIV, based on discussions at a meeting convened by UNAIDS in October 2017 in Glion, Switzerland. These metrics have since been included in UNAIDS’ 2018 reports [2,3] for countries and regions. Metrics and benchmarks to track progress in reducing stigma and discrimination—a goal to be pursued on its own merit that also represents a reduction in key determinants of HIV-related service delivery—are also needed and are discussed in a separate paper in preparation for this collection. Relevant and available data for metrics to track progress in reducing stigma and discrimination have also been included in UNAIDS’ 2018 reports [2,3].
HIV epidemic transition metrics
We consider six metrics: (1) an absolute rate of HIV incidence, (2) an absolute rate of AIDS-related deaths, (3) a percentage reduction in new HIV infections, (4) a percentage reduction in AIDS-related deaths [both 3 and 4 as compared to an agreed baseline date], (5) an incidence:prevalence ratio (IPR), and (6) an incidence:mortality ratio (IMR). Fig 1 shows the changing values of the six metrics globally for the percentage reduction during 2010–2016 and for the other metrics during 1990–2016, based on UNAIDS estimates. Key characteristics of the metrics and their benchmark values are shown in Table 1.
An absolute rate of HIV incidence
The SDG target for HIV (indicator 3.3.1) is monitored by the number of new HIV infections per 1,000 uninfected population, disaggregated by sex, age, and key populations [10]. A numerical target signifying the ‘End of the AIDS epidemic’ for the HIV incidence rate has been proposed at 1/1,000 person-years (py) in South Africa in the original analysis exploring the powerful effects of antiretroviral treatment in reducing incidence [11]. More recently, the same target value of 1/1,000 py has also been suggested for other high-burden countries [12,13].
However, incidence rates are very different in different populations. A target incidence level for a country with high historical incidence, such as the countries in southern Africa, may not be relevant for a country with historically lower incidence. For example, the incidence in India, taken as a whole, was estimated to be 0.10 (0.08−0.14) / 1,000 py in 2016 [14], and it has never exceeded the 1/1,000 py proposed benchmark [15]. Hence, meaningful targets can only be set in countries and local jurisdictions.
While an incidence rate has been proposed for monitoring the SDG target, both the incidence rate and the number of new HIV infections can be monitored. It is important to realise that, in circumstances of important population growth, absolute numbers of new HIV infections could be increasing while the incidence rate is declining.
An absolute rate of AIDS-related deaths
The level of AIDS-related mortality varies among countries, within countries, by age, and by population groups. AIDS-related mortality in South Africa, for example, peaked in 2006 when 42% of all deaths were attributable to HIV and the AIDS-related mortality rate was approximately 5/1,000 population [14,16,17]. While an AIDS-related mortality of less than 1/1,000 per year may be relevant for the high-prevalence countries in southern Africa, meaningful targets can only be set in countries and local jurisdictions. The proposed indicator for monitoring AIDS-related mortality is the number of AIDS-related deaths per 1,000 population. As above for the incidence metric, both the AIDS-related mortality rate and the number of AIDS-related deaths can be monitored. In the case of important population growth and a decline in mortality, the rate would decline faster than the number of AIDS-related deaths.
A percentage reduction in the number of new HIV infections
For the purpose of the Fast-Track modelling, which aimed to develop programmatic targets and resource needs estimates [18], ‘Ending the AIDS epidemic as a public health threat’ was interpreted as achieving an important reduction in incidence and mortality. Programmatic targets and effect estimates were included in the model for testing, treatment, and viral suppression; condom use; key populations (men who have sex with men, sex workers, people who inject drugs, transgender people, and prisoners) intervention packages; preexposure prophylaxis; voluntary male medical circumcision; and conditional cash transfers. Specifically, the percentage reduction target was set to a 90% reduction in the number of new HIV infections in the entire population between 2010 and 2030. The modelling of the impact resulting from reaching the different programmatic targets achieved a reduction by 2030 of nearly 90% [18]. The 2016 UN high-level meeting adopted values of 90% reduction by 2030 and the interim target of 75% for the year 2020, as well as the corresponding programmatic target values [19].
A percentage reduction in the number of AIDS-related deaths
As for the above percentage reduction in new HIV infections, a 90% reduction in AIDS-related deaths was aimed for in the Fast-Track modelling between 2010 and 2030 [18]. The modelling of the impact resulting from reaching the different programmatic targets achieved a nearly 80% reduction by 2030 [18]. The 2016 UN high-level meeting adopted a target of 90% reduction by 2030 and 75% by 2020 for AIDS-related mortality, together with the corresponding programmatic target values [19].
An IPR
The IPR (incidence:prevalence ratio) is defined as the number of new infections occurring per year in a population divided by the number of persons living with HIV in that same population. When the IPR is below a certain threshold, the epidemic declines—if the IPR is held below that threshold for a long time, the epidemic will eventually be eliminated. The IPR is thus an indicator for the epidemic response ‘proceeding in the right way’, as opposed to it having achieved its goal of ending the AIDS epidemic. It was initially used by researchers in high-income countries [20,4,5], relating it to the effective epidemic number and using it to judge progress in the epidemic and the response. More recently, it has been used to judge progress in the response to the United States epidemic [5–7].
A global benchmark value is obtained by considering the replacement level for the infection: for an epidemic to decline, on average, there should be fewer than one new infection per person living with HIV over the course of their infection. If we assume that newly infected persons survive for D years and there is an equal risk of transmission over this time and that it is the same for all people, then it follows that the benchmark value is equal to 1/D at equilibrium. Making further simplifying assumptions, we can say that D is approximately 33 years (the approximate survival time, accounting for the proportion of PLHIV that benefit from antiretroviral therapy [ART] under UNAIDS’ treatment targets) [9], and so the threshold may be approximately 0.03. We note that this provides only a rough ‘rule of thumb’; a separate paper is in preparation for this collection to explore further the behaviour of the IPR. As the IPR contains elements related to incidence reduction as well as to extending survival, it conveys two major aims of the programmatic response.
An IMR
The IMR (incidence:mortality ratio) is defined as the ratio of the number of people who become HIV infected per year to the number of people among those already infected who die (from any cause) per year. When this number is greater than one, the size of the population of PLHIV grows; when it is less than one, the size of that population shrinks [21,22].
A target of IMR < 1 on its own does not require a reduction of mortality. In fact, dropping below IMR < 1 is possible with a high level of mortality. An additional target therefore needs to be considered in conjunction with the IMR target [21]. A possible target for a direct mortality reduction is that mortality among PLHIV should approach mortality among the HIV-negative population (which will be country and population specific). Indirect targets could relate to ART coverage—for example, ART coverage > 70% [23] or ART coverage > 81% by 2020 and >86% by 2030 [18,24].
There is a close relationship between the IPR (discussed above under the IPR section) and the IMR. At equilibrium, the two metrics become equivalent if the IMR < 1 criterion provides for the mortality rate being below the same level as that implied by the IPR threshold (1/D).
Measurement issues
Questions regarding measurement arise for each of the proposed metrics, as the availability of empirical data is a challenge for all proposed metrics.
Modelled estimates versus empirical estimates
There is a long history of countries developing modelled estimates of HIV incidence, HIV prevalence, AIDS-related mortality, and all-cause mortality among PLHIV. A major process is undertaken by UNAIDS and partners that involves soliciting expert advice about new model features, software development, capacity building in modelling, and annual country-level development of modelled estimates [25]. This results in the most widely available and consistent set of country-level estimates and time trends in the incidence and prevalence of HIV and HIV-related mortality. In addition, several academic groups are active in this field and publish topic- or country-specific models and estimates [16,26,27] or global and country estimates [28].
Clearly, the quality of modelled estimates depends on the availability and validity of input data. Mathematical models that estimate HIV incidence and AIDS-related mortality may include, besides demographic data and assumptions, the following empirical data: sentinel surveillance prevalence among pregnant women, programmatic data on prevalence among pregnant women, national survey–derived HIV prevalence, numbers of people on ART, national survey–derived incidence, cohort-derived incidence among 15–49 year olds, case reports of new HIV diagnoses, case reports of AIDS-related deaths, and coverage and regimen distribution for prevention of mother-to-child transmission (PMTCT). Data-informed assumptions are typically made about the survival probability of people receiving ART, the effectiveness of antiretroviral regimens to prevent MTCT, and other parameters [29]. Modelled estimates are typically produced at the national level and increasingly for subnational geographic entities: however, currently they typically are not available for specific key population groups.
The major challenge with model-based estimates is that they tend to be most uncertain (least precise) in recent years and are, by necessity, dependent on assumptions for which direct empirical data are lacking. When comparing, for example, incidence and mortality, two quantities are being compared, both of which are being modelled from a dataset that is predominantly informed by trends in HIV prevalence and ART coverage. This can be addressed by using the models to ‘test’ whether there is evidence of a particular target being reached or not, in which the uncertainty attendant in the methods is fully expressed. It may be the case that with current surveillance systems and data availability, one may not be able to make very precise statements regarding meeting particular thresholds as soon as we would like. However, new development in the availability of empirical data—especially measures of incidence and deaths—will bolster this ability.
Empirical data on HIV incidence, AIDS-related mortality, all-cause mortality among PLHIV, and HIV prevalence
Empirical data on HIV incidence are increasingly available but remain rare. Cohort studies that measure the incidence rate directly are costly and time-consuming and may suffer from participation bias [30]. Hence, only a few national cohort studies exist [31,32], with other studies focused on entire populations or subpopulations in specific locations [33,34]. Recently, the cross-sectional population-based HIV impact assessment surveys [35] have been used to generate estimates of HIV incidence (using algorithms that include assays to estimate the number of recent infections) at the national level, although not at the subnational level or among specific key populations. As are cohort studies, these surveys are also subject to participation bias. Separate cross-sectional surveys among key populations are now also recommended to include the measurement of incidence [36], although the body of empirical measurements is currently limited. For both national surveys and surveys among key populations, having a sample size that is large enough to estimate HIV incidence with precision is costly, and this will become even more so as the level of incidence falls to lower values in future years. Nevertheless, the assay-based methods for the measurement of incidence in cross-sectional surveys continue to be investigated and developed [37], and when this information is combined (in models) with other data, the precision of model-based incidence estimates can be improved. Countries with well-developed case-reporting systems can use the annual number of new diagnoses to estimate HIV incidence taking into account other information on the time to diagnosis, underdiagnosis, and failure to report [38,39]. Efforts are ongoing in other countries (including those with the highest levels of prevalence) to develop case-based surveillance and patient-monitoring systems [40]—it is currently unclear whether such systems will allow for the estimation of incidence among key populations.
Comprehensive empirical data on mortality among PLHIV are rare, especially in high-prevalence countries. In countries with well-developed case-reporting systems, data are recorded on all deaths among PLHIV who are diagnosed. In these systems, a proportion of these deaths are registered among people who were not previously known to be living with HIV. Data on all-cause mortality among key populations living with HIV are not available for most countries, although countries with well-developed case-reporting systems that include reporting of the assumed mode of transmission may be able to make estimates based on reported data [39]. In countries with high prevalence of HIV and high mortality among PLHIV, the overall level and the age- and sex-specific patterns of all-cause mortality may be used to constrain modelled estimates [41]. Comprehensive empirical data on AIDS-related mortality specifically are even rarer, especially in countries with a generalised epidemic. Failure to correctly record AIDS-related deaths may be due to stigma [17,42]. In addition, registers may contain the number of PLHIV who have died, but the vital status of individuals lost to follow-up may not be up to date. In countries with well-developed vital registration systems, the failure to correctly record AIDS-related deaths may be due to misdiagnosis of the cause of death [43].
Empirical data on HIV prevalence are widely available. HIV prevalence data are generated for key populations (typically only in specific locations) and for pregnant women in special surveys or through routine reporting systems, especially in countries with a generalised epidemic, and for the entire population from national surveys such as the Demographic and Health surveys [44] and, more recently, the population-based HIV impact assessments [35].
Conclusion
Much progress has been achieved in recent years in reducing HIV incidence and AIDS-related deaths. In addition to the previously widely used metrics of incidence and mortality rates, additional metrics that show percentage reductions or that relate the number of new infections to either the total number of PLHIV or their all-cause mortality are useful to measure transitions in national or local epidemics. These metrics are now increasingly being used, including by UNAIDS and by the President’s Emergency Plan for AIDS Relief (PEPFAR) [2,3,23]. The different metrics convey information about different aspects of the epidemic: metrics that focus on incidence reductions centre on curbing epidemic spread such that reductions in sickness, death, and fiscal burden will follow later; metrics that focus on reducing the death rate speak to whether there is an immediate reduction in sickness and death; and the metrics that relate to the size of the epidemic speak to whether the fiscal burden is immediately contracting (IMR) or whether the response is ‘on track’ to reduce the fiscal burden (IPR)
The aim of the AIDS response in each local epidemic will be to reach the metric’s benchmark corresponding to epidemic transition and maintain the metric as low as possible below this benchmark level. As the epidemic recedes, the response will need to adapt to the epidemic becoming concentrated in specific population groups, taking into account their specific social and biological characteristics.
Progress in achieving HIV transitions is increasingly going to depend on effectively reducing stigma and discrimination, as they are a key determinant of effective service delivery. Hence, specific tracking of progress in this area is required [2,3].
Given the importance of targets for accountability and programme management, and given the dearth of empirical data, especially on HIV incidence and on mortality, more investment in generating, compiling, reporting, and analysing empirical data is essential.
Acknowledgments
The authors would like to thank J Daher and M Mahy for help with data compilation and E Fadriquela for help with Fig 1.
References
- 1.
United Nations. Transforming our world: the 2030 Agenda for Sustainable Development. New York: United Nations; 2015. Available from: https://sustainabledevelopment.un.org/content/documents/21252030%20Agenda%20for%20Sustainable%20Development%20web.pdf
- 2.
UNAIDS. Miles to go. Global AIDS update 2018. Geneva: UNAIDS; 2018. Available from: http://www.unaids.org/sites/default/files/media_asset/miles-to-go_en.pdf
- 3.
UNAIDS. UNAIDS data 2018. Geneva: UNAIDS; 2018. Available from: http://www.unaids.org/sites/default/files/media_asset/unaids-data-2018_en.pdf
- 4. Holtgrave DR, Anderson T. Utilizing HIV transmission rates to assist in prioritizing HIV prevention services. Int J STD AIDS 2004; 15: 789–792. pmid:15601483
- 5. White PJ, Ward H, Garnett GP. Is HIV out of control in the UK? An example of analyzing patterns of HIV spreading using incidence-to-prevalence ratios. AIDS 2006; 20: 1898–1901. pmid:16954735
- 6. Holtgrave DR, Hall HI, Rhodes PH, Wolitski RJ. Updated Annual HIV Transmission Rates in the United States, 1977–2006. J Acquir Immune Defic Syndr 2009; 50: 236–238.
- 7. Holtgrave DR. Apparent declines in the global HIV transmission rate. Int J STD AIDS 2009; 20: 876–878. pmid:19948904
- 8.
CDC Factsheet. HIV Transmission Rates in the United States, 1977–2006 [Internet]. The Centers for Disease Control and Prevention; 2008. [cited 19 February 2018]. Available from: https://www.cdc.gov/nchhstp/newsroom/docs/CDC_TransmissionRates_FactSheet.pdf
- 9.
UNAIDS. Ending AIDS. Progress towards the 90-90-90 targets. Global AIDS Update 2017. Geneva: UNAIDS; 2017. Available from: http://www.unaids.org/sites/default/files/media_asset/Global_AIDS_update_2017_en.pdf
- 10.
United Nations Statistical Commission pertaining to the 2030 Agenda for Sustainable Development. Global indicator framework for the Sustainable Development Goals and targets of the 2030 Agenda for Sustainable Development. A/RES/71/313. New York, 2017.
- 11. Granich RM, Gilks CF, Dye C, De Cock KM, Williams BG. Universal voluntary HIV testing with immediate antiretroviral therapy as a strategy for elimination of HIV transmission: a mathematical model. Lancet 2009; 373: 48–57. pmid:19038438
- 12. Granich R, Williams B, Montaner J, Zuniga JM. 90-90-90 and ending AIDS: necessary and feasible. Lancet 2017; 390: 341–343. pmid:28745591
- 13. Williams BG, Granich R. Ending AIDS: myth or reality? Lancet 2017; 390: 357. pmid:28745597
- 14.
AIDSinfo data, UNAIDS, Geneva, Switzerland. [cited 17 March 2018]. Available from: http://aidsinfo.unaids.org/
- 15. Pandey A, Dhingra N, Kumar P, Sahu D, Reddy DCS, Narayan P, et al. Sustained progress, but no room for complacency: Results of 2015 HIV estimations in India. Indian J Med Res 2017; 146: 83–96. pmid:29168464
- 16. Bradshaw D, Msemburi W, Dorrington R, Pillay-van Wyk V, Laubscher R, Groenewald P. HIV/AIDS in South Africa: how many people died from the disease between 1997 and 2010? AIDS 2016; 30: 771–778. pmid:26509830
- 17. Groenewald P, Nannan N, Bourne D, Laubscher R, Bradshaw D. Identifying deaths from AIDS in South Africa. AIDS 2005; 19: 193–201. pmid:15668545
- 18. Stover J, Bollinger L, Izazola JA, Loures L, DeLay P, Ghys PD. What Is Required to End the AIDS Epidemic as a Public Health Threat by 2030? The Cost and Impact of the Fast-Track Approach. PLoS ONE 2016; 11(5): e0154893. pmid:27159260
- 19.
United Nations. Political Declaration on HIV and AIDS: On the Fast-Track to Accelerate the Fight against HIV and to End the AIDS Epidemic by 2030. New York: United Nations; 2016. Available from: http://www.unaids.org/sites/default/files/media_asset/2016-political-declaration-HIV-AIDS_en.pdf
- 20. Amundsen EJ, Stigum H, Rottingen JA, Aalen OO. Definition and estimation of an actual reproductive number describing past infectious disease transmission: application to HIV epidemics among homosexual men in Denmark, Norway and Sweden. Epidemiol Infect 2004; 132: 1139–1149. pmid:15635973
- 21.
Over M. Achieving an AIDS Transition. Washington DC, USA; 2011. Available from: https://www.cgdev.org/sites/default/files/achieving-an-aids-transition-web.pdf
- 22.
US President’s Emergency Plan for AIDS Relief. PEPFAR 3.0. Controlling the Epidemic: Delivering on the Promise of an AIDS-free Generation. Washington DC, USA; 2014.
- 23.
US President’s Emergency Plan for AIDS Relief. Strategy for Accelerating HIV/AIDS Epidemic Control (2017–2020). Washington DC, USA; 2017. Available from: https://www.pepfar.gov/documents/organization/274400.pdf
- 24.
UNAIDS. 90-90-90. An ambitious treatment target to help end the AIDS epidemic. Geneva, Switzerland; 2014.
- 25. Case KK, Gregson S, Mahy M, Ghys PD, Hallett TB. Editorial: methodological developments in the Joint United Nations Programme on HIV/AIDS estimates. AIDS 2017; 31 (Suppl 1): S1–S4.
- 26. Johnson LF, May MT, Dorrington RE, Cornell M, Boulle A, Egger M, et al. Estimating the impact of antiretroviral treatment on adult mortality trends in South Africa: A mathematical modelling study. PLoS Med 2017; 14(12): e1002468. pmid:29232366
- 27. Ndawinz JDA, Costagliola D, Supervie V. New method for estimating HIV incidence and time from infection to diagnosis using HIV surveillance data. AIDS 2011; 25: 1905–1913. pmid:21811147
- 28. GBD 2015 HIV Collaborators. Estimates of global, regional, and national incidence, prevalence, and mortality of HIV, 1980–2015: the Global Burden of Disease Study 2015. Lancet HIV 2016; 3: e361–87. pmid:27470028
- 29. Stover J, Brown T, Puckett R, Peerapatanapokin W. Updates to the Spectrum/Estimations and Projections Package model for estimating trends and current values for key HIV indicators. AIDS 2017; 31 (Suppl 1): S5–S11
- 30. Ghys PD, Kufa E, George MV, for the UNAIDS Reference Group on Estimates, Modelling and Projections’ ad hoc Working Group on Interpreting trends in prevalence and incidence of HIV infection in countries with generalised epidemics. Measuring trends in prevalence and incidence of HIV infection in countries with generalised epidemics. Sex Transm Inf 2006; 82; 52–56.
- 31. Nsanzimana S, Remera E, Kanters S, Mulindabigwi A, Suthar AB, Uwizihiwe JP, et al. Household survey of HIV incidence in Rwanda: a national observational cohort study. Lancet HIV 2017; 4: e457–64. pmid:28801191
- 32. Justman J, Reed JB, Bicego G, Donnell D, Li K, Bock N, et al. Swaziland HIV Incidence Measurement Survey (SHIMS): a prospective national cohort study. Lancet HIV 2017; 4: e83–92. pmid:27863998
- 33. Reniers G, Wamukoya M, Urassa M, Nyaguara A, Nakiyingi-Miiro J, Lutalo T, et al. Data Resource Profile: Network for Analysing Longitudinal Population-based HIV/AIDS data on Africa (ALPHA Network), Int J Epidemiol 2016; 45(1): 83–93. pmid:26968480
- 34. van Griensven F, Holtz TH, Thienkrua W, Chonwattana W, Wimonsate W, Chaikummao S, et al. Temporal trends in HIV-1 incidence and risk behaviours in men who have sex with men in Bangkok, Thailand, 2006–13: an observational study. Lancet HIV 2015; 2: e64–70. pmid:26424462
- 35.
PHIA Project [Internet]. ICAP, Columbia University, New York, USA. [cited 27 March 2018]. Available from: http://phia.icap.columbia.edu/
- 36.
WHO, CDC, UNAIDS, FHI 360. Biobehavioral survey guidelines for Populations at Risk for HIV. Geneva: World Health Organization; 2017. Available from: http://apps.who.int/iris/bitstream/handle/10665/258924/9789241513012-eng.pdf?sequence=1&ua=1
- 37.
UNAIDS, WHO. Technical update on incidence assays for surveillance and monitoring purposes. Geneva: UNAIDS; 2015. Available from: http://www.unaids.org/sites/default/files/media_asset/HIVincidenceassayssurveillancemonitoring_en.pdf
- 38. van Sighem A, Nakagawa F, De Angelis D, Quinten C, Bezemer D, de Coul EO, et al. Estimating HIV Incidence, Time to Diagnosis, and the Undiagnosed HIV Epidemic Using Routine Surveillance Data. Epidemiology 2015; 26: 653–660. pmid:26214334
- 39. Song R, Hall HI, Green TA, Szwarcwald CL, Pantazis N. Using CD4 Data to Estimate HIV Incidence, Prevalence, and Percent of Undiagnosed Infections in the United States. J Acquir Immune Defic Syndr 2017; 74: 3–9. pmid:27509244
- 40.
WHO. Consolidated guidelines on person-centred HIV patient monitoring and case surveillance. Geneva: World Health Organization; 2017. Available from: http://apps.who.int/iris/bitstream/handle/10665/255702/9789241512633-eng.pdf?sequence=1
- 41. Masquellier B, Eaton JW, Gerland P, Pelletier F, Mutai KF. Age patterns and sex ratios of adult mortality in countries with high HIV prevalence. AIDS 2017; 31: S77–S85. pmid:28296803
- 42. Birnbaum JK, Murray CJ, Lozano R. Exposing misclassified HIV/AIDS deaths in South Africa. Bull World Health Organ 2011; 89: 278–285. pmid:21479092
- 43. Fazito E, Cuchi P, Fat DM, Ghys PD, Pereira MG, Vasconcelos AM, et al. Identifying and quantifying misclassified and under-reported AIDS deaths in Brazil: a retrospective analysis from 1985 to 2009. Sex Transm Infect 2012; 88: i86–i94. pmid:23172349
- 44.
Demographic and Health surveys [Internet]. ICF, Rockville, Maryland, USA. [cited 27 March 2018]. Available from: https://dhsprogram.com/