The success of antiretroviral treatment (ART) programs can be compromised by high rates of patient loss to follow-up (LTFU). We assessed the incidence and risk factors of LTFU in a large cohort of HIV-infected children receiving ART in Thailand.
All children participating in a multicenter cohort (NCT00433030) between 1999 and 2014 were included. The date of LTFU was 9 months after the last contact date. ART interruption was defined as ART discontinuation for more than 7 days followed by resumption of treatment. Baseline and time-dependent risk factors associated with LTFU were identified using Fine and Gray competing risk regression models with death or referral to another hospital as competing events.
Of 873 children who were followed during a median of 8.6 years (interquartile range 4.5–10.6), 196 were LTFU, 73 died, and 195 referred. The cumulative incidence of LTFU was 2.9% at 1 year, 7.3% at 5 years and 22.2% at 10 years. Children aged 13 years and more had a 3-fold higher risk (95% confidence interval 2.06–4.78) of LTFU than those younger. Children who had interrupted ART within the previous year had a 2.5-fold higher risk (1.12–5.91) than those who had not. The risk of LTFU was lower in children stunted (height-for-age Z-scores <-2 SD) (0.42–0.96) or underweight (weight-for-age Z-scores <-2 SD) (0.24–0.97).
Citation: Kawilapat S, Salvadori N, Ngo-Giang-Huong N, Decker L, Kanjanavanit S, Puangsombat A, et al. (2019) Incidence and risk factors of loss to follow-up among HIV-infected children in an antiretroviral treatment program. PLoS ONE 14(9): e0222082. https://doi.org/10.1371/journal.pone.0222082
Editor: Graciela Andrei, Katholieke Universiteit Leuven Rega Institute for Medical Research, BELGIUM
Received: May 28, 2019; Accepted: August 21, 2019; Published: September 17, 2019
Copyright: © 2019 Kawilapat et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The de-identified dataset used for the analysis is available as part of Supporting Information.
Funding: The PHPT prospective multicenter cohort study was funded by the Global Fund to AIDS, Tuberculosis and Malaria, Thailand (PR-A-N-008) to ML; Oxfam Great Britain, Thailand (THAA51) to ML; Ministry of Public Health, Thailand; and Institut de Recherche pour le Développement (IRD), France to GJ. This study was financially supported for publication by Chiang Mai University. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Loss to follow-up (LTFU) among HIV-infected children on antiretroviral therapy (ART) is associated with treatment discontinuation, which in turn negatively may affect clinical outcomes and increase the risk of hospital admission or death [1–9].
Reported incidence rates (IR) of LTFU in children after ART initiation have been highly variable: from 4.2 to 18.2 per 100 child-years depending on studies [10–13]. During the first year of follow-up, rates reported in country-specific or multi-country studies varied from 4% to 19% in Africa and Asia [10, 13–16]. A cohort study of the TREAT Asia Pediatric HIV Observational Database (TApHOD) conducted in Cambodia, India, Indonesia, Malaysia, and Thailand estimated that the cumulative LTFU rate was a 24% five years after treatment initiation .
Several characteristics of children have been reported associated with the risk of LTFU, and results have been sometimes conflicting: immunosuppression [12, 13, 17], regimen substitution , diarrhea , wasting [13, 15], poor nutritional status , infancy and very young age [11, 13], but also adolescence (11–19 compared to ≤10 years) , mother as primary caregiver , calendar years [11, 13], and factors related to the organization of care [11, 15].
LTFU cases may lead to an under-estimation of mortality rates and an overestimation of a program efficiency. A meta-analysis conducted among HIV-infected children initiating ART in Southern Africa found that the mortality rate would be almost twice higher, would LTFU be taken into account . We estimated the incidence and studied factors associated with LTFU in a large cohort of HIV-infected children on ART in Thailand.
Materials and methods
Study design and population
Data analyzed were prospectively collected between January 1, 1999 and December 31, 2014 from all HIV-infected children aged <18 years participating in the Program for HIV Prevention and Treatment (PHPT) prospective multicenter cohort study (ClinicalTrials.gov: NCT00433030) that was implemented in 43 hospitals located throughout Thailand.
Follow-up and data collection
Children were seen by a physician or a specialized nurse at ART initiation (baseline), 2 weeks, 1, 3, 6 months and every 6 months thereafter. Demographics, clinical and laboratory data (complete blood count, chemistry and virologic data) were collected at each visit. Compensation for visit transportation cost was provided as needed. Efforts were made to trace children who were LTFU through telephone calls and home visits.
The baseline variables assessed for association with the risk of LTFU were: sex, age, country of birth, type of hospital of birth, relationship with the caregiver, height-for-age and weight-for-age using growth standard of Thai children , period of ART initiation, HIV stage based on Centers for Disease Control and Prevention (CDC) classification, HIV-RNA load, CD4 percentage, and anemia status based on World Health Organization (WHO) criteria . Time-dependent variables assessed were: age, height-for-age, weight-for-age, HIV CDC stage, HIV-RNA load, CD4 percentage, anemia status, ART interruptions (defined as discontinuation for more than 7 days followed by resumption), and switches of ART regimen.
A child was considered LTFU when he/she has not attended HIV clinic for more than 9 months (3 months later than the scheduled visit) despite repeated attempts to reach him/her with telephone calls or home visits.
Continuous variables are described using medians and interquartile ranges (IQR), and categorical variables are presented as frequencies and percentages.
The cumulative incidence of LTFU was estimated using a cumulative incidence function accounting for death and referral to another hospital as competing events. The 95% confidence intervals (CIs) of estimated incidence rates were calculated based on the log-log transformation .
Baseline and time-dependent risk factors associated with LTFU were identified using Fine and Gray competing risk regression models  with death and referral to another hospital considered as competing events. All models were adjusted on the region of follow-up (northern Thailand versus others regions) to account for regional differences and on the period of ART initiation, i.e. before or after the establishment of the national AIDS treatment program in 2005 .
P-values from models were derived from the Wald test . Missing values at baseline were imputed using the available data nearest to ART initiation (within 1 year before or, if still missing, within 15 days after), and missing values for time-dependent variables were imputed using linear interpolation  based on the previous and following observed values within 1 year before and after. Factors with a p-value lower than 0.25 in the univariable analysis  were included in the multivariable analysis, and a backward elimination procedure was used to identify factors independently associated with LTFU. Possible interactions between factors in the final model were assessed. The validity of the proportional hazards assumption for each variable was tested using time-varying interaction terms [23, 26].
All analyses and missing data imputation were performed using Stata 12.0 or R 3.4.0.
After receiving information about the study, parents or guardians of the participating children provided written consent before enrollment. All data were collected anonymously using patient identification numbers. The PHPT cohort study protocol was approved by the ethics committees at the Thai Ministry of Public Health and local hospitals.
Of 873 children included in the analysis, 471 (54%) were female. Baseline characteristics of the population are presented in Table 1. The median age was 6.5 years (interquartile range [IQR]: 2.4–9. 6); the majority of children (61%) were followed up in the northern region of Thailand and most (91%) were living with their relatives (mother, father, grandparents, or other relatives). The median HIV-RNA load was 5.2 log10 copies/mL (4.7–5.7) and CD4 percentage 8% (2–16) (Table 1).
Cumulative incidence of loss to follow-up
The median duration of follow-up was 8.6 years (IQR, 4.5–10.6). During the study period, 73 children died, 196 were LTFU and 195 were referred to another hospital. A total of 38 experienced at least once ART interruption for >1 week, including 4 who died. The overall incidence rate of LTFU was 2.92 per 100 child-years (2.53–3.35). Considering death and referral to another hospital as competing events, the cumulative incidence of LTFU was 2.9% (95% CI: 1.9–4.1%) at 1 year, 7.3% (5.7–9.1%) at 5 years and 22.2% (19.3–25.2%) at 10 years (Fig 1).
Factors associated with loss to follow-up
In the univariable analysis adjusting for the period of ART initiation and region in Thailand, baseline variables associated with a higher risk of LTFU were: age ≥7 years (subhazard ratio = 1.58; 95% CI = 1.19–2.09) and living with relatives (2.58; 1.27–5.22). Time-dependent variables associated with LTFU within the previous year were: age ≥13 years (2.81; 1.93–4.10), stunting (height-for-age Z-scores < -2 SD) (0.51; 0.34–0.77), underweight (weight-for-age Z-scores <-2 SD) (0.44; 0.25–0.77), moderate or severe anemia (0.63; 0.41–0.97), and ART interruption (2.60; 1.17–5.80) (Table 2).
In the multivariable analysis adjusting for the period of ART initiation and region, the time-dependent variables associated with a higher risk of LTFU were age ≥13 years (adjusted subhazard ratio = 3.14;95% CI = 2.06–4.78) and ART interruption (2.57; 1.12–5.91), and the variables associated with a lower risk were stunting (0.63; 0.42–0.96), and underweight (0.43; 0.24–0.77) (Table 2). There was no significant interaction between the factors associated with the risk of LTFU (S1 Table).
In this cohort of 873 HIV-infected children followed for a median of 8 years in an ART program in Thailand, 196 were LTFU. At 1 year, the cumulative incidence of LTFU was 2.9%, a lower incidence than in studies using similar LTFU definition, i.e. no return to HIV clinics within the 9 months after last visit: 18.8% in a study including 11 cohorts from four countries in southern Africa . The incidence seems also lower than in studies using a shorter time after last visit to define a LTFU event: 7% in a study in four southern Africa countries (6 months) , 7.3% in one study in South Africa (6 months) , and 6.9% in Nigeria (3 months) . In contrast, the LTFU rate reported in Asia by TApHOD (12 months before a child is considered LTFU)  was only 4.0%, closer to our findings. At 5 years, the cumulative incidence rate of LTFU, 7.3%, was also lower than the 24.0% LTFU incidence reported in TApHOD . Differences in LTFU rate estimates may reflect some heterogeneity between settings in term of HIV care experience, local policies and organization of care, as well as sociodemographic characteristics of children.
We considered both baseline and time-dependent variables for the evaluation of risk factors of LTFU. Interestingly, the risk of LTFU seemed more related to events arising during the follow-up than factors known at treatment initiation. We found that adolescence was a strong risk factor of LTFU, similar to a study in Ethiopia where the risk of LTFU in HIV-infected adolescents (aged 11–19 years) was 2.1 times higher than in younger children . Other pediatric studies did not study the role of age at the time of loss to follow-up [11–13, 15]. A study in western Kenya reported that 16% of HIV-infected LTFU did not return to the clinic because of fear of disclosure or discrimination within the family and community .
In addition to adolescence, we found that transient ART interruption during follow-up was associated with a higher risk of LTFU. To our knowledge, there have been no studies assessing the association between ART interruption and risk of LTFU.
As opposed to a previous study in South Africa where underweight children at ART initiation were at a higher risk of LTFU , we found that stunted and/or underweight children were actually at a lower risk of LTFU. This could indicate that children who have -or have regained- a normal or suboptimal nutritional appearance may be more likely to interrupt from their hospital follow-up. Caregivers concerned with a child’s health may be reassured when he/she is no longer stunted or excessively thin and may be less motivated for regular follow-up.
In addition to the quality of the data available (prospectively collected over a median follow-up of 8.6 years and a limited number of missing data), a strength of our study was the availability of longitudinal data to evaluate the effect of changes in some key variables during the follow-up. A limitation of our study is the lack of data on some factors that other studies found associated with LTFU, such as the organization of care in each clinic , the distance between place of residence and clinic , or stigma and discrimination problems .
Beside the increased risk of LTFU in adolescents, any ART interruption may be a warning that should trigger specific interventions and maybe prompt for enhanced communication with families and children to promote the need for close monitoring. Optimal growth should not be taken as reason for relaxing measures to ensure long term follow-up.
S1 Dataset. De-identified dataset used for the analysis.
We thank all the children who participated in the PHPT cohort study as well as their caregivers.
The site principal investigators were: Lamphun: Pornpun Wannarit; Phayao Provincial Hospital: Pornchai Techakunakorn; Chiangrai Prachanukroh: Rawiwan Hansudewechakul; Chiang Kham: Vanichaya Wanchaitanawong; Phan: Sookchai Theansavettrakul; Mae Sai: Sirisak Nanta; Prapokklao: Chaiwat Ngampiyaskul; Banglamung: Siriluk Phanomcheong; Chonburi: Suchat Hongsiriwon; Rayong: Warit Karnchanamayul; Bhuddasothorn Chacheongsao: Ratchanee Kwanchaipanich; Somdej Prapinklao: Nareerat Kamonpakorn, Maneeratn Nantarukchaikul; Bhumibol Adulyadej: Prapaisri Layangool; Pranangklao: Paiboon Lucksanapisitkul, Sudarat Watanayothin; Hat Yai: Boonyarat Warachit; Regional Health Promotion Center 6, Khon Kaen: Sansanee Hanpinitsak; Nong Khai: Sathit Potchalongsin; Samutsakhon: Pimpraphai Thanasiri, Sawitree Krikajornkitti; Phaholpolphayuhasena: Pornsawan Attavinijtrakarn; Kalasin: Sakulrat Srirojana; Nakhonpathom: Suthunya Bunjongpak; Mahasarakam: Sathaporn Na-Rajsima; Roi-et: Pornchai Ananpatharachai; Vachira Phuket: Weerasak Lawtongkum; Chiangdao: Prapawan Kheunjan, Thitiporn Suriyaboon, Airada Saipanya.
We are grateful to all investigators and PHPT staff for their involvement in the PHPT cohort study, in particular Kanchana Than-in-at, Nirattiya Jaisieng, Rapeepan Suaysod, Sanuphong Chailoet, Kriengkrai Suebmongkolchai, Suriyan Tanasri, Kanchaya Yoddee, Naritsara Naratee, Rukchanok Peongjakta, Marin Inta, Autchara Rakpor, Suwalai Chalermpantmetagul, Rukchanok Peongjakta and Paporn Mongkolwat. We are also grateful to Jean-Yves Mary and Sukon Prasitwattanaseree who provided statistical advice.
The PHPT prospective multicenter cohort study was funded by the Global Fund to AIDS, Tuberculosis and Malaria, Thailand (PR-A-N-008); Oxfam Great Britain, Thailand (THAA51); Ministry of Public Health, Thailand; and Institut de Recherche pour le Développement (IRD), France. This research was supported by Chiang Mai University.
- 1. Kaplan JE, Hanson D, Dworkin MS, Frederick T, Bertolli J, Lindegren ML, et al. Epidemiology of human immunodeficiency virus-associated opportunistic infections in the United States in the era of highly active antiretroviral therapy. Clinical infectious diseases: an official publication of the Infectious Diseases Society of America. 2000;30 Suppl 1:S5–14. Epub 2000/04/20. pmid:10770911.
- 2. Adam BD, Maticka-Tyndale E, Cohen JJ. Adherence practices among people living with HIV. AIDS care. 2003;15(2):263–74. Epub 2003/07/15. pmid:12856347.
- 3. Brennan AT, Maskew M, Sanne I, Fox MP. The importance of clinic attendance in the first six months on antiretroviral treatment: a retrospective analysis at a large public sector HIV clinic in South Africa. Journal of the International AIDS Society. 2010;13:49. Epub 2010/12/08. pmid:21134297; PubMed Central PMCID: PMC3012655.
- 4. Bygrave H, Kranzer K, Hilderbrand K, Whittall J, Jouquet G, Goemaere E, et al. Trends in loss to follow-up among migrant workers on antiretroviral therapy in a community cohort in Lesotho. PloS one. 2010;5(10):e13198. Epub 2010/10/27. pmid:20976289; PubMed Central PMCID: PMC2951905.
- 5. Dalal RP, Macphail C, Mqhayi M, Wing J, Feldman C, Chersich MF, et al. Characteristics and outcomes of adult patients lost to follow-up at an antiretroviral treatment clinic in Johannesburg, South Africa. Journal of acquired immune deficiency syndromes (1999). 2008;47(1):101–7. Epub 2007/11/01. pmid:17971708.
- 6. Low-Beer S, Yip B, O'Shaughnessy MV, Hogg RS, Montaner JS. Adherence to triple therapy and viral load response. Journal of acquired immune deficiency syndromes (1999). 2000;23(4):360–1. Epub 2000/06/03. pmid:10836763.
- 7. Malcolm SE, Ng JJ, Rosen RK, Stone VE. An examination of HIV/AIDS patients who have excellent adherence to HAART. AIDS care. 2003;15(2):251–61. Epub 2003/07/15. pmid:12856346.
- 8. Murphy DA, Sarr M, Durako SJ, Moscicki AB, Wilson CM, Muenz LR. Barriers to HAART adherence among human immunodeficiency virus-infected adolescents. Archives of pediatrics & adolescent medicine. 2003;157(3):249–55. Epub 2003/03/08. pmid:12622674.
- 9. Taiwo B. Understanding transmitted HIV resistance through the experience in the USA. International journal of infectious diseases: IJID: official publication of the International Society for Infectious Diseases. 2009;13(5):552–9. Epub 2009/01/13. pmid:19136289.
- 10. Hansudewechakul R, Sirisanthana V, Kurniati N, Puthanakit T, Lumbiganon P, Saphonn V, et al. Antiretroviral therapy outcomes of HIV-infected children in the TREAT Asia pediatric HIV observational database. Journal of acquired immune deficiency syndromes (1999). 2010;55(4):503–9. pmid:20842043.
- 11. McCormick NM, Li N, Sando D, Muya A, Manji KP, Kisenge R, et al. Implementation and Operational Research: Risk Factors of Loss to Follow-up Among HIV-Positive Pediatric Patients in Dar es Salaam, Tanzania. Journal of acquired immune deficiency syndromes (1999). 2015;70(3):e73–83. Epub 2015/08/08. pmid:26247894; PubMed Central PMCID: PMC4650894.
- 12. Braitstein P, Katshcke A, Shen C, Sang E, Nyandiko W, Ochieng VO, et al. Retention of HIV-infected and HIV-exposed children in a comprehensive HIV clinical care programme in Western Kenya. Tropical medicine & international health: TM & IH. 2010;15(7):833–41. Epub 2010/05/22. pmid:20487430; PubMed Central PMCID: PMC2929358.
- 13. Sengayi M, Dwane N, Marinda E, Sipambo N, Fairlie L, Moultrie H. Predictors of loss to follow-up among children in the first and second years of antiretroviral treatment in Johannesburg, South Africa. Global health action. 2013;6:19248. Epub 2013/02/01. pmid:23364098; PubMed Central PMCID: PMC3556704.
- 14. Fenner L, Brinkhof MW, Keiser O, Weigel R, Cornell M, Moultrie H, et al. Early mortality and loss to follow-up in HIV-infected children starting antiretroviral therapy in Southern Africa. Journal of acquired immune deficiency syndromes (1999). 2010;54(5):524–32. Epub 2010/07/01. pmid:20588185; PubMed Central PMCID: PMC2925143.
- 15. Ojikutu B, Higgins-Biddle M, Greeson D, Phelps BR, Amzel A, Okechukwu E, et al. The association between quality of HIV care, loss to follow-up and mortality in pediatric and adolescent patients receiving antiretroviral therapy in Nigeria. PloS one. 2014;9(7):e100039. Epub 2014/07/31. pmid:25075742; PubMed Central PMCID: PMC4116117.
- 16. Porter M, Davies MA, Mapani MK, Rabie H, Phiri S, Nuttall J, et al. Outcomes of Infants Starting Antiretroviral Therapy in Southern Africa, 2004–2012. Journal of acquired immune deficiency syndromes (1999). 2015;69(5):593–601. Epub 2015/07/15. pmid:26167620; PubMed Central PMCID: PMC4509628.
- 17. Berheto TM, Haile DB, Mohammed S. Predictors of Loss to follow-up in Patients Living with HIV/AIDS after Initiation of Antiretroviral Therapy. North American journal of medical sciences. 2014;6(9):453–9. Epub 2014/10/16. pmid:25317390; PubMed Central PMCID: PMC4193152.
- 18. Working Group on Using Weight and Height References in Evaluating the Growth Status of Thai Children. Manual on using weight and height references in evaluating the growth status of Thai children. Bangkok: Department of Health, Ministry of Public Health; 2000.
- 19. World Health Organization. Haemoglobin concentrations for the diagnosis of anaemia and assessment of severity. Internet. Geneva: World Health Organization, 2011 Contract No.: WHO/NMH/NHD/MNM/11.1.
- 20. Borgan Ø, Liestøl K. A Note on Confidence Intervals and Bands for the Survival Function Based on Transformations. Scandinavian Journal of Statistics. 1990;17(1):35–41.
- 21. Fine JP, Gray RJ. A Proportional Hazards Model for the Subdistribution of a Competing Risk. Journal of the American Statistical Association. 1999;94(446):496–509.
- 22. Siraprapasiri T, Ongwangdee S, Benjarattanaporn P, Peerapatanapokin W, Sharma M. The impact of Thailand's public health response to the HIV epidemic 1984–2015: understanding the ingredients of success. Journal of virus eradication. 2016;2(Suppl 4):7–14. Epub 2017/03/10. pmid:28275444; PubMed Central PMCID: PMC5337415.
- 23. StataCorp LP. Stata survival analysis and epidemiological tables reference manual release 13. College Station, Texas: A Stata Press Publication.
- 24. Cokluk O, Kayri M. The Effects of Methods of Imputation for Missing Values on the Validity and Reliability of Scales. Educational Sciences: Theory and Practice. 2019;11(1):303–9.
- 25. Mickey RM, Greenland S. The impact of confounder selection criteria on effect estimation. American journal of epidemiology. 1989;129(1):125–37. Epub 1989/01/01. pmid:2910056.
- 26. Therneau T CC, Atkinson E. Using Time dependent covariates and time dependent coefficients in the cox model 2018. Available from: https://cran.r-project.org/web/packages/survival/vignettes/timedep.pdf.
- 27. Braitstein P, Songok J, Vreeman RC, Wools-Kaloustian KK, Koskei P, Walusuna L, et al. "Wamepotea" (they have become lost): outcomes of HIV-positive and HIV-exposed children lost to follow-up from a large HIV treatment program in western Kenya. Journal of acquired immune deficiency syndromes (1999). 2011;57(3):e40–6. Epub 2011/03/17. pmid:21407085; PubMed Central PMCID: PMC3145828.
- 28. Bekolo CE, Webster J, Batenganya M, Sume GE, Kollo B. Trends in mortality and loss to follow-up in HIV care at the Nkongsamba Regional hospital, Cameroon. BMC research notes. 2013;6:512. Epub 2013/12/07. pmid:24308609; PubMed Central PMCID: PMC3937159.