Figures
Abstract
Introduction
In people living with HIV, adherence to antiretroviral therapy (ART) is essential for achieving and sustaining viral suppression and reducing mortality. In young people living with HIV, ART adherence and retention remain a challenge with unsatisfactory viral suppression rates despite facility-based intensive adherence counseling that is the standard of care. Few studies have evaluated mHealth adherence interventions among young people living with HIV in resource-limited settings.
Methods
This was a randomized parallel trial. Young people aged between15-24 living with HIV, initiating ART, or on ART for not more than 6 months at three ART clinics were recruited and randomized to a ratio of 1:1 to either standard of care or the intervention “Call for Life-Interactive Voice Response” with standard of care, between 12th August 2020 and 1st June 2022. The intervention is mobile technology-based software, that has interactive voice response functionalities, with a web-based interface, that allows interaction through the use of voice and tones via a dial pad. The primary outcome was viral suppression defined as HIV RNA below 1,000 copies per mL at 12 months with retention in care and viral suppression at month 6 as a secondary outcome. Descriptive statistics were used for participant characteristics. Primary outcomes and factors associated with viral load failure were assessed using the log-binomial model. All calculations were done using statistical software release 16.0.
Results
A total of 206 participants were recruited and randomized; the mean age was 22.5(SD±1.9) years and 81% (167/206) were female. The intervention had 78.6% (81/103), females, while the standard of care had 83.5% (86/103). Viral suppression at 12 months in the intervention arm was 73.6% (67/91) versus 51.9% (40/77) in the standard of care arm, p=0.01. Retention in care was 88.4% (91/103) in the intervention vs. 74.7% (77/103) in the standard of care arm p=0.01.
Citation: Bwanika Naggirinya A, Meya DB, Nabaggala MS, Banturaki G, Kiragga A, Rujumba J, et al. (2024) Effectiveness of interactive voice response-call for life mHealth tool on adherence to anti-retroviral therapy among young people living with HIV: A randomized trial in Uganda. PLoS ONE 19(11): e0308923. https://doi.org/10.1371/journal.pone.0308923
Editor: Andrew Max Abaasa, London School of Hygiene and Tropical Medicine Faculty of Epidemiology and Population Health, UGANDA
Received: November 30, 2023; Accepted: July 9, 2024; Published: November 19, 2024
Copyright: © 2024 Bwanika Naggirinya et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files, 1,2 and 3
Funding: ABN received a scholarship from the Infectious Diseases Institute, College of Health Sciences, Makerere University.URL website: https://https://idi.mak.ac.ug/. The sponsors did not participate in any role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. This was solely by the doctoral student.
Competing interests: I have read the journal’s policy and the authors of this manuscript have the following competing interests: RPR discloses that Infectious Diseases Institute received funds from Janssen, the Pharmaceutical Companies of Johnson and Johnson for Call for Life Projects and other Project Research.
Introduction
Globally, 26% of the new HIV infections in 2021 occurred in young people aged 15-24 [1]. This is mainly due to power dynamics and socio-economic and gender-related inequalities. Poor adherence to antiretroviral therapy (ART) is a particular challenge in young people, increasing the risk of ART drug resistance [2] and stalling progress in halting the pandemic. Young people living with HIV (YPLHIV) require special attention due to their inherent risk of poor pill adherence and poor retention in care [3–5].
Sustained, high adherence to ART is essential to achieve HIV viral suppression, leading to improved immunological and clinical outcomes [6, 7] and decreasing the risk of developing ART drug resistance and subsequent transmission of these resistant HIV strains. YPLHIV globally continue to have suboptimal viral load suppression [8], adherence to ART [9], and retention in care [10].
Retention in care is defined as regular attendance at medical scheduled visits, and it offers benefits for both patients and society [11]. For the patient, retention in care ensures access to uninterrupted ART medication, viral load monitoring, and viral suppression, leading to improvement in clinical outcome and survival. For society, retention in HIV care is essential for the effectiveness of HIV treatment through reducing community viral load to prevent HIV transmission [12], as undetectable equals untransmissible [13].
Mobile health (mHealth) involves the use of mobile phones and other wireless technology in medical care [14, 15]. In 2020, over 400,000 young people were newly infected with HIV [16]. As the burden of HIV continues to grow among adolescents and youths, mHealth technology could address many of the healthcare needs of YLWH, including adherence to HIV medications [17, 18], retention in care, and self-management [19], which are critical needs for this priority population.
Few studies have evaluated mHealth adherence interventions among YPLHIV in resource-limited settings [20, 21]. As of March 2021, Uganda had an increase in phone subscribers to 28.3 million from 27.7 million in December 2020 [22, 23], since ownership of a mobile device is common among the youth, the use of mHealth can help increase both engagement and retention in HIV care [24, 25]. The Call for Life-interactive voice response (CFL-IVR) system utilizes both smart and analog cell phones, despite high phone penetration in Uganda, about 71% of those connected have a basic phone [26], and thus the system has leveraged this to reach out to the young people.
The CFL-IVR system is an automated phone-based technology, it sends out pre-recorded messages with voice prompts, allows participants to provide feedback using their phone keypads, can schedule calls at particular times, and route calls through any phone network. The system allows real-time data collection and can reach a large and diverse population including those with limited internet and low literacy levels. The system offers individualized pill reminders, clinic visit reminders; health tips messages; and functionality to support self-reported symptoms in English and other languages of preference specific to use cases. The system’s development content is in English, however customization of the user interface including translation to other languages like French has been previously done, and any translation to other country-specific languages is possible.
We evaluated an mHealth intervention “Call for life interactive voice response” tool on viral suppression and retention in care among YPLHIV in a randomized trial at a rural district in North-Western Uganda. Adherence to antiretroviral therapy (ART) is crucial for achieving and maintaining viral suppression, which in turn reduces the risk of AIDS progression and mortality [27]. Using the Information - Motivation - Behavioral (IMB) model, we examined the tool’s effect on ART adherence behavior and retention in care among young people receiving ART in a rural district in Mid-Western Uganda. The IMB model identifies three key constructs necessary for engaging in a given health behavior: information, motivation, and behavioral skills. Information involved the provision of correct information through the CFL-IVR tool; Motivation through the tool was individualized pill reminder calls, clinic reminders, and symptom reporting and support, to encourage behavioral skills, adherence to daily pills, and clinic visits for drug refills [28].
Materials and methods
Study design
Between 20th Aug 2020 and 1st Jun 2022, we recruited for a randomized parallel trial in a Kiryandongo district, 225 km away from the capital, which houses the largest refugee settlement in Uganda. The follow-up period started on 27th Jan 2021 and was completed on 1st Jun 2022.
Study sites
Recruitment was from three ART clinics run in a health facility II level (Nyakadot Health Centre II), health facility III (Panyadoli Health Centre III), and a hospital (Kiryandongo Hospital).
The health facility level III is located within a refugee settlement and is the busiest clinic in the district. Panyadoli HC, located at the Kiryandongo Refugee Settlement in Bweyale, Uganda, provides healthcare services to over 100,000 refugees and persons in the community.
Participants
Young people living with HIV 15-24 years, initiating ART or on ART for ≤ 6 months registered at any of the three study sites were eligible for randomization in a ratio 1:1 to either Standard of Care which is usual care, or the intervention "CFL-IVR plus standard of care”.
Study procedures
Randomization and concealment.
Block randomization at a 1:1 ratio was done to either standard of care or Call for life-IVR with standard of care. Computerized varying blocks of six randomizations were done by an independent statistician who kept the treatment code list. We followed sequentially numbered, opaque, sealed envelopes; the treatment allocation envelopes (TAE) were tamper-evident, and identical (except the pre-written study number). One envelope was created for each particular trial subject. Each envelope had a study identification number. The envelopes were secured in a lockable drawer kept by an independent non-study staff. Inside each envelope was a piece of white paper printed clearly with the study number and the allocation given either "Call for life" or "standard of care". All participants were given a basic mobile phone after randomization to minimize differences in baseline characteristics and ensure no participants were excluded due to lack of a phone. Blinding was not possible and was not done.
Standard of care (usual care) arm.
Participants received minimum care facility-based services that occurred 6 monthly and included: Clinical evaluation and monitoring for World Health Organisation (WHO) clinical stage of disease; ART therapy regardless of clinical stage or CD4; nutritional assessment, counseling & support, sexual reproductive health services, screening and management of opportunistic infections e.g. TB, isoniazid prophylaxis if eligible, screen and treatment of co-morbidities, adherence counseling and support, psychosocial support, assessment of stigma, family support, and client disclosure to family [29]. Participants were seen every six months as per the Ministry of Health Consolidated guidelines for the prevention and treatment of HIV [29].
Intervention description (Call for life-IVR mHealth arm).
The CFL-IVR tool is a software that is based on open-source Mobile Technology for Community Health (MoTeCH). MoTeCH was initially developed by the Grameen Foundation and the University of Southern Maine with the support of Janssen, the Pharmaceutical Companies of Johnson & Johnson [30]. CFL-IVR offered individualized pill reminders, clinic visit reminders; health tips messages; and functionality to support self-reported symptoms [31]. The intervention arm received weekly health information on sexual reproductive health, HIV & ART, positive living, prevention of mother-to-child transmission, and AIDS-related opportunistic infections. The daily pill reminders and 6-monthly clinic reminders were individualized, and participants had an opportunity to report symptoms at the end of a day’s pill reminder and when the need arose, in addition, they received standard of care as per Uganda Ministry of Health guidelines for HIV care and management [29].
Demographics, medical history, self-reported stigma, socio-economic evaluation, HIV basic Knowledge, and Sexual Behaviour questionnaire completed.
Viral load testing: In August 2014, Uganda’s Ministry of Health launched a centralized Viral Load (VL) testing system at Central Public Health Laboratories (CPHL) to monitor the response of Anti-retroviral therapy (ART) nationally. Samples from facilities involved in HIV care and management are transported and tested at CPHL through the National Laboratory Sample Transport system. Participants’ samples are drawn based on eligibility criteria, with six-monthly testing for adolescents and young adults, and the hub system used to transport to CPHL for testing.
Outcomes.
Viral load (VL) testing was performed at baseline (for those on ART for 6 months), and repeat VL samples were taken at month 6, and month 12 study visits. Participants were seen at months 6, and 12 visits, and all procedures were repeated on these visits. The primary outcome was viral suppression at 12 months, defined as viral copies below 1000/mL at month 12 visit. The secondary outcomes were retention in care defined as the proportion of participants that turned up for care at month 12, and viral suppression at month 6 visit.
Statistical analysis.
The sample size calculation was based on the primary outcome using the openEpi.com sample size calculation formula for randomized clinical trials [32]. We used a two-sided significance level (alpha) of 0.05, a power of 80, with a ratio of unexposed: exposed of 1. The primary endpoint was viral load suppression at month 12, defined as viral load count below detection (<1000 copies/ml); we estimated 79% viral suppression in the control arm based on previous results in the study area [33], with 94% virally suppressed in the intervention arm [34]. Factoring 10% loss to follow-up, the total sample size was estimated at 206 (103 for each arm). The primary endpoint was viral load suppression at 12 months. Data was collected and managed using Research Electronic Data Capture (%) 10.0.25 - © 2023 Vanderbilt University hosted at Infectious Diseases Institute. The primary outcome was estimated using a log-binomial regression model adjusting for facility level and ART status at entry at month 12, and sensitivity analysis of the primary outcome was estimated using a log-binomial regression model adjusting for more factors including facility level, ART status at entry, age, gender, and reasons for not taking pills: Simply forgot. The percentages were predicted from the adjusted model.
Viral load results at month 12 were analyzed, and proportions of those with detectable VL and those with suppressed VL were estimated in both arms; risk ratios and factors associated with viral load failure were calculated with a p-value of 0.05 taken as statistically significant. The secondary outcome (viral suppression at month 6) was estimated using a log-binomial regression model adjusting for facility level and ART status at entry at month. For the secondary outcome on proportions retained in care at 6 and 12-month visits, the difference in proportion and its confidence interval across the groups was obtained using the binomial method (unadjusted).
Per protocol analysis was conducted including only the participants attending the month 12 study visit for assessment of the proportions of viral load suppression. Statistical analysis was performed using Stata version 16.0 (Stata Corp, College Station, Texas, USA).
Data monitoring committee: We had a Data Steering Committee (DSC) consisting of independent members with expertise in relevant clinical specialties, and statistical data management among which the doctoral committee supervisors were. Their responsibility was to ensure that the safety of study subjects was protected while the scientific goals of the study were being met, and generated data queries to the study team.
Ethical approvals and processes.
The study was approved and cleared by the School of Medicine Research Ethics Committee (Rec Ref# 2019-083) and Uganda National Council of Science & Technology (UNCST Folio# HS576ES). At baseline study information was given and written informed consent was obtained from all participants 18 years and above. For those below 18 years of age, parental/guardian consent was obtained and assent from the minors. For the emancipated minors (16 -17 years) according to UNCST guidelines, no parental consent was required. As per the standard of care, all participants on ART for 6 months and with unsuppressed VL were offered intense adherence counseling (IAC) by the study research assistants and the nurse counselors in the ART clinic. The participants received monthly counseling sessions for three consecutive months.
Reimbursement was waived since it would interfere with a willingness to return for clinic visits as the majority would be returning for reimbursement fees and this would not give the pragmatic retention rates. Trial registration was done on clinicaltrials.gov registry NCT 04718974.
Results
We screened 296 participants of which 206 were enrolled and were randomized in a 1:1 ratio to either Call for Life Intervention or SoC. At month 12, only those who returned for follow-up were included in the analysis (91 in the intervention; 77 in the standard of care arm), "Fig 1".
Fig 1 shows the participant flow from recruitment to study exit.
Baseline characteristics
The participants’ mean age was 22.4(2.1) years, 81% (167/206) were females, 88% (183/206) had a sexual partner, and 25% (52/206) had a secondary level of education. About 64% (n=131) of participants were newly initiated on ART and not eligible for viral load testing at baseline. Of 75 young adults that had viral load tests done at baseline (39 Intervention and 36 SoC); 22.3% (46) had undetectable VL, 21 in the intervention arm while 25 in the standard of care arm, the arms did not have major differences at baseline (Table 1).
Primary and secondary outcome
Viral suppression by arm: At 12 months, 73.6% (67/91) of those on intervention had a suppressed VL compared to 51.9% (40/77) SoC, with a difference in percentage and 95% Confidence Interval of -0.20(-0.35 to -0.06) which was statistically significant P=0.01. Secondary outcomes which included viral suppression at month 6 did not differ statistically between arms (Table 2).
Retention in care at 12- and 6-month visits: There was a statistically significant difference in percentage (95% CI percentage points) for retention in care at month 6 of 8.7% (0.2% to 17.3%) and 12 months, a difference of 13.5% (3.1% to 24.0%) in favor of the intervention (Table 3).
Factors associated with non-suppression using the log-binomial model after adjusting for various variables included, facility level, education level, employment, and those who report the reason for missing pills as "simply forgot". Various factors were assessed for viral load failure and Table 4. shows the unadjusted and adjusted model with factors linked to non-suppression (Table 4).
ART adherence and reasons for missing medication at month 12 bivariate analysis with Pearson chi-square test and Fisher’s exact test: Around 34 participants reported ever missing pills, and the reasons for non-adherence leading to missed pills at month 12 visit included; being away from home (n= 30), simply forgot (n=44), not wanting to be seen taking drugs (n=31), ran out drugs (n=32) and feeling healthy (n=10). These reasons differed significantly between arms (Table 5).
Added value of this study: The study introduces an interactive voice response system, which doesn’t depend on literacy levels, it is secured with a 4-digit PIN code to ensure confidentiality and privacy. It reaches out to the youth in a most appealing way. This study is the first mHealth technology to show a positive effect on YPLHIV in Uganda and indeed sub-Saharan Africa. The large effect seen in the study of a 21.7% improvement in viral suppression is very encouraging as a tool to support drug adherence and retention in care for young people. By using a simple (analog) phone, this digital intervention can easily be accessed by the majority of YPLHIV in Africa. This tool has pill reminders, clinic appointment reminders, health tips, and remote symptom reporting which can be accustomed to an individual’s needs and schedule. All patient data can be accessed on the tool dashboard by the clinician who has rights and login credentials.
Discussion
This is the first study to show improvement in viral suppression and retention in care using mHealth among YPLHIV in a resource-limited setting. The Call for life intervention had a 21% positive effect on viral suppression at the end of the study. Significant viral load suppression proportions of 73.6% in the intervention arm as compared to 51.9% in the standard of care arm at twelve months, and retention rate of 88.4% retention in care for the intervention arm as compared to 74.7% in the standard of care arm. Our population was mainly young females, this is not surprising and concurs with literature and surveys done in Uganda and elsewhere in the world, where the prevalence of HIV is higher among females, 2.9% versus 0.8% [35].
Most new HIV infections among young persons aged 15-24 years, occurring among adolescent girls and young women, are attributed to gender violence, limited access to prevention information, and lack of comprehensive and accurate knowledge about HIV. However, due to the availability of HIV testing during antenatal visits and child health days, females are captured more.
Retention in care represents the process of ongoing participation in HIV medical care, in our study, the average retention rates in our study were 93.6% for the intervention arm compared to 86.9% in the standard of care arm, a non-significant difference of 6.7%. At 6 and 12-months clinical follow-up, retention rates in intervention versus standard of care were 93.2% and 84.5%; 88.4% and 74.7% respectively, with the latter having a statistically significant difference of 13.5% between arms in favor of the CFL-IVR intervention. All our retention rates were higher than retention rates reported by previous mHealth in HIV studies; WelTel Retain trial that used interactive text-messaging as an intervention [36], a retrospective study among a similar population of young people [37], and a cross-sectional study [5] with similar settings although the latter two never used mHealth intervention. These mHealth studies used short-text messaging services which might not be appealing to the youth compared to interactive voice response intervention. Further, the IVR doesn’t depend on or require the beneficiary to be literate.
This study is one of the first to demonstrate that a mobile health intervention can have a positive impact on retention in care among young people, one other mHealth intervention in an adult population, had a similar impact but the population was predominantly male (63%) and in a developed setting [38]. A systematic review of mHealth trials reported over half of the studies had a significant positive effect on primary outcomes of retention and adherence [39]. A six-month pilot study in the United States used text messaging and reported similar retention rates [38]. Globally, studies have reported challenges of retention in care among youths living with HIV [40–42] and the world is still lagging on targets set for young people [1]. More female participants were lost to follow-up during the study. This attrition was highest in the standard of care arm. This is similar to a cross-sectional study in southwestern Uganda, where being male was associated with retention in HIV care [5]. More studies have reported males being lost to follow-up contrary to our findings [43–45]. The barriers to retention in care were mainly fear of disclosure to others as previously reported in a retrospective study of a mixed population [46], social isolation [47], stigma [48, 49], and unfriendly clinic settings and services. There are still noteworthy gaps in the HIV clinical care cascade among the youth as we pursue the Joint United Nations Programme on HIV and AIDS 95–95–95 targets. Achieving these targets could potentially be attained through the use of mHealth tool kits [48, 50].
ART adherence and viral suppression: Adherence to ART is vital for viral suppression, various mHealth interventions have been deployed in the adult population [51], however, the adolescents and young people living with HIV still lack interventions. In our study, the mHealth Call for Life-IVR tool had a significant impact on viral suppression, our finding is similar to one study in Cameroon, although the population here had TB coinfection [52]. In the United States, mHealth had a positive impact, among cisgender MSM and transgender women [53].
Our study is among the first mHealth studies using IVR in young people living with HIV in the sub-Saharan region that has shown a significant effect on viral suppression. Most mHealth interventions have been tested in studies with small sample sizes to assess acceptability, and non-HIV conditions [54], and the majority have used short-message services (SMS) [18, 55], whereas our intervention was interactive voice response. Other studies have found no association with viral suppression but only with medication adherence [21, 56].
Due to confidentiality, the ability to personalize reminders, and the option of call-in for symptom reporting, these features make the Call for Life –IVR very appealing to young adults. The other advantages of IVR over SMS/text message-based intervention are that the level of literacy does not influence interaction and there are minimal chances of misunderstanding the information. The system is interoperable, can be synchronized to any database, and information is mapped and displayed on the computer dashboard and accessed by the provider whenever needed, making it generalizable.
Conclusion
Retention and adherence are distinct interrelated health behaviors and require tools and systems focused on them. Therefore, it is necessary to target both retention and adherence to attain viral suppression thus reducing new HIV infections, addressing health disparities, and improving health outcomes in YPLHIV. This mHealth Call for life-IVR tool has demonstrated robust performance in improving ART adherence with subsequent viral suppression and retention in care among young adults in this population.
Supporting information
S1 Checklist. CONSORT 2010 checklist of information to include when reporting a randomised trial*.
https://doi.org/10.1371/journal.pone.0308923.s001
(DOC)
Acknowledgments
We acknowledge the Call for Life Youth Project staff; George Eram, and Winnie Aziku. The Academy IS team; Annet Nanungi, Francis Musinguzi, the Kiryandongo Hospital ART clinic Staff, Panyadoli, Nyakadot Health Centre ART clinic staff, and Kiryandongo District Health Office.
References
- 1.
UNAIDS, Young people and HIV, 2021. https://www.unaids.org/sites/default/files/media_asset/young-people-and-hiv_en.pdf.
- 2.
M. Meresse, C. March L Fau - Kouanfack, R. C. Kouanfack C Fau - Bonono, S. Bonono Rc Fau - Boyer, G. Boyer S Fau - Laborde-Balen, A. Laborde-Balen G Fau - Aghokeng, et al "Patterns of adherence to antiretroviral therapy and HIV drug resistance over time in the Stratall ANRS 12110/ESTHER trial in Cameroon," British HIV Association, vol. 15, no. 8, pp. 449-512, Mar 3, 2014, 2014. https://doi.org/10.1111/hiv.12140. pmid:24589279.
- 3. Velloza J., Kapogiannis B., Bekker L. G., Celum C., Hosek S., Delany-Moretlwe S., et al "Interventions to improve daily medication use among adolescents and young adults: what can we learn for youth pre-exposure prophylaxis services?," BMC Public Health, vol. 35, no. 3, pp. 463–475, Mar 1, 2021. pmid:33252486 PMCid:PMC7855564.
- 4. Okonji E. A.-O., Mukumbang F. A.-O., Orth Z. A.-O., Vickerman-Delport S. A., and Van Wyk B. A.-O., "Psychosocial support interventions for improved adherence and retention in ART care for young people living with HIV (10-24 years): a scoping review," no. 1471-2458 (Electronic), 2020.
- 5. Muwanguzi M., Lugobe H. M., Ssemwanga E., Lule A. P., Atwiine E., Kirabira V., et al. "Retention in HIV care and associated factors among youths aged 15-24 years in rural southwestern Uganda," BMC Public Health, vol. 21, no. 1, pp. 1489, 2021/07/31, 2021. pmid:34332556 PMCid:PMC8325848.
- 6. Abdullahi S. B., Ibrahim O. R., Okeji A. B., Yandoma R. I., Bashir I., Haladu S., et al, "Viral suppression among HIV-positive patients on antiretroviral therapy in northwestern Nigeria: an eleven-year review of tertiary care centre records, January 2009-December 2019," BMC Infect Dis, vol. 21, no. 1, pp. 1031, Oct 2, 2021. pmid:34600477 PMCid:PMC8487150.
- 7.
World Health Organisation, What’s new in treatment monitoring:Viral load and CD4 testing, 2017. https://www.who.int/publications/i/item/WHO-HIV-2017.22.
- 8. Weijsenfeld A. M., Blokhuis C., Stuiver M. M., Wit F., and Pajkrt D., "Longitudinal virological outcomes and factors associated with virological failure in behaviorally HIV-infected young adults on combination antiretroviral treatment in the Netherlands, 2000 to 2015," pmid:31393344
- 9. Biney I. J. K., Kyei K. A., Ganu V. J., Kenu E., Puplampu P., Manortey S., et al. "Antiretroviral therapy adherence and viral suppression among HIV-infected adolescents and young adults at a tertiary hospital in Ghana," African Journal of AIDS Research, vol. 20, no. 4, pp. 270–276, 2021/10/02, 2021. pmid:34905452.
- 10. Holtzman C. W., Brady Ka Fau - Yehia B. R., and Yehia B. R., "Retention in care and medication adherence: current challenges to antiretroviral therapy success," no. 1179-1950 (Electronic), 2015. PMCid:PMC4384328. pmid:25792300
- 11. Horstmann E., Brown J., Islam F., Buck J., and Agins B. D., "Retaining HIV-Infected Patients in Care: Where Are We? Where Do We Go from Here?," Clinical Infectious Diseases, vol. 50, no. 5, pp. 752–761, 2010. pmid:20121413.
- 12. Stricker S. M., Ka Fau - Baggaley R. Fox, Baggaley R Fau - Negussie E, Negussie E Fau - de Pee S., de Pee S Fau - Grede N. M. W. Grede N Fau - Bloem , et al. "Retention in care and adherence to ART are critical elements of HIV care interventions," AiDS Behaviour, vol. 18 Suppl 5, no. 1573-3254 (Electronic), pp. S465–75, 2014 Oct, 2014. pmid:24292251.
- 13. Thomford N. A.-O., Mhandire D., Dandara C. A.-O., and Kyei G. A.-O., "Promoting Undetectable Equals Untransmittable in Sub-Saharan Africa: Implication for Clinical Practice and ART Adherence. LID - 10.3390/ijerph17176163 [doi] LID - 6163," no. 1660-4601 (Electronic). https://doi.org/10.3390/ijerph17176163. pmid:32854292 PMCid:PMC7503341.
- 14.
WHO, mHealth: use of mobile wireless technologies for public health, 139/8, WHO Executive Secretariat, 2016. https://apps.who.int/gb/ebwha/pdf_files/EB139/B139_8-en.pdf.
- 15. Holman T. "Definition of mHealth," May 30th 2022; https://www.techtarget.com/searchhealthit/definition/mHealth.
- 16.
UNICEF. "HIV and AIDS in adolescents:Turning the tide against AIDS will require more concentrated focus on adolescents and young people," 11-01, 2023; https://data.unicef.org/topic/hiv-aids/.
- 17. Kim J., Zhang W., Nyonyitono M., Lourenco L., Nanfuka M., Okoboi S., et al. "Feasibility and acceptability of mobile phone short message service as a support for patients receiving antiretroviral therapy in rural Uganda: a cross-sectional study," International AIDS Society. Journal, vol. 18, pp. 20311, 2015. pmid:26654029 PMCid:PMC4676808.
- 18. Cele M. A., and Archary M., "Acceptability of short text messages to support treatment adherence among adolescents living with HIV in a rural and urban clinic in KwaZulu-Natal," South Afr J HIV Med., no. 2078-6751 (Electronic), 2019. pmid:31616573 PMCid:PMC6779962.
- 19. Steve Kanters J. J. H. P., Keith Chan, Maria Eugenia Socias, Nathan Ford, Jamie I Forrest, Kristian Thorlund, et al. "Interventions to improve adherence," www.theLancet.com/HIV, 2016. https://doi.org/10.1016/S2352-3018(16)30206-5.
- 20. Campbell J. I., Aturinda I., Mwesigwa E., Burns B., Santorino D., Haberer J. E., et al "The Technology Acceptance Model for Resource-Limited Settings (TAM-RLS): A Novel Framework for Mobile Health Interventions Targeted to Low-Literacy End-Users in Resource-Limited Settings," AiDS Behaviour, no. 1573-3254 (Electronic), 2017. pmid:28421356 PMCid:PMC5763567.
- 21.
J. E. Haberer, E. C. Musiimenta A Fau - Atukunda, N. Atukunda Ec Fau - Musinguzi, M. A. Musinguzi N Fau - Wyatt, N. C. Wyatt Ma Fau - Ware, D. R. Ware Nc Fau - Bangsberg, et al. "Short message service (SMS) reminders and real-time adherence monitoring improve antiretroviral therapy adherence in rural Uganda," AIDS (London, England), no. 1473-5571 (Electronic), 2016. https://doi.org/10.1097/QAD.0000000000001021. pmid:26760452 PMCid:PMC4851578.
- 22.
Uganda Bureau of Statistics (UBOS), Uganda Bureau of Statistics,Population estimates, 2019. https://www.ubos.org/wpcontent/uploads/publications/01_20202019_Statistical_Abstract_-Final.pdf.
- 23.
Uganda Communications Commission, "Market Performance Report," Ministry of ICT & National Guidance, ed., 2021, p. 13. https://www.ktaadvocates.com/wp-content/uploads/2023/05/POLICY-PAPER-ON-UGANDAS-DIGITAL-ECONOMY.pdf.
- 24. Ippoliti N.B., L’Engle K. Meet us on the phone: mobile phone programs for adolescent sexual and reproductive health in low-to-middle income countries. Reprod Health 14, 11 (2017). pmid:28095855
- 25. Swahn M. H., Braunstein S., and Kasirye R., "Demographic and psychosocial characteristics of mobile phone ownership and usage among youth living in the slums of Kampala, Uganda," West J Emerg Med, vol. 15, no. 5, pp. 600–3, Aug, 2014. pmid:25157308 PMCid:PMC4140203.
- 26.
F. Kimbuacha, "Mobile Penetration Uganda," https://www.geopoll.com/blog/mobile-penetration-uganda/, GEOPOLL 14 Sep GeoPoll, ed., GeoPoll, 2021.
- 27.
CDC, Centers for Disease Control and Prevention. Report of the NIH Panel to Define Principles of Therapy of HIV Infection and Guidelines for the Use of Antiretroviral Agents in HIV-Infected Adults and Adolescents. MMWR 1998;47(No. RR-5), vol. 47, 1994. https://stacks.cdc.gov/view/cdc/13529.
- 28. Fisher W. A., Fisher J. D., and Harman J., "The Information-Motivation-Behavioral Skills Model: A General Social Psychological Approach to Understanding and Promoting Health Behavior," pp. 82–106, 2003. .
- 29.
Ministry of Health Uganda (MoH), Consolidated Guidelines for Prevention and Treatment of HIV in Uganda, Kampala, 2018. http://library.health.go.ug/communicable-disease/hivaids/consolidated-guidelines-prevention-and-treatment-hiv-uganda.
- 30. LeFevre A. E., Mohan D., Hutchful D., Jennings L., Mehl G., Labrique A., et al. "Mobile Technology for Community Health in Ghana: what happens when technical functionality threatens the effectiveness of digital health programs?," BMC Med Inform Decis Mak, vol. 17, no. 1, pp. 27, Mar 14, 2017. pmid:28292288 PMCid:PMC5351254.
- 31. Byonanebye DM, Nabaggala MS, Naggirinya AB, Lamorde M, Oseku E, King R, et al. An interactive voice response software to improve the quality of life of people living with hiv in uganda: randomized controlled trial. JMIR mHealth and uHealth. 2021;9(2):e22229. pmid:33570497
- 32.
A. D. Kevin M. Sullivan, Minn M. Soe;. "Sample Size for a Cross-Sectional, Cohort, or Clinical Trial Studies," 2019; https://www.openepi.com/SampleSize/SSCohort.htm.
- 33.
Ministry of Health Uganda, "Uganda Population-based HIV Impact Assessment (UPHIA) 2016-2017: Final Report, Ministry of Health Jul, 2019. Access This Report Online https://phia.icap.columbia.edu/wp-content/uploads/2019/07/UPHIA_Final_Report_Revise_07.11.2019_Final_for-web.pdf.
- 34.
A. De Costa, N. Shet A Fau - Kumarasamy, P. Kumarasamy N Fau - Ashorn, B. Ashorn P Fau - Eriksson, L. Eriksson B Fau - Bogg, V. K. Bogg L Fau - Diwan, et al. "Design of a randomized trial to evaluate the influence of mobile phone reminders on adherence to first line antiretroviral treatment in South India--the HIVIND study protocol. http://www.biomedcentral.com/1471-2288/10/25.
- 35.
UPHIA, UGANDA POPULATION-BASED HIV IMPACT ASSESSMENT, 2022. https://phia.icap.columbia.edu/wp-content/uploads/2022/08/UPHIA-Summary-Sheet-2020.pdf.
- 36. van der Kop M. L., Muhula S., Nagide P. I., Thabane L., Gelmon L., Awiti P. O., et al. "Effect of an interactive text-messaging service on patient retention during the first year of HIV care in Kenya (WelTel Retain): an open-label, randomised parallel-group study," no. 2468-2667 (Electronic), 2018. pmid:29361433.
- 37. Okoboi S., Ssali L., Yansaneh A. I., Bakanda C., Birungi J., Nantume S., et al. "Factors associated with long‐term antiretroviral therapy attrition among adolescents in rural Uganda: a retrospective study," Journal of the International AIDS Society, vol. 19, pp. 20841, 2016. pmid:27443271 PMCid:PMC4956735.
- 38. Rebecca Dillingham K. I., Tabor E. Flickinger, Ava Lena Waldman, Marika Grabowski, Colleen Laurence, Erin Wispelwey, et al. "PositiveLinks: A Mobile Health Intervention for Retention in HIV Care and Clinical Outcomes with 12-Month Follow-Up," AIDS Patient Care and STDs, vol. 32, no. 6, pp. 241–250, 2018. pmid:29851504 PMCid:PMC5982157.
- 39. Demena B. A., Artavia-Mora L., Ouedraogo D., Thiombiano B. A., and Wagner N., "A Systematic Review of Mobile Phone Interventions (SMS/IVR/Calls) to Improve Adherence and Retention to Antiretroviral Treatment in Low-and Middle-Income Countries," no. 1557-7449 (Electronic), 2020. pmid:32049555.
- 40. Wong V. J., Murray K. R., Phelps B. R., Vermund S. H., and McCarraher D. R., "Adolescents, young people, and the 90-90-90 goals: a call to improve HIV testing and linkage to treatment," AIDS, vol. 31, pp. S191–S194, 2017. pmid:28665876 PMCid:PMC5497776.
- 41. Philbin M. M., Tanner A. E., DuVal A., Ellen J. M., Xu J., Kapogiannis B., et al. The Adolescent Trials Network for, "Factors Affecting Linkage to Care and Engagement in Care for Newly Diagnosed HIV-Positive Adolescents Within Fifteen Adolescent Medicine Clinics in the United States," AIDS and Behavior, vol. 18, no. 8, pp. 1501–1510, 2014/08/01, 2014. pmid:24682848 PMCid:PMC4000283.
- 42. Meloni S. T., Agaba P., Chang C. A., Yiltok E., Oguche S., Ejeliogu E., et al. "Longitudinal evaluation of adherence, retention, and transition patterns of adolescents living with HIV in Nigeria. pmid:32735566
- 43. Nuwagira E., Lumori B. A. E., Muhindo R., A. Kanyesigye M Fau - Amir, Amir A W. Muyindike , et al. "Incidence and predictors of early loss to follow up among patients initiated on protease inhibitor-based second-line antiretroviral therapy in southwestern Uganda," AIDS Research and Therapy, vol. 18, no. 7, 2021. pmid:33743748 PMCid:PMC7980600.
- 44. Giordano T. P., Gifford A. L., White A. C. Jr., Almazor M. E. S., Rabeneck L., Hartman C., et al. "Retention in Care: A Challenge to Survival with HIV Infection," Clinical Infectious Diseases, vol. 44, no. 11, pp. 1493–1499, 2007. pmid:17479948.
- 45. Seifu W., Ali W., and Meresa B., "Predictors of loss to follow up among adult clients attending antiretroviral treatment at Karamara general hospital, Jigjiga town, Eastern Ethiopia, 2015: a retrospective cohort study," BMC Infectious Diseases, no. 1471-2334 (Electronic), 2018. pmid:29914400 PMCid:PMC6006768.
- 46. Elopre L., Hook E. W., Westfall A. O., Zinski A., Mugavero M. J., Turan J., et al. "The Role of Early HIV Status Disclosure in Retention in HIV Care," AIDS Patient Care and STDs. no. 1557-7449 (Electronic), 2015. pmid:26588053
- 47. Zanoni B. A.-O., Sibaya T., Cairns C., and Haberer J. E., "Barriers to Retention in Care are Overcome by Adolescent-Friendly Services for Adolescents Living with HIV in South Africa: A Qualitative Analysis," AiDS Behaviour, vol. 23, no. 14, pp. 957–965, 2019. pmid:30535836 PMCid:PMC6459720.
- 48. St Clair-Sullivan N., Mwamba C., Whetham J., Bolton Moore C., Darking M., and Vera J., "Barriers to HIV care and adherence for young people living with HIV in Zambia and mHealth," mHealth, no. 2306-9740 (Print), 2019. PMCid:PMC6789205. pmid:31620472
- 49. Mesic A. A.-O., Halim N., MacLeod W., Haker C., Mwansa M., and Biemba G., "Facilitators and Barriers to Adherence to Antiretroviral Therapy and Retention in Care Among Adolescents Living with HIV/AIDS in Zambia: A Mixed Methods Study," AiDS Behaviour, vol. 23, no. 9, 2019. pmid:31093820.
- 50. Pfammatter A. F., Mitsos A., Wang S., Hood S. H., and Spring B., "Evaluating and improving recruitment and retention in an mHealth clinical trial: an example of iterating methods during a trial," mHealth, no. 2306-9740 (Print), 2017. PMCid:PMC5682361. pmid:29184901
- 51.
T. Horvath, G. E. Azman H Fau - Kennedy, G. W. Kennedy Ge Fau - Rutherford, and G. W. Rutherford, "Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection," The Cochrane Database of Systematic Reviews, no. 1469-493X (Electronic), 2012. https://doi.org/10.1002/14651858.CD009756. PMCid:PMC6486190.
- 52. Kibu O. D., Siysi V. V., Albert Legrand S. E., Asangbeng Tanue E., and Nsagha D. A.-O., "Treatment Adherence among HIV and TB Patients Using Single and Double Way Mobile Phone Text Messages: A Randomized Controlled Trial," Journal of Tropical Medicine, no. 1687-9686 (Print), 2022. pmid:35996467 PMCid:PMC9392638.
- 53. Arayasirikul S., Turner C. M., Trujillo D., Maycott J., & Wilson E. C., "The Dose Response Effects of Digital HIV Care Navigation on Mental Health and Viral Suppression Among Young People Living With HIV: Single-Arm, Prospective Study With a Pre-Post Design," Journal of medical Internet research, vol. 24(7), no. 1438-8871 (Electronic), 2022. pmid:35849442 PMCid:PMC9345131.
- 54. Ssemugabo C., Rutebemberwa E., Kajungu D., Pariyo G. W., Hyder A. A., and Gibson D. G., "Acceptability and Use of Interactive Voice Response Mobile Phone Surveys for Noncommunicable Disease Behavioral Risk Factor Surveillance in Rural Uganda: Qualitative Study," no. 2561-326X (Electronic), 2019.
- 55. Amankwaa I., Boateng D., Quansah D. Y., Akuoko C. P., and Evans C., "Effectiveness of short message services and voice call interventions for antiretroviral therapy adherence and other outcomes: A systematic review and meta-analysis," no. 1932-6203 (Electronic), 2018. PMCid:PMC6150661. pmid:30240417
- 56. Amico K. A.-O., Lindsey J. C., Hudgens M., Dallas R., Horvath K. J., Dunlap A., et al. "Randomized Controlled Trial of a Remote Coaching mHealth Adherence Intervention in Youth Living with HIV," no. 1573-3254 (Electronic). pmid:35670987