https://orcid.org/0000-0002-8152-6754
Figures
Abstract
Background
Retaining clients on antiretroviral therapy (ART) is challenging, especially during the first year on ART. Mobile health (mHealth) interventions show promise to close retention gaps. We aimed to assess reach (who received the intervention?) and effectiveness (did it work?) of a hybrid two-way texting (2wT) intervention to improve ART retention at a large public clinic in Lilongwe, Malawi.
Methods
Between August 2021—June 2023, in a quasi-experimental study, outcomes were compared between two cohorts of new ART clients: 1) those opting into 2wT who received automated, weekly motivation short messaging service (SMS) messages and response-requested appointment reminders; and 2) a matched historical cohort receiving standard of care (SoC). Reach was defined as “the proportion clients ≤6 months of ART initiation eligible for 2wT”. 2wT effectiveness was assessed in time-to-event analysis. Retention was presented in a Kaplan-Meier plot and compared between 2wT and SoC using a log-rank test. The effect of 2wT on ART dropout (lost to follow-up or stopped ART) was estimated using Fine-Gray competing risk regression models, adjusting for sex, age and WHO HIV stage at ART initiation.
Results
Of 1,146 clients screened, 501 were eligible for 2wT, a reach of 44%. Lack of phone (393/645; 61%) and illiteracy (149/645; 23%) were the most common ineligibility reasons. Among 468 participants exposed to 2wT, 12-month probability of ART retention was 91% (95% CI: 88% - 94%) compared to 76% (95% CI: 72% - 80%) among 468 SoC participants (p<0.001). Compared to SoC, 2wT participants had a 65% lower hazard of ART dropout at any timepoint (sub-distribution hazard ratio 0.35, 95% CI: 0.24–0.51; p<0.001).
Citation: Feldacker C, Klabbers RE, Huwa J, Kiruthu-Kamamia C, Thawani A, Tembo P, et al. (2024) The effect of proactive, interactive, two-way texting on 12-month retention in antiretroviral therapy: Findings from a quasi-experimental study in Lilongwe, Malawi. PLoS ONE 19(8): e0298494. https://doi.org/10.1371/journal.pone.0298494
Editor: Hamufare Dumisani Dumisani Mugauri, University of Zimbabwe Faculty of Medicine: University of Zimbabwe College of Health Sciences, ZIMBABWE
Received: January 30, 2024; Accepted: July 15, 2024; Published: August 29, 2024
Copyright: © 2024 Feldacker et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: Research reported in this publication was supported by the Fogarty International Center of the National Institutes of Health (https://www.fic.nih.gov/) under Award Number R21TW011658/R33TW011658, under PI Feldacker and multiple PI Tweya. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The funders played no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
In sub-Saharan Africa (SSA), persistent gaps in retention on antiretroviral therapy (ART) among specific groups and geographies of people living with HIV (PLHIV) threaten decades of impressive progress [1]. Loss to follow up (LTFU) is highest among those newly on ART through 6 months in care [2,3]. Gaps in retention are a problem: even short treatment interruptions can lead to increased client morbidity, mortality, drug resistance, and HIV transmission risk [4]. Most efforts to address LTFU are reactive, waiting for clients to miss visits before intervening, resulting in tracing delays that reduce the likelihood of finding, returning, and retaining clients in care [5,6]. Addressing retention gaps is costly, often relying on healthcare workers (HCWs) to call or trace clients identified as LTFU in-person [7]. Recent reductions in global funding, chronic shortages of HCWs, and increasing client volumes exacerbate retention challenges. Proactive, lower-intensity, effective retention interventions, especially for ART clients in their first year in care, are needed in routine, low-resource SSA settings.
Numerous mobile health (mHealth) interventions show promise to significantly increase ART retention (alive in care, adherence to ART, visit compliance) among adults [8–14]. Effectiveness, however, is not guaranteed; not all mHealth interventions are associated with improved ART retention [15–19]. Previous mHealth intervention research suggests that several mHealth intervention characteristics raise the likelihood of ART retention impact. First, lower technology approaches that rely on short-message service (SMS) which requires only feature phones appear better suited to low- or middle-income country (LMIC) settings [20,21]. SMS-focused interventions show high acceptability [11,22–24] and reduce digital health equity concerns associated with apps that require smartphones [25]. Second, interactive interventions that enhance communication between clients and HCWs are more effective than one-way blast communication to engage clients in care [13,26]. Interaction potentially diminishes message fatigue and facilitates more personalized, intensive support when needed [27]. Third, engagement of diverse stakeholders throughout the design, testing, and evaluation process creates ownership and buy-in [28], helping tailor the right interventions to the local context [29]. Lastly, iterative monitoring and evaluation (M&E) of mHealth in accordance with digital health best practices suggested by the World Health Organization (WHO) helps to ensure these interventions complement, as opposed to conflict with, ongoing health system strengthening [30,31].
Malawi is an ideal location to assess mHealth to improve client retention. Malawi is a low-resource country with an adult HIV prevalence of ~7% [32]. Although progress towards 95-95-95, the global targets that state that by 2025, 95% of people living with HIV should be aware of their HIV status, 95% of those diagnosed with HIV should receive sustained ART, and 95% of those receiving ART should be virally suppressed, appears on track [4], LTFU is high, especially during in the first year on ART [33]. Five years after ART initiation, only 54% of PLHIV are retained in ART care [34]. Given pervasive HCW shortages [35], alternatives to human resource-intensive solutions are needed. In Malawi, the Ministry of Health (MoH) has tested several ART-related innovations at Lighthouse Trust (LT), one of the largest ART providers and a WHO-recognized ART Centre of Excellence in Lilongwe, the capital [36]. LT provides integrated HIV care to 38,000 ART clients in its two flagship clinics in urban Lilongwe: 25,000 at Martin Preuss Centre (MPC) and 13,000 at Lighthouse clinic (LH). At LT, retention at twelve months post-ART initiation is estimated at 73%, falling to 63% by 24 months.
In 2006, LT established an intensive client tracing program, “Back-To-Care” (B2C), to trace and return clients to care after they miss ART dispensing visits. B2C does not provide visit reminders. As part of B2C, every week health workers manually generate a tracing list of clients who missed their ART visit by ≥14 days. Subsequently, up to three calls or home visits are attempted to encourage each client on this list who misses their scheduled appointment to return to care. B2C has been well-recognized for its success returning clients to care [37–41]. However, B2C, like other reactive tracing efforts, is highly resource intensive [38]. At MPC clinic from July-September, 2023, there were 18,842 scheduled ART visits; 1,798 clients (10%) missed visits by ≥14 days and were referred to B2C. With five, full-time B2C tracers, only 40% (719/1798) of potential LTFU clients during that period were successfully found. B2C tracing efforts are stretched, leading to delayed or missed tracing. LT needs proactive, effective, retention innovations that reflect the reality of routine, low-resource, public settings.
In 2021, LT and partners at the University of Washington’s International Training and Education Center for Health (I-TECH) and Medic developed a two-way texting (2wT) system to improve early retention at MPC clinic. 2wT is a hybrid (automated and interactive) intervention combining weekly non-HIV-related motivational messaging and response requested scheduled ART visit reminders, aiming to provide proactive retention support to prevent care gaps before they happen. Early 2wT usability assessment among new ART initiates (within 6 months of initiation) demonstrated high client acceptability and support for the 2wT approach [42].
We aimed to assess the impact of the 2wT intervention on our primary research objective, to improve 12-month retention among new ART initiates at MPC, using a quasi-experimental design. We employed an implementation science (IS) approach to enhance the quality, speed, and impact of translating 2wT research findings into routine practice [43]. We applied the RE-AIM framework (reach, effectiveness, adoption, implementation, maintenance) to guide our evaluation [44] and further understanding for whom, where, why and how 2wT works [45]. In this paper, we assess 2wT reach by describing the participant flow from 2wT screening, eligibility, and enrollment. With our primary objective to improve ART retention, we examine 2wT effectiveness by comparing ART retention at 12 months between 1) new ART clients who opted into 2wT (intervention) versus 2) a historical cohort of routine MPC new initiates who received standard of care (SoC) (comparison). We hypothesized that 2wT would improve 12-month retention.
Methods
Setting
The study was conducted at MPC, LT’s largest urban clinic in Lilongwe, Malawi. LT operates as part of MoH ART service delivery and employs the MoH electronic medical record system (EMRS) at MPC [46]. On average, MPC initiates 450 PLHIV on ART per quarter following the test and treat strategy. At ART registration, clients’ demographics, phone number(s) and WHO HIV stage (4-level clinical staging system for HIV ranging from ‘stage 1’ (asymptomatic) to ‘stage 4’ (AIDS)) are captured in the EMRS. During the first three to six months after ART initiation, clients are seen monthly, after which, if clients are stable and adherent to ART, visit frequency is typically decreased to once every three- or six-months. The vast majority of clients are initiated on an oral first-line ART regimen of tenofovir/lamivudine/dolutegravir (TDF + 3TC + DTG), or if they weigh <30kg, on abacavir/lamivudine/dolutegravir (ABC + 3TC + DTG) [47]. ART is taken daily, and treatment is lifelong.
2wT behavior change theory
2wT design was informed by the theory that prompts can spur action to change [48]. By using SMS to target key individual-level constructs proven effective in previous HIV-related behavior change programs [49–52] it is expected that the 2wT intervention will improve early retention on ART (Fig 1). To increase behavioral control over timely attendance at scheduled ART visits, participants are reminded by SMS in advance to provide time to arrange transport or free their schedules. 2wT helps improve participant motivation to make decisions for their own wellness, including adhering to ART, via weekly non-HIV (neutral) messages or educational content that support participant engagement in their health. Initial 2wT participant education and subsequent interaction with 2wT officers encourages self-efficacy by providing participants with an opportunity to request visit date changes, report transfers, or communicate about any issues related to their visits.
ART: Antiretroviral therapy; SMS: Short messaging service; 2wT: Two-way texting.
Retention interventions
Standard of care (SoC) retention support.
The historical comparison cohort received SoC at MPC (Box 1). As of mid-2019, as part of SoC, all new ART initiates at MPC were assigned an ART Buddy, a PLHIV on ART at LT who would serve as a peer “buddy” for their first 12 months on ART, only. The role of the ART Buddy is to guide clients through early ART care by providing visit reminders, health education, disclosure support, and adherence counseling. ART Buddies are considered Expert Clients (a cadre of paid, trained, peer-supporters). Each ART Buddy is paid a nominal fee to support ~15 new ART initiates. Communication between ART Buddies and clients both before and after missed visits occurs mainly through phone calls, which are favored for the ability to verify client identity, but SMS communication is also utilized.
The 2wT and historical SoC comparison cohort received different retention support (Box 1).
2wT intervention retention support.
The 2wT approach was developed in accordance with the Principles for Digital Development [53] and based on the open-source Community Health Toolkit (CHT) [54]. 2wT’s easy-to-use CHT-based design resulted from an iterative human-centered design (HCD) process that incorporated feedback from LT clients, HCWs, and retention officers, described previously [55]. In brief, 2wT is a free, proactive, mHealth intervention that combines automated motivation messages with interactive individualized visit reminders (Fig 2) [42]. 2wT does not use an app, nor does it require participants to download anything. ART clients who opt into 2wT are sent weekly one-way, “blast” motivation messages containing non-HIV-related content such as generic messages of encouragement (e.g., “You can do it”, “You are making great choices every day”) and general health advice (e.g., “Drink boiled and clean water”, “Seek help when you do not feel well”). Additionally, 2wT participants receive response-requested individualized visit reminders day 3 and 1 before their scheduled clinic visit. Participants who confirm visit reminders with a “yes” end the dialogue. A "no" triggers interactive SMS with a HCW in which participants may change their appointment dates, report transfers, or chat about other visit-related issues. Participants who miss a scheduled clinic visit are sent follow-up reminders 2, 5, and 11 days after the appointment (unless they return to care). Messages are stopped upon participant request, transfer or death. There are no costs associated with sending or receiving 2wT messages for participants. 2wT clients were not assigned ART Buddies.
ART: Antiretroviral therapy; B2C: Back to care; EMRS: Electronic medical record system; SMS: Short messaging service; 2wT: Two-way texting.
Study design, cohort creation and sample size
We hypothesized that 2wT would improve 12-month retention by at least 10%, improving from 73% at baseline to 83% at 12-months. A quasi-experimental design was used to assess the effect of 2wT on 12-month ART retention by comparing retention among a cohort of 2wT participants to that among a matched historical comparison cohort receiving SoC at MCP one year prior to 2wT implementation. The intervention cohort was matched 1:1 on age (bands of 5 years), sex, and WHO stage at initiation via random selection from an MPC dataset of 1,455 ART clients who had a phone number. Based on a baseline 12-month retention of 73% at MPC in March 2021, an expected 2wT effect size of ≥10%, and a power of 90%, 438 participants would be required in each arm to detect a difference in 12-month retention between 2wT and SoC. We aimed to recruit a 10–15% larger sample size to accommodate 2wT participant transfer-out, withdraws and deaths. 2wT participants-initiated ART between May 2021 –April 2022 and were followed through 12 months post-ART initiation. The historical, matched, comparison SoC cohort initiated ART at MPC between November 2019—November 2020, before 2wT launch.
2wT recruitment: Screening and enrollment
During the 2wT enrollment period (August 2021—April 2022), all new ART clients at MPC were screened for study eligibility, including: 1) initiated ART <6 months prior; 2) ≥18 years; 3) possessed phone at enrolment; 4) had basic literacy; 5) completed informed consent; and 6) received their 2wT enrollment text. Eligible participants enrolled to receive messages in either Chichewa or English, based on their preference, but could send SMS in any language. Participants received instructions on how to respond to 2wT messages.
Data collection
For both the 2wT and SoC cohort, data on routine MoH ART outcomes were extracted from the EMRS for participants’ first twelve months post-ART initiation (May 2021 –June 2023 for 2wT and November 2019 –January 2022 for SoC). These outcomes could be either 1) alive and on ART (alive and retained in ART care on the date of record review); 2) stopped ART treatment (alive but informed the clinic they stopped ART); 3) transferred (documented move to another facility); 4) dead (all cause mortality); and 5) LTFU (no return to clinic within 60 days of a scheduled visit) [56]. To ensure correct ART outcome ascertainment, intervention and comparison group outcomes were updated for 60 days beyond the 12-month period. Participants who requested to stop visit reminder messages were considered to have withdrawn from the study and were classified as withdrew. SMS data was obtained from the 2wT database and the SMS aggregator, Africa’s Talking.
Study outcomes
Reach was defined as the proportion of screened PLHIV eligible and willing to participate in 2wT and was measured using screening data. As definitions of ART retention vary [57], we define 2wT effectiveness to improve 12-month ART retention using Malawi MoH ART outcome definitions. We consider 2wT to be effective if a greater proportion of 2wT clients compared to SoC clients is retained as “alive and on ART” in contrast to having dropped out of care, which we defined as having either “stopped ART treatment” or become “LTFU”, 12 months post-ART initiation. We defined retained and dropout as mutually exclusive and opposite categories. We examined message response rates and 6-month retention on ART care as secondary analyses.
Statistical analysis
2wT participants were considered exposed to the intervention and included in analysis if at least one visit reminder SMS was successfully delivered to their phone within the 12-month follow-up period. Descriptive statistics were used to present matching success between the 2wT and SoC cohort, MoH ART outcomes at 6- and 12-month follow-up for 2wT vs. SoC clients, and describe 2wT reach. Counts and frequencies report the number of messages sent by the 2wT platform and by participants as well as message response rates. Chi-square tests were performed to compare the distribution of ART outcomes between the 2wT and SoC cohort. 2wT participants who withdrew from the study were excluded from the denominator.
Time-to-event analysis was conducted to compare retention probability between the 2wT and SoC arm and to assess the effect of the 2wT intervention on the primary outcome of interest: ART retention, defined as having the MoH ART outcome “alive and on ART”. ART ‘dropout’ (either “stopped ART treatment” or “LTFU”) was considered a failure event. “Transferred”, “withdrew”, and “dead” were censoring events. Participants were censored twelve months after ART initiation. 2wT clients who enrolled in the study after ART initiation were considered to come under observation at the time of enrolment but entered analysis taking account of the accumulated time on ART. A Kaplan-Meier survival plot, chosen for its widespread use, simplicity and ease of interpretation, was created to provide a visual representation of the probability of ART retention in both study arms over time [34,58]. Probabilities of being retained alive on ART six and twelve months post-ART initiation are reported, comparing 2wT and SoC groups using a log-rank test.
To address potential bias in the Kaplan-Meier results resulting from the presence of competing risks, we conducted a sensitivity analysis in which death was considered a competing risk. Cumulative incidence functions (CIFs) were used to assess dropout in the 2wT and SoC study arms [59] and findings were qualitatively compared with Kaplan-Meier results. Using the Fine-Gray competing risks approach [60] the association between study arm (2wT or SoC) and ART drop out was modelled, adjusting for sex, age and WHO HIV stage at ART initiation to assess the ability of 2wT to reduce dropout, and thereby improve ART retention. We assessed the proportional sub-distribution hazards assumption using graphical methods and assessed interaction between the intervention and relevant covariates. The unadjusted sub-distribution hazard ratio (sHR) as well as the adjusted sHRs for all covariates were reported with 95% confidence intervals (CI).
Ethics
The study protocol was approved by the Malawi National Health Sciences Research Committee (#20/06/2565) and the University of Washington, Seattle, USA ethics review board (STUDY000101060). At enrolment, 2wT participants provided written informed consent in either Chichewa or English, according to their preference. SoC clients did not consent as only de-identified, routine monitoring and evaluation data was collected from EMRS.
Results
2wT Reach: Enrollment
The study team screened 1,146 new ART clients at MPC to yield a cohort of 501 2wT participants who were eligible and enrolled in the intervention, an intervention reach of 44% (Fig 3). The most common reasons for ineligibility were lack of phone access (393, 61%), illiteracy (149, 23%), and age under 18 years (48, 7%). Of the 501 enrolled participants, 468 (94%) were exposed to the intervention and included in the analysis. The majority of 2wT participants were female (56%), had an average age of 33 years, and WHO HIV stages 1 or 2. Among 2wT participants, 373 (80%) were enrolled at the ART initiation visit while the remaining 95 (20%) were enrolled during a subsequent visit, on average 99 days (standard deviation (SD): 53 days) after ART initiation. The matching process successfully created similarity in matched demographic and clinical characteristics between 2wT and SoC groups (Table 1).
ART: Antiretroviral therapy; 2wT: Two-way texting.
2wT platform engagement
During the study period, the 2wT platform recorded a total of 31,861 messages (Fig 4). The 2wT system sent 27,859 SMS (87%): 18,093 motivational messages (65%); 4,561 visit reminders (16%); 1,468 missed visit reminders (5%); and 3,737 other messages (13%) (Fig 4). The delivery success rate was 76% for motivation messages; 79% for visit reminders; and 75% for missed appointment reminders. Of all 31,862 messages, 4,002 messages (13%) were sent by participants. Participants responded to 39% of successfully delivered pre-visit reminders (proactive) and 32% of successfully delivered post-missed visit reminders (reactive). Of 16 (3%) participants who requested to stop 2wT messaging, 5 lost interest (31%), 5 noted confidentiality concerns (31%), and 3 noted no longer needing texts to remember their appointments (19%) as reasons to stop.
MoH-defined ART outcomes at 6 and 12 months
The distribution of ART outcomes differed between the 2wT and SoC arm six months post-ART initiation (p<0.001) (Table 2). Six months post-ART initiation, 88% were alive and in care in the 2wT arm as compared to 76% in the SoC arm. The 2wT arm had lower LTFU (5% vs. 11%) and lower stopped treatment (1% vs. 5%) than SoC, respectively. Differences persisted at 12 months post-ART initiation (p<0.001). In the 2wT arm, 81% of participants were alive and in care as compared to 66% of SoC. The 2wT arm had lower LTFU (7% vs 18%) and stopped treatment (2% vs 6%) compared to SoC. Roughly equal percentages of 2wT and SoC participants had transferred out (8% vs 9%) or died (2% vs 2%) at twelve months.
Kaplan-Meier retention plots (alive and on ART) in the first 12 months on ART
Kaplan-Meier curves revealed differences in retention on ART over time between the 2wT and the SoC arm (p<0.001) (Fig 5A). In survival analysis, the probability of being retained on ART six months post-ART initiation in the 2wT group was 92% (95% CI: 90% - 95%) compared to 79% (95%CI: 75% - 83%) in the SoC group, corresponding to a probability of dropout at six months of 8% and 21%, respectively. At twelve months, the probability of retention on ART was 91% among 2wT participants (95% CI: 88% - 94%) and 76% among SoC participants (95% CI: 72% - 80%), corresponding to a probability of dropout at twelve months of 9% and 24%, respectively.
A: Kaplan-Meier curve of retention on ART among 2wT and SoC clients over time, displaying 95% confidence intervals and log-rank test p-value. B: Cumulative Incidence Function of ART dropout (LTFU and stopping ART treatment) among 2wT and SoC clients over time.
2wT effectiveness: Competing risks analysis
After accounting for competing risks, cumulative incidence functions (CIFs) demonstrated probabilities of dropout consistent with Kaplan-Meier results (Fig 5B): 8% for 2wT compared to 21% for SoC at six months, and 9% for 2wT compared to 24% for SoC at twelve months. The results indicate higher retention among 2wT as compared to SoC clients. In unadjusted Fine-Gray competing risk regression analysis, being in the 2wT arm was associated with a 65% lower hazard of ART dropout at any point during follow-up (sHR 0.35, 95%CI: 0.24–0.51) as compared to SoC. Controlling for sex, age and WHO HIV stage in adjusted analysis, a similar positive effect of 2wT compared to SoC on dropout was found (sHR 0.35, 95% CI: 0.24–0.51). In adjusted analysis, being female was associated with a 29% lower hazard of dropout from ART care as compared to being male (sHR 0.71, 95% CI 0.52–0.99). Each additional year of age was associated with a 4% reduction in the hazard of dropout (sHR 0.96, 95% CI:0.94–0.98). There was no difference in the hazard of ART dropout comparing individuals with WHO HIV stage 1 and 2 and those with WHO HIV stage 3 at ART initiation (sHR 0.98, 95% CI 0.60–1.58) or those with WHO stage 4 (sHR 1.24, 95% CI 0.66–2.31).
Discussion
As a result of the combined motivation messages and automated visit reminders of the 2wT intervention, retention in ART care at 12 months was 15% higher among 2wT participants as compared to SoC clients. At any point over the first year on ART, those with 2wT support were 65% less likely to drop out of ART care compared to their SoC peers. For both 2wT and SoC, women were less likely to drop out than men, and older clients were more likely to be retained. Improved retention among 2wT participants is most striking in the first months immediately after ART initiation, a high risk period when care gaps are most likely [39]. Still, 2wT effectiveness should not eclipse limitations in 2wT reach: over 50% of those invited to participate were ineligible, largely due to lack of phone access or illiteracy. This evidence informs discussion of the strengths and weaknesses of the 2wT approach and provides guidance for transitioning the optimization of 2wT from research to routine practice.
Several aspects of 2wT design likely contributed to success. First, we used a human-centered, co-design process with clients, HCWs, and stakeholders, informing iterative improvements that likely raised the likelihood of matching the right 2wT design to the expressed local need [61]. For participants, the 2wT approach was perceived as user-friendly, responses were easy, and both motivational and visit reminders were appreciated [42]. For HCWs, 2wT was highly usable and was perceived to improve their connection with participants, reflecting their needs [55]. Lighthouse HCWs currently maintain the day-to-day operations and management of the 2wT system independently, factors that enhance the likelihood of sustaining the intervention [62]. The open-source 2wT technology, itself, appears to be the right fit for the low-resource setting. Most participants do not have access to a smartphone and 2wT requires only basic phones with SMS capability (no smartphones, no need to download apps, no data plan) and has a web-based interface for HCWs that runs on commonly available PC computers and Android tablets. The workload also meets the low resource setting. Currently, one 2wT officer handles all client interaction for over 400 participants as compared to SoC where each ART Buddy is assigned up to 15 new ART clients. The hybrid automated and manual 2wT design relies heavily on automated 2wT reminders, both before visits and after missed appointments, keeping the workload of direct participant-HCW interaction within manageable levels.
The intervention messages and their scheduling also likely improved outcomes. First, 2wT messages were informed by health behavior theory, adapting the messages alongside software optimization to increase the strength of both [63]. Over two decades of research demonstrates the importance of having a strong theoretical model to provide rationale for how interventions may influence behaviors [64]. We suggest that 2wT content helped improve participant motivation, behavioral control, and self-efficacy, hoping to create positive habits of ART adherence from initiation onward. Second, the cadence of 2wT messaging intensity appears to suit participants. Although other mHealth with weekly response-requested messaging found no effect on 12-month retention [65], 2wT included weekly motivational or education messages without requesting a response and only required participants to interact with the system or HCWs with a single “1 = yes” or 0 = no” to confirm visits a few days before appointments, with option to interact more if needed or desired. The 2wT nudge and minimal participant effort likely lessened the potential fatigue that more messages could cause [13]. Furthermore, a previous mHealth qualitative study noted that fears of unintended disclosure from HIV-related message content could reduce SMS intervention participation or uptake [11]. Using suggestions from current 2wT users, 2wT may have found the right type of mixed educational and motivational content, without HIV-related messaging.
Despite effectiveness, effort will be needed to expand 2wT reach as only 44% of those screened for participation met the 2wT eligibility criteria. Current access in Malawi to mobile phones in 2022 was estimated at 60% [66] with access among females likely lower [67]. However, growth in mobile phone ownership is expected to rise, potentially reducing these concerns in future. Likewise, as more than 25% of adults in Malawi are unable to read or write [68], future voice functionality in 2wT or improved “flash” features (calling a number to trigger a voice call back) could expand reach in response to low literacy client needs [13]. As 2wT participants noted a preference for SMS over calls, given that messages are discrete and do not require a participant to pick up or attend to them at a specific time [42], voice should not replace SMS, but augment existing options. Additive retention models, where clients can have more than one retention support may also lead to gains [12], improving reach and impact as 2wT moves from research to routine practice. 2wT should complement rather than replace other retention support initiatives such as the SoC ART buddies, whose firsthand experience navigating challenges related to HIV may provide a valuable source of peer-support for newly initiated clients. Expanding enrolment into 2wT for any client on ART, and including clients ages 15 and older (the age of consent in Malawi) combined with efforts to improve 2wT awareness among LT clients who come on evenings and weekends (when study team were not available) could improve uptake of 2wT retention support. A forthcoming costing study of 2wT versus SoC retention approaches will shed light on the feasibility and cost-effectiveness of expanding 2wT and ART Buddy support [69], providing Lighthouse with guidance to drive retention program decision-making.
Limitations
Our findings should be considered in light of limitations. First, it is possible that 2wT effect could diminish over time [70], and future studies of 2wT reach adaptation, flexibility, or optimization should explore how to maintain the early retention gains. Second, despite successful matching, using a historical comparison group may pose a threat to internal validity, especially given the different temporal influences of COVID-19 on participants. Third, the extent to which the two study cohorts received the intended retention support, i.e., whether 2wT participants actually received 2wT (were SMS read?) or whether PLHIV buddies actually called SoC participants (did ART Buddies provide intended support?) is unknown, calling for future fidelity investigation of both 2wT and SoC interventions in practice. Moreover, 2wT was opt-in, allowing those who were eligible and interested to volunteer for the retention support. Participants who choose an intervention are likely more open and responsive to the support. Additionally, 20% of 2wT participants were enrolled during a subsequent clinic visit after their ART initiation, which may have introduced selection bias. These participants, by virtue of still being in care at that point in time, likely represent a group with greater engagement than general ART population, which includes clients who do not attend care beyond their initiation visit. Inclusion of CD4 count data was not possible due to large quantities of missing data; however, consideration of CD4 data would be valuable in future analysis when CD4 machines are integrated with EMRS, providing quality data. Lastly, we did not include the outcomes of those who transferred out as we lacked resources to track clients to other clinics. Despite these limitations, the strengths of this quasi-experimental design in the routine Malawi ART setting suggests that this specific 2wT approach may be beneficial to improve early retention among the sizeable population who wish to opt-in.
Conclusions
At a high-volume, routine ART clinic in Malawi, the proactive, low-intensity 2wT approach improved 12-month retention among new ART initiates who enrolled. 2wT should be scaled as a part of, and not a replacement for, complementary retention efforts in routine ART settings in Malawi. Even with sub-optimal reach, adoption the 2wT approach as a component of routine retention efforts could benefit the ART client population as a whole by freeing existing HCWs to trace more clients presumed LTFU, returning more clients to care. More retention choices could also help cater to the diverse preferences and practicalities of retaining clients on ART over time. Given the large client volume of LT clinics, Lighthouse’s leadership, and continued MoH collaboration, expansion of the 2wT retention approach for both new and existing ART clients could positively impact overall ART program success at scale.
Supporting information
S1 File. Dataset.
Retention outcomes dataset in CSV format.
https://doi.org/10.1371/journal.pone.0298494.s001
(CSV)
Acknowledgments
We would like to acknowledge the study participants, the study team (Kondwani Masiye, Harrison Chirwa, Blessings Wandira, Daniel Mwakanema, Madalitso Chawanje, William Maziya, Isaac Nyirenda), colleagues from Medic (Maryanne Mureithi, Femi Oni, Beatrice Wasunna, Edwin Kagereki, Adinan Alhassan, Kawere Wagaba, Evelyn Waweru, and Mourice Barasa), the MPC clinic, M&E teams, B2C team, and MoH staff at Bwaila for their invaluable contribution to the study.
References
- 1.
UNAIDS. GLOBAL AIDS STRATEGY 2021–2026 END INEQUALITIES. END AIDS.2021. Available from: https://www.unaids.org/en/resources/documents/2021/2021-2026-global-AIDS-strategy.
- 2. Chammartin F, Zurcher K, Keiser O, Weigel R, Chu K, Kiragga AN, et al. Outcomes of Patients Lost to Follow-up in African Antiretroviral Therapy Programs: Individual Patient Data Meta-analysis. Clin Infect Dis. 2018;67(11):1643–52. Epub 2018/06/12. pmid:29889240
- 3. Muhula S, Gachohi J, Kombe Y, Karanja S. Interventions to improve early retention of patients in antiretroviral therapy programmes in sub-Saharan Africa: A systematic review. PloS one. 2022;17(2):e0263663. Epub 2022/02/10. pmid:35139118
- 4.
UNAIDS. IN DANGER: UNAIDS Global AIDS Update 20222022. Available from: https://www.unaids.org/sites/default/files/media_asset/2022-global-aids-update_en.pdf.
- 5. Beres LK, Mody A, Sikombe K, Nicholas LH, Schwartz S, Eshun-Wilson I, et al. The effect of tracer contact on return to care among adult, “lost to follow-up” patients living with HIV in Zambia: an instrumental variable analysis. Journal of the International AIDS Society. 2021;24(12):e25853. pmid:34921515
- 6. Mirzazadeh A, Eshun-Wilson I, Thompson RR, Bonyani A, Kahn JG, Baral SD, et al. Interventions to reengage people living with HIV who are lost to follow-up from HIV treatment programs: A systematic review and meta-analysis. PLOS Medicine. 2022;19(3):e1003940. Epub pmid:35290369.
- 7. Bershteyn A, Jamieson L, Kim H, Milali M, Brink D, Martin-Huges M. Modeling the impact and cost-effectiveness of interventions for retention in HIV care. CROI. 2022.
- 8.
World Health Organization. WHO guideline: recommendations on digital interventions for health system strengthening: web supplement 2: summary of findings and GRADE tables. World Health Organization, 2019.
- 9. Mayer JE, Fontelo P. Meta-analysis on the effect of text message reminders for HIV-related compliance. AIDS care. 2017;29(4):409–17. Epub 2016/08/02. pmid:27477580
- 10. Kruse C, Betancourt J, Ortiz S, Valdes Luna SM, Bamrah IK, Segovia N. Barriers to the Use of Mobile Health in Improving Health Outcomes in Developing Countries: Systematic Review. J Med Internet Res. 2019;21(10):e13263. Epub 2019/10/09. pmid:31593543
- 11. Ronen K, Unger JA, Drake AL, Perrier T, Akinyi P, Osborn L, et al. SMS messaging to improve ART adherence: perspectives of pregnant HIV-infected women in Kenya on HIV-related message content. AIDS care. 2018;30(4):500–5. Epub 2017/12/20. pmid:29254362
- 12. Kanters S, Park JJ, Chan K, Socias ME, Ford N, Forrest JI, et al. Interventions to improve adherence to antiretroviral therapy: a systematic review and network meta-analysis. The lancet HIV. 2017;4(1):e31–e40. Epub 2016/11/20. pmid:27863996
- 13. Amankwaa I, Boateng D, Quansah DY, Akuoko CP, Evans C. Effectiveness of short message services and voice call interventions for antiretroviral therapy adherence and other outcomes: A systematic review and meta-analysis. PloS one. 2018;13(9):e0204091. Epub 2018/09/22. pmid:30240417
- 14. Demena BA, Artavia-Mora L, Ouedraogo D, Thiombiano BA, Wagner N. A Systematic Review of Mobile Phone Interventions (SMS/IVR/Calls) to Improve Adherence and Retention to Antiretroviral Treatment in Low-and Middle-Income Countries. AIDS Patient Care STDS. 2020;34(2):59–71. Epub 2020/02/13. pmid:32049555
- 15. Linnemayr S, Huang H, Luoto J, Kambugu A, Thirumurthy H, Haberer JE, et al. Text messaging for improving antiretroviral therapy adherence: no effects after 1 year in a randomized controlled trial among adolescents and young adults. American journal of public health. 2017;107(12):1944–50. pmid:29048966
- 16. Mehra N, Tunje A, Hallström IK, Jerene D. Effectiveness of mobile phone text message reminder interventions to improve adherence to antiretroviral therapy among adolescents living with HIV: A systematic review and meta-analysis. PloS one. 2021;16(7):e0254890. pmid:34293033
- 17. Gross R, Ritz J, Hughes MD, Salata R, Mugyenyi P, Hogg E, et al. Two-way mobile phone intervention compared with standard-of-care adherence support after second-line antiretroviral therapy failure: a multinational, randomised controlled trial. Lancet Digit Health. 2019;1(1):e26–e34. Epub 2019/09/19. pmid:31528850
- 18. Kemp CG, Velloza J. Implementation of eHealth Interventions Across the HIV Care Cascade: a Review of Recent Research. Curr HIV/AIDS Rep. 2018;15(6):403–13. Epub 2018/09/02. pmid:30171519
- 19. Kinuthia J, Ronen K, Unger JA, Jiang W, Matemo D, Perrier T, et al. SMS messaging to improve retention and viral suppression in prevention of mother-to-child HIV transmission (PMTCT) programs in Kenya: A 3-arm randomized clinical trial. PLoS Med. 2021;18(5):e1003650. Epub 2021/05/25. pmid:34029338
- 20. Wang Z, Zhu Y, Cui L, Qu B. Electronic health interventions to improve adherence to antiretroviral therapy in people living with HIV: Systematic review and meta-analysis. JMIR mHealth and uHealth. 2019;7(10):e14404. Epub 20191016. pmid:31621641
- 21. Linde DS, Korsholm M, Katanga J, Rasch V, Lundh A, Andersen MS. One-way SMS and healthcare outcomes in Africa: Systematic review of randomised trials with meta-analysis. PloS one. 2019;14(6):e0217485. Epub 2019/06/07. pmid:31170176
- 22. Georgette N, Siedner MJ, Zanoni B, Sibaya T, Petty CR, Carpenter S, Haberer JE. The Acceptability and Perceived Usefulness of a Weekly Clinical SMS Program to Promote HIV Antiretroviral Medication Adherence in KwaZulu-Natal, South Africa. AIDS and behavior. 2016;20(11):2629–38. Epub 2016/10/21. pmid:26781866
- 23. Pienaar J, Day S, Setswe G, Wasunna B, Ncube V, Ndebele F, et al. ‘I understood the texting process well’. Participant perspectives on usability and acceptability of SMS-based telehealth follow-up after voluntary medical male circumcision in South Africa. DIGITAL HEALTH. 2023;9:20552076231194924. Epub 2023/09/01. pmid:37654716
- 24. Feldacker C, Holeman I, Murenje V, Xaba S, Korir M, Wambua B, et al. Usability and acceptability of a two-way texting intervention for post-operative follow-up for voluntary medical male circumcision in Zimbabwe. PloS one. 2020;15(6):e0233234. Epub 2020/06/17. pmid:32544161
- 25. Holeman I, Kane D. Human-centered design for global health equity. Information Technology for Development. 2020;26(3):477–505.
- 26. Odegard ES, Langbraten LS, Lundh A, Linde DS. Two-way text message interventions and healthcare outcomes in Africa: Systematic review of randomized trials with meta-analyses on appointment attendance and medicine adherence. PloS one. 2022;17(4):e0266717. Epub 2022/04/15. pmid:35421134
- 27. Wald DS, Butt S, Bestwick JP. One-way versus two-way text messaging on improving medication adherence: meta-analysis of randomized trials. Am J Med. 2015;128(10):1139 e1-5. Epub 2015/06/19. pmid:26087045
- 28. Huang F, Blaschke S, Lucas H. Beyond pilotitis: taking digital health interventions to the national level in China and Uganda. Global Health. 2017;13(1):49. Epub 2017/08/02. pmid:28756767
- 29. Shah R, Watson J, Free C. A systematic review and meta-analysis in the effectiveness of mobile phone interventions used to improve adherence to antiretroviral therapy in HIV infection. BMC public health. 2019;19(1):915. Epub 20190709. pmid:31288772
- 30. World Health Organization. Monitoring and Evaluating Digital Health Interventions: A practical guide to conducting research and assessment2016 [cited 2021. Available from: https://apps.who.int/iris/bitstream/handle/10665/252183/9789241511766-eng.pdf.
- 31.
World Health Organization. Technical update: considerations for developing a monitoring and evaluation framework for viral load testing: collecting and using data for scale-up and outcomes. World Health Organization, 2019.
- 32.
UNAIDS. Country Overview: Malawi Geneva: UNAIDS; 2022 [cited 2023 August 6]. Available from: https://www.unaids.org/en/regionscountries/countries/malawi.
- 33. Mugglin C, Haas AD, van Oosterhout JJ, Msukwa M, Tenthani L, Estill J, et al. Long-term retention on antiretroviral therapy among infants, children, adolescents and adults in Malawi: A cohort study. PloS one. 2019;14(11):e0224837. pmid:31725750
- 34. Fox MP, Rosen S. Retention of Adult Patients on Antiretroviral Therapy in Low- and Middle-Income Countries: Systematic Review and Meta-analysis 2008–2013. J Acquir Immune Defic Syndr. 2015;69(1):98–108. Epub 2015/05/06. pmid:25942461
- 35. Muula AS. The paradox of Malawi’s health workforce shortage: pragmatic and unpopular decision are needed. Malawi Medical Journal. 2023;35(1):1–2.
- 36. Phiri S, Neuhann F, Glaser N, Gass T, Chaweza T, Tweya H, Lighthouse G. The path from a volunteer initiative to an established institution: evaluating 15 years of the development and contribution of the Lighthouse trust to the Malawian HIV response. BMC health services research. 2017;17(1):548. Epub 2017/08/11. pmid:28793895
- 37. Weigel R, Hochgesang M, Brinkhof MW, Hosseinipour MC, Boxshall M, Mhango E, et al. Outcomes and associated risk factors of patients traced after being lost to follow-up from antiretroviral treatment in Lilongwe, Malawi. BMC infectious diseases. 2011;11(1):31. pmid:21272350
- 38. Tweya H, Oboho IK, Gugsa ST, Phiri S, Rambiki E, Banda R, et al. Loss to follow-up before and after initiation of antiretroviral therapy in HIV facilities in Lilongwe, Malawi. PloS one. 2018;13(1):e0188488. pmid:29373574
- 39. Weigel R, Estill J, Egger M, Harries AD, Makombe S, Tweya H, et al. Mortality and loss to follow-up in the first year of ART: Malawi national ART programme. AIDS. 2012;26(3):365–73. Epub 2011/11/19. pmid:22095194
- 40. Tweya H, Feldacker C, Estill J, Jahn A, Ng’ambi W, Ben-Smith A, et al. Are they really lost?“True” status and reasons for treatment discontinuation among HIV infected patients on antiretroviral therapy considered lost to follow up in urban Malawi. PloS one. 2013;8(9):e75761. pmid:24086627
- 41. Tweya H, Gareta D, Chagwera F, Ben‐Smith A, Mwenyemasi J, Chiputula F, et al. Early active follow‐up of patients on antiretroviral therapy (ART) who are lost to follow‐up: the ‘Back‐to‐Care’project in Lilongwe, Malawi. Tropical Medicine & International Health. 2010;15:82–9. pmid:20586965
- 42. Huwa J, Tweya H, Mureithi M, Kiruthu-Kamamia C, Oni F, Chintedza J, et al. “It reminds me and motivates me”: Human-centered design and implementation of an interactive, SMS-based digital intervention to improve early retention on antiretroviral therapy: Usability and acceptability among new initiates in a high-volume, public clinic in Malawi. PloS one. 2023;18(7):e0278806. Epub 2023/07/20. pmid:37471383
- 43. Holtrop JS, Estabrooks PA, Gaglio B, Harden SM, Kessler RS, King DK, et al. Understanding and applying the RE-AIM framework: Clarifications and resources. J Clin Transl Sci. 2021;5(1):e126. Epub 2021/08/10. pmid:34367671
- 44. Glasgow RE, Harden SM, Gaglio B, Rabin B, Smith ML, Porter GC, et al. RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review. Front Public Health. 2019;7(64):64. Epub 2019/04/16. pmid:30984733
- 45. Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. The joint commission journal on quality and patient safety. 2008;34(4):228–43.
- 46.
Malawi Ministry of Health. Government of Malawi Ministry of Health Integrated HIV Program Report 2022 Q12022. Available from: https://dms.hiv.health.gov.mw/dataset/malawi-integrated-hiv-program-report-2022-q1/resource/44d5a99e-1745-4a4e-b973-37f45caad990.
- 47. Bansi-Matharu L, Mudimu E, Martin-Hughes R, Hamilton M, Johnson L, Ten Brink D, et al. Cost-effectiveness of voluntary medical male circumcision for HIV prevention across sub-Saharan Africa: results from five independent models. Lancet Glob Health. 2023;11(2):e244–e55. Epub 2022/12/24. pmid:36563699
- 48.
Fogg BJ, editor A behavior model for persuasive design. Proceedings of the 4th international Conference on Persuasive Technology; 2009.
- 49. Bandura A. Health promotion from the perspective of social cognitive theory. Psychology and health. 1998;13(4):623–49.
- 50.
Fishbein M, Ajzen I. Predicting and changing behavior: The reasoned action approach: Taylor & Francis; 2011.
- 51.
Glanz K, Rimer BK, Viswanath K. Health behavior and health education: theory, research, and practice: John Wiley & Sons; 2008.
- 52. Godin G, Kok G. The theory of planned behavior: a review of its applications to health-related behaviors. Am J Health Promot. 1996;11(2):87–98. Epub 1996/10/04. pmid:10163601
- 53.
Principles for Digital Development. Principles for Digital Development 2022 [cited 2022 August 2022]. Available from: https://digitalprinciples.org/.
- 54.
CHT Core Framework. Community Health Toolkit,. 4.5.0 ed: Medic; 2023.
- 55. Mureithi M, Ng’aari L, Wasunna B, Kiruthu-Kamamia C, Sande O, Chiwaya GD, et al. Centering healthcare workers in digital health design: Usability and acceptability of two-way texting to improve retention in antiretroviral therapy in a public HIV clinic in Lilongwe, Malawi. PLOS Digital Health. 2024;3(4):e0000480. Epub pmid:38568904.
- 56.
Malawi Ministry of Health. Clinical management of HIV in children and adults. Malawi Integrated Guidelines and Standard Operating Procedures for Providing HIV Services. Lilongwe: Ministry of Health, Malawi 2022.
- 57. Phillips TK, Orrell C, Brittain K, Zerbe A, Abrams EJ, Myer L. Measuring retention in HIV care: the impact of data sources and definitions using routine data. AIDS. 2020;34(5):749–59. Epub 2020/02/01. pmid:32004202
- 58. Rosen S, Fox MP, Gill CJ. Patient retention in antiretroviral therapy programs in sub-Saharan Africa: a systematic review. PLoS Med. 2007;4(10):e298. Epub 2007/10/19. pmid:17941716
- 59. Lau B, Cole SR, Gange SJ. Competing risk regression models for epidemiologic data. American journal of epidemiology. 2009;170(2):244–56. pmid:19494242
- 60. Fine JP, Gray RJ. A proportional hazards model for the subdistribution of a competing risk. Journal of the American statistical association. 1999;94(446):496–509.
- 61. Johnston W, Keogh A, Dickson J, Leslie SJ, Megyesi P, Connolly R, et al. Human-Centered Design of a Digital Health Tool to Promote Effective Self-care in Patients With Heart Failure: Mixed Methods Study. JMIR Form Res. 2022;6(5):e34257. Epub 2022/05/11. pmid:35536632
- 62. Mamuye A, Nigatu AM, Chanyalew MA, Amor LB, Loukil S, Moyo C, et al. Facilitators and Barriers to the Sustainability of eHealth Solutions in Low-and Middle-Income Countries: Descriptive Exploratory Study. JMIR Formative Research. 2023;7:e41487. Epub pmid:37171865.
- 63. Moller AC, Merchant G, Conroy DE, West R, Hekler E, Kugler KC, Michie S. Applying and advancing behavior change theories and techniques in the context of a digital health revolution: proposals for more effectively realizing untapped potential. J Behav Med. 2017;40(1):85–98. Epub 2017/01/07. pmid:28058516
- 64. Fishbein M. The role of theory in HIV prevention. AIDS care. 2000;12(3):273–8. Epub 2000/08/06. pmid:10928203
- 65. van der Kop ML, Muhula S, Nagide PI, Thabane L, Gelmon L, Awiti PO, et al. Effect of an interactive text-messaging service on patient retention during the first year of HIV care in Kenya (WelTel Retain): an open-label, randomised parallel-group study. Lancet Public Health. 2018;3(3):e143–e52. Epub 2018/01/24. pmid:29361433
- 66.
Statista. Number of mobile cellular subscriptions per 100 inhabitants in Malawi from 2000 to 2022 2023 [updated July 2023January 10, 2024]. Available from: https://www.statista.com/statistics/509554/mobile-cellular-subscriptions-per-100-inhabitants-in-malawi/.
- 67. Anto-Ocrah M, Latulipe RJ, Mark TE, Adler D, Zaihra T, Lanning JW. Exploring association of mobile phone access with positive health outcomes and behaviors amongst post-partum mothers in rural Malawi. BMC Pregnancy Childbirth. 2022;22(1):485. Epub 2022/06/14. pmid:35698066
- 68.
UNICEF. Malawi Education Fact Sheet Geneva: UNICEF; 2022 [cited 2023 March 17]. Available from: https://data.unicef.org/wp-content/uploads/2022/12/2022Malawi_Factsheet_InDesign-FINAL-2.pdf.
- 69. Kiruthu-Kamamia C, Weldemariam H, Chipanda M, Jacqueline Huwa D, Johnnie S, Harrison C, et al. Cost-effectiveness analysis of two-way texting (2wT) intervention to improve ART retention among newly-initiated antiretroviral therapy clients in Malawi. medRxiv. 2024:2024.04.17. pmid:38699324. Epub 20240419.
- 70. Nordberg B, Kaguiri E, Chamorro de Angeles KJ, Gabriel EE, van der Kop ML, Mwangi W, et al. The use, adherence, and evaluation of interactive text-messaging among women admitted to prevention of mother-to-child transmission of HIV care in Kenya (WelTel PMTCT). BMC Pregnancy and Childbirth. 2024;24(1):25. Epub pmid:38172881.