The efficacy of antiretroviral therapy depends on patient adherence to a daily medication regimen, yet many patients fail to adhere at high enough rates to maintain health and reduce the risk of transmitting HIV. Given the explosive global growth of cellular-mobile phone use, text-messaging interventions to promote adherence are especially appropriate. This meta-analysis synthesized available text messaging interventions to promote antiretroviral therapy adherence in people living with HIV.
We performed Boolean searches of electronic databases, hand searches of recent year conference abstracts and reverse searches. Included studies (1) targeted antiretroviral therapy adherence in a sample of people living with HIV, (2) used a randomized-controlled trial design to examine a text messaging intervention, and (3) reported at least one adherence measurement or clinical outcome.
Eight studies, including 9 interventions, met inclusion criteria. Text-messaging interventions yielded significantly higher adherence than control conditions (OR = 1.39; 95% CI = 1.18, 1.64). Sensitivity analyses of intervention characteristics suggested that studies had larger effects when interventions (1) were sent less frequently than daily, (2) supported bidirectional communication, (3) included personalized message content, and (4) were matched to participants’ antiretroviral therapy dosing schedule. Interventions were also associated with improved viral load and/or CD4+ count (k = 3; OR = 1.56; 95% CI = 1.11, 2.20).
Text-messaging can support antiretroviral therapy adherence. Researchers should consider the adoption of less frequent messaging interventions with content and timing that is individually tailored and designed to evoke a reply from the recipient. Future research is needed in order to determine how best to optimize efficacy.
Citation: Finitsis DJ, Pellowski JA, Johnson BT (2014) Text Message Intervention Designs to Promote Adherence to Antiretroviral Therapy (ART): A Meta-Analysis of Randomized Controlled Trials. PLoS ONE 9(2): e88166. doi:10.1371/journal.pone.0088166
Editor: Alan Winston, Imperial College London, United Kingdom
Received: August 15, 2013; Accepted: January 6, 2014; Published: February 5, 2014
Copyright: © 2014 Finitsis et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was supported by U.S. Public Health Service Institutional National Research Service Award T32-MH074387 (PI: Seth C. Kalichman; trainees: David J. Finitsis and Jennifer A. Pellowski) and grant R01-MH58563 (PI: Blair T. Johnson). http://www.nimh.nih.gov/. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The efficacy of antiretroviral therapy (ART) depends on patient adherence to a daily medication regimen, yet many patients fail to adhere at high enough rates to maintain health and reduce the risk of transmitting HIV , . In one recent meta-analysis of 84 observational studies, nearly 40% of participants reported less than 90% adherence . For the individual, poor ART adherence can lead to quicker progression of HIV to AIDS ,  while increasing the potential for the development of ART-resistant viral strains –. Drug-resistant strains of HIV virus may then be spread from the individual to community level through sexual and injection drug use networks , . Promoting adherence sufficient to achieve viral suppression helps to create optimal outcomes in both individual and public health.
The current standard of care in promoting adherence is patients’ contact with their health care providers. Although research on adherence behavior shows the importance of adherence counseling on biological outcomes (e.g., viral load, CD4+ levels) implementation costs prove increasingly onerous as healthcare providers continue to be pressured to do “more with less” both in developed countries  and in resource-limited settings . A number of reviews support the efficacy of behavioral interventions to promote ART adherence –, yet these interventions have diverse approaches and variable financial costs. In order to translate effectively, the practice community requires effective interventions that minimize the necessary financial burden to implement .
One promising approach is the use of electronic text-messaging to deliver behavioral interventions . In the last decade, mobile-cellular phone ownership has seen marked growth throughout the world . Presently, there are nearly as many mobile-cellular phone subscriptions as there are people in the world; in the developing world, there are 89 subscriptions for every 100 people . In a recent systematic review, Horvath and colleagues (2012) found high quality evidence of efficacy in interventions using short weekly messages  and World Health Organization guidelines include a strong recommendation to consider text messaging “for promoting adherence to ART as part of a package of adherence interventions .” Text-messaging provides researchers with the flexibility of personalizing message content, promoting bidirectional communication, and pairing message timing to ART dosage schedules –. The fact that there are so many variations of intervention design in text-messaging trials makes it unclear what specific ingredients actively and successfully promote adherence. Moreover, there are numerous studies currently in early phases of development and implementation that rely on messaging strategies . A quantitative comparison of text-message intervention designs to promote ART adherence is therefore timely.
Intervention trials reported in English were included if they (1) targeted ART adherence in a sample of people living with HIV (PLWH), (2) used a randomized-controlled trial to examine an electronic text messaging intervention, and (3) reported at least one adherence measurement (i.e., self-report, pill count, electronic drug monitoring device, pharmacy refill) or biological outcome (i.e., viral load, CD4+ count). Studies were excluded when reported data were insufficient to calculate effect sizes and contacted authors were unable to provide the necessary additional data. Listings of excluded studies with justification for exclusion are included as supplemental tables in Appendix S2 and S3.
Relevant studies were located through multiple strategies. We conducted serial searches of PsycINFO, PubMed, CINAHL, and ProQuest Dissertations and Theses for the years 1990 through October 2013, using Boolean strategy with the following terms: (cellphone OR “cellular phone” OR “mobile phone” OR “text message” OR “simple message service” OR SMS OR pager OR “two-way electronic messaging system”) AND (HIV OR HIV+ OR HIV-positive OR “people living with HIV/AIDS” OR “human immunodeficiency virus positive” OR “human immunodeficiency virus-positive” OR PLWHA) AND (“highly active antiretroviral therapy” OR “antiretroviral therapy” OR ART OR HAART) AND (adherence OR “medication adherence” OR MNA OR “medication non-adherence”). Unpublished literature was sought both through the ProQuest electronic database described above and through reviewing abstracts from conferences with a focus on HIV and adherence over the past five years and contacting authors to request inclusion of their work in this synthesis. Finally, the reference sections of all relevant studies were searched for any additional relevant literature. The numbers of results returned by each electronic database are included in Appendix S1.
Coding of Interventions
Two reviewers independently abstracted data from the studies using a standardized coding form, including general information (e.g., trial location, year of data collection), participant characteristics (e.g., age, gender, race/ethnicity, baseline lab values), design parameters (e.g., length of intervention, type of control condition), messaging intervention features (e.g., device type, messaging frequency, unidirectional vs. bidirectional), and outcomes (e.g., method and frequency of assessment for adherence). Across coded variables there was a 94% reviewer agreement rate; coding discrepancies were reconciled through discussion.
Risk of Bias of Individual Studies
Description of included studies’ methodological quality is an important facet of the systematic review. We assessed for risk of bias within individual studies using Downs and Black’s methodological quality scale , a 27-item instrument that assesses five dimensions of research methodology: reporting bias, external validity, measurement bias, confounding (selection bias), and statistical power. Two independent raters showed substantial  strength of agreement in their use of the instrument (kappa = 0.633; 95%CI = 0.515, 0.751; p<0.001). We report each of the instrument’s five sub-scales separately in order to provide a clearer appraisal of individual methodological elements than may be gained by a summary score . All elements of this research are reported in accordance with PRISMA guidelines .
Trials reported different numbers and types of outcomes; most reported multiple adherence outcomes (e.g., self-report, viral load). To uphold the assumption of independence, effect sizes (ESs) were averaged across adherence measures. When trials reported multiple follow up assessments, the last follow up was used in order to assess the greatest persistence and sustainability of the intervention effect. There was variation in the operationalization of adherence in this sample. Some studies reported outcomes entirely as continuous measures (k = 3), some in purely dichotomous terms (k = 4) and one reported a combination of continuous and dichotomous outcomes. For analyses, ESs were estimated with the standardized mean difference (d) ; ESs and inverse variance weights for each outcome were also calculated . Final meta-analytical tests of derived ESs were performed using SPSS version 20.0 . For presentation purposes, ESs were converted to ORs using the dCox transformation . ORs greater than 1 reflect improvement in adherence or biological outcome; those less than 1 reflect declination.
Weighted mean ESs were calculated to estimate overall difference between treatment and control groups  on adherence as well as on biological outcome variables (viral load and CD4+), as clinical impact is the desired endpoint of adherence. ESs were analyzed using random-effects assumptions and the magnitude of heterogeneity across ESs was assessed using the I2 statistic , which is known to have low statistical power when the number of available studies is small . There are now sufficient trials available to begin to evaluate the literature, to determine the consistency and magnitude of adherence gains, and to conduct sensitivity analyses that may provide clues as to the active ingredients necessary to create better adherence to ART. Based on recent qualitative and theoretical work –, we expected a priori that messaging interventions would work better when provided more frequently using messaging that was individually tailored, offered an opportunity for bidirectional communication between parties, and were timed to correspond to the patient’s ART dosing schedule. Analyses using the Q statistic as a measure of variance in a meta-analytic analog to the one-way ANOVA  assessed whether intervention characteristics across between-group interventions explained variability in the ESs, presented as stratified sensitivity analyses.
Eight studies – reporting 9 interventions met inclusion criteria (see Figure 1); Table 1 summarizes their features. The sample consists of 7 peer-reviewed journal articles and an unpublished dissertation, all written in English. Half (k = 4) of included studies were conducted in North America, 3 took place in Africa, and 1 in South America. Most data (70%) were collected during or after the year 2007 (range = 1999–2010). In total, 1,785 individuals consented and 1,463 (82%) of these were retained to at least one follow-up time point. The sample was 49% female and African participants made up 65% of the sample. Mean participant age was 40.00 years (range = 36.21–42.95). In those trials that reported it, mean baseline CD4+ was 291.83 cells/µL (SD = 107.46; k = 5) and viral load was 4.34 log10 copies/mL (SD = 0.32; k = 4).
Design and Intervention Characteristics
The average length of intervention was about six months (M = 177.49 days; range = 14–365). The mean number of outcomes reported was 2.33 (range = 1–4). The majority of interventions (k = 5) used multiple adherence measurements while three studies relied on a single form of adherence measurement: self-report  and electronic drug monitoring (EDM) , . Self-report and EDM were the most commonly used adherence measurements (k = 6), followed by biological measures (i.e., viral load, CD4+; k = 3). A minority of studies employed in-person pill counts (k = 2) or pharmacy refill data (k = 1) to operationalize adherence. Among the 6 (67%) interventions that dichotomized adherence, threshold values ranged from 80 to 100% (median = 95%).
Seven (78%) interventions used cellular-mobile phones – and two used two-way alphanumeric pagers , , with no statistically significant effect by device type observed (between groups Q = 0.56; p = 0.46). Messages were sent daily in 5 (56%) interventions. Message timing was matched to dosing schedule in 4 (44%) interventions. Three (33%) interventions personalized message content to the individual participant. Five (56%) interventions supported bidirectional communication in the design (i.e., participants were allowed, encouraged, or required to respond to incoming messages).
Did Text Messaging Improve Adherence?
Table 2 shows the weighted mean ESs across the outcome measures. Overall, the interventions significantly improved the average adherence outcome (k = 9; OR = 1.39; 95% CI = 1.18, 1.64). Table 2 also shows that mean effects on individual measures all fell within the confidence interval for the average effect; that is, the type of adherence measure appears not to have played a marked role in how large an effect appeared. Of note, biological outcomes also had a weighted mean effect size that achieved statistical significance (k = 3; OR = 1.56; 95% CI = 1.11, 2.20); individual outcome measures did not always achieve statistical significance, but it should be noted that the numbers of available studies limited statistical power. A forest plot depicting the distribution of individual study ESs, averaged across available adherence measures, appears in Figure 2. There was little indication of heterogeneity in the averaged effect sizes, and within individual measures there was only one case, CD4+ counts, that was significantly heterogeneous.
In Table 1, we report individual study scores on the five sub-scales of methodological quality assessed by the Downs and Black scale. Individual studies showed low risk of reporting bias overall (range of possible scores = 0–11; M = 9.25; SD = 1.58). There was also low risk of measurement bias (range of possible scores = 0–7; M = 5.25; SD = 0.71) and sampling bias (range of possible scores = 0–6; M = 4.62; SD = 1.19) among individual studies. However, external validity was low in most studies (range of possible scores = 0–3; M = 1.12; SD = 0.99) and a substantial proportion of individual studies (62.5%; k = 5) were underpowered.
Given the small sample size, determining moderators of ES magnitude would typically seem ill-advised; yet, an important question to be answered through this meta-analysis involves determining the active ingredients of the interventions. In addition, several design variations were fairly evenly distributed across studies in this review. We therefore stratified analyses across those intervention design parameters that were reasonably well-distributed in the sample. The results of these sensitivity analyses appear in Table 3. Studies were more likely to report larger effects when messaging interventions (1) were not sent daily, (2) supported bidirectional communication, (3) included personalized message content, and (4) were matched to participants’ ART dosing schedule. Although none of these patterns achieved statistical significance as sub-group analyses, the mean effect sizes for these categories were statistically significant whereas the effect size sometimes did not achieve significance when these categories were absent.
The main result of this meta-analysis is that text-messaging interventions improve HIV treatment outcomes. In this sample, compared to control groups, those receiving text messages’ support were more likely to maintain adherence thresholds at follow up and meet the clinical goals of lower viral load and higher CD4+ count (see Table 2). In addition, sensitivity analyses suggest that several design elements can enhance intervention effects further. Specifically, interventions messaging participants once or more times daily demonstrated smaller effects than interventions that messaged several times a week or weekly (Table 3). This apparent relationship between increased frequency and decreased response was contrary to our predictions but may have resulted from habituation, response fatigue and the possible intrusion that multiple daily messaging could represent. At the same time, it is not clear if the optimal “dosage” is somewhere between daily and weekly messaging or if a less than weekly messaging frequency would show the largest effects.
Another design element in need of further exploration is that of directionality. Designs that allowed, encouraged, or required message recipients’ response exhibited better outcomes than “one-way” reminder messages, which may have occurred because of enhanced engagement. Engagement is the “tuning in” of the recipient to the communication and has been identified as a necessary prerequisite for health behavior change . Greater engagement of the recipient with the message may take place when the recipient acknowledges or replies to the sender. Another possible factor is the extent to which bidirectional communication bolsters the patient-provider relationship, increasing trust . Evidence suggests that patients are better able to manage their care and are more likely to achieve adherence goals when they perceive their providers care about and like them , . It is possible that messaging back and forth with clinic staff sufficiently evokes a relationship dynamic as to further bolster the extant patient-provider relationship.
A third element of messaging design investigated here was that of individual tailoring of message content. Interventions that used participant input to generate personalized message content saw larger effects on outcomes than those that sent uniform messages to all participants. While providers are certainly the experts of disease, patients are the experts of themselves. Interventionists who sought the participants’ own words and preferences may have produced intervention content that was less intrusive and more relatable for participants.
The final facet of intervention design considered in this review is messaging that is matched to dosage timing. A greater effect was observed in studies where messaging corresponded to the time of an ART dose, an effect that seems akin to that of receiving a timed reminder . Although cellular phones typically have a built-in function allowing users to set multiple alarms, messaging paired to ART dosage lowers this barrier even further. Still, it is unclear how adoption of this element would correspond or conflict with the adoption of a less frequent messaging schedule overall and which element promotes the largest effect. These are all important areas for future research to explore.
There are several limitations of the current study. Although inclusion criteria were kept as broad as possible while maintaining focus on the research question, only 8 studies representing 9 interventions met inclusion criteria. Although 5 additional reports (see Appendix S2) met criteria for initial inclusion, reporting was insufficient for data abstraction (e.g., messaging interventions were bundled together with other co-interventions; only a conference abstract was available). Although we considered including these studies in the sample, we ultimately omitted them as too ambiguous. Whereas authors were contacted, none were able to provide additional data to allow inclusion of their work in this review. This small sample limitation raises a specter of publication bias and increases the importance of assessing for bias within individual studies. Yet, only 2 (22%) of the 9 intervention ESs reported herein are significant (Figure 2), which is not strongly suggestive of publication bias in itself given that all but one of the studies were subjected to peer-review. Using a validated methodological quality assessment tool  we concluded that there was low overall risk of bias in individual studies. Nonetheless, there were discrete areas of methodological weakness that do contribute limitations to the present study. External validity scores were low in this sample of studies as few studies used random sampling of a representative frame in their design. Moreover, most studies lacked sufficient statistical power to detect intervention effects. The developmental trajectory of intervention research is to first establish the efficacy of an intervention under internally valid conditions before expanding research to assess its effectiveness in a more ecologically valid setting. We felt that in the context of a burgeoning mHealth adherence intervention literature it was important to include all available studies in order to sample and compare the greatest diversity of intervention designs.
The sampling frame is another important contextualizing factor through which to view these findings. The majority of intervention trials sampled an ART-naïve HIV+ population and only 2 interventions targeted individuals with demonstrated non-adherence. It is unclear what effect a predominantly ART naïve sample may have had on the overall effect size estimates. If baseline adherence behavior approaches a normal distribution in this population, a “signal-noise” effect may occur with inherently adherent individuals in the intervention group attenuating the perceived effect, which has been observed elsewhere . Future research comparing the effects of messaging interventions in samples of ART naïve and ART “experienced” (i.e., those with documented nonadherence) PLWH can serve the process of translational research and the formulation of best practices.
Although the effect size associated with text-messaging is of fairly modest size, one should recognize that many of the control groups in the sampled trials received standard of care interventions, which logically would enhance adherence and thereby decrease the effect size in the treatment vs. control comparisons that the current meta-analysis examined . Future meta-analyses could capture this variance if change over time were examined instead of the between-groups comparison, and such an analysis would no doubt reveal a much larger effect size for text messaging in increasing adherence to highly active antiretroviral therapy.
Variation in the operationalization and measurement of adherence has been described before in the adherence literature ,  and remains a limitation of the present study. While means of assessing adherence have proliferated, a true “gold standard” of adherence measurement remains elusive with each method possessing both strengths and limitations , . Comparisons among different measurement strategies typically yield significantly correlated but not identical results –. In this review, the number and types of measurement varied across included studies; effects by individual outcome measure also varied and did not always achieve statistical significance. It is noteworthy that the numbers of available studies limited statistical power, particularly at this level of analysis. While we feel that aggregating differently derived effect sizes in each study is the most appropriate approach in this case, it is nonetheless a limitation of this study that the limited statistical power of the small sample size prevented a more detailed analysis of effect size by adherence measure.
The implementation of adherence thresholds also varied in our sample. The task of operationalizing “sufficient” adherence is necessarily fraught with multiple contributing factors. Providers historically have set a goal of perfect (100%) adherence , however, changes in drug potency appear be moving the goal posts. Evidence is accumulating that newer, more potent combination therapies are effective at imperfect (i.e., less than 95%) adherence levels , . Further, Lima and colleagues reported that duration of viral suppression may moderate risk of viral rebound secondary to an episode of nonadherence with a longer duration lowering risk . These findings suggest that less than 100% adherence can still be effective, but leave the operationalization of adherence a somewhat open question. The variation present in the small sample of studies included in this review makes estimation across studies more difficult.
Finally, this review combined results from first-wave large scale trials with early pilot studies, resulting in a wide range of intervention and follow up durations (Table 1). We attempted to mitigate this by considering the last follow up time points within each study. While it is a limitation of this review that more reports of longer duration interventions with follow up were not available, we felt the inclusion of smaller scale, shorter duration trials was important and necessary in order to address the research questions. Moreover, a recently published individual patient data meta-analysis of large scale (k = 3) trials , ,  found similar overall effects of intervention over control conditions ; this suggests that our inclusion of pilot studies may not have unduly biased our overall findings.
Electronic messaging interventions can help PLWH achieve enhanced adherence to ART and improved clinical outcomes. The simple fact that such interventions can be disseminated en masse using technology that even in the developing world is increasingly mainstream makes it exceedingly cost-effective to implement; this is in addition to the savings in medical cost offset secondary to increased ART adherence. All of this bodes well for the eventual translation of this intervention strategy from research into practice. Future research is needed to model the impact of this type of intervention on health care systems. A formal cost-effectiveness analysis can compare the costs to implement electronic messaging with the benefits of enhanced ART adherence upon (1) drug resistance and the attendant escalation of pharmacotherapy; (2) the number of HIV-related hospitalizations/care; and (3) HIV transmission rates.
In conclusion, there is good reason for optimism about text-messaging interventions to promote ART adherence. Researchers should consider the adoption of a less than daily frequency of messaging that is individually timed and tailored and designed to evoke a reply from the recipient. Future research is needed to formally compare these design and intervention characteristics described and analyzed here in order to titrate each of these parameters to an optimal effect.
Literature Search Results by Database.
Reports excluded after full-text review with justification.
Reports excluded based on title and abstract with justification.
PRISMA reporting checklist.
The authors would like to thank the editor Dr. Alan Winston and the reviewers including Dr. Edward J. Mills; they conducted a thoughtful and thorough review process that significantly strengthened this paper. The authors also wish to recognize the efforts of the researchers whose work is included in this review and the Center for Health, Intervention, and Prevention (CHIP) at the University of Connecticut. Finally, the authors would like to thank Dr. Seth C. Kalichman for his continuing inspired mentorship of student investigators.
Conceived and designed the experiments: DJF BTJ. Performed the experiments: DJF JAP. Analyzed the data: DJF BTJ. Contributed reagents/materials/analysis tools: DJF BTJ. Wrote the paper: DJF JAP BTJ.
- 1. Sahay S, Reddy K, Dhayarkar S (2011) Optimizing adherence to antiretroviral therapy. Indian J Med Res134: 835–849.
- 2. Aberg JA, Kaplan JE, Libman H, Emmanuel P, Anderson JR, et al. (2009) Primary care guidelines for the management of persons infected with human immunodeficiency virus: 2009 update by the HIV medicine association of the infectious diseases society of America. Clin Infect Dis 49: 651–681.
- 3. Ortego C, Huedo-Medina TB, Llorca J, Sevilla L, Santos P, et al. (2011) Adherence to highly active antiretroviral therapy (HAART): A meta-analysis. AIDS Behav 15: 1381–1396.
- 4. Bangsberg DR, Sharon P, Charlebois ED, Clark RA, Roberston M, et al. (2001) Non-adherence to highly active antiretroviral therapy predicts progression to AIDS. AIDS 15: 1181–1183.
- 5. Sherr L, Lampe F, Clucas C, Johnson M, Fisher M, et al. (2010) Self-reported non-adherence to ART and virological outcome in a multclinic UK study. AIDS Care 22: 939–945.
- 6. Assoumou L, Descamps D, Yerly S, Dos Santos G, Marcelin AG, et al. (2013) Prevalence of HIV-1 drug resistance in treated patients with viral load >50 copies/mL in 2009: A French nationwide study. J Antimicrob Chemother. Available: doi:10.1093/jac/dkt033.
- 7. Ferreira JL, Rodrigues R, Lanca AM, Correia de Almeida V, Rocha SQ, et al. (2013) Transmitted drug resistance among people living with HIV/AIDS at major cities of Sao Paulo State, Brazil. Adv Virol. Available: http://dx.doi.org/10.1155/2013/878237.
- 8. Sinha S, Ahmad H, Shekhar RC, Kumar N, Dar L, et al. (2012) Prevalence of HIV drug resistance mutations in HIV type 1 isolates in antiretroviral therapy naive population from northern India. AIDS Res Treat. doi:10.1155/2012/905823.
- 9. Thao VP, Le T, Torok EM, Yen NT, Chau TT, et al. (2012) HIV-1 drug resistance in antiretroviral-naive individuals with HIV-1-associated tuberculous meningitis initiating antiretroviral therapy in Vietnam. Antivir Ther. doi:10.3851/IMP2092; 10.3851/IMP2092.
- 10. Friedman SR, Bolyard M, Mateu-Gelabert P, Goltzman P, Pawlowicz MP, et al. (2007) Some data-driven reflections on priorities in AIDS network research. AIDS Behav 11: 641–651. doi10.1007/s10461-006-9166-7.
- 11. Johnson BT, Redding CA, DiClemente RJ, Dodge BM, Mustanski BS, et al. (2010). A Network-Individual-Resource model for HIV prevention. AIDS Behav: 204–221. doi:10.1007/s10461-010-9803-z.
- 12. Park-Wyllie LY, Kam D, Bayoumi AM (2009) The adherence support gap: The ‘ideal’ versus ‘reality’ of antiretroviral adherence support provided by HIV health providers in clinical practice. Ann Pharmacother 43: 1036–1044.
- 13. World Health Organization (2006) Working together for health: The world health report. Geneva: WHO press.
- 14. Amico KR, Harman JJ, Johnson BT (2006) Efficacy of antiretroviral therapy adherence interventions: A research synthesis of trials, 1996 to 2004. J Acquir Immune Defic Syndr 41: 285–297.
- 15. Barnighausen T, Chaiyachati K, Chimbindi N, Peoples A, Haberer J, et al. (2011) Interventions to increase antiretroviral adherence in sub-saharan Africa: A systematic review of evaluation studies. Lancet Infect Dis 11: 942–951 DOI:10.1016/S1473-3099(11)70181-5.
- 16. Simoni JM, Frick PA, Pantalone DW, Turner BJ (2003) Antiretroviral adherence interventions: a review of current literature and ongoing studies. Top HIV Med 11: 185–198.
- 17. Amico KR, Orrell C (2013) Antiretroviral therapy adherence support: Recommendations and future directions. J Int Assoc Provid AIDS Care. Published online January 18, 2013. doi:10.1177/1545109712459041.
- 18. Wise J, Operario D (2008) Use of electronic reminder devices to improve adherence to antiretroviral therapy: A systematic review. AIDS Patient Care STDs 22: 495–504 DOI:10.1089/apc.2007.0180.
- 19. Goggin G (2006) Cell phone culture: Mobile technology in everyday life. New York: Routledge. 240 p.
- 20. Sanou B. Telecommunication Development Bureau, ICT Data and Statistics Division. (2013) The world in 2013: ICT facts and figures. Available: http://www.itu.int/en/ITU-D/Statistics/Documents/facts/ICTFactsFigures2013.pdf. Accessed 12 June 2013.
- 21. Horvath T, Azman H, Kennedy GE, Rutherford GW (2012) Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection. Cochrane Database Syst Rev. Available: DOI:10.1002/14651858.CD009756. Accessed 1 May 2012.
- 22. World Health Organization (2013) Consolidated guidelines on general HIV care and the use of antiretroviral drugs for treating and preventing HIV infection: recommendations for a public health approach. Available: www.who.int/iris/bitstream/10665/85321/1/9789241505727_eng.pdf. Accessed 1 October 2013.
- 23. Coomes CM, Lewis MA, Uhrig JD, Furberg RD, Harris JL, et al. (2012) Beyond reminders: A conceptual framework for using short message service to promote prevention and improve healthcare quality and clinical outcomes for people living with HIV. AIDS Care 24: 348–357 doi:10.1080/09540121.2011.608421.
- 24. Crankshaw T, Corless IB, Giddy J, Nicholas PK, Eichbaum Q, et al. (2010) Exploring the patterns of use and the feasibility of using cellular phones for clinic appointment reminders and adherence messages in an antiretroviral treatment clinic, Durban, South Africa. AIDS Patient Care STDs 24: 729–734 doi:10.1089/apc.2010.0146.
- 25. Curioso WH, Quistberg DA, Cabello R, Gozzer E, Garcia PJ, et al. (2009) “It’s time for your life”: How should we remind patients to take medicines using short text messages? AMIA Annu Symp Proc: 129–133.
- 26. Harris LT, Lehavot K, Huh D, Yard S, Andrasik MP, et al. (2010) Two-way text messaging for health behavior change among human immunodeficiency virus-positive individuals. Telemed J 16: 1024–1029 doi:10.1089/tmj.2010.0050.
- 27. International Association of Providers in AIDS Care (2013). Poster Abstracts: the 8th International Conference on HIV Treatment and Prevention Adherence, Miami, FL, USA. Available: http://www.iapac.org/AdherenceConference/Adherence_2013.html. Accessed 12 June 2013.
- 28. Card N (2012) Applied meta-analysis for social science research. New York: The Guilford Press. 377 p.
- 29. Johnson BT, Huedo-Medina TB (2012). Meta-analytic statistical inferences for continuous measure outcomes as a function of effect size metric and other assumptions. Technical report EHC-2012-01-0011.R2 for the Agency for Healthcare Research and Quality.
- 30. Wilson DB (2002). Meta-analysis macros for SAS, SPSS, and Stata [Computer Software]. Available: http://mason.gmu.edu/~dwilsonb/ma.html. Accessed 7 April 2012.
- 31. Sánchez-Meca J, Marín-Martínez F, Chacón-Moscoso S (2003) Effect-size indices for dichotomized outcomes in meta-analysis. Psychol Methods 8: 448–467 DOI:10.1037/1082-989X.8.4.448.
- 32. Huedo-Medina TB, Johnson BT (2011) Estimating the standardized mean difference effect size and its variance from different data sources: A spreadsheet. Storrs, CT, USA: Authors.
- 33. Higgins JPT, Thompson SG, Deeks JJ, Altman DG (2003) Measuring inconsistency in meta-analysis. BMJ 327: 557–560 DOI:10.1136/bmj.327.7414.557.
- 34. Huedo-Medina TB, Sánchez-Meca J, Marın-Martınez F, Botella J (2006) Assessing heterogeneity in meta-analysis: Q statistic or I2 index? Psychol Methods 11: 193–206.
- 35. Downs SH, Black N (1998) The feasibility of creating a checklist for the assessment of the methodological quality both of randomized and non-randomized studies of health care interventions J Epidemiol Community Health. 52: 377–384.
- 36. Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from www.cochrane-handbook.org.
- 37. Moher D, Liberati A, Tetzlaff J, Altman DG (2009) Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med: Available: e1000097. doi:10.1371/journal.pmed1000097. Accessed 5 June 2013.
- 38. da Costa TM, Barbosa BJP, Gomes e Costa DA, Sigulem D, de Fatima Marin H, et al. (2012) Results of a randomized controlled trial to assess the effects of a mobile SMS-based intervention on treatment adherence in HIV/AIDS-infected brazilian women and impressions and satisfaction with respect to incoming messages. Int J Med Inform 81: 257–269 doi:10.1016/j.ijmedinf.2011.10.002.
- 39. Hardy H, Kumar V, Doros G, Farmer E, Drainoni M, et al. (2011) Randomized controlled trial of a personalized cellular phone reminder system to enhance adherence to antiretroviral therapy. AIDS Patient Care STDs: 153–161.
- 40. Lester RT, Ritvo P, Mills EJ, Kariri A, Karanja S, et al. (2010) Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): A randomised trial. The Lancet 376: 1838–1845 doi:10.1016/S0140-6736(10)61997-6.
- 41. Musser D (2001) The effect of a technology-linking care (TLC) intervention on HIV/AIDS patients’ therapeutic drug regimen adherence. (Unpublished doctoral dissertation, University of Missouri-St. Louis). Available from ProQuest Dissertations and Theses. Accessed 19 March 2012.
- 42. Mbaugbaw L, Thabane L, Ongolo-Zogo P, Lester RT, Mills EJ, et al. (2012) The Cameroon mobile phone SMS (CAMPS) trial: A randomized trial of text messaging versus usual care for adherence to antiretroviral therapy. PLoS One 7. Available: http://www.plosone.org/Article/info%3Adoi%2F10.1371%2Fjournal.pone.0046909. Accessed 23 January 2013.
- 43. Pop-Eleches C, Thirumurthy H, Habyarimana JP, Zivin JG, Goldstein MP, et al. (2011) Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: A randomized controlled trial of text message reminders. AIDS 25: 825–834 doi:10.1097/QAD.0b013e32834380c1.
- 44. Safren SA, Hendriksen ES, Desousa N, Boswell SL, Mayer KH (2003) Use of an on-line pager system to increase adherence to antiretroviral medications. AIDS Care 15: 787–793 doi:10.1080/09540120310001618630.
- 45. Simoni JM, Huh D, Frick PA, Pearson CR, Andrasik MP, et al. (2009) Peer support and pager messaging to promote antiretroviral modifying therapy in seattle: A randomized controlled trial. J Acquir Immune Defic Syndr 52: 465–473.
- 46. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33: 159–174.
- 47. Miller WR, Rollnick S (2013) Motivational Interviewing: Helping people change (3rd Ed.) Guilford Press: New York. 482 p.
- 48. Brion J (2013) The patient-provider relationship as experienced by a diverse sample of highly adherent HIV-infected people. J Assoc Nurses AIDS Care: In press. Available: http://dx.doi.org/10.1016/j.jana.2013.01.006. Accessed 2 July 2013.
- 49. Russell J, Krantz S, Neville S (2004) The patient-provider relationship and adherence to highly active antiretroviral therapy. J Assoc Nurses AIDS Care 15: 40–47.
- 50. de Bruin M, Viechtbauer W, Schaalma HP, Kok G, Abraham C, et al. (2010) Standard care impact on effects of highly active antiretroviral therapy adherence interventions: A meta-analysis of randomized controlled trials. Arch Intern Med, 170(3), 240–250.
- 51. Mihalko SL, Brenes GA, Farmer DF, Katula JA, Balkrishman R, et al. (2004) Challenges and innovations in enhancing adherence. Controlled Clin Trials 25: 447–457.
- 52. Samet JH, Sullivan LM, Traphagen ET, Ickovics JR (2001) Measuring adherence among HIV-infected persons: Is MEMS consummate technology? AIDS Behav 5: 21–30.
- 53. Wilson IB, Carter AE, Berg KM (2009) Improving the self-report of HIV antiretroviral medication adherence: Is the glass half full or half empty? Curr HIV/AIDS rep 6: 177–186.
- 54. Shi L, Liu J, Koleva Y, Fonseca V, Kalsekar A, et al. (2010) Concordance of adherence measurement using self-reported adherence questionnaires and medication monitoring devices. Pharmacoeconomics 28: 1097–1107.
- 55. Berg KM, Wilson IB, Li X, Arnsten JH (2012) Comparison of antiretroviral adherence questions. AIDS Behav 16: 461–468.
- 56. Buscher A, Hartman C, Kallen MA, Giordano TP (2011) Validity of self-report measures in assessing antiretroviral adherence of newly diagnosed, HAART-naive, HIV patients. HIV Clin Trials 12: 244–254 doi:;10.1310/hct1205-244; 10.1310/hct1205-244.
- 57. Kalichman SC, Amaral CM, Swetzes C, Jones M, Macy R, et al. (2009) A simple single-item rating scale to measure medication adherence: Further evidence for convergent validity. J Int Assoc Provid AIDS Care 8 367–374 doi:;10.1177/1545109709352884; 10.1177/1545109709352884.
- 58. Oyugi JH, Byakika-Tusiime J, Charlebois ED, Kityo C, Mugerwa R, et al. (2004) Multiple validated measures of adherence indicate high levels of adherence to generic HIV antiretroviral therapy in a resource-limited setting. J Acquir Immune Defic Syndr Syndromes 36: 1100–1102.
- 59. Walsh JC, Mandalia S, Gazzard BG (2002) Responses to a 1 month self-report on adherence to antiretroviral therapy are consistent with electronic data and virological treatment outcome. AIDS 16: 269–277.
- 60. Paterson DL, Swindells S, Mohr J, Brester M, Vergis E, et al. (2000) Adherence to protease inhibitor therapy and outcomes in patients with HIV infection. Ann of Intern Medicine 133: 21–30.
- 61. Bangsberg DR (2006) Less than 95% adherence to nonnucleoside reverse-transcriptase inhibitor therapy can lead to viral suppression. Clin Infect Dis 43: 939–41.
- 62. Shuter J, Sarlo JA, Kanmaz TJ, Rode RA, Zingman BS (2007) HIV-infected patients receiving lopinavir/ritonavir-based antiretroviral therapy achieve high rates of virologic suppression despite adherence rates less than 95%. J Acquir Immune Defic Syndr: 4–8.
- 63. Lima V, Bangsberg D, Harrigan P, Deeks S, Yip B, et al. (2010) Risk of viral failure declines with duration of suppression on HAART, irrespective of adherence level. J Acquir Immune Defic Syndr 55: 460–465.
- 64. Mbuagbaw L, van der Kop ML, Lester RT, Thirumurthy H, Pop-Eleches C, et al. (2013) Mobile phone text messages for improving adherence to antiretroviral therapy (ART): an individual patient data meta-analysis of randomised trials. BMJ Open 3(12): e003950 doi: 10.1136/bmjopen-2013-003950.