Adherence is central to the success of antiretroviral therapy. Supporting adherence has gained importance in HIV care in many national treatment programs. The ubiquity of mobile phones, even in resource-constrained settings, has provided an opportunity to utilize an inexpensive, contextually feasible technology for adherence support in HIV in these settings. We aimed to assess the influence of mobile phone reminders on adherence to antiretroviral therapy in South India. Participant experiences with the intervention were also studied. This is the first report of such an intervention for antiretroviral adherence from India, a country with over 800 million mobile connections.
Study design: Quasi-experimental cohort study involving 150 HIV-infected individuals from Bangalore, India, who were on antiretroviral therapy between April and July 2010. The intervention: All participants received two types of adherence reminders on their mobile phones, (i) an automated interactive voice response (IVR) call and (ii) A non-interactive neutral picture short messaging service (SMS), once a week for 6 months. Adherence measured by pill count, was assessed at study recruitment and at months one, three, six, nine and twelve. Participant experiences were assessed at the end of the intervention period.
The mean age of the participants was 38 years, 27% were female and 90% urban. Overall, 3,895 IVRs and 3,073 SMSs were sent to the participants over 6 months. Complete case analysis revealed that the proportion of participants with optimal adherence increased from 85% to 91% patients during the intervention period, an effect that was maintained 6 months after the intervention was discontinued (p = 0.016). Both, IVR calls and SMS reminders were considered non-intrusive and not a threat to privacy. A significantly higher proportion agreed that the IVR was helpful compared to the SMS (p<0.001).
Citation: Rodrigues R, Shet A, Antony J, Sidney K, Arumugam K, Krishnamurthy S, et al. (2012) Supporting Adherence to Antiretroviral Therapy with Mobile Phone Reminders: Results from a Cohort in South India. PLoS ONE 7(8): e40723. https://doi.org/10.1371/journal.pone.0040723
Editor: Landon Myer, University of Cape Town, South Africa
Received: September 26, 2011; Accepted: June 13, 2012; Published: August 27, 2012
Copyright: © Rodrigues et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was funded by a European Commission FP7 grant for the HIVIND project. [URL: http://cordis.europa.eu/fetch?CALLER=FP7_PROJ_EN&ACTION=D&DOC=1&CAT=PROJ&QUERY=0132a68e52ee:51ac:213dc128&RCN=90123]. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors declare that no competing interests exist.
Adherence to treatment in HIV is a complex phenomenon influenced by the illness, patient characteristics; healthcare system; treatment regimen and environment , . As adherence is critical to treatment success in HIV , a number of interventions to support adherence have been implemented. Some of the interventions used to support adherence to antiretroviral therapy (ART) include directly administered ART , ; financial incentives ; education, counseling and social support ; electronic and phone reminders , , .
The popularity of mobile phones and their low cost, even in resource constrained settings, has resulted in the use of the technology in healthcare delivery. Examples of evolving uses of this technology in healthcare include data collection, behavior counseling for adherence, disease outbreak tracking and training healthcare workers in remote settings , . Of these, recent reports of the use of mobile phones for HIV disease management, including adherence, are available from the Americas and sub Saharan Africa , , , , .
With 800 million mobile phone connections and the relatively low cost of mobile handsets and services in India , mobile communication technology provides a contextually suitable opportunity for antiretroviral adherence support. Approximately 240,000 Indian HIV infected individuals receive first line ART under the National AIDS Control Program . Given the prohibitive costs of second line ART, it is important that the efficacy of first-line regimens is preserved for as long as possible  by supporting adherence. We aimed to assess the influence of weekly mobile phone reminders on adherence to antiretroviral therapy in South India and to study their post intervention effects on adherence. Participant experiences with the intervention were also studied. To our knowledge, this is the first such report on mobile phone reminders for adherence support in India.
The study was implemented at the Infectious Disease Clinic, St. John's National Academy of Health Sciences, Bangalore, South India. This is a tertiary level, non profit, private healthcare facility. The clinic provides routine care and treatment to approximately 2,000 HIV infected individuals from within the province of Karnataka and the neighboring provinces of Andhra Pradesh, Tamil Nadu and Kerala. This quasi-experimental cohort study was conducted between March 2010 and July 2011.
The participants included were (i) HIV infected adults who followed up at the clinic as outpatients (ii) had access to a mobile phone and (iii) were on ART for at least a month prior to enrollment. Patients who were participants of other adherence studies were excluded.
First line ART in the setting of India's National AIDS Control Program consists of zidovudine or stavudine, plus lamivudine plus nevirapine (or efavirenz in patients on anti tuberculosis treatment) to be taken by the patient twice daily . These antiretrovirals are available free of cost to HIV infected individuals through a network of public healthcare facilities and public private partnerships. Our intervention was restricted to individuals on such first line regimens.
The intervention studied was adherence support with mobile phone reminders. Each reminder comprised of two components, (i) an interactive voice response (IVR) call and (ii) a non interactive neutral picture delivered as a short message service (SMS). All participants received both components of the intervention once a week for 6 months from the date of enrollment. Each component was received on two separate days in a week at a time chosen by the participant. Both components were demonstrated to participants at recruitment. All participants were trained to respond to the IVR and to access the pictorial message.
The interactive call component required participants to respond to the question “have you taken all your medicines yesterday?” with a “1” if they had not missed any doses in the previous 24 hours and “2” if they had. If participants missed the call, three additional calls were made over the ensuing 24 hours, providing participants with an opportunity to receive and respond to the call. However, in this study, patient responses were not used as measures of adherence but were used only to make the reminder interactive. Online, web-based interfaces captured for each participant, (i) the status of IVR delivery and receipt (ii) the participant responses to the IVR. For the IVR, participants could choose one of five languages i.e.; English, Kannada, Telugu, Tamil or Hindi. These languages were those commonly spoken in south India.
The SMS was a line diagram of a lamp. There was no text included in the SMS. All participants received the same picture SMS throughout the intervention period. The SMS delivery status was captured by the online web based interface for each participant.
Instruments and follow up
Demographic details and prior experience with mobile phones were ascertained at enrollment. The outcome measure studied was change in adherence over a 12 month period (6 months during the intervention and 6 months after discontinuation of the intervention). Adherence at baseline, during and after the intervention was assessed using the pill count. Pill count was measured at baseline, followed by month 1, month 3, month 6 during the intervention, and at two time points post intervention i.e. month 9 and month 12. At each time point, adherence for the previous month was measured. Adequate adherence was defined a priori as having consumed ≥95% of ART pills for that month. Pill count was then calculated as a proportion; i.e. the number of pills taken over the last month divided by number of pills expected to be taken as per prescription and expressed as a percentage. Barriers to adherence such as reasons for missing medication doses were also recorded at baseline and at each follow up visit during the intervention period using the ‘ACTG barriers to adherence self report (ACTG ql0777)’ . Both the pill count and barriers to adherence were assessed by trained research assistants not involved in routine care of the patient. Participant experiences with the intervention in terms of receipt, usefulness, privacy and intrusion were assessed on a five-point Likert scale at the end of the intervention period.
Demographic characteristics, adherence and participant experiences were expressed using frequencies; measures of central tendency and dispersion. Binary logistic regression was used to assess the association between socio-demographic variables and baseline adherence.
Adherence, the main outcome variable, had some missing data (described below) due to participants lost to follow-up. We therefore used three approaches to assess the influence of the intervention on adherence. These approaches to data analysis were (i) complete case analysis, where, cases with missing outcome measures were excluded from the analysis (ii) missing equals adequately adherent, i.e. all cases with missing adherence measures at any time point were considered as “adequately adherent” and included in the analysis and (iii) missing equals not adequately adherent, i.e. all cases with missing adherence measures at any time point were considered “not adequately adherent” at that time point and included in the analysis. Cochran's Q for k related samples and Mc Nemar's test with Bonferroni correction were used to study change in adherence over time. The level of significance for change in adherence was defined as p<0.003. The Wilcoxon signed rank test was used to compare participant experiences at 6 months with respect to the IVR and SMS. Ordinal regression was used to compare participant experiences with socio-demographic variables.
The study was approved by the institutional review board at St. John's National Academy of Health Sciences, Bangalore, India. Written informed consent was obtained from all participants prior to enrollment.
Of the 231 eligible participants invited to participate in the study, 150 enrolled. Reasons for non participation included time constraints (33%) followed by disinterest (25%) and stigma (13%). Non participants were similar to participants with respect to age, sex, marital status, education, time since diagnosis, duration on ART, type of regimen, and baseline CD4 counts. However, a larger proportion of nonparticipants (31%) were rural residents in comparison to the participants (10%).
Retention rate in the study at month 12 was 94%. The participant characteristics at baseline are described in Table 1. Two thirds of the participants were men. This reflected the sex distribution of patients attending the clinic at the time of enrollment. Table 1 also describes the associations between studied participant characteristics and baseline adherence.
A total of 4,103 calls were expected to be delivered to the participants during the 6 months of the intervention. Of these 204 (5%) of the calls were not delivered due to technical problems with the service; thus 3,895 calls were made to the participants. Of these, 3372 (87%) calls were received by the participants. Of the 3372 calls received by the participants, the “1” (taken all pills) response was recorded for 2725 (81%) calls, the “2” (not taken pills) response was recorded for 43 (1%) calls while the rest of the calls (18%) recorded an erroneous response (any other number).
A total of 3,073 picture messages were delivered to the participants during the study. For month 6 of the intervention, 89 (59%) participants reported that they had viewed all the messages, while 20 (13%) persons reported that they had viewed none of the messages in the last month of the intervention. Of the 20 participants who did not view their messages, 16 made limited use of the SMS feature, and 11 reported that they did not know how to use the SMS feature on their mobile phones despite being trained at enrollment.
Nine (6%) of the 150 participants had missing adherence data at different time points. Of these nine participants, three were transferred out to another clinic for second line ART, four were transferred to clinics closer to their homes for logistic reasons and two could not be traced.
Complete case analysis for 141 participants with complete data showed that those adequately adherent at baseline, month 1, month 3, month 6, month 9 and month 12 were 120 (85%), 132 (94%), 131 (93%), 128 (91%), 134 (95%), and 133 (94%) respectively. There was a significant improvement in proportions adherent over time (p = 0.016) (Fig. 1).
The figure shows the change in proportion of participants adherent over time during the study period (1 year) based on the 3 analytical approaches used in the i.e. complete case analysis, missing equals adherent and missing equals non adherent.
Using the second approach where missing adherence data at any time point was considered “adequately adherent” at that time point, participants adherent were 129 (86%) at baseline, 140 (93%) at month 1, 139 (93%) at month 3, 136 (91%) at month 6, 143 (95%) at month 9 and 144 (96%) at month 12. A significant increase in proportions adequately adherent over time was also seen with this approach (p = 0.022).
The third approach, where missing adherence data at any time point were considered as “not adequately adherent”, showed that, participants adequately adherent were 129 (86%) at baseline, 140 (93%) at month 1, 137 (91%) at month 3, 133 (89%) at month 6, 134 (89%) at month 9, and 133 (89%) at month 12. No significant increase in proportions adequately adherent over time was seen with this approach (p = 0.321) (Fig. 1).
Barriers to adherence
Forgetfulness was the most common reason for non-adherence throughout the study. Seventeen percent of the participants reported forgetfulness as a barrier at enrollment. However, this significantly decreased from baseline with time during the intervention period (17%; 10%; 6% and 3% at baseline, 1 month, 3 months, and 6 months respectively, p<0.001).
Experiences with the intervention
Participant experiences with the two components of the intervention are described in Table 2. Of 136 participants who reported their experiences with the intervention at the end of month 6, 23 reported not receiving all their calls in the last 4 weeks. Of these 23, 12 reported technical issues with the mobile phone/handset and 11 reported being away from their phone. All 136 participants considered the IVR easy to use. A significantly higher proportion of participants agreed that the IVR was helpful compared to the SMS (p<0.001). Both the SMS and the IVR were considered comparable in terms of privacy and intrusion (Table 2). Ordinal regression showed no association between participant experiences and demographic variables listed in Table 1. Preference: Of the 136 respondents, 42 (34%), preferred only the phone call, 15 (11%) preferred only the SMS, 60 (44%) preferred both the phone call and the SMS, while the rest preferred neither.
Based on the analytical approach used the effect of the intervention on adherence (change in adherence) showed differing results. A complete case analysis showed beneficial effect of the intervention on adherence. Similar results were obtained when subjects with missing data were considered adequately adherent. On the other hand, when subjects with missing data for adherence were considered non-adherent, no significant influence of the intervention was observed. While it is reported that patients who miss clinic attendance for medication refills were more likely to be non-adherent , this may not necessarily be the case in our study as seven of nine patients with missing values were transferred to other treatment centers for either second line ART or logistic reasons (i.e.; proximity to their homes). These seven patients may or may not have been adherent to treatment after transfer. On the contrary, two of the nine participants who did not complete the study could not be traced, and hence, were considered completely lost to follow-up (LFU). It is more likely that these two participants were not adequately adherent to treatment . The beneficial effect of the intervention on adherence was also observed, on excluding from the analysis, the seven participants who were transferred to other treatment centers (p<0.029 when LFU = not adequately adherent and p<0.011 when LFU = adequate adherence).
Though there are reports of improvement in adherence with interventions for supporting adherence, only a few studies have addressed their post intervention effect , . A study done on adolescents in Los Angeles, USA, reported a decline in adherence and increase in viral load in HIV infected adolescents when daily cell phone reminder calls were tapered over a period of 24 weeks . The participants in this study were eight youth aged 16–24 yrs most of who reported substance abuse. These participant characteristics possibly influenced the decline in adherence while tapering the intervention. Our results differed from the Los Angeles study possibly due to different participant demographics and study contexts. A randomized controlled trial (RCT) from Pakistan showed improvements in adherence for up to 2 weeks after the cessation of weekly phone calls for a month . The results were similar to those in our cohort, though the post intervention effect was assessed earlier. However, participant demographics like age structure and sex distribution were similar to those in our study. In another study from the United Kingdom, the sustained effect of pagers used to improve memory, seven weeks after their withdrawal, was attributed to establishment of routines . Participants in this study had problems with memory, attention, or organizational issues. Electronic devices like pagers are thought to provide consistent and reliable prompts that may be difficult for family members to provide. We did not assess memory and its effect on adherence in our study. However the weekly reminders probably enabled establishment of routines, especially in patients more recently initiated on ART.
As in our study, individual sociodemographic factors were not found to be associated with adherence in another setting in Bangalore, India . Forgetfulness was the most common cause of non-adherence in our study and has been reported in literature , , . A study from California, USA, recommends the use of programmable electronic medication reminders that increase the quality, distinctiveness and relatedness of external cues to minimize forgetfulness and improve adherence in HIV . Further evidence to support this theory is available from reports of improved adherence with the use pagers , watch alarms , phone calls , and SMS reminders  to support adherence . A study on tuberculosis, HIV and syphilis from North Carolina reported a significant correlation between forgetting one's medications and considering SMS medication reminders helpful . Reports of forgetfulness reduced with time during the intervention in our study. On the contrary digital reminders for improving adherence to ART were not found effective in an RCT in Nairobi, Kenya. This study reported intensive early adherence counseling to have a sustained effect on adherence in comparison to digital reminders . The interactiveness of the intervention in our study was probably the reason for the difference in effect observed between the two studies.
Recent studies of mobile phones for adherence support in HIV have used SMS technology. In an RCT in Kenya, HIV infected research participants were expected to call their healthcare worker in response to an SMS query regarding their health . Another study from Kenya independently reported a significantly larger proportion of adherent participants exposed to SMS reminders in comparison to controls . A study from Boston, USA, also reported better adherence to ART in participants receiving personalized SMS reminders in comparison to controls with beepers . Most of these studies used SMS reminders unlike our study that used a combination of IVR and SMS reminders. We combined IVR and SMS reminders as a pilot study in our setting showed that patients preferred voice calls over SMSs . We confirmed this preference for IVR technology by patients one month after initiation of the intervention . RCT of IVR and SMS based adherence support interventions are underway in Cameroon and India, the results of which are awaited , .
Call completion rates of 75–87% have been reported by studies that have used IVR technology for adherence support, and were similar to the call completion rates in our study , . As previously reported, our study also identified technical challenges with the phones and being away from their phones as reasons for not answering the calls .
The IVR technology in our study was considered easy to use. Previous studies involving IVR technology with voice recognition have reported difficulties in decoding participant responses. This resulted in persistence of the call and frustration on behalf of the participant . Additionally, participants have found both IVR and SMS prompts difficult to follow . The simplicity of the intervention used in our study probably made it easy to use.
We also studied intrusiveness and privacy concerns with the two components of the intervention. Weekly, IVRs and neutral SMSs timed to the participant's convenience probably reduced intrusion and enhanced the privacy of the intervention. Unlike our study, the study from Los Angeles reported that HIV patients found cell phone reminder calls to be intrusive . Both, the IVR and SMS were comparable in terms of intrusion and privacy in our study, despite concerns in literature to the contrary . Even though comparable, IVR calls were preferred to SMSs and considered more helpful by participants. This is probably due to the generally lower use of the SMS function by participants in our study. Similar findings, reported by previous studies in the same setting, were the basis of our intervention , . A study from Uganda reported illiteracy, language barriers and possibility for direct communication as reasons for preferring voice calls to SMSs in other resource limited settings . The ability to choose the language and the interaction of the IVR probably enhanced its preference in our study. In contrast, unacceptability of IVR calls due to an inability to speak to a real person was reported from Quebec, Canada . The role of personal interaction in adherence improvement has been confirmed by a study from Cape Town, South Africa .
Although adherence was the outcome of interest in this study, the technology also has the potential to improve other aspects of HIV care like clinic attendance . It can also be explored for improving adherence in communicable and chronic disease like tuberculosis and diabetes , .
(i) The clinic setting, close follow-ups and routine ART counseling, may have resulted in the relatively high adherence rates at baseline. Despite the clinic setting and high adherence rates at baseline, we observed improvements in adherence during the study. This implies that the benefits of the intervention could possibly be greater in general clinic settings where adherence rates may be lower . (ii) Also participants could have been more motivated than non participants to maintain adequate adherence. However, background characteristics of non participants were similar to participants in our study, except that the former were more rural. (iii) Adherence is affected by duration on treatment . In our study the duration on ART varied from one to 86 months, this could have affected their adherence ART. (iv) As patients were under study and so closely followed up, the Hawthorne effect on adherence cannot be ruled out . An RCT of the intervention will provide stronger results and enable assessment of clinical and virological outcomes that were not assessed in our study. (v) The different approaches to analysis of change in adherence in our study provided differing results . We have alluded to this at the beginning of the discussion.
Overall, our study contributes to the growing body of evidence on the capacity of mobile phone reminders to influence medication adherence in HIV infected individuals. While the findings of our study vary depending upon the analytical approach used, a complete case analysis indicates significant effect of the intervention on adherence. Despite the limitations of this study as discussed, given the ubiquity of mobile phones in the Indian setting and the simplicity of the intervention, the use of mobile phones for support of adherence to antiretroviral therapy holds promise and is worthy of further exploration in the Indian context.
Authors would like to thank Ravience Digital, Mumbai, India for technical assistance with the intervention, the National AIDS Control Organisation for their support, the staff at the Infectious Disease Clinic, St. John's National Academy of Health Sciences, Bangalore, India; Mr. As Mohammad, Swaroop N, Ashwini GS and Navya CJ from the department of Community Medicine, St. John's Medical College, for their assistance with the study data.
Conceived and designed the experiments: RR AD AS GD KS. Performed the experiments: AD AS RR JA KS SK. Analyzed the data: RR AS KA. Contributed reagents/materials/analysis tools: GD AS. Wrote the paper: RR AS JA KS KA SK GD AD.
- 1. Bhat VG, Ramburuth M, Singh M, Titi O, Antony AP, et al. (2010) Factors associated with poor adherence to anti-retroviral therapy in patients attending a rural health centre in South Africa. Eur J Clin Microbiol Infect Dis 29: 947–953.
- 2. Roberts KJ (2000) Barriers to and facilitators of HIV-positive patients' adherence to antiretroviral treatment regimens. AIDS Patient Care STDS 14: 155–168.
- 3. Bartlett JA (2002) Addressing the challenges of adherence. J Acquir Immune Defic Syndr 29 Suppl 1: S2–10.
- 4. Ickovics JR, Meisler AW (1997) Adherence in AIDS clinical trials: a framework for clinical research and clinical care. J Clin Epidemiol 50: 385–391.
- 5. Read T, Mijch A, Fairley CK (2003) Adherence to antiretroviral therapy: are we doing enough? Intern Med J 33: 254–256.
- 6. Altice FL, Springer SA (2010) DAART for human immunodeficiency virus-infected patients: Studying subjects not at risk for nonadherence and use of untested interventions. Arch Intern Med 170: 109–110.
- 7. Nyanzi-Wakholi B, Lara AM, Munderi P, Gilks C (2011) The charms and challenges of antiretroviral therapy in Uganda: the DART experience. AIDS Care 24: 137–142.
- 8. Rigsby MO, Rosen MI, Beauvais JE, Cramer JA, Rainey PM, et al. (2000) Cue-dose training with monetary reinforcement: pilot study of an antiretroviral adherence intervention. J Gen Intern Med 15: 841–847.
- 9. Tesoriero J, French T, Weiss L, Waters M, Finkelstein R, et al. (2003) Stability of adherence to highly active antiretroviral therapy over time among clients enrolled in the treatment adherence demonstration project. J Acquir Immune Defic Syndr 33: 484–493.
- 10. Boyer EW, Smelson D, Fletcher R, Ziedonis D, Picard RW (2010) Wireless Technologies, Ubiquitous Computing and Mobile Health: Application to Drug Abuse Treatment and Compliance with HIV Therapies. J Med Toxicol 6: 212–216.
- 11. Lester RT, Ritvo P, Mills EJ, Kariri A, Karanja S, et al. (2010) Effects of a mobile phone short message service on antiretroviral treatment adherence in Kenya (WelTel Kenya1): a randomised trial. Lancet 376: 1838–1845.
- 12. Pop-Eleches C, Thirumurthy H, Habyarimana JP, Zivin JG, Goldstein MP, et al. (2011) Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders. AIDS 25: 825–834.
- 13. Kalichman SC, Kalichman MO, Cherry C, Swetzes C, Amaral CM, et al. (2011) Brief behavioral self-regulation counseling for HIV treatment adherence delivered by cell phone: an initial test of concept trial. AIDS Patient Care STDS 25: 303–310.
- 14. Vital Wave Consulting (2009) mHealth for development: The opportunity of mobile technology for healthcare in the developing world.
- 15. Armstrong AW, Watson AJ, Makredes M, Frangos JE, Kimball AB, et al. (2009) Text-message reminders to improve sunscreen use: a randomized, controlled trial using electronic monitoring. Arch Dermatol 145: 1230–1236.
- 16. Crankshaw T, Corless IB, Giddy J, Nicholas PK, Eichbaum Q (2010) Exploring the patterns of use and the feasibility of using cellular phones for clinic appointment reminders and adherence messages in an antiretroviral treatment clinic, Durban, South Africa. AIDS patient care and STDs 24: 729–734.
- 17. Hardy H, Kumar V, Doros G, Farmer E, Drainoni ML, et al. (2011) Randomized controlled trial of a personalized cellular phone reminder system to enhance adherence to antiretroviral therapy. AIDS Patient Care STDS 25: 153–161.
- 18. TRAI (2011) The Indian telecom services performance Indicators January - March 2011. Mahanagar Doorsanchar Bhawan JLNM, New Delhi, India: Telecom Regulatory Authority of India.
- 19. NACO (2011) National AIDS Control Organisation Annual Report 2010-11. India: Ministry of Health and Family Welfare.
- 20. Freedberg KA, Kumarasamy N, Losina E, Cecelia AJ, Scott CA, et al. (2007) Clinical impact and cost-effectiveness of antiretroviral therapy in India: starting criteria and second-line therapy. Aids 21 Suppl 4: S117–128.
- 21. NACO (2007) Antiretroviral therapy guidelines for HIV-infected adults and adolescents including post-exposure prophylaxis. Government of India: Ministry of Health and Family Welfare.
- 22. NIAID Adult AIDS Clinical Trials Group (2003) Adherence barriers self report (ql0777).
- 23. Kunutsor S, Walley J, Katabira E, Muchuro S, Balidawa H, et al. (2010) Clinic attendance for medication refills and medication adherence amongst an antiretroviral treatment cohort in Uganda: A prospective study. AIDS Research and Treatment
- 24. Simoni JM, Amico KR, Pearson CR, Malow R (2008) Strategies for promoting adherence to antiretroviral therapy: a review of the literature. Curr Infect Dis Rep 10: 515–521.
- 25. Cote JK, Godin G (2005) Efficacy of interventions in improving adherence to antiretroviral therapy. Int J STD AIDS 16: 335–343.
- 26. Puccio JA, Belzer M, Olson J, Martinez M, Salata C, et al. (2006) The use of cell phone reminder calls for assisting HIV-infected adolescents and young adults to adhere to highly active antiretroviral therapy: a pilot study. AIDS Patient Care STDS 20: 438–444.
- 27. Uzma Q, Emmanuel F, Ather U, Zaman S (2011) Efficacy of Interventions for Improving Antiretroviral Therapy Adherence in HIV/AIDS Cases at PIMS, Islamabad. J Int Assoc Physicians AIDS Care (Chic) 10: 373–383.
- 28. Cauldbeck MB, O'Connor C, O'Connor MB, Saunders JA, Rao B, et al. (2009) Adherence to anti-retroviral therapy among HIV patients in Bangalore, India. AIDS Research and Therapy
- 29. Chesney MA, Ickovics JR, Chambers DB, Gifford AL, Neidig J, et al. (2000) Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: the AACTG adherence instruments. Patient Care Committee & Adherence Working Group of the Outcomes Committee of the Adult AIDS Clinical Trials Group (AACTG). AIDS Care 12: 255–266.
- 30. El-Khatib Z, Ekstrom AM, Coovadia A, Abrams EJ, Petzold M, et al. (2011) Adherence and virologic suppression during the first 24 weeks on antiretroviral therapy among women in Johannesburg, South Africa - a prospective cohort study. BMC Public Health 11: 88.
- 31. Woods SP, Moran LM, Carey CL, Dawson MS, Iudicello JE, et al. (2008) Prospective memory in HIV infection: is “remembering to remember” a unique predictor of self-reported medication management? Arch Clin Neuropsychol 23: 257–270.
- 32. Safren SA, Hendriksen ES, Desousa N, Boswell SL, Mayer KH (2003) Use of an on-line pager system to increase adherence to antiretroviral medications. AIDS Care 15: 787–793.
- 33. Lyon ME, Trexler C, Akpan-Townsend C, Pao M, Selden K, et al. (2003) A family group approach to increasing adherence to therapy in HIV-infected youths: results of a pilot project. AIDS Patient Care STDS 17: 299–308.
- 34. Roux P, Kouanfack C, Cohen J, Marcellin F, Boyer S, et al. (2011) Adherence to antiretroviral treatment in HIV-positive patients in the Cameroon context: promoting the use of medication reminder methods. J Acquir Immune Defic Syndr 57 Suppl 1: S40–43.
- 35. Person AK, Blain ML, Jiang H, Rasmussen PW, Stout JE (2011) Text messaging for enhancement of testing and treatment for tuberculosis, human immunodeficiency virus, and syphilis: a survey of attitudes toward cellular phones and healthcare. Telemed J E Health 17: 189–195.
- 36. Chung MH, Richardson BA, Tapia K, Benki-Nugent S, Kiarie JN, et al. (2011) A randomized controlled trial comparing the effects of counseling and alarm device on HAART adherence and virologic outcomes. PLoS Med 8: e1000422.
- 37. Shet A, Arumugam K, Rodrigues R, Rajagopalan N, Shubha K, et al. (2010) Designing a mobile phone-based intervention to promote adherence to antiretroviral therapy in South India. AIDS Behav 14: 716–720.
- 38. Sidney K, Antony J, Rodrigues R, Arumugam K, Krishnamurthy S, et al. (2011) Supporting patient adherence to antiretrovirals using mobile phone reminders patient responses from South India. AIDS Care 24: 612–617.
- 39. Mbuagbaw L, Thabane L, Ongolo-Zogo P, Lester RT, Mills E, et al. (2011) The Cameroon mobile phone SMS (CAMPS) trial: a protocol for a randomized controlled trial of mobile phone text messaging versus usual care for improving adherence to highly active anti-retroviral therapy. Trials 12: 5.
- 40. De Costa A, Shet A, Kumarasamy N, Ashorn P, Eriksson B, et al. (2010) Design of a randomized trial to evaluate the influence of mobile phone reminders on adherence to first line antiretroviral treatment in South India–the HIVIND study protocol. BMC Med Res Methodol 10: 25.
- 41. Rudd P, Byyny RL, Zachary V, LoVerde ME, Titus C, et al. (1989) The natural history of medication compliance in a drug trial: limitations of pill counts. Clin Pharmacol Ther 46: 169–176.
- 42. Reidel K, Tamblyn R, Patel V, Huang A (2008) Pilot study of an interactive voice response system to improve medication refill compliance. BMC Med Inform Decis Mak 8: 46.
- 43. Milam J, Richardson JL, McCutchan A, Stoyanoff S, Weiss J, et al. (2005) Effect of a brief antiretroviral adherence intervention delivered by HIV care providers. J Acquir Immune Defic Syndr 40: 356–363.
- 44. Kaplan WA (2006) Can the ubiquitous power of mobile phones be used to improve health outcomes in developing countries? Global Health 2: 9.
- 45. Kunutsor S, Walley J, Katabira E, Muchuro S, Balidawa H, et al. (2010) Using mobile phones to improve clinic attendance amongst an antiretroviral treatment cohort in rural Uganda: a cross-sectional and prospective study. AIDS Research and Treatment
- 46. Nachega JB, Chaisson RE, Goliath R, Efron A, Chaudhary MA, et al. (2011) Randomized controlled trial of trained patient-nominated treatment supporters providing partial directly observed antiretroviral therapy. Aids 24: 1273–1280.
- 47. Granger BB, Bosworth HB (2011) Medication adherence: emerging use of technology. Curr Opin Cardiol 26: 279–287.
- 48. Reynolds NR, Testa MA, Su M, Chesney MA, Neidig JL, et al. (2008) Telephone support to improve antiretroviral medication adherence: a multisite, randomized controlled trial. J Acquir Immune Defic Syndr 47: 62–68.
- 49. Bastard M, Fall MB, Laniece I, Taverne B, Desclaux A, et al. (2011) Revisiting long-term adherence to highly active antiretroviral therapy in Senegal using latent class analysis. J Acquir Immune Defic Syndr 57: 55–61.
- 50. Harris AD, Bradham DD, Baumgarten M, Zuckerman IH, Fink JC, et al. (2004) The use and interpretation of quasi-experimental studies in infectious diseases. Clin Infect Dis 38: 1586–1591.
- 51. Sterne JA, White IR, Carlin JB, Spratt M, Royston P, et al. (2009) Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. Bmj 338: b2393.