Figures
Abstract
Background
Low adherence in recent HIV prevention clinical trials highlights the need to better understand, measure, and support product use within clinical trials. Conventional self-reported adherence instruments within HIV prevention trials, often relying on single-item questions, have proven ineffective. While objective adherence measures are desirable, none currently exist that apply to both active and placebo arms. Scales are composed of multiple items in the form of questions or statements that, when combined, measure a more complex construct that may not be directly observable. When psychometrically validated, such measures may better assess the multiple factors contributing to adherence/non-adherence. This study aimed to develop and psychometrically evaluate tools to screen and monitor trial participants’ adherence to HIV prevention products within the context of clinical trial research.
Methods and findings
Based on an extensive literature review and conceptual framework, we identified and refined 86 items assessing potential predictors of adherence and 48 items assessing adherence experience. A structured survey, including adherence items and other variables, was administered to former ASPIRE and Ring Study participants and similar non-trial participants (n = 709). We conducted exploratory factor analyses (EFA) to identify a reduced set of constructs and items that could be used at screening to predict potential adherence, and at follow-up to monitor and intervene on adherence. We examined associations with other variables to assess content and construct validity. The EFA of screener items resulted in a 6-factor solution with acceptable to very good internal reliability (α: .62-.84). Similar to our conceptual framework, factors represent trial-related commitment (Distrust of Research and Commitment to Research); alignment with trial requirements (Visit Adherence and Trial Incompatibility); Belief in Trial Benefits and Partner Disclosure. The EFA on monitoring items resulted in 4 Product-specific factors that represent Vaginal Ring Doubts, Vaginal Ring Benefits, Ring Removal, and Side Effects with good to very good internal reliability (α = .71-.82). Evidence of content and construct validity was found; relationship to social desirability bias was examined.
Conclusions
These scales are easy and inexpensive to administer, available in several languages, and are applicable regardless of randomization. Once validated prospectively, they could (1) screen for propensity to adhere, (2) target adherence support/counselling, and (3) complement biomarker measures in determining true efficacy of the experimental product.
Citation: Tolley EE, Guthrie KM, Zissette S, Fava JL, Gill K, Louw CE, et al. (2018) Optimizing adherence in HIV prevention product trials: Development and psychometric evaluation of simple tools for screening and adherence counseling. PLoS ONE 13(4): e0195499. https://doi.org/10.1371/journal.pone.0195499
Editor: Paula Braitstein, University of Toronto Dalla Lana School of Public Health, CANADA
Received: June 14, 2017; Accepted: March 24, 2018; Published: April 12, 2018
Copyright: © 2018 Tolley et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data underlying this study is available at the Harvard Dataverse repository at https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/5W9HXM (DOI: 10.7910/DVN/5W9HXM).
Funding: This study was funded by the United States Agency for International Development under the terms of the Adherence Measurement and Optimization of Long-Acting ARV-Based Vaginal Ring Agreement, AID-OAA-A-14-00003. KM was principal investigator of the award. ET was a co-principal investigator. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The prophylactic use of antiretroviral drugs (ARV) to prevent HIV transmission has proven moderately to highly efficacious in several clinical trials testing the use of a peri-coital vaginal gel [1], daily oral pills [2–4], and, most recently, vaginal rings [5]. Despite these successes, adherence–both its measurement and optimization–has emerged as a serious challenge for HIV prevention clinical trial research. In two large trials of heterosexual African women (the Vaginal and Oral Interventions to Control the Epidemic or VOICE trial and the FEM-PrEP trial) [6–8], inability to determine product effectiveness was attributed to poor adherence to daily vaginal (VOICE) and oral (VOICE and FEM-PrEP) dosing regimens, based on low or no drug detection in plasma from random subsamples of women in the active study arms. Furthermore, even in trials that have shown product efficacy, adherence has been highly variable. For example, adherence levels lower than 50% led investigators to discontinue recruitment in two sites in the ASPIRE trial [5]. In iPrEx, adherence varied regionally, with highest objectively measured adherence in MSM in sites in the United States and lowest levels in Peru [9]. Overall, adherence was high in the Partners PrEP trial among HIV discordant couples with known risk for HIV, but low in other prevention trials of African women. In several trials, younger women had higher HIV incidence and lower adherence than older women [5, 8].
Several qualitative sub-studies further examined women’s experiences with product adherence and reasons for non-use. In Fem-PrEP, participants classified as highly adherent tended to describe their commitment to trial goals for either altruistic reasons or because they believed that trial participation would reduce their own risk; they developed habits or relied on tools to ensure they adhered to product use and trial visits and reported having support from partners and other community members [10]. Partner and community concerns about the safety and potency of the drugs being tested in the VOICE trial may have reduced women’s motivation to adhere to product use [11]. When asked post-trial about potential reasons for non-adherence, some former VOICE participants acknowledged their own occasional non-use of study product due to forgetfulness or boredom, but almost all suggested that intentional non-use was common among other trial participants, due to their own or others’ distrust of the trial and/or of the product [12]. Indeed, among a sample of former VOICE participants randomized to an active product and for whom pharmacokinetic results existed, at least 50% had no evidence of tenofovir in their blood samples [8, 13]. Women in this sub-study suggested that they would be more likely to adhere to product use, if they knew they could be objectively monitored [13].
Because high and sustained adherence is essential to the evaluation of product safety and efficacy in clinical trials [14], there is an urgent need to develop objective biomarkers of adherence [15–17]. Nevertheless, the unique aspects of clinical trial participation may continue to attract some participants who have little incentive to adhere (or strong incentive to adhere only before visits)–or who face barriers to adherence that emerge primarily from the clinical trial context itself [18, 19]. Furthermore, while objective measures can indicate suboptimal adherence, they cannot identify reasons for, or guide approaches to intervening on, non-adherence. For these reasons, additional approaches to measuring and optimizing adherence should also be considered [20].
An approach which has long been used to assess treatment non-compliance [21–23], involves summated rating scales, which are composed of multiple items in the form of questions or statements that, when combined, measure a more complex construct that may not be directly observable [24, 25]. Validated multi-item measures tend to be more stable, reliable and precise than single items because they produce a set of internally consistent replies that are “less prone to socio-psychological biases”, enabling the random error in the measure to be minimized or canceled out [26]. As such, they may better assess the multiple factors likely to contribute to ring non-adherence.
Project overview
The overall goal of the project was to develop and provide initial psychometric validation for a set of scale measures that may prove inexpensive and easy to administer, with better predictive ability than current self-report adherence measures. Two types of scales were envisioned: 1) Screener measures, administered prior to product use (i.e., during a screening visit) that might predict an individual’s propensity to adhere; and 2) Adherence Monitoring measures that could be administered periodically during participant follow-up to assess participants’ attitudes about and experiences with the product.
We followed a standard scale development process, which included identifying an item and construct pool from the published literature related to adherence measurement and HIV prevention (specifically microbicide) clinical trial research; rounds of cognitive interviewing to improve item framing, comprehensibility and salience; and administration of a survey to facilitate exploratory factor analyses and psychometric evaluation of resulting constructs. After this initial evaluation, we envisioned sharing the resulting scale measures with other clinical researchers, who could prospectively evaluate the scales’ ability to predict adherence among participants in a new HIV prevention clinical trial.
Conceptual framework
We conducted a comprehensive review of the peer-reviewed literature to identify articles describing psychometrically validated scales or other measures related to adherence or compliance. We included measures of adherence in the context of both treatment and prevention to a range of conditions, including HIV, pregnancy prevention, and other disease areas (i.e., blood pressure, diabetes). Measures assessing adherence within clinical trial contexts were of particular interest. In addition, we conducted additional searches on measures assessing motivations for clinical trial participation, as well as measures of social desirability bias.
Based on the literature review, we developed a conceptual framework (Fig 1) depicting potential domains for adherence screening and monitoring tools. As depicted on the left-hand side of the diagram, our screener tool would ideally identify whether a potential trial participant was likely to be adherent, unintentionally non-adherent, or intentionally non-adherent. These adherence categories are based in the Necessities-Concerns Framework [27], a conceptual model postulating that adherence to a range of chronic disease medications is explained by an individual’s perceived need for treatment and their concerns about the potential consequences of taking it [28]. Despite limited application of the framework to prevention, findings from the qualitative studies described earlier are consistent with the framework’s adherence constructs. Predisposing factors which emerged in the qualitative HIV prevention literature and for which we identified potential screening measures include: reasons for trial participation [29–36]; beliefs about clinical trials or the products being tested [37, 38]; and personal attributes such as commitment, self-efficacy, or agency [21, 38–40]. The literature review also identified barriers and facilitators of adherence that might be experienced once a trial participant began using the study product and which could be assessed over time, including: the beneficial or negative impact of trial staff [38, 41, 42]; practical constraints, including travel, cost of participation, and impact on daily life [22, 37, 43, 44]; experience of side effects [44–46]; and impact of stigma [30, 44]. These constructs are presented on the right-hand side of our conceptual framework. Finally, the larger box within which predisposing and experienced factors are located represents the potential for some participants to respond in a socially desirable manner. We reviewed and included measures of social desirability bias in this study [47–50]. In this paper, we describe the outcomes of our survey and initial validation procedures.
Methods
Between February and June 2016, we administered a cross-sectional survey in four South African clinical trial sites located in Johannesburg, Cape Town, Madibeng and Ladysmith. Prior to implementation, the study was reviewed and approved by the FHI 360 Protection of Human Subjects Committee, the Wits Human Research Ethics Committee in Johannesburg, and Pharma Ethics for Madibeng and Ladysmith sites. The survey was administered electronically on tablets by same-sex interviewers, with a total of 709 women. Eligibility included being between the ages of 18–40 and willingness to provide written informed consent which was captured electronically, prior to taking part in the survey. Participants were both former participants (FTP) of vaginal ring or other HIV prevention clinical trials and trial-naïve participants (TNP). Participants could choose to hear and respond to all or individual survey items in English or their local language (i.e., isiZulu in Johannesburg and Ladysmith, Xhosa in Cape Town, and Tswana in Madibeng.)
The survey was divided into three sections. All women regardless of trial experience responded to 76 “screener” items measuring potential predictors of adherence; 26 culturally relevant items from the Marlowe-Crowne social desirability scale (SDB) [49] were also distributed in groups within this section. Participants received a point for each item in which their response was in the more socially-desirable direction. Only former trial participants responded to an additional set of 48 monitoring items assessing product-specific adherence attitudes and behaviors. A six-point scale ranging from “1 = Disagree A Lot” to “6 = Agree A Lot” was used for potential adherence screening and monitoring items. The last section, administered to all participants, included additional demographic and psychosocial variables, including age and education level, as well as whether a participant earned her own income (0 = no; 1 = yes), believed her partner had other partners (0 = no; 1 = unsure; 2 = yes) and whether she was 1 = willing, 2 = persuaded, or 3 = forced to have sex at the last sex act.
Exploratory dimensional analysis (EDA)
We conducted separate EDAs of screening and monitoring items. Prior to each EDA, we first examined the response distribution, means, standard deviations, skew and kurtosis of all items, eliminating items with very high mean scores (> 5.8 of maximum 6.0). With each set of items, we conducted an exploratory factor analysis (EFA) with oblique (Promax) rotations and a principal component analysis (PCA) with orthogonal (varimax) rotation, retaining items with loadings of .4 or higher on both procedures, and assessing similarities in the resulting factor structure of the two analyses.
We used both the scree test [51] and the parallel analysis (PA) procedure [52, 53] in our initial determination of the underlying dimensional structure of the screening and the adherence monitoring measures. We also examined the internal consistency of each derived factor and used Cronbach’s Coefficient Alpha statistic [54] to help refine an individual scale by removing items with low inter-item correlations to increase reliability. Our final decision as to whether to keep or remove a specific item was based on the conceptual content of each item as it related to a specific factor.
Initial validation
We qualitatively evaluated the fit between our conceptual framework and the resulting constructs. In addition, we made predictions about the direction and strength of correlations between our adherence screener and monitoring constructs, as well as between scale constructs and other sociodemographic variables. We ran Pearson Product Moment Correlations to test our predictions. Finally, we reran our EDA of screener items separately for FTP and TNP samples to assess whether a different factor structure and/or item composition existed in these two groups.
Results
Sociodemographic information
Overall, 60% of survey participants (n = 425) had participated in past HIV prevention clinical trial research; the majority (n = 339: 79.8%) were former participants of ASPIRE or the Ring Study–two trials evaluating the efficacy of an HIV prevention intravaginal ring, while 74 (17.4%) women had used a vaginal gel in the FACTS trial and 12 (2.8%) had used oral pills in the VOICE trial (Table 1). Trial-naïve participants, who were drawn from the same communities, tended to be younger, but similar to the FTP group on other sociodemographic information.
Screener results
We began with 86 potential screening items and retained 40 items, loading onto six factors (Table 2). The 6-factor solution explained 64% of the variance in the full sample and 57% and 48% in the FTP and TNP samples respectively. Internal reliability of items ranged from acceptable for the Commitment to Research factor (α = .61) to very good for the Partner Disclosure factor (α = .80).
The 6-factor solution mapped well to our conceptual framework (Fig 1), consisting of factors that measured reasons for clinical trial participation (Commitment to Research, Personal & Health Benefits), beliefs about the trial and product (Distrust of Research) and commitment/agency (Trial Incompatibility, Partner Disclosure, Visit Adherence). While the full and subgroup EDAs produced similar underlying factor structures, item composition differed for several factors. For example, in the TNP subgroup, the Distrust factor did not include two items related to the use of experimental products, however, the TNP Distrust factor did include the item “I believe that people who participate in HIV prevention research can experience unpleasant side effects.” This same item did not load on Distrust for the FTP subgroup, but instead, loaded negatively onto the Personal & Health Benefits factor. Additionally, several items indicating potential risk disinhibition (i.e., belief in the therapeutic benefit of an experimental product) loaded onto the Personal & Health Benefits factor for the FTP subgroup, but did not do so for the TNP subgroup. The Trial Incompatibility factor showed the largest differences in item composition by subgroup. Over the full sample, the items suggest participants’ incompatibility or non-alignment with the trial, including being motivated by study reimbursements and having concerns about how others would react to their trial participation. Within the TNP subgroup, most items loading on this factor suggested an external locus of control–that God, luck or others determined their ability to accomplish behaviors. Many of these items did not load onto the Trial Incompatibility factor in the FTP subgroup analysis.
Adherence monitoring results
Adherence monitoring items were adapted during our cognitive interviewing process (not described) to assess attitudes and experiences specific to product use. Because our survey included very few vaginal gel or pill users, we conducted this analysis with FTPs of previous vaginal ring trials only (n = 339). Out of 48 potential adherence monitoring items, we retained 29 items loading on four factors (Table 3), including an “enacted” adherence measure (Ring Removal), several factors related to the presence or absences of practical constraints (Vaginal Ring Doubts and Vaginal Ring Benefits) and Side Effects. The 4-factor solution explained 64% of the variance in items. The resulting scales had moderate to high internal reliability. Although no specific factors emerged that related to Trial Staff or Social Stigma, several items from these domains did load onto the Vaginal Ring Doubts factor.
Social desirability
Overall, trial-naïve participants scored lower on the social desirability measure than former trial participants. Participants who scored high (1 SD above the mean) on the SDB scale scored significantly lower on the Distrust in Research and Trial Incompatibility screening scales as well as the Vaginal Ring Doubts and Concern about Side Effects monitoring scales; they also scored significantly higher in the Commitment to Research, Visit Adherence and Vaginal Ring Benefits scales (Table 4).
Initial construct validation
After developing the scales, we made a priori predictions about the correlations between screener constructs and several sociodemographic variables, as well as with the adherence follow-up measures (Table 5). The bolded cells in Table 4 show where our predictions matched findings. Few of our screener constructs performed as hypothesized relative to the sociodemographic variables. In many cases, we assumed significant relationships between screening scale scores and demographic information when correlations were not significant. However, our predictions of correlations between screener and adherence monitoring scales were often correct. In particular, participants who scored higher on Distrust in Research–and lower on Visit Adherence–were more likely to have high scores on Vaginal Ring Removal, Vaginal Ring Doubts and Side Effects. Conversely, high scores on Personal & Health Benefits and Visit Adherence were associated with high scores on Vaginal Ring Benefits. The Partner Disclosure scale was negatively correlated with Vaginal Ring Removal, but not associated with other monitoring scales. As predicted, participants with low scores on our SDB measure had higher scores on Distrust in Research, as well as Vaginal Ring Removal, Vaginal Ring Doubts and Side Effects.
Correlations between Screening scales and sociodemographic and behavioral variables (as identified in Table 1) shown in non-shaded cells. Correlations between Screening and Monitoring scales shown in shaded cells. Bolded text represents confirmation of hypothesized relationship.
Discussion
The inability of several recently concluded trials to determine the efficacy of new HIV prevention products due in part to low product adherence has prompted the field to consider alternative strategies for trial implementation [55]. This study was based on the premise that achieving product adherence within randomized, placebo-controlled HIV prevention trials is complex, requiring participants to possess not only accurate knowledge and behavioral skills, but also sufficient motivation, social support and life organization. If it were possible to identify and either screen out or more effectively monitor and support individuals with a low propensity to adhere to product use, the ability of a clinical trial to determine product efficacy would be increased. Our study developed two sets of tools, one set to identify individuals at screening who exhibit substantial adherence-related challenges and a second set aimed at monitoring adherence challenges over the course of trial participation with the goal of achieving better overall adherence during the trial. All scale items have been thoroughly evaluated in English and three South African languages for comprehensibility, salience and ease of response. Although not presented in this paper, product-related items for monitoring scales have also been adapted to other product contexts, including oral pills and vaginal gels.
Screening measures
This study produced a set of six scale measures that have the potential to identify individuals at screening who may face challenges with adherence to clinical trial requirements and product use. Two of the screening scales, Commitment to Research and Personal & Health Benefits, represent reasons identified by others as underlying motivations to participate in a range of prevention trials [36, 56–59]. Altruism (a component of the Commitment to Research scale), expressing feelings or actions that show a selfless concern for others, was identified as an independent predictor of adherence in a randomized, placebo controlled trial assessing use of estrogen for the prevention of stroke [60]. It was endorsed by the vast majority of participants in the VaxGen trial as a primary reason for joining the trial [31, 61]; it was also identified in qualitative sub-studies with men-who-have-sex with men (MSM) from U.S. sites of the iPrEX trial [62]. While women participating in the ADAPT open-label pre-exposure prophylaxis (PrEP) study in Cape Town, South Africa were engaged in research to benefit themselves, many also identified “Ubuntu”–contributing to the wellbeing of one’s community–as a strong motivator for study participation [63]. Women, selected to participate in a Fem-PrEP sub-study whose mean drug concentration levels throughout the trial were moderate to high, reported that a mix of personal benefits and altruism motivated their adherence to study product [10]. Indeed, personal benefits, such as access to good healthcare, access to social services or routine testing for HIV and other conditions, were more frequently mentioned as a reason to participate in HIV vaccine research among high-risk drug-using women in the U.S. [64], as well as women participating in a PrEP trial in South Africa [65].
A third set of items produced from our screening items related to Distrust of Research, a construct identified as limiting trial participation among African Americans in cardiovascular trials [66] and HIV prevention trials [36, 67, 68], high-risk women [64] and minorities in the U.S.[68]. In the VOICE-C sub-study, both women and men in Uganda, Zimbabwe and South Africa described how a lack of understanding and trust in research and the product being tested made it difficult for some women to adhere to product use [69]. Similarly, South African women participating in the qualitative sub-study of the ADAPT open-label PrEP study revealed an underlying level of skepticism about PrEP and HIV prevention research more generally [63]. As the authors note, this skepticism did not lead women to reject the research outright, but did lead some to approach study and product use requirements cautiously. Based on their qualitative data, they theorize that participants who hold strong feelings of fear and distrust may still join PrEP trials or open-label studies, particularly if they see high value from other aspects of trial participation, while intentionally avoiding PrEP use and actively discouraging others from using their products.
Additionally, three other potential screening scales assess aspects of the participants’ personal, social and daily contexts that affect their ability to adhere to trial and product use. They include a 15-item Trial Incompatibility scale, a five-item Partner Disclosure scale, and a three-item Visit Adherence scale. In contrast to the Distrust in Research scale, the Trial Incompatibility scale appears to represent attitudes towards health and a life context that is disorganized and therefore doesn’t support the exigencies of clinical trial participation. Although the composition of scale items substantially differs between former trial participants and those who were trial-naïve, they both include items indicating motivation for monetary rather than health reasons for trial participation and that others may influence their health and/or trial-related behaviors. Both also have items suggesting incompatibility with the trial due to disliking risk or the time commitment required by participation. The scale solution produced from the trial-naïve sample also includes several items suggesting that other forces outside of their control (God or fate, for example) influence their behaviors. The Perceptions and Practicalities Approach, a framework developed to explain non-adherence of therapeutic medications, suggests that unintentional non-adherence is driven by lack of capacity and resources which might include perceived difficulty in organizing their life circumstances, lack of social support [28, 70]. The inability to disclose to sexual partners about one’s participation in research and use of study products has been identified by numerous researchers as barrier to product use [13, 71]. The Visit Adherence scale may tap into an individual’s commitment and/or ability to organize their daily lives around health visits, a construct that has been shown to relate to adherence [72].
Monitoring scales
We produced a set of four monitoring scale measures that could be used to tailor counseling and address specific barriers or concerns to product use over trial follow-up. The Vaginal Ring Removal scale is composed of items expressing circumstances in which participants may have removed their ring since the previous follow-up visit. Because participants can express a degree of (dis)agreement to the items, they may be more willing to indicate problems with adherence than if asked direct “yes” or “no” questions. The Vaginal Ring Doubts, Vaginal Ring Benefits and Side Effects scales could provide counselors with some indications of whether ring use is perceived as potentially harmful or beneficial and how well it fits into their daily lives and sexual contexts. Several items on the Vaginal Ring Benefits scale indicated belief in the therapeutic benefit of ring use–a belief that might not be accurate within the context of a randomized, placebo-controlled trial.
Social desirability bias
Ancillary studies from several past HIV prevention trials have found that a non-negligible group of women report high adherence despite having little or no intention of using their study product [7, 13]. However, to date, there do not appear to be any tools available to identify participants who are predisposed to exaggerate their adherence. We adapted and included a measure of social desirability bias, the Marlowe-Crowne scale, to explore, through cognitive interviewing, whether these items translated cross-culturally, and if so, whether the set of items might be used in combination with other scale scores to identify women with potential adherence problems. The Marlowe-Crowne scale has been described as assessing two underlying factors that lead individuals to misrepresent their behaviors–impression management and self-deception [50]. Because the SDB measure was associated in predictable ways with our screening and monitoring measures, it might be a useful tool to identify a subset of participants whose reported trial-related perceptions and behaviors are potentially “too good to be true”. However, before using such a tool to actively screen out potential participants, further research is needed to determine the predictive validity of the measure as it relates to an objective adherence measure. It is notable that SDB scores in our study were higher, on average, among former trial participants than women who had not previously participated in an HIV prevention trial. It is unclear, however, whether trial participation itself conditions individuals to manage the impressions that others have of them, whether those who choose to join trials differ from non-participants on one or both of these underlying factors (i.e., impression management and self-deception), or whether they are generally just more agreeable people.
We believe that the scale approach pursued in this study offers a novel and promising strategy to improving adherence within future HIV prevention clinical trials. Nevertheless, our study has several limitations. First, screening items could perform differently if individuals believe their responses could affect enrollment. Further research is needed to assess the predictive validity of our screening scales, as well as the timing and approach to their administration. We invite collaboration with clinical researchers to integrate these screening and/or monitoring scales into future trials or demonstration studies to determine how well one or more of these scales correlate with objective biomarkers of adherence. Second, the psychometric properties of several scales could be improved. For example, several screening scales, including Commitment to Research, Personal and Health Benefits and Partner Disclosure, are moderately to highly negatively skewed, meaning that a large proportion of participants reported high levels of agreement with items. Without prospective validation, it is difficult to determine whether this is problematic, reducing the scales’ ability to provide meaningful information about participants’ trial-related motivations and partner contexts. On the other hand, perhaps they are adequately sensitive and specific enough to identify the subset of participants whose low levels of commitment, concerns about health impacts, or inability to disclose to a partner would drive intentional non-adherence. Finally, the factor solutions for several of our scales differed for women who had previous trial-experience versus those who were trial naïve. Because most HIV prevention trials will recruit women with a range of trial experience, researchers may want to consider using all items initially, assessing item loading and internal reliability of each scale before analysis.
Conclusion
Product adherence is essential for the successful evaluation of new HIV prevention candidates in clinical trials, but determining how best to measure and optimize adherence remains elusive. Increasingly, trials are relying on objective markers to detect whether products are being used–yet these measures provide only part of the picture. They do not, for example, provide information about why a participant has low or no evidence of product use, or whether and how such adherence barriers can be resolved. Therefore, despite shortcomings, behavioral adherence assessments which are inexpensive, non-invasive, and allow for immediate feedback, are likely to remain a standard component of trials. This study lays the groundwork for the development of a more integrated biomedical-behavioral approach to achieving high levels of adherence within HIV prevention trials. Ultimately, we envision being able to implement brief, easy to implement tools that identify attitudinal, partner-related or other contextual barriers likely to impede product adherence within trials. Once prospectively validated, the screening tool could be used to modify recruitment procedures, either screening out or more effectively addressing the concerns of potential participants whose propensity to adhere to product and trial requirements is low. Because such information would be collected prior to a participant’s randomization, it could complement biomarker adherence measures in determining the true efficacy of the product being tested. Finally, the periodic administration of monitoring tools to assess product-related beliefs and concerns could facilitate a more rapid and tailored intervention by clinic staff to better understand contexts of non-use, address product-related doubts, manage perceived side effects or ensure that participants do not misunderstand product-related benefits in ways that increase their risk of HIV.
Acknowledgments
This study would not have been possible without the efforts of the research assistants in each site who took great care to evaluate participants’ understanding of adherence-related items during cognitive interviews, summarize and share their insights on weekly calls that could last several hours at a time, and then administer hundreds of surveys of the revised items. They include:
- Wits Reproductive Health & HIV Institute, Johannesburg: Portia Duma, Florence Mathebula, Angeline Mzolo, Amukelani Vuma
- Madibeng Centre for Research, Brits: Rose Baaitjies, Leonie Jansen van Vuuren, Mamphi Mafoka, Selina Mashabane, Mavis Senne, Nomonde Sibabela
- Qhakaza Mbokodo Research Clinic, Ladysmith: Thabile Khumalo, Nomonde Mtshali, Nqobile Andiswa Sibisi
- Desmond Tutu HIV Centre, Cape Town: Nomvuyiso Wadie Dyani, Ntombomzi Mcanjana, Ntombozuko Ngetu, Jabulisile Zuma
We are grateful to all of them for their skillful contributions!
We would also like to thank Mr. Andres Martinez for his guidance and additional statistical support and to Ms. Eunice Okumu, who helped manage the project, including keeping in close communication with the sites, and management of site contracts, institutional review board submissions and budget reviews. It has truly been a team effort!
References
- 1. Abdool Karim Q, Abdool Karim SS, Frohlich JA, Grobler AC, Baxter C, Mansoor LE, et al. Effectiveness and safety of tenofovir gel, an antiretroviral microbicide, for the prevention of HIV infection in women. Science. 2010;329(5996):1168–74. pmid:20643915; PubMed Central PMCID: PMCPMC3001187.
- 2. Baeten JM, Donnell D, Ndase P, Mugo NR, Campbell JD, Wangisi J, et al. Antiretroviral prophylaxis for HIV prevention in heterosexual men and women. N Engl J Med. 2012;367(5):399–410. pmid:22784037; PubMed Central PMCID: PMCPMC3770474.
- 3. Thigpen MC, Kebaabetswe PM, Paxton LA, Smith DK, Rose CE, Segolodi TM, et al. Antiretroviral preexposure prophylaxis for heterosexual HIV transmission in Botswana. N Engl J Med. 2012;367(5):423–34. pmid:22784038.
- 4. Choopanya K, Martin M, Suntharasamai P, Sangkum U, Mock PA, Leethochawalit M, et al. Antiretroviral prophylaxis for HIV infection in injecting drug users in Bangkok, Thailand (the Bangkok Tenofovir Study): a randomised, double-blind, placebo-controlled phase 3 trial. Lancet. 2013;381(9883):2083–90. pmid:23769234.
- 5. Baeten JM, Palanee-Phillips T, Brown ER, Schwartz K, Soto-Torres LE, Govender V, et al. Use of a Vaginal Ring Containing Dapivirine for HIV-1 Prevention in Women. N Engl J Med. 2016. pmid:26900902; PubMed Central PMCID: PMCPMC4993693.
- 6. Van Damme L, Corneli A, Ahmed K, Agot K, Lombaard J, Kapiga S, et al. Preexposure prophylaxis for HIV infection among African women. N Engl J Med. 2012;367(5):411–22. pmid:22784040; PubMed Central PMCID: PMCPMC3687217.
- 7. Corneli AL, Deese J, Wang M, Taylor D, Ahmed K, Agot K, et al. FEM-PrEP: adherence patterns and factors associated with adherence to a daily oral study product for pre-exposure prophylaxis. J Acquir Immune Defic Syndr. 2014;66(3):324–31. pmid:25157647; PubMed Central PMCID: PMCPMC4059551.
- 8. Marrazzo JM, Ramjee G, Richardson BA, Gomez K, Mgodi N, Nair G, et al. Tenofovir-based preexposure prophylaxis for HIV infection among African women. N Engl J Med. 2015;372(6):509–18. pmid:25651245; PubMed Central PMCID: PMCPMC4341965.
- 9. Amico KR, Marcus JL, McMahan V, Liu A, Koester KA, Goicochea P, et al. Study product adherence measurement in the iPrEx placebo-controlled trial: concordance with drug detection. J Acquir Immune Defic Syndr. 2014;66(5):530–7. pmid:24853306; PubMed Central PMCID: PMCPMC4110718.
- 10. Corneli A, Perry B, Agot K, Ahmed K, Malamatsho F, Van Damme L. Facilitators of adherence to the study pill in the FEM-PrEP clinical trial. PLoS One. 2015;10(4):e0125458. pmid:25867624; PubMed Central PMCID: PMCPMC4395082.
- 11. van der Straten A, Stadler J, Luecke E, Laborde N, Hartmann M, Montgomery ET, et al. Perspectives on use of oral and vaginal antiretrovirals for HIV prevention: the VOICE-C qualitative study in Johannesburg, South Africa. J Int AIDS Soc. 2014;17(3 Suppl 2):19146. pmid:25224610; PubMed Central PMCID: PMCPMC4163995.
- 12. van der Straten A, Stadler J, Montgomery E, Hartmann M, Magazi B, Mathebula F, et al. Women's experiences with oral and vaginal pre-exposure prophylaxis: the VOICE-C qualitative study in Johannesburg, South Africa. PLoS One. 2014;9(2):e89118. pmid:24586534; PubMed Central PMCID: PMCPMC3931679.
- 13. van der Straten A, Montgomery ET, Musara P, Etima J, Naidoo S, Laborde N, et al. Disclosure of pharmacokinetic drug results to understand nonadherence. AIDS. 2015;29(16):2161–71. pmid:26544581; PubMed Central PMCID: PMCPMC4638164.
- 14. Haberer JE, Bangsberg DR, Baeten JM, Curran K, Koechlin F, Amico KR, et al. Defining success with HIV pre-exposure prophylaxis: a prevention-effective adherence paradigm. AIDS. 2015;29(11):1277–85. pmid:26103095; PubMed Central PMCID: PMCPMC4480436.
- 15. Stalter RM, Moench TR, MacQueen KM, Tolley EE, Owen DH, Consortium for Ring A. Biomarkers and biometric measures of adherence to use of ARV-based vaginal rings. J Int AIDS Soc. 2016;19(1):20746. pmid:27142091.
- 16. Williams AB, Amico KR, Bova C, Womack JA. A proposal for quality standards for measuring medication adherence in research. AIDS Behav. 2013;17(1):284–97. pmid:22407465; PubMed Central PMCID: PMCPMC3434290.
- 17. van der Straten A, Brown ER, Marrazzo JM, Chirenje MZ, Liu K, Gomez K, et al. Divergent adherence estimates with pharmacokinetic and behavioural measures in the MTN-003 (VOICE) study. J Int AIDS Soc. 2016;19(1):20642. pmid:26850270; PubMed Central PMCID: PMCPMC4744323.
- 18. Woodsong C, MacQueen K, Amico KR, Friedland B, Gafos M, Mansoor L, et al. Microbicide clinical trial adherence: insights for introduction. J Int AIDS Soc. 2013;16:18505. pmid:23561044; PubMed Central PMCID: PMCPMC3619032.
- 19.
Tolley E, Friedland B, Gafos M, Amico K, Van Damme L, Woodsong C, et al. Socio-economic and behavioral factors influencing choice, adherence and success of microbicide formulations. In: dN J, S B, editors. Drug delivery and development of anti-HIV microbicides. Singapore: Pan Stanford Publishing; 2014. p. 569–628.
- 20. MacQueen KM, Tolley EE, Owen DH, Amico KR, Morrow KM, Moench T, et al. An interdisciplinary framework for measuring and supporting adherence in HIV prevention trials of ARV-based vaginal rings. J Int AIDS Soc. 2014;17(3 Suppl 2):19158. pmid:25224617; PubMed Central PMCID: PMCPMC4164000.
- 21. Morisky DE, Green LW, Levine DM. Concurrent and predictive validity of a self-reported measure of medication adherence. Med Care. 1986;24(1):67–74. pmid:3945130.
- 22. Johnson MO, Neilands TB, Dilworth SE, Morin SF, Remien RH, Chesney MA. The role of self-efficacy in HIV treatment adherence: validation of the HIV Treatment Adherence Self-Efficacy Scale (HIV-ASES). J Behav Med. 2007;30(5):359–70. pmid:17588200; PubMed Central PMCID: PMCPMC2423379.
- 23. Wu JR, Chung M, Lennie TA, Hall LA, Moser DK. Testing the psychometric properties of the Medication Adherence Scale in patients with heart failure. Heart Lung. 2008;37(5):334–43. pmid:18790334; PubMed Central PMCID: PMCPMC2796425.
- 24. Mahoney CA, Thombs DL, Howe CZ. The art and science of scale development in health education research. Health Educ Res. 1995;10(1):1–10. pmid:10150418.
- 25.
DeVellis RF. Scale development: theory and applications. 2nd ed. Thousand Oaks, Calif.: Sage Publications, Inc.; 2003. viii, 171 p. p.
- 26. Bowling A. Just one question: If one question works, why ask several? Journal of Epidemiological Community Health. 2005;59(5):342–5.
- 27. Horne R, Cooper V, Gellaitry G, Date HL, Fisher M. Patients' perceptions of highly active antiretroviral therapy in relation to treatment uptake and adherence: the utility of the necessity-concerns framework. J Acquir Immune Defic Syndr. 2007;45(3):334–41. pmid:17514019.
- 28. Horne R, Chapman SC, Parham R, Freemantle N, Forbes A, Cooper V. Understanding patients' adherence-related beliefs about medicines prescribed for long-term conditions: a meta-analytic review of the Necessity-Concerns Framework. PLoS One. 2013;8(12):e80633. pmid:24312488; PubMed Central PMCID: PMCPMC3846635.
- 29. Aby JS, Pheley AM, Steinberg P. Motivation for participation in clinical trials of drugs for the treatment of asthma, seasonal allergic rhinitis, and perennial nonallergic rhinitis. Annals of allergy, asthma & immunology: official publication of the American College of Allergy, Asthma, & Immunology. 1996;76(4):348–54. Epub 1996/04/01. pmid:8612117.
- 30. Balfour L, Corace K, Tasca GA, Tremblay C, Routy J-P, Angel JB. Altruism motivates participation in a therapeutic HIV vaccine trial (CTN 173). AIDS Care. 2010;22(11):1403–9. 2010-21378-014. pmid:20936540
- 31. Colfax G, Buchbinder S, Vamshidar G, Celum C, McKirnan D, Neidig J, et al. Motivations for participating in an HIV vaccine efficacy trial. J Acquir Immune Defic Syndr. 2005;39(3):359–64. pmid:15980699.
- 32. Doshi MS, Kulkarni SP, Ghia CJ, Gogtay NJ, Thatte UM. Evaluation of factors that motivate participants to consent for non-therapeutic trials in India. Journal of Medical Ethics: Journal of the Institute of Medical Ethics. 2013;39(6):391–6. 2013-18270-013.
- 33. Gabbay M, Thomas J. When free condoms and spermicide are not enough: barriers and solutions to participant recruitment to community-based trials. Controlled clinical trials. 2004;25(4):388–99. Epub 2004/08/07. pmid:15296813.
- 34. Lee SJ, Lenert L, Weisman S, Kavanaugh A. Factors affecting rheumatoid arthritis patients' decisions to participate in clinical trials. The Journal of rheumatology. 2005;32(12):2317–25. Epub 2005/12/07. pmid:16331756.
- 35. Schuber PA. Measuring attitudes toward participation in cancer treatment and cancer prevention trials: The Attitudes Toward Cancer Trials Scales (ACTS). Journal of Nursing Measurement. 2008;16(2):136–52. 2009-06730-005. pmid:18939718
- 36. Sengupta S, Strauss RP, DeVellis R, Quinn SC, DeVellis B, Ware WB. Factors affecting African-American participation in AIDS research. J Acquir Immune Defic Syndr. 2000;24(3):275–84. pmid:10969353.
- 37. Colwell HH, Mathias SD, Cimms TA, Rothman M, Friedman AJ, Patrick DL. The ORTHO BC-SAT—a satisfaction questionnaire for women using hormonal contraceptives. Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation. 2006;15(10):1621–31. Epub 2006/10/13. pmid:17031502.
- 38.
DiMatteo MR, Hays RD, Gritz ER, Bastani R, Crane L, Elashoff R, et al. Adherence Determinants Questionnaire. 1993.
- 39. Aragones C, Sanchez L, Campos JR, Perez J. Antiretroviral therapy adherence in persons with HIV/AIDS in Cuba. MEDICC Review. 2011;13(2):17–23. pmid:21654587.
- 40. Huang L, Li L, Zhang Y, Li H, Li X, Wang H. Self-efficacy, medication adherence, and quality of life among people living with HIV in Hunan Province of China: a questionnaire survey. Journal of the Association of Nurses In AIDS Care. 2013;24(2):145–53. http://dx.doi.org/10.1016/j.jana.2012.04.006. pmid:22770801.
- 41. de Carvalho Leite JC, Seminotti N, Fontoura Freitas P, de Lourdes Drachler M. The Psychosocial Treatment Expectations Questionnaire (PTEQ) for alcohol problems: Development and early validation. European Journal of Psychological Assessment. 2011;27(4):228–36. 2011-21479-003. PsycARTICLES Identifier: jpa-27-4-228. First Author & Affiliation: de Carvalho Leite, José Carlos.
- 42. Bova C, Fennie KP, Watrous E, Dieckhaus K, Williams AB. The health care relationship (HCR) trust scale: development and psychometric evaluation. Res Nurs Health. 2006;29(5):477–88. pmid:16977644.
- 43. Coetzee B, Kagee A. The development of an inventory to assess the structural barriers to clinic attendance and pill-taking amongst users of antiretroviral therapy. AIDS and behavior. 2013;17(1):319–28. http://dx.doi.org/10.1007/s10461-012-0374-z. pmid:23229338.
- 44. Murphy DA, Sarr M, Durako SJ, Moscicki AB, Wilson CM. Barriers to HAART adherence among human immunodeficiency virus-infected adolescents. Archives of Pediatrics and Adolescent Medicine. 2003;157(3):249–55. pmid:12622674.
- 45. Wilson KJ, Doxanakis A, Fairley CK. Predictors for non-adherence to antiretroviral therapy. Sexual health. 2004;1:251–7. pmid:16335755.
- 46. Buckshee K, Kumar S, Saraya L. Contraceptive vaginal ring—a rising star on the contraceptive horizon. Advances in contraception: the official journal of the Society for the Advancement of Contraception. 1990;6(3):177–83. Epub 1990/09/01. pmid:2123369.
- 47. Abbott RA, Ploubidis GB, Huppert FA, Kuh D, Croudace TJ. An Evaluation of the Precision of Measurement of Ryff's Psychological Well-Being Scales in a Population Sample. Social indicators research. 2010;97(3):357–73. Epub 2010/06/15. pmid:20543875; PubMed Central PMCID: PMCPMC2879484.
- 48. af Wåhlberg AE. Social desirability effects in driver behavior inventories. Journal of safety research. 2010;41(2):99–106. 2010-10545-004. pmid:20497795
- 49. Crowne DP, Marlowe D. A new scale of social desirability independent of psychopathology. J Consult Psychol. 1960;24:349–54. pmid:13813058.
- 50. Paulhus DL. Two-Component Models of Socially Desirable Responding. Journal of Personality and Social Psychology. 1984;46(3):598–609.
- 51. Cattell RB. The scree test for the number of factors. Multivariate Behavioral Research. 1966;1:245–76. pmid:26828106
- 52. Horn JL. A rationale and test for the number of factors in factor analysis Psychometrika. 1965;30:179–85. pmid:14306381
- 53. O'Connor BP. SPSS and SAS programs for determining the number of components using parallel analysis and velicer's MAP test. Behav Res Methods Instrum Comput. 2000;32(3):396–402. pmid:11029811.
- 54. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.
- 55.
AVAC, CONRAD. Workshop on Alternative Trial Designs for Microbicides. 2014.
- 56. Dhalla S, Poole G. Motivators of enrolment in HIV vaccine trials: a review of HIV vaccine preparedness studies. AIDS Care. 2011;23(11):1430–47. pmid:21722022.
- 57. Koblin BA, Heagerty P, Sheon A, Buchbinder S, Celum C, Douglas JM, et al. Readiness of high-risk populations in the HIV Network for Prevention Trials to participate in HIV vaccine efficacy trials in the United States. AIDS. 1998;12(7):785–93. pmid:9619811.
- 58. MacQueen KM, Vanichseni S, Kitayaporn D, Lin LS, Buavirat A, Naiwatanakul T, et al. Willingness of injection drug users to participate in an HIV vaccine efficacy trial in Bangkok, Thailand. J Acquir Immune Defic Syndr. 1999;21(3):243–51. pmid:10421249.
- 59. Newman PA, Logie C, James L, Charles T, Maxwell J, Salam K, et al. "Speaking the dialect": understanding public discourse in the aftermath of an HIV vaccine trial shutdown. Am J Public Health. 2011;101(9):1749–58. pmid:21778490; PubMed Central PMCID: PMCPMC3154228.
- 60. Rosenbaum JR, Wells CK, Viscoli CM, Brass LM, Kernan WN, Horwitz RI. Altruism as a reason for participation in clinical trials was independently associated with adherence. J Clin Epidemiol. 2005;58(11):1109–14. pmid:16223653.
- 61. Perisse AR, Schechter M, Moreira RI, do Lago RF, Santoro-Lopes G, Harrison LH. Willingness to participate in HIV vaccine trials among men who have sex with men in Rio de Janeiro, Brazil. Projeto Praca Onze Study Group. J Acquir Immune Defic Syndr. 2000;25(5):459–63. pmid:11141246.
- 62. Gilmore HJ, Liu A, Koester KA, Amico KR, McMahan V, Goicochea P, et al. Participant experiences and facilitators and barriers to pill use among men who have sex with men in the iPrEx pre-exposure prophylaxis trial in San Francisco. AIDS Patient Care STDS. 2013;27(10):560–6. pmid:24093809; PubMed Central PMCID: PMCPMC3791030.
- 63. Amico KR, Wallace M, Bekker LG, Roux S, Atujuna M, Sebastian E, et al. Experiences with HPTN 067/ADAPT Study-Provided Open-Label PrEP Among Women in Cape Town: Facilitators and Barriers Within a Mutuality Framework. AIDS Behav. 2016. pmid:27317411.
- 64. Voytek CD, Jones KT, Metzger DS. Selectively willing and conditionally able: HIV vaccine trial participation among women at "high risk" of HIV infection. Vaccine. 2011;29(36):6130–5. pmid:21704110; PubMed Central PMCID: PMCPMC3164286.
- 65. Macphail C, Delany-Moretlwe S, Mayaud P. 'It's not about money, it's about my health': determinants of participation and adherence among women in an HIV-HSV2 prevention trial in Johannesburg, South Africa. Patient Prefer Adherence. 2012;6:579–88. pmid:22936844; PubMed Central PMCID: PMCPMC3429154.
- 66. Braunstein JB, Sherber NS, Schulman SP, Ding EL, Powe NR. Race, medical researcher distrust, perceived harm, and willingness to participate in cardiovascular prevention trials. Medicine (Baltimore). 2008;87(1):1–9. pmid:18204365.
- 67. Newman PA, Duan N, Lee SJ, Rudy E, Seiden D, Kakinami L, et al. Willingness to participate in HIV vaccine trials: the impact of trial attributes. Prev Med. 2007;44(6):554–7. pmid:17275895; PubMed Central PMCID: PMCPMC2819663.
- 68. Newman PA, Duan N, Roberts KJ, Seiden D, Rudy ET, Swendeman D, et al. HIV vaccine trial participation among ethnic minority communities: barriers, motivators, and implications for recruitment. J Acquir Immune Defic Syndr. 2006;41(2):210–7. pmid:16394854.
- 69. Montgomery ET, van der Straten A, Stadler J, Hartmann M, Magazi B, Mathebula F, et al. Male Partner Influence on Women's HIV Prevention Trial Participation and Use of Pre-exposure Prophylaxis: the Importance of "Understanding". AIDS Behav. 2015;19(5):784–93. pmid:25416076; PubMed Central PMCID: PMCPMC4416996.
- 70.
Horne R, Weinman J, Barber N, Elliott R, Morgan M, Cribb A, et al. Concordance, adherence and compliance in medicine taking. London: NCCSDO. 2005;2005:40–6.
- 71. Montgomery ET, van der Straten A, Chidanyika A, Chipato T, Jaffar S, Padian N. The importance of male partner involvement for women's acceptability and adherence to female-initiated HIV prevention methods in Zimbabwe. AIDS Behav. 2011;15(5):959–69. pmid:20844946; PubMed Central PMCID: PMCPMC3111667.
- 72. Magazi B, Stadler J, Delany-Moretlwe S, Montgomery E, Mathebula F, Hartmann M, et al. Influences on visit retention in clinical trials: insights from qualitative research during the VOICE trial in Johannesburg, South Africa. BMC Womens Health. 2014;14:88. pmid:25065834; PubMed Central PMCID: PMCPMC4115485.