Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Acceptability of a dapivirine levonorgestrel vaginal ring in two Phase 1 trials (MTN-030/IPM 041 and MTN-044/IPM 053/CCN019): Implications for multipurpose prevention technology development

  • Barbara A. Friedland ,

    Roles Conceptualization, Methodology, Writing – original draft, Writing – review & editing

    bfriedland@popcouncil.org

    Affiliation Center for Biomedical Research, Population Council, New York, NY, United States of America

  • Holly Gundacker,

    Roles Data curation, Formal analysis, Writing – original draft, Writing – review & editing

    Affiliation Statistical Center for HIV/AIDS Research and Prevention (SCHARP), Fred Hutchinson Cancer Center, Seattle, Washington, United States of America

  • Sharon L. Achilles,

    Roles Investigation, Methodology, Project administration, Supervision, Writing – review & editing

    Current address: Bill & Melinda Gates Foundation, Seattle, Washington, United States of America

    Affiliations Department of Obstetrics, Gynecology, and Reproductive Sciences, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America, Magee-Womens Research Institute, Pittsburgh, Pennsylvania, United States of America

  • Beatrice A. Chen,

    Roles Investigation, Supervision, Writing – review & editing

    Affiliations Department of Obstetrics, Gynecology, and Reproductive Sciences, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America, Magee-Womens Research Institute, Pittsburgh, Pennsylvania, United States of America

  • Craig Hoesley,

    Roles Investigation, Supervision, Writing – review & editing

    Affiliation University of Alabama at Birmingham Heersink School of Medicine, Birmingham, Alabama, United States of America

  • Barbra A. Richardson,

    Roles Investigation, Supervision, Writing – review & editing

    Affiliations Vaccine and Infectious Disease Division, Fred Hutchinson Cancer Center, Seattle, Washington, United States of America, Department of Biostatistics and Global Health, University of Washington, Seattle, Washington, United States of America

  • Clifton W. Kelly,

    Roles Data curation, Formal analysis, Methodology, Writing – review & editing

    Affiliation Statistical Center for HIV/AIDS Research and Prevention (SCHARP), Fred Hutchinson Cancer Center, Seattle, Washington, United States of America

  • Jeanna Piper,

    Roles Funding acquisition, Project administration, Writing – review & editing

    Affiliation National Institutes of Allergy and Infectious Disease, NIH, Bethesda, Maryland, United States of America

  • Sherri Johnson,

    Roles Project administration, Writing – review & editing

    Affiliation FHI 360, Durham, North Carolina, United States of America

  • Brid Devlin,

    Roles Resources, Supervision, Writing – review & editing

    Affiliation International Partnership for Microbicides, Silver Spring, Maryland, United States of America

  • John Steytler,

    Roles Investigation, Writing – review & editing

    Affiliation International Partnership for Microbicides, Silver Spring, Maryland, United States of America

  • Kyle Kleinbeck,

    Roles Resources, Writing – review & editing

    Affiliation International Partnership for Microbicides, Silver Spring, Maryland, United States of America

  • Bindi Dangi,

    Roles Resources, Writing – review & editing

    Affiliation International Partnership for Microbicides, Silver Spring, Maryland, United States of America

  • Chantél Friend,

    Roles Resources, Writing – review & editing

    Affiliation International Partnership for Microbicides, Silver Spring, Maryland, United States of America

  • Mei Song,

    Roles Methodology, Project administration, Writing – review & editing

    Affiliations Department of Obstetrics, Gynecology, and Reproductive Sciences, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America, Magee-Womens Research Institute, Pittsburgh, Pennsylvania, United States of America

  • Barbara Mensch,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Population Council, New York, NY, United States of America

  • Ariane van der Straten,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation RTI International, San Francisco, CA, United States of America

  • Cindy Jacobson,

    Roles Resources, Writing – review & editing

    Current address: FHI360, Durham, NC, United States of America

    Affiliation Department of Pharmaceutical Sciences, School of Pharmacy, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America

  • Craig W. Hendrix,

    Roles Methodology, Writing – review & editing

    Affiliation Division of Clinical Pharmacology, Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, Maryland, United States of America

  • Jill Brown,

    Roles Investigation, Writing – review & editing

    Current address: Uniformed Services University of the Health Sciences, Bethesda, Maryland, United States of America

    Affiliation Contraceptive Development Program, DIPHR, National Institute of Child Health and Human Development, NIH, Bethesda, Maryland, United States of America

  • Diana Blithe,

    Roles Funding acquisition, Project administration, Supervision, Writing – review & editing

    Affiliation Contraceptive Development Program, DIPHR, National Institute of Child Health and Human Development, NIH, Bethesda, Maryland, United States of America

  • Sharon L. Hiller,

    Roles Conceptualization, Funding acquisition, Methodology, Supervision, Writing – review & editing

    Affiliations Department of Obstetrics, Gynecology, and Reproductive Sciences, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America, Magee-Womens Research Institute, Pittsburgh, Pennsylvania, United States of America

  •  [ ... ],
  • on behalf of the MTN-030/IPM 041 and MTN-044/IPM 053/CCN019 Protocol Teams for the Microbicide Trials Network and the Contraceptive Clinical Trials Network

    Membership of the MTN-030/IPM 041 and MTN-044/IPM 053/CCN019 Protocol Teams for the Microbicide Trials Network and the Contraceptive Clinical Trials Network is listed in the Acknowledgments.

  • [ view all ]
  • [ view less ]

Abstract

End-user feedback early in product development is important for optimizing multipurpose prevention technologies for HIV and pregnancy prevention. We evaluated the acceptability of the 90-day dapivirine levonorgestrel ring (DPV-LNG ring) used for 14 days compared to a dapivirine-only ring (DVR-200mg) in MTN-030/IPM 041 (n = 23), and when used for 90 days cyclically or continuously in MTN-044/IPM 053/CCN019 (n = 25). We enrolled healthy, non-pregnant, HIV-negative women aged 18–45 in Pittsburgh, PA and Birmingham, AL (MTN-030 only). Self-reports of vaginal bleeding and adherence (ring removals, expulsions) were collected via daily short message service. Acceptability data were recorded in face-to-face interviews at study exit. We assessed differences in acceptability by product characteristics and adherence; and associations between baseline characteristics/demographics, number of bleeding days, adherence, and overall acceptability. Most (21/23) women in the 14-day MTN-030 study and about half (13/25) in the 90-day MTN-044 study liked their assigned rings. In MTN-030 there were no significant associations between any variables and overall acceptability of either ring. In MTN-044, women who disliked the DPV-LNG ring had a significantly higher incidence of unanticipated vaginal bleeding, and reporting that vaginal bleeding changes were unacceptable than those who liked it. Although we found no overall association between adherence and acceptability, significantly more women who disliked (versus liked) the DPV-LNG ring reported expulsions during toileting. The DPV-LNG ring could meet the needs of women seeking simultaneous protection from HIV and unintended pregnancy. Addressing issues related to vaginal bleeding and expulsions early in product development will likely enhance acceptability of the DPV-LNG ring.

Trial registration: Clinical Trial Registration: MTN-030/IPM 041: ClinicalTrials.gov NCT02855346; MTN-044/IPM 053/CCN019: ClinicalTrials.gov NCT03467347.

Introduction

Despite advances in HIV treatment and prevention over the last decade, AIDS-related diseases continue to be the leading cause of death globally among women aged 15–49 years old [1]. Oral pre-exposure prophylaxis (PrEP) is an HIV prevention option that is more than 90% effective in reducing HIV transmission when used consistently [2], yet most oral PrEP trials and demonstration projects in women have been plagued by poor uptake and adherence [38]. The dapivirine vaginal ring (DVR), which contains 25mg of the non-nucleoside reverse transcriptase inhibitor (NNRTI) dapivirine, is a novel HIV prevention product currently being rolled out in several African countries [9]. The DVR received a favorable opinion from the European Medicines Agency [10] based on two Phase 3 efficacy trials that demonstrated an approximate 30 percent HIV risk reduction [11, 12]. Secondary analyses and data from open label extension studies indicated that higher rates of adherence were correlated with increased protection [1315]. Growing evidence suggests that many women may be more likely to use a multipurpose prevention technology (MPT) product that prevents pregnancy in addition to HIV infection [1621]. Some participants in one of the Phase 3 trials of the DVR reported telling their partners they were using a new contraceptive rather than an HIV prevention product, a strong indication that pairing HIV prevention with contraception may facilitate PrEP use [22]. Several novel contraceptive MPTs are in development, including a 90-day ring containing dapivirine for HIV prevention and the progestin levonorgestrel for pregnancy prevention [2326].

Dapivirine (DPV) formulated as vaginal rings, gels, vaginal films, and in an oral formulation has been evaluated in multiple clinical trials and found to be safe [27]. Levonorgestrel (LNG) is a synthetic progestin that has been approved for use in contraceptive products for more than 30 years [28] and is now being developed in several MPT vaginal rings [29, 30]. The higher dapivirine loading dose (200 mg vs 25 mg) in the DPV-LNG ring compared to the DVR was designed to enable less frequent ring replacements (quarterly versus monthly), which may reduce user burden, facilitate streamlined service delivery, and thus, improve acceptability and adherence. Given the observed critical role of adherence in effectiveness for the DVR, it is important to identify modifiable factors that can impact correct and consistent use as early as possible in product development of the DPV-LNG ring [3135]. In this paper, we present acceptability data from two Phase 1 trials of the DPV-LNG ring used continuously for 14 days (MTN-030/IPM 041) or either cyclically or continuously for 90 days (MTN-044/IPM 053/CCN019) [36].

Methods

Trial designs

MTN-030/IPM 041 (herein, referred to as MTN-030) was a Phase I, two-arm, double-blind, randomized trial conducted in 24 healthy, HIV-uninfected, non-pregnant women 18 to 45 years old at the University of Pittsburgh (Pittsburgh, PA) and the University of Alabama (Birmingham, AL). Methods have been described in detail previously [36]. Briefly, eligibility criteria included use of an effective, non-hormonal contraceptive (including sterilization and non-hormonal intrauterine devices [IUDs], but not condoms) or engaging exclusively in sex with women; regular menstrual cycles (21–35 days); and willingness to abstain from sexual activity and insertion of any vaginal products 24 hours before enrollment through the last day of product use. Participants were enrolled and randomized 1:1 to use one of two silicone elastomer rings for 14 days continuously: the DPV-LNG ring (200 mg of DPV, 320 mg of LNG) or a ring with dapivirine only–the DVR-200mg (200 mg of dapivirine). Both products are flexible, smooth, off-white rings with an outer diameter of 56mm and a cross-sectional diameter of 7.7mm, designed to provide sustained drug release over a minimum of three months [27, 36]. Participants’ menstrual cycles were taken into consideration when scheduling the Enrollment Visit so that, ideally, no bleeding would occur during the 14 days of product use. The ring was inserted at Enrollment and removed on Day 14 (or an Early Termination Visit) by the participant herself (and checked for proper placement by a study staff member) or by a study staff member, if necessary (Fig 1). Participants were given detailed instructions on insertion and removal procedures, and what to do in the event of ring expulsion or loss. Primary and secondary objectives were safety, pharmacokinetics (PK), and reported vaginal bleeding during use of the DPV-LNG ring versus the DVR-200mg. Exploratory objectives included assessments of acceptability, based on self-reported attitudes about ring attributes and willingness to use it in the future, and adherence, based on the frequency and duration of voluntary removals and involuntary expulsions.

MTN-044/IPM 053/CCN019 (herein referred to as MTN-044) was a Phase I, two-arm, open-label, single-site, randomized trial of the DPV-LNG ring in 25 healthy, HIV-uninfected 18-45-year-old cis-gender women at the University of Pittsburgh. Eligibility criteria were similar to MTN-030, with the addition of consistent and correct male condom use as an acceptable contraceptive method and willingness to abstain from sex and vaginal product use for 24 hours before Enrollment, visits when samples were taken, and for one week after cervical biopsy collection (Fig 2). Participants were randomized 1:1 at Enrollment to use the DPV-LNG ring (200 mg DPV, 320 mg LNG) for 90 days continuously or cyclically (keep ring in place for 28 days; then wash and store for two days, prior to reinsertion to start the next cycle). Similar to MTN-030, participants were given detailed instructions on ring insertion and removal, and what to do in the event of ring expulsion or loss. The ring was inserted by participants (with a clinician confirming proper placement) or by a study staff member, if requested. For participants in the cyclic use group, rings were collected on Days 28 and 58, rinsed with tap water, stored at the study site for two days, and then reinserted on Days 30 and 60. Primary and secondary objectives were PK and safety of the DPV-LNG ring used continuously versus cyclically for 90 days, respectively. Exploratory objectives included assessments of vaginal bleeding patterns (number of episodes and total number of days of vaginal bleeding), acceptability (self-reported attitudes about ring attributes, use regimens and tolerability), and adherence (frequency and duration of voluntary ring removals and involuntary expulsions). Methods have been described in detail previously [36].

Measures

Acceptability.

In both studies, we based our assessments on the Mensch et al. PrEP/Microbicide acceptability framework (Fig 3), which outlines specific domains and items to assess depending on clinical trial phase [37] and focuses on individual characteristics (influencing factors), product characteristics and use attributes (product acceptability), and execution (adherence). Quantitative acceptability data were collected via face-to-face interviews and recorded on case report forms (CRFs) at Enrollment (Visit 2 for both studies) and after completing ring use (Visit 7 in MTN-030 and Visit 11 in MTN-044). In MTN-030, there were two open-ended questions at the end of the interview in which participants were asked for any additional comments about the study or their experiences using the ring. In MTN-044, detailed acceptability data were also captured qualitatively via in-depth interviews and are presented elsewhere [38].

thumbnail
Fig 3. Framework for evaluating acceptability in microbicide and PrEP trials [37].

https://doi.org/10.1371/journal.pone.0312957.g003

Baseline interviews included questions about influencing factors, such as previous use of contraception and vaginal products, sexual activity, and partnership status, as well as their thoughts and concerns prior to ring use. After completing product use (Day 14 or Day 90), questions about product acceptability emphasized product characteristics and use attributes, such as experiences inserting and removing the rings, comfort, and awareness of the ring during routine activity and during sex, partners’ experiences, and side effects. The primary acceptability outcome in both trials was overall rating of the ring on Day 14 (MTN-030) or Day 90 (MTN-044) on a four-point Likert scale: dislike very much, dislike, like, and like very much.

Vaginal bleeding. Participants in both trials received a daily short message service (SMS) in which they were asked if they had experienced any spotting or bleeding in the last 24 hours and, if so, if it was light, moderate, or heavy. SMS has been used previously to track bleeding patterns and adherence in research and in service delivery [3942]. In MTN-044, women who reported any bleeding were also asked how bothersome the spotting or bleeding had been (not at all, a little, somewhat, very much). Participants in MTN-030 were also interviewed about bleeding at every study visit (Visits 3 through 9). In MTN-044, participants’ daily SMS entries were transcribed onto a Bleeding SMS CRF at each follow-up visit (Visits 3 through 14).

Adherence.

In both trials, adherence was measured based on ring outages, including the frequency and duration of expulsions (ring falling out) or unscheduled removals. In MTN-030, adherence was assessed using multiple methods [43, 44], including daily SMS, interviews recorded on CRFs at every study visit during the product use period (Visits 3, 4, 5, 6 and 7), and data convergence interviews at Visits 6 (Day 7) and 7 (Day 14). SMS captured the frequency of partial or full outages, how the ring came out (deliberate removal or expulsion), if applicable, and if an outage lasted more than three hours. The Ring Adherence CRF captured dates and times of any outages and reasons for removals or expulsions. The Ring Outage Convergence Interview was only used to clarify any discrepancies between data collected via SMS and on the CRFs. The SMS and CRF data, along with the counselor’s/clinician’s converged assessment of the most likely ring adherence, constituted the summary adherence database. In MTN-044, adherence was assessed via weekly SMS messages, as described for MTN-030 with additional questions about the circumstances in which the ring came out (such as during menses or before, during or after sex).

Statistical analysis

Our original plan was to examine differences in acceptability, adherence, and bleeding patterns by study arm (DPV-LNG ring vs DVR-200mg; or DPV-LNG ring used cyclically or continuously). We assessed differences between study product arms by end-of-study product preferences and acceptability using Chi-squared or Fisher’s exact tests for categorical variables and the Mann-Whitney U test for continuous variables. However, we found no significant differences in any outcomes by arm in either study. Therefore, we focused our analysis on factors that affected overall acceptability, such as baseline characteristics, vaginal bleeding, and adherence, and used aggregate data combining study arms for all analyses. We dichotomized overall acceptability into “like,” which included “like” and “like very much” versus “dislike,” which included “dislike” and “dislike very much.” We calculated vaginal bleeding incidence rates as the total number of bleeding days per person-month and present the 95% confidence interval of the bleeding incidence rates. We classified participants as fully adherent if they reported having kept the ring inserted all the time during the study, without any product discontinuations or holds, and without any unscheduled ring outages (removals or expulsions). We used descriptive statistics to summarize overall acceptability by baseline sociodemographic characteristics and sexual behavior, and by specific aspects of acceptability (such as product characteristics or use attributes) reported at the last product use visit (Day 14 or Day 90). We assessed differences in overall acceptability by product characteristics and adherence using Chi-squared or Fisher’s exact tests for categorical variables. We used logistic regression models to test associations between participant baseline characteristics/demographics, bleeding days, study product adherence, and overall acceptability. In the multivariable logistic regression model, we used stepwise selection to retain only the baseline factors significant at the 0.10 level in the final adjusted model. Due to the exploratory nature of these analyses, we made no adjustments for multiple comparisons. We used SAS® 9.4 (SAS Institute, Inc., Cary, NC) and R software (version 4.1.3) to generate all analyses.

Ethics statement

The MTN-030 study protocol was approved by the local Institutional Review Boards at the University of Alabama and the University of Pittsburgh and was overseen by the regulatory infrastructure of the Division of AIDS (DAIDS) and Microbicide Trials Network (MTN). The MTN-044 study protocol was approved by the local Institutional Review Board at the University of Pittsburgh and was overseen by the regulatory infrastructure of the Contraceptive Clinical Trials Network and the MTN. All participants provided written informed consent before undergoing any procedures.

Results

As shown in Table 1, 23 participants were eligible, enrolled, and completed MTN-030 (May 3-August 18, 2017). As previously described [36], 24 participants were enrolled and completed the study, however, one participant in the DVR-200mg arm was found to be ineligible after completing the study and was excluded from analyses. In MTN-044, 21/25 participants who enrolled (July 17, 2018-October 7, 2019), completed the study. Four participants withdrew early: one due to recurrent ring expulsions, one who used HIV post-exposure prophylaxis (a protocol-prohibited medication) following sexual assault, one who experienced an unrelated adverse event (AE), and one who did not agree to the cervical biopsy procedure. We included data in our analyses for all 25 participants enrolled through the point of discontinuation. Most participants in both studies were White, non-Hispanic, college-educated, in their 30’s, with a primary partner, and without children. Participants had a wide range of prior experiences with contraceptive use and numbers of lifetime sexual partners.

thumbnail
Table 1. Baseline characteristics by study and study arm (MTN-030/IPM 041 [n = 23] and MTN-044/IPM 053/CCN019 [n = 25]).

https://doi.org/10.1371/journal.pone.0312957.t001

Acceptability

Table 2 displays opinions about overall acceptability and specific product characteristics by study arm for both trials. As noted above, we found no significant differences by arm in either study.

thumbnail
Table 2. Acceptability by study (MTN-030/IPM 041 [n = 23] and MTN-044/IPM 053/CCN019 [n = 25]) and by study arm.

https://doi.org/10.1371/journal.pone.0312957.t002

MTN-030

In MTN-030, 21/23 participants (91.3%; 95% CI 72.0%-98.9%) participants said they liked their assigned ring at the end of the study; the two women who disliked the ring were both in the DPV-LNG ring arm. Most participants said they liked the ring the same (74%) or more (22%) than they thought they would before they had used it, with no differences by study arm. All 23 women said their assigned ring was easy to use and that it was comfortable to wear continuously for 14 days, the majority of whom (65%) said it was easy to insert the first time they tried doing so. A majority (65%) reported having thought about the ring being in their bodies at some point during the study and 26% said they were aware of the ring during daily activities.

Nine women (DVR-200mg arm: 4/11, DPV-LNG ring arm: 5/12) reported that the ring increased the sensation of vaginal wetness, six of whom said the increased wetness bothered them a little and one who said it bothered her somewhat. Among women who did not report increased wetness, four (all in the DPV-LNG ring arm) reported increased dryness; two said the increased dryness did not bother them at all, one said it bothered her a little, and one said it bothered her somewhat. When asked if they would be willing to use a ring in the future like the one used in the trial, 63% of participants in the DVR-200mg arm and 50% of participants in the DPV-LNG ring arm said yes (Fisher’s exact p = 0.68). Regardless of which ring they had used, the majority (74%) of participants said they preferred a ring combining HIV and pregnancy prevention versus separate methods for each.

When asked if they had any additional comments at the end of the study, 14 women had none and four re-emphasized that their assigned ring had been easy to use and comfortable or unnoticeable. Five participants had comments or concerns: two (1 DVR-200mg, 1 DPV-LNG ring) said that they could not imagine having sex with the ring in place; one participant (DPV-LNG ring) described the ring as “floppy” when trying to insert it, and said that although it was comfortable once it was in place, she believed it would be difficult to remove (the clinician removed it, per protocol); one participant (DPV-LNG ring) attributed early onset of menses to the ring and said she did not care for wearing it while menstruating; and one (DPV-LNG ring) reported becoming aroused during a movie and experiencing a burning sensation inside her vagina, which had never happened before.

MTN-044

In MTN-044, 13/25 women (52.0%, 95% CI 31.3%-72.2%) reported liking the DPV-LNG ring, with no difference between those in the continuous (6/12) or cyclical use (7/13) arms (Table 2). Most participants found the ring easy to use (84%), easy to insert the first time they tried doing so (84%), and comfortable to wear for 90 days continuously or cyclically (84%). Most participants reported that they had thought about the ring being in their bodies during the study (88%) or that they were aware of the ring during daily activities (76%), with no significant differences by arm. Thirteen women (5/12, continuous arm; 8/13, cyclic arm) reported that the ring made their vaginas feel wetter. Six women said the increased vaginal wetness bothered them a little, six said it bothered them somewhat and one said it bothered her a lot. One participant (continuous arm) reported increased dryness that she said bothered her somewhat.

Vaginal bleeding

The heatmap (Fig 4) summarizes the number of bleeding days that occurred in MTN-030. As expected, most participants (15/23) had no vaginal bleeding during the trial. Four participants reported light or moderate menstrual bleeding (three in the DVR-200mg arm and one in the DPV-LNG ring arm) and four participants in the DPV-LNG ring arm reported light bleeding that was not associated with menses with no significant difference in vaginal bleeding incidence (bleeding days per person-month) between the DVR-200mg (1.3; 95% CI: 0.6, 2.5) and DPV-LNG (3.7; 95% CI: 2.4, 5.5) arms (Table 3).

thumbnail
Fig 4. Heatmap of bleeding patterns, MTN-030/IPM 041 (n = 23).

green = no bleeding, yellow = light bleeding, pink = moderate bleeding, red = heavy bleeding.

https://doi.org/10.1371/journal.pone.0312957.g004

thumbnail
Table 3. Adherence (expulsions and removals) and bleeding incidence by study (MTN-030/IPM 041 [n = 23] and MTN-044/IPM 053/CCN019 [n = 25]) and by study arm.

https://doi.org/10.1371/journal.pone.0312957.t003

In MTN-044, in which vaginal bleeding was expected, the bleeding patterns were similar for women in the continuous and cyclic use arms, as illustrated in the heatmaps (Fig 5). One participant (cyclic use arm) reported no bleeding during more than 91 days of follow-up, whereas heavy bleeding was reported by six participants, two in the cyclic arm and four in the continuous arm. Vaginal bleeding incidence (bleeding days per person-month) was comparable between the continuous (12.9; 95% CI: 11.7, 14.2) and cyclic (12.8; 95% CI: 11.7, 14.0) use arms (Table 3).

thumbnail
Fig 5. Heatmap of bleeding patterns, MTN-044/IPM 053/CCN019 (n = 25).

green = no bleeding, yellow = light bleeding, pink = moderate bleeding, red = heavy bleeding.

https://doi.org/10.1371/journal.pone.0312957.g005

Adherence

In MTN-030, 20/23 women were adherent (ring in place for the entire 14 days). Three women had a ring outage, all lasting 15 minutes or less. All three outages were involuntary expulsions in the DPV-LNG ring arm, one of which overlapped with a day of light, non-menstrual bleeding. In MTN-044, a total of 20 women experienced any outages, including partial or complete expulsions or unscheduled removals (Table 3). The 13/25 women who experienced no full outages were considered adherent, with no differences by arm. Among women with full outages (due to expulsions or removals), the most common reasons cited were the ring being out of place or moving (75%); bowel movement, urination or ring falling in the toilet (67%); and exercise or other activities (42%), with no significant differences by arm.

Factors associated with acceptability

In MTN-030, we found no significant associations between product characteristics, adherence, or vaginal changes (such as increased wetness or dryness), and overall acceptability (Table 4). In MTN-044, we found no significant association between adherence and acceptability (Fisher’s Exact Test, p = 0.43). Although not statistically significant (Fisher’s Exact Test, p = 0.43), more women who liked the ring were adherent (8/13) than those who disliked the ring (5/12). In addition, women who disliked the ring did not have significantly more outages than those who liked the ring (median 1.5, range 0–39 versus median 1.0, range 0–5; logistic regression p = 0.21). However, more women who disliked (7/12) versus liked (1/13) the ring attributed outages to involuntary expulsions during toileting—bowel movement, urination or ring falling in toilet (Fisher’s Exact Test, p = 0.01). Women who disliked the ring (in both arms) had a significantly higher incidence of vaginal bleeding than those who liked the ring (17.8 bleeding days per person-months, 95% CI 16.2, 19.3 versus 8.8 bleeding days per person-months, 95% CI: 7.9, 9.8). Furthermore, significantly more women who disliked the ring reported that vaginal bleeding changes were unacceptable than those who liked it (7/12 versus 0/13; Fisher’s Exact Test: unadjusted two-sided p-value = 0.002). One woman who said the bleeding changes were unacceptable reported approximately 67 days of bleeding and was found to have expelled the ring at an unknown date (between Days 74 and 90) prior to her Day 90/end of product use visit. In univariate analyses, we found that women who had used a condom at last sex at baseline (versus did not use a condom) had significantly lower odds of liking the ring after completing product use (OR 0.1, 95% CI: 0.1, 0.6; p = 0.01), as did women who were not worried about wearing the ring versus worried about wearing the ring (OR 0.1, 95% CI: 0.1, 0.6; p = 0.01). By contrast, we found that high school graduates had significantly higher odds of liking the ring compared to college graduates (OR 12.8, 95% CI: 1.3, 130.5; p = 0.03). Women with no prior IUD use (versus prior IUD use) or who were single (versus married/in a relationship/divorced) had higher odds of liking the ring (OR 5.5, 95% CI: 0.8, 36.2; p = 0.08 and OR 4.8, 95% CI: 0.9, 26.8; p = 0.07, respectively), but these associations were not significant, and no associations were significant in multivariable analysis.

thumbnail
Table 4. Impact of product characteristics, adherence, and bleeding patterns on overall acceptability, by study (MTN-030/IPM 041 [n = 23] and MTN-044/IPM 053/CCN019 [n = 25]).

https://doi.org/10.1371/journal.pone.0312957.t004

Discussion

In these two early Phase 1 trials of the DPV-LNG ring, most women (all MTN-030 participants, 84% of MTN-044 participants) said the ring was easy to use and comfortable to use for the duration of their study participation. However, more participants reported thinking about the ring being in their bodies or being aware of it during daily activities when using it for 90 days in MTN-044 than those using it for only 14 days in MTN-030. Furthermore, most women in MTN-030 liked their assigned ring after using it continuously for 14 days whereas only about half of those in MTN-044 liked the DPV-LNG ring after using it continuously or cyclically for up to 90 days.

The different outcomes are not unexpected given the different durations of ring use and comparison groups, study designs and objectives, procedures, and data collection methods. In MTN-030, half of the participants used the DPV-LNG ring while the other half used the DVR-200mg for 14 days continuously. In MTN-044, all participants used the DPV-LNG ring for 90 days, either continuously or cyclically. By design, study visits and ring use were scheduled when menstrual bleeding was not anticipated in MTN-030, whereas in MTN-044, women were instructed to use the ring continuously or cyclically per protocol, even during bleeding episodes.

We found no associations between any variables and overall acceptability in MTN-030, which is not surprising since only two women reported not liking the ring. Although the incidence of vaginal bleeding was not significantly associated with acceptability in MTN-030, the two women who disliked the ring, both in the DPV-LNG ring arm, experienced unanticipated bleeding. It is also notable that the three women who experienced an expulsion were all in the DPV-LNG ring arm. Finally, only 50% of women (6/12) assigned to use the DPV-LNG ring arm said they would be willing to use the ring in the future compared to 64% in the DVR-200mg arm. Although we did not ask participants why they would not want to use the ring, we can hypothesize from their comments that they did not consider themselves to be at risk of HIV (or pregnancy), or that specific product attributes–such as size, compression strength, or durometer (hardness)–or vaginal changes that were not bothersome for 14 days might limit enthusiasm for longer use.

The trends seen in MTN-030 were more pronounced in MTN-044, where higher incidence of vaginal bleeding and unacceptable bleeding changes were the strongest predictors of low acceptability. Although there was no statistically significant difference in frequency of outages overall between those who liked or disliked the ring, most participants (19/25) experienced an expulsion, and women who disliked the ring experienced more expulsions than those who liked the ring. Furthermore, significantly more women who disliked the ring experienced expulsions during toileting compared to women who liked the ring. As noted above, in MTN-044, willingness to use the ring in the future was discussed in in-depth interviews and is described in detail elsewhere [38]. In brief, of the 17 women in MTN-044 who said they would be willing to use the ring in the future, only three said they would use it as is, with no changes. The other 14 women, many of whom had experienced unexpected vaginal bleeding, feeling like the ring was slipping, or complete expulsions, said that if they were at higher risk of HIV, the benefits would outweigh the interference in their daily activities.

The DPV-LNG ring was well-tolerated and achieved target drug levels needed for efficacy. However, the results of this study suggest that ring expulsions and bleeding irregularities decreased the overall acceptability of this product. Our findings have been critical for redesigning the DPV-LNG ring when it is still feasible to make significant changes. To that end, the product developers evaluated rings with different polymers, mechanical properties, such as durometer (hardness), and designs for optimal drug release to limit episodes of non-menstrual bleeding and reduce the likelihood of expulsions. The reformulated DPV-LNG ring is currently being tested in a Phase 1 trial [45].

Early end-user feedback is critical to ensure that MPTs are not only safe and efficacious but have characteristics that facilitate uptake and sustained use [32, 4652]. Several examples from contraceptive ring development highlight the importance of incorporating end user data early as once products are in efficacy trials, it is too late to change the design if issues related to vaginal bleeding, ease of use, comfort and expulsions indicate acceptability concerns [5358]. In a study of a levonorgestrel ring designed for 90 days of continuous use, about 17% of women discontinued the trial early due to menstrual disturbances [58]. In clinical trials of the one-month contraceptive NuvaRing®, 30% of participants discontinued use due to discomfort during sex, feeling a “foreign body,” or spontaneous (involuntary) expulsions [59]. And in the Phase 3 trial of the one-year contraceptive vaginal system Annovera®, women who removed the ring for longer than two hours were nearly twice as likely to discontinue using it [60]. Several recent reviews of ring studies have highlighted the associations between vaginal bleeding changes, ease of use, expulsions, and impact on sex with acceptability or discontinuation [6164], yet little empirical data exist on how specific physical ring properties influence the incidence of expulsions and removals and ultimately satisfaction [65].

Research is needed to explore the intersection of ring characteristics and individual women’s physical characteristics (such as body mass index, vaginal length and genital hiatus) to improve ring design. Age, partnership status, risk perception, and previous contraceptive experience are likely to have an impact on acceptability, intention to use, uptake, and effective use of the DPV-LNG ring [66]. Although we found no significant associations between women’s background characteristics and acceptability of the ring, we did see trends in MTN-044 that will need to be further explored in larger, longer studies. For example, women who had used a condom at last sex or who had previously used an IUD were less likely to find the ring acceptable, perhaps because they were satisfied with their current contraceptive methods. On the other hand, women who had been worried about wearing the ring at baseline were more likely to find the ring acceptable than those who had not been worried about using it. This interesting finding could be about the ring itself, which exceeded expectations for some women and did not meet expectations for others. Or it is possible that some women are more likely to worry about trying a new product than others. Our data reinforce the importance of developing an array of MPTs, as there is no single product that will be right for all individuals.

Our analysis had several limitations. First, both studies were Phase I trials with small sample sizes that had several analytic implications: for some relationships of interest sample size (and limited variability in response) precluded statistical testing whereas for others the sample size limited the ability to estimate associations with precision. In addition, because of the different study designs, rings used (DVR-200mg and DPV-LNG in MTN-030 vs DPV-LNG only in MTN-044), durations (14 versus 90 days) and conditions (with or without sex and menses), and the way data were collected (questions asked in one trial but not in the other), we were unable to combine data from the two trials to conduct more robust analyses. Despite these design constraints, we were able to explore associations that informed design modifications. Second, data were self-reported. If women underreported instances of vaginal bleeding or ring outages, it may mean the ring was less acceptable than our data show. However, because participants had to be at low risk of HIV and using an effective, non-hormonal contraceptive to be in the trials, it is conceivable that the ring would be more acceptable to women at higher risk of HIV or not already using contraception. A third limitation was inclusion of only US women. Additional studies will be needed to assess the acceptability of a multipurpose ring among likely intended users.

In conclusion, the DPV-LNG ring has the potential to increase women’s options for simultaneous prevention from HIV and unintended pregnancy. Particularly for prevention products, in which use is a choice (versus products that are necessary and desired to treat or cure an existing medical condition), products must be highly acceptable to users. Gathering acceptability data early in product development is critical for identifying factors that could undermine product uptake and satisfaction. Reformulating the DPV-LNG ring to address vaginal bleeding issues and expulsions is likely to enhance its acceptability for a broader group of users.

Acknowledgments

We would like to thank the participants and study staff at University of Alabama at Birmingham and University of Pittsburgh for their participation in and implementation of the studies; Irene Bruce for assistance with citations and formatting the manuscript; and Helen Lu for creating the heatmaps.

References

  1. 1. Joint United Nations Programme on HIV/AIDS (UNAIDS). We’ve got the Power: Women, Adolescent Girls and the HIV Response [Internet]. Geneva, Switzerland: Joint United Nations Programme on HIV/AIDS (UNAIDS); 2020 [cited 2022 Nov 16]. Available from: https://www.unaids.org/sites/default/files/media_asset/2020_women-adolescent-girls-and-hiv_en.pdf
  2. 2. Eakle R, Venter F, Rees H. Pre-exposure prophylaxis (PrEP) in an era of stalled HIV prevention: Can it change the game? Retrovirology. 2018;15(1):29. pmid:29609619
  3. 3. Yun K, Xu J, Zhang J, Li J, Hu Q, Chu Z, et al. Female and younger subjects have lower adherence in PrEP trials: a meta-analysis with implications for the uptake of PrEP service to prevent HIV. Sex Transm Infect. 2018;94(3):163–8. pmid:28756409
  4. 4. Van Damme L, Corneli A, Ahmed K, Agot K, Lombaard J, Kapiga S, et al. Preexposure prophylaxis for HIV infection among African women. New Eng J Med. 2012;367(5):411–22. pmid:22784040
  5. 5. Marrazzo JM, Ramjee G, Richardson BA, Gomez K, Mgodi N, Nair G, et al. Tenofovir-Based Preexposure Prophylaxis for HIV Infection among African Women. New England Journal of Medicine. 2015 Feb 5;372(6):509–18. pmid:25651245
  6. 6. Gombe MM, Cakouros BE, Ncube G, Zwangobani N, Mareke P, Mkwamba A, et al. Key barriers and enablers associated with uptake and continuation of oral pre-exposure prophylaxis (PrEP) in the public sector in Zimbabwe: Qualitative perspectives of general population clients at high risk for HIV. PLoS one. 2020;15(1):e0227632. pmid:31931514
  7. 7. Bekker LG, Pike C, Hillier SL. HIV prevention: better choice for better coverage. J Int AIDS Soc. 2022 Jan;25(1):e25872. pmid:35030296
  8. 8. Mugwanya KK, Pintye J, Kinuthia J, Abuna F, Lagat H, Begnel ER, et al. Integrating preexposure prophylaxis delivery in routine family planning clinics: A feasibility programmatic evaluation in Kenya. PLoS Med. 2019 Sep;16(9):e1002885. pmid:31479452
  9. 9. AVAC. Access to the Dapivirine Vaginal Ring: A timeline on progress [Internet]. AVAC. 2022 [cited 2022 Dec 1]. Available from: https://www.avac.org/infographic/access-dapivirine-vaginal-ring-timeline-progress
  10. 10. European Medicines Agency. Dapivirine Vaginal Ring 25 mg: Opinion on medicine for use outside EU [Internet]. European Medicines Agency. 2021 [cited 2022 Nov 15]. Available from: https://www.ema.europa.eu/en/opinion-medicine-use-outside-EU/human/dapivirine-vaginal-ring-25-mg
  11. 11. Nel A, van Niekerk N, Kapiga S, Bekker LG, Gama C, Gill K, et al. Safety and Efficacy of a Dapivirine Vaginal Ring for HIV Prevention in Women. N Engl J Med. 2016 Dec 1;375(22):2133–43. pmid:27959766
  12. 12. Baeten J, Palanee-Phillips T, Brown E, Schwartz K, Soto-Torres L, Govender V, et al. Use of a vaginal ring containing dapivirine for HIV-1 prevention in women. N Engl J Med. 2016 Dec;375(22):2121–32. pmid:26900902
  13. 13. Baeten JM, Palanee-Phillips T, Mgodi NM, Mayo AJ, Szydlo DW, Ramjee G, et al. Safety, uptake, and use of a dapivirine vaginal ring for HIV-1 prevention in African women (HOPE): an open-label, extension study. Lancet HIV. 2021 Feb;8(2):e87–95. pmid:33539762
  14. 14. Nel A, van Niekerk N, Van Baelen B, Malherbe M, Mans W, Carter A, et al. Safety, adherence, and HIV-1 seroconversion among women using the dapivirine vaginal ring (DREAM): an open-label, extension study. Lancet HIV. 2021 Feb;8(2):e77–86. pmid:33539761
  15. 15. Brown ER, Hendrix CW, van der Straten A, Kiweewa FM, Mgodi NM, Palanee‐Philips T, et al. Greater dapivirine release from the dapivirine vaginal ring is correlated with lower risk of HIV‐1 acquisition: a secondary analysis from a randomized, placebo‐controlled trial. J Int AIDS Soc. 2020 Nov 18;23(11):e25634. pmid:33206462
  16. 16. Friedland BA, Plagianos M, Savel C, Kallianes V, Martinez C, Begg L, et al. Women Want Choices: Opinions from the Share.Learn.Shape Global Internet Survey About Multipurpose Prevention Technology (MPT) Products in Development. AIDS Behav. 2023 Jul;27(7):2190–204. pmid:36881183
  17. 17. Hynes JS, Sales JM, Sheth AN, Lathrop E, Haddad LB. Interest in multipurpose prevention technologies to prevent HIV/STIs and unintended pregnancy among young women in the United States. Contraception. 2018;97(3):277–84. pmid:29055782
  18. 18. IPSOS. Assessing the potential of MPTs in Uganda, Nigeria and South Africa. Report commissioned by the Bill and Melinda Gates Foundation [Internet]. 2014. Available from: http://www.theimpt.org/resource-results/35-reports/202-assessing-the-potential-of-mpts-in-south-africa-uganda-and-nigeria
  19. 19. van der Straten A, Agot K, Ahmed K, Weinrib R, Browne EN, Manenzhe K, et al. The Tablets, Ring, Injections as Options (TRIO) study: what young African women chose and used for future HIV and pregnancy prevention. J Int AIDS Soc. 2018 Mar;21(3):e25094. pmid:29600595
  20. 20. Beksinska M, Greener R, Smit J, Maphumulo B, Mphili N, Kilbourne-Brook M, et al. A Randomized Crossover Study Evaluating the Use and Acceptability of the SILCS Diaphragm Compared to Vaginal Applicators for Vaginal Gel Delivery. AIDS Behav. 2018 Jan;22(1):127–32. pmid:28993940
  21. 21. Karim SA, Baxter C, Frohlich J, Karim QA. The need for multipurpose prevention technologies in sub-Saharan Africa. BJOG. 2014 Oct;121 Suppl 5:27–34. pmid:25335838
  22. 22. Laborde ND, Pleasants E, Reddy K, Atujuna M, Nakyanzi T, Chitukuta M, et al. Impact of the Dapivirine Vaginal Ring on Sexual Experiences and Intimate Partnerships of Women in an HIV Prevention Clinical Trial: Managing Ring Detection and Hot Sex. AIDS Behav. 2017/11/21 ed. 2018 Feb;22(2):437–46.
  23. 23. IMPT for Reproductive Health. MPT Product Development Database [Internet]. IMPT for Reproductive Health. 2022 [cited 2022 Dec 5]. Available from: https://mpts101.org/
  24. 24. Kerns J, Darney P. Vaginal ring contraception. Contraception. 2011 Feb;83(2):107–15. pmid:21237335
  25. 25. Monteiro I, Guazzelli CF, Bahamondes L. Advances in contraceptive vaginal rings: what does the future hold? Expert Opin Pharmacother. 2018 Oct;19(15):1685–91. pmid:30286682
  26. 26. Notario-Pérez F, Ruiz-Caro R, Veiga-Ochoa MD. Historical development of vaginal microbicides to prevent sexual transmission of HIV in women: from past failures to future hopes. Drug Des Devel Ther. 2017;11:1767–87. pmid:28670111
  27. 27. Data on File: International Partnership for Microbicides (IPM). Investigator’s Brochure: Dapivirine Vaginal Ring (Version 15.0). 2022.
  28. 28. Data on File: International Partnership for Microbicides (IPM). Investigator’s Brochure: Dapivirine-Levonorgestrel Vaginal Ring (Version 9.0). 2021.
  29. 29. Murphy DJ, Boyd P, McCoy CF, Kumar S, Holt JDS, Blanda W, et al. Controlling levonorgestrel binding and release in a multi-purpose prevention technology vaginal ring device. J Control Release. 2016 Mar 28;226:138–47. pmid:26878974
  30. 30. Dallal Bashi YH, McCoy CF, Murphy DJ, Boyd P, Spence P, Kleinbeck K, et al. Towards a dapivirine and levonorgestrel multipurpose vaginal ring: Investigations into the reaction between levonorgestrel and addition-cure silicone elastomers. Int J Pharm. 2019 Oct 5;569:118574. pmid:31352053
  31. 31. Woodsong C, Holt JDS. Acceptability and preferences for vaginal dosage forms intended for prevention of HIV or HIV and pregnancy. Adv Drug Deliv Rev. 2015 Sep 15;92:146–54. pmid:25703190
  32. 32. Guthrie KM, Dunsiger S, Vargas SE, Fava JL, Shaw JG, Rosen RK, et al. Perceptibility and the “Choice Experience”: User Sensory Perceptions and Experiences Inform Vaginal Prevention Product Design. AIDS Res Hum Retroviruses. 2016 Nov 1;32(10–11):1022–30. pmid:26942455
  33. 33. Rosen RK, van den Berg JJ, Vargas SE, Senocak N, Shaw JG, Buckheit RW, et al. Meaning-making matters in product design: users’ sensory perceptions and experience evaluations of long-acting vaginal gels and intravaginal rings. Contraception. 2015 Dec;92(6):596–601. pmid:26276246
  34. 34. Weinrib R, Minnis A, Agot K, Ahmed K, Owino F, Manenzhe K, et al. End-Users’ Product Preference Across Three Multipurpose Prevention Technology Delivery Forms: Baseline Results from Young Women in Kenya and South Africa. AIDS Behav. 2018;22(1):133–45. pmid:29052018
  35. 35. Patel SK, Rohan LC. On-demand Microbicide Products: Design Matters. Drug Deliv Transl Res. 2017 Dec;7(6):775–95. pmid:28589452
  36. 36. Achilles SL, Kelly CW, Hoesley CJ, Blithe DL, Brown J, Richardson BA, et al. Phase 1 randomized trials to assess safety, pharmacokinetics, and vaginal bleeding associated with use of extended duration dapivirine and levonorgestrel vaginal rings. PLoS One. 2024; 19 (6): e0304552. pmid:38838028
  37. 37. Mensch BS, van der Straten A, Katzen LL. Acceptability in microbicide and PrEP trials: current status and a reconceptualization. Curr Opin HIV AIDS. 2012 Nov;7(6):534–41. pmid:23032737
  38. 38. Shapley-Quinn MK, Song M, Chen BA, Devlin B, Luecke E, Brown J, et al. Participant experiences with a multipurpose vaginal ring for HIV and pregnancy prevention during a phase 1 clinical trial: learning from users to improve acceptability. Front Reprod Health. 2023;5:1147628. pmid:37484873
  39. 39. Broderick CR, Herbert RD, Latimer J, Mathieu E, van Doorn N, Curtin JA. Feasibility of short message service to document bleeding episodes in children with haemophilia. Haemophilia. 2012 Nov;18(6):906–10. pmid:22681182
  40. 40. Nippita S, Oviedo JD, Velasco MG, Westhoff CL, Davis AR, Castaño PM. A randomized controlled trial of daily text messages versus monthly paper diaries to collect bleeding data after intrauterine device insertion. Contraception. 2015 Dec;92(6):578–84. pmid:26363433
  41. 41. Shimoni N, Choudhury T, Goldman AR, Frondelli M, Chen PH. Bleeding and spotting with the levonorgestrel 13.5 mg intrauterine system: the impact of insertion timing. Contraception. 2019 Jun;99(6):340–4. pmid:30831104
  42. 42. Lim MSC, Sacks-Davis R, Aitken CK, Hocking JS, Hellard ME. Randomised controlled trial of paper, online and SMS diaries for collecting sexual behaviour information from young people. J Epidemiol Community Health. 2010 Oct;64(10):885–9. pmid:19767322
  43. 43. Pool R, Montgomery CM, Morar NS, Mweemba O, Ssali A, Gafos M, et al. A mixed methods and triangulation model for increasing the accuracy of adherence and sexual behaviour data: the Microbicides Development Programme. PLoS One. 2010 Jul 21;5(7):e11600. pmid:20657778
  44. 44. MacQueen KM, Tolley EE, Owen DH, Amico KR, Morrow KM, Moench T, et al. An interdisciplinary framework for measuring and supporting adherence in HIV prevention trials of ARV-based vaginal rings. J Int AIDS Soc. 2014 Sep 8;17(3Suppl 2):19158. pmid:25224617
  45. 45. International Partnership for Microbicides, Inc. A Randomized, Double-Blind, Phase 1b Study in Healthy HIV-Negative Women to Evaluate the Pharmacokinetics, Safety, and Bleeding Patterns Associated With 90-Day Use of Core-Sheath Vaginal Rings Releasing Dapivirine and Levonorgestrel [Internet]. 2022 [cited 2022 Dec 15]. Available from: https://clinicaltrials.gov/ct2/show/NCT05041699
  46. 46. Weld ED, Hiruy H, Guthrie KM, Fava JL, Vargas SE, Buckheit K, et al. A Comparative Pre-Phase I Study of the Impact of Gel Vehicle Volume on Distal Colon Distribution, User Experience, and Acceptability. AIDS Res Hum Retroviruses. 2017 May;33(5):440–7. pmid:27824253
  47. 47. Guthrie KM, Rosen RK, Vargas SE, Getz ML, Dawson L, Guillen M, et al. User evaluations offer promise for pod-intravaginal ring as a drug delivery platform: A mixed methods study of acceptability and use experiences. PLoS One. 2018;13(5):e0197269. pmid:29758049
  48. 48. Guthrie KM, Fava JL, Vargas SE, Rosen RK, Shaw JG, Kojic EM, et al. The Role of Volume in the Perceptibility of Topical Vaginal Formulations: User Sensory Perceptions and Experiences of Heterosexual Couples During Vaginal Sex. AIDS Res Hum Retroviruses. 2020 Dec;36(12):1059–70. pmid:32988214
  49. 49. Guthrie KM, Rosen RK, Vargas SE, Guillen M, Steger AL, Getz ML, et al. User input in iterative design for prevention product development: leveraging interdisciplinary methods to optimize effectiveness. Drug Deliv Transl Res. 2017 Oct;7(5):761–70. pmid:28653286
  50. 50. Guthrie KM, Rosen RK, Guillen M, Ramirez JJ, Vargas SE, Fava JL, et al. Designing Dual Compartment HIV Prevention Products: Women’s Sensory Perceptions and Experiences of Suppositories for Rectal and Vaginal Use. AIDS Res Hum Retroviruses. 2022 Jul;38(7):601–10. pmid:34544269
  51. 51. Krogstad EA, Atujuna M, Montgomery ET, Minnis A, Ndwayana S, Malapane T, et al. Perspectives of South African youth in the development of an implant for HIV prevention. J Int AIDS Soc. 2018 Aug;21(8):e25170. pmid:30152004
  52. 52. Carballo-Dieguez A, Giguere R, Lentz C, Dolezal C, Fuchs EJ, Hendrix CW. Rectal Douching Practices Associated with Anal Intercourse: Implications for the Development of a Behaviorally Congruent HIV-Prevention Rectal Microbicide Douche. AIDS Behav. 2019 Jun 1;23(6):1484–93. pmid:30415431
  53. 53. López-Picado A, Lapuente O, Lete I. Efficacy and side-effects profile of the ethinylestradiol and etonogestrel contraceptive vaginal ring: a systematic review and meta-analysis. Eur J Contracept Reprod Health Care. 2017 Apr;22(2):131–46. pmid:28256919
  54. 54. Müller A, Sailer M, Colli E, Regidor PA. Safety, efficacy and quality of life of the novel vaginal contraceptive ring containing etonogestrel/ethinylestradiol 11.0/3.474 mg after 3 years of “real life” experience. Eur Rev Med Pharmacol Sci. 2020 Nov;24(22):11810–9. pmid:33275253
  55. 55. Brucker C, Karck U, Merkle E. Cycle control, tolerability, efficacy and acceptability of the vaginal contraceptive ring, NuvaRing: results of clinical experience in Germany. Eur J Contracept Reprod Health Care. 2008 Mar;13(1):31–8. pmid:17853162
  56. 56. Dahiya P, Dalal M, Yadav A, Dahiya K, Jain S, Silan V. Efficacy of combined hormonal vaginal ring in comparison to combined hormonal pills in heavy menstrual bleeding. Eur J Obstet Gynecol Reprod Biol. 2016 Aug;203:147–51. pmid:27285306
  57. 57. Palacios S, Algorta J, Colli E, Regidor PA, Mayr M, Roemer T. Multicenter, international observational study on quality of life and acceptability of a vaginal contraceptive ring containing etonogestrel/ethinylestradiol 11.00/3.474 mg over six months of use. Eur Rev Med Pharmacol Sci. 2022 Oct;26(19):7204–11. pmid:36263530
  58. 58. Koetsawang S, Ji G, Krishna U, Cuadros A, Dhall GI, Wyss R, et al. Microdose intravaginal levonorgestrel contraception: a multicentre clinical trial. I. Contraceptive efficacy and side effects. World Health Organization. Task Force on Long-Acting Systemic Agents for Fertility Regulation. Contraception. 1990 Feb;41(2):105–24. pmid:2107054
  59. 59. Wieder DR, Pattimakiel L. Examining the efficacy, safety, and patient acceptability of the combined contraceptive vaginal ring (NuvaRing). Int J Womens Health. 2010 Nov 12;2:401–9. pmid:21151688
  60. 60. Stifani BM, Plagianos M, Vieira CS, Merkatz RB. Factors associated with nonadherence to instructions for using the Nestorone®/ethinyl estradiol contraceptive vaginal ring. Contraception. 2018 May;97(5):415–21.
  61. 61. Ridgeway K, Montgomery ET, Smith K, Torjesen K, van der Straten A, Achilles SL, et al. Vaginal ring acceptability: A systematic review and meta-analysis of vaginal ring experiences from around the world. Contraception. 2022 Feb;106:16–33. pmid:34644609
  62. 62. Griffin JB, Ridgeway K, Montgomery E, Torjesen K, Clark R, Peterson J, et al. Vaginal ring acceptability and related preferences among women in low- and middle-income countries: A systematic review and narrative synthesis. PLoS One. 2019;14(11):e0224898. pmid:31703094
  63. 63. Harris DM, Dam A, Morrison K, Mann C, Jackson A, Bledsoe SM, et al. Barriers and Enablers Influencing Women’s Adoption and Continuation of Vaginally Inserted Contraceptive Methods: A Literature Review. Stud Fam Plann. 2022 Sep;53(3):455–90. pmid:35922382
  64. 64. Delvaux T, Jespers V, Benova L, van de Wijgert J. Acceptability and Satisfaction of Contraceptive Vaginal Rings in Clinical Studies: A Systematic Review and Narrative Synthesis. Front Glob Womens Health. 2021;2:799963. pmid:34970653
  65. 65. Boyd P, Merkatz R, Variano B, Malcolm RK. The ins and outs of drug-releasing vaginal rings: a literature review of expulsions and removals. Expert Opin Drug Deliv. 2020 Nov;17(11):1519–40. pmid:32684013
  66. 66. Friedland BA, Mathur S, Haddad LB. The Promise of the Dual Prevention Pill: A Framework for Development and Introduction. Front Reprod Health. 2021 Jun 23;3:682689. pmid:34318291