“You can’t have a PrEP program without a PrEP Coordinator”: Implementation of a PrEP panel management intervention

Lack of healthcare provider knowledge, capacity, and willingness to prescribe PrEP are barriers to PrEP delivery in clinical settings. We implemented the PrEP Optimization Intervention (PrEP-OI) combining a PrEP Coordinator with an online panel management tool to assist providers with PrEP uptake, persistence, and management in 12 San Francisco Department of Public Health Primary Care Clinics. Medical directors (N = 10) identified important factors to consider prior to implementation, including shortage of clinical space for coordinators, medical mistrust, language barriers, and limited lab hours, along with the need for education of providers and staff and patient outreach. Among 110 providers who completed a baseline survey, the majority had reservations in asking about sexual practices and having conversations about PrEP. Providers reported PrEP-OI increased their efficiency and capacity to manage PrEP patients, and served as a gateway to additional services. These results highlight the promise of a provider-based intervention to improve the PrEP continuum and maximize the impact of PrEP.


Introduction
HIV pre-exposure prophylaxis (PrEP) resulted in significant reduction in HIV acquisition in numerous studies [1][2][3]. However, despite data from the Centers for Disease Control and Prevention (CDC) estimating that nearly 1.2 million individuals had a PrEP indication, its coverage was as low as 18.1% in 2018 [4]. One major barrier to PrEP implementation is the lack of healthcare provider knowledge and willingness to prescribe it [5][6][7][8]. A report on the early experiences with PrEP uptake and delivery in San Francisco identified the need for increased PrEP knowledge among healthcare providers and the need for expanded PrEP access by developing interventions to facilitate PrEP delivery in clinical settings as priority steps to maximize PrEP's public health impact [9].
Panel management has been defined as an approach to population-based care that proactively focuses on the health of patients assigned to a clinic. These strategies typically entail identifying a care gap, training staff to serve as panel managers, developing a registry and a health maintenance template, and adopting clinical practice guidelines to close care gaps. Panel management strategies using a patient coordinator have been used in numerous chronic conditions, including cancer, diabetes, cardiovascular disease, dementia, and HIV [10]. Task sharing associated with panel management has been shown to enhance the efficiency, consistency, and quality of care, along with improving health outcomes [11][12][13]. In prior studies, panel management strategies were associated with patients being referred to a PrEP provider and receiving a PrEP prescription [14]; earlier PrEP initiation [15]; and assisting with provision of patient education, adherence counseling, and resolution of insurance and pharmacy barriers [16]. We implemented a PrEP intervention consisting of a PrEP Coordinator and a web-based panel management tool called PrEP-Rx to assist healthcare providers from the San Francisco Department of Public Health (SFDPH) Primary Care Clinics in PrEP uptake, persistence, and management. In this paper, we report the results of formative discussions with medical directors, quantitative surveys with providers, and one-on-one qualitative interviews with providers from these study clinics on their experiences with the PrEP intervention. The purpose of these data were to examine facilitators and barriers to the initial implementation and sustainability of our PrEP panel management strategy.

Study overview
The PrEP Optimization Intervention (PrEP-OI) study included PrEP coordination services provided by four PrEP Coordinators (PCs) plus a web-based panel management tool to augment and organize the PrEP coordination services. The PCs were designated non-clinical staff who coordinated the interaction between the patients and the healthcare teams and augmented the provider's role to more effectively conduct PrEP panel management activities. The responsibilities of the PC were to examine electronic health records or patient registries to identify those who had tested positive for sexually transmitted infections (STIs) or receive referrals for PrEP initiation from the healthcare team; schedule appointments with patients to evaluate risk of HIV acquisition; assess the need for post-exposure prophylaxis (PEP); assist with PEP to PrEP transitions; educate on HIV risk reduction with PrEP use and other risk reduction methods; conduct baseline and quarterly lab tests (as allowed through SFDPH standard operating procedures) and any follow-ups visits (in person, by telephone, or via text messaging) in the place of or along with the provider visit; educate patients on STI self-swabbing; assess medical insurance coverage for PrEP and complete forms for prior authorization and/or patient assistance programs; counsel patients on PrEP initiation and persistence; provide PrEP adherence counseling; send PrEP prescription to provider for signature; communicate with the provider regarding the patient's questions, side effects, and progress; and educate the patient on new PrEP medications or dosing strategies. As such, upon hire, the PC received training on HIV treatment and prevention, financial benefits navigation, PEP and PrEP initiation and follow-up counseling, required lab tests and frequency of testing, methods for evaluating medication adherence, risk reduction counseling, new PrEP medication options and dosing strategies, using electronic health records (EHR) and the web-based PrEP panel management tool, and providing unbiased patient care.
To create an efficient workflow for the PC, we created a web-based tool called PrEP-Rx [17] which had three main features: 1-a comprehensive self-administered HIV risk assessment using an integrated survey tool; 2-automated reminders to PCs for patient lab monitoring and follow-up visits for adherence, side effect assessment, and risk reduction counseling; and 3-a PrEP timeline for each patient to allow PCs and providers to see a patient's PrEP use history and upcoming visits in one snapshot. The risk assessment was created by the study team using the CDC risk index [18], information from Smith et al [19], and input from behavioral research experts at the University of California, San Francisco (UCSF) Center for AIDS Prevention Studies. PrEP-Rx also provided a list of questions for PCs to ascertain at PrEP initiation and follow-ups (e.g., assessing for acute HIV symptoms, screening for STIs, evaluating medication adherence, and reviewing need for refills), and the ability to export these answers into a medical chart note in the patient's EHR. PrEP-Rx was created using a HIPAA-compliant Salesforce platform and refined using an iterative agile methodology [20].
PrEP-OI was initiated in 12 SFDPH primary care clinics (three clinics under one administration with overlapping healthcare providers and drop-in services for adolescents and young adults were grouped together for a total of 10 clinical sites). Clinics were randomized to start the intervention on a monthly basis starting November 2018 using a Stepped-wedge design, with all clinics randomized by September 2019, and were later continued on the intervention for a year follow-up phase (to be completed in September 2020). Details of the PrEP-OI study protocol have been published [21]. The UCSF Institutional Review Board (IRB) approved this study.

Organizational assessments with medical directors
Before the initiation of the study, we met with each of the 10 clinical site's medical directors in person to conduct a brief organizational assessment to inform how our program could best fit within existing workflows and to identify any unique aspects of the clinic that the PrEP-OI study should consider. We also asked about the clinic's weekly schedule, lab hours, staffing, capacity for STI testing, and educational needs. This organizational assessment was guided by a set of specific questions, which were developed by the PrEP-OI investigative team and PCs. These prompts were used to ensure that we covered consistent content across clinics. Subsequently, content from the field notes were tabulated to facilitate comparison across clinics. In particular, we looked for areas of convergence, highlighting implementation considerations that were likely to affect the intervention across sites. In addition, we identified areas of divergence, which helped to inform facets of project operating protocols at each location. As the divergences were clinic-specific, we focused on areas of convergence for this manuscript, identifying those aspects of the findings that influenced the operations of the PrEP-OI across sites. Findings were grouped and summarized.

Quantitative survey
Prior to initiation of PrEP-OI at each clinic, we asked 135 healthcare providers (defined as any PrEP prescribing provider such as physicians, nurse practitioners, pharmacists, etc.) to complete a brief online quantitative survey using Qualtrics (S1 File). Surveys were emailed to each clinic's providers two months prior to onboarding the clinic.
The survey inquired about provider demographics (gender, race/ethnicity, primary profession, years providing direct patient care), number of patients on panel, number of patients receiving HIV treatment, number of patients on PrEP, team members who provide PrEP services in their practice (i.e., those who provide sexual risk reduction counseling, PrEP adherence counseling, and lab tests and monitoring), and frequency of offering risk reduction measures in the past year (e.g., frequency of asking about sexual partner(s), sex practices, condom use, etc.). We describe the sample of healthcare providers who participated in the quantitative survey using measures of central tendency (mean, standard deviation, etc.)

Healthcare provider interviews
From November 2019 to February 2020, we conducted individual semi-structured qualitative interviews (S2 File) with healthcare providers from the 10 clinical sites. Participants were recruited purposively [22] as we sought to ensure variability in the clinic(s) where individuals worked, their professional training (e.g., physician, nurse practitioner), role within clinic (e.g., any management duties in addition to serving as a provider), and engagement with the PCs. To facilitate this objective, we first reached out to PCs to inquire about providers to interview based on their level of engagement with PrEP services. We then augmented these numbers by reaching out to all providers at the clinics to ensure all sites were represented. To facilitate participant comfort and honesty, scheduling of interviews with the providers, interviews, and analyses were conducted exclusively by study investigators and staff not engaged in delivery of PrEP coordination services. Interviews took place on a HIPAA-compliant videoconferencing platform to allow for flexibility in scheduling and recording of the interviews. Interviews lasted 40-60 minutes and verbal informed consent was received as approved by the UCSF IRB.
Using an interview guide, interview domains included 1-provider's experience with PrEP initiation and/or monitoring prior to PrEP-OI implementation; 2-provider's experience with PrEP initiation and/or monitoring during PrEP-OI implementation; 3-PrEP-OI's potential impact on the provider's capacity, capability, or opportunity to prescribe PrEP; 4-PrEP-OI's role in changing other practices in the clinic; 5-requested modifications of the PrEP-OI services to improve use; 6-strategies to increase the provider's PrEP offering and prescribing practices; and 7-best ways to support providers when new PrEP formulations become available.
Qualitative interviews were audio-recorded, transcribed verbatim, and field notes were created from each interview. We followed the procedures of Framework Analysis [23], a type of thematic analysis for qualitative content. Two investigators coding and organizing the research data into a framework matrix, which was used to identify overarching themes and findings. The investigators discussed emerging patterns and themes, synthesized results based on participant responses, and selected exemplary quotes to further elucidate important discussion points.

Organizational assessments with medical directors
We conducted a total of 10 assessments with medical directors from the 10 clinical sites. Across sites, informants highlighted a shortage of clinical space for the PC, medical mistrust, and language barriers as the top barriers to providing PrEP coordination services in their clinics. The need for education of the providers and staff, patient outreach, and coordination of PrEP services with lab hours were also noted as important challenges. Ideas for outreach to patients included contacting patients who had tested positive for an STI in the past using a clinic-approved script, asking nursing staff to refer patients being treated for STIs, and notifying nearby methadone clinics about the availability of PrEP services. Table 1 summarizes the demographics of the 110 (81.5%) healthcare providers from all 10 clinical sites who participated in the quantitative surveys. These individuals had a mean age of 41.8 years, were mainly female (74.5%), White (45.5%), and physicians (71.8%). Approximately 77.3% of the participants had ever prescribed PrEP and had a median of one patient on PrEP ( Table 2). Participants reported to always or often offer HIV testing to patients who engaged in high-risk behaviors (76.4%), ask about sexual partners (71.8%), and ask about condom use (66.4%). However, among the 110 respondents, 50% always or often asked patients about their sex practices, 27.3% always or often asked about sexual partners' HIV status and 21.8% always or often initiated a conversation about PrEP. Participants noted that the physicians and nurses were primarily responsible for providing sexual risk reduction counseling, PrEP adherence counseling, and PrEP lab testing and monitoring in their practice.

Healthcare provider interviews
From 11/20/19-2/7/20, we interviewed a select group of 24 providers from across the 8 clinical sites who had a mean age = 40.4 years (standard deviation [SD] = 9.9), 73.7% were female, 68.4% were White, and 68.4% were physicians. Interviewed providers noted that they had a median of four patients on PrEP (interquartile range [IQR] = 2-14). Responses to questions were summarized as such: 1-Provider's experience with PrEP initiation and/or monitoring before the launch of PrE-P-OI: Participants noted barriers when initiating PrEP and following up with patients on PrEP prior to the start of PrEP-OI. At PrEP initiation, lack of time (due to having patients with complex comorbidities during short appointments), lack of personal PrEP knowledge (resulting in discomfort with discussing self-swabbing and sex), and pharmacy and insurance issues (e.g., prior authorizations and patient assistance programs) were noted as the main barriers ( Table 3).    At follow-up, time for refilling PrEP or ordering labs, referring patients to other locations due to not having clinical support to provide PrEP, and lack of method to contact patients unresponsive to telephone calls were the main barriers. Providers also talked about having a "reactive" follow-up strategy, meaning that they relied on the patient to request a refill or contact the provider before remembering to order labs, check in about adherence and side effects, or send refills. As a result, patients who would not request refills or contact the provider would be lost to follow-up.
It feels a little irresponsible when we were providing PrEP prescriptions without that level of service and management. So this feels like night and day in terms of somebody monitoring follow up and reaching out to patients because if we don't, 90% of our patients are not going to come back in after the 90 days if somebody doesn't reach out to them.

2-Provider's experience with PrEP initiation and/or monitoring after the launch of PrEP-OI:
In contrast, after the start of PrEP-OI, participants noted improvements across the entire PrEP continuum from PrEP awareness to adherence and retention in care ( Table 3). Providers described the PC as a conduit between the provider and the patient with more time to provide PrEP education, screening, and counseling. The issue of task sharing was discussed by numerous providers in that, by having the PC provide specialized PrEP services, the provider could focus on the medically important issues.
It took so many things off of my plate. So, I'm there to be able to do the medical assessment. She's able to do the things that don't have to be done by a physician. After visit work that needs to be done in order to ensure that patients are able to get the medication and take it appropriately and follow up, none of that has to be done by a physician.
The assistance of the PC was associated with reduced provider anxiety and stress.

It's nice that [PC] has the time to sit down with them and use a phone interpreter. She's not limited to the 15 minute in and out primary care provider visit, where we're trying to address multiple things at once. That's why it's been so critical to have her on-site and have the texting capability, which we as primary care providers don't really offer. I personally just feel better about it. Like I don't worry that the patient's falling through the cracks or if I prescribe this refill. Just knowing that [PC] is tracking them and following up with them, I just feel more at ease.
Providers also noted the more efficient identification of PrEP candidates, increased ease of PrEP prescribing due to resolution of insurance and pharmacy issues, and faster PrEP starts (from 1-2 weeks to 1-2 days).

It's just simply much easier and much faster because the majority of my patients have [health access program] and I couldn't simply write a prescription and send them to [pharmacy]. It could've been 1-2 weeks and now it's pretty much immediate or next day or same day. There's a huge difference in having him around.
Providers reported that this increased efficiency achieved through the panel management strategy resulted in fewer patients falling out of care and not needing to be referred to another clinic to receive PrEP. Finally, providers noted an increase in PrEP adherence and retention due to frequent contact with the PC, receiving timely refills, and completing quarterly lab tests. This was referred to as a "proactive" follow-up (in contrast to the previously described "reactive" follow-up), which further prevented patients from falling out of care.
Sometimes I would give people 90 days with one refill and say when you're due for your refill, you need to come in, but I didn't really have a good system. You know, we're primary care so I don't really have the bandwidth to monitor that, so having someone who is paying attention to that is really helpful. [PC] is proactive about getting them back in. My practice by necessity was a little bit reactive. So when I got the refill request, it would be like oh crap, ok it's been 3 months, so now I need to call them or get somebody to call them to get them in.
Additionally, the use of mobile telephones by the PC to send text messages to the patient further enhanced their capacity for patient access.

3-PrEP-OI's potential impact on the provider's capacity, capability, or opportunity to prescribe PrEP:
Providers noted that the shifts from before to after PrEP-OI had resulted in their increased capacity, capability, and opportunity to offer PrEP and manage patients on PrEP. This was accomplished mainly by decreasing barriers to PrEP initiation (faster resolution of insurance and pharmacy issues, providing patient education and building trust, developing care plans, removing the need for quarterly appointments with the provider, or patient referral to another clinic). Due to the perceived increase in efficiency, providers were more likely to want to offer PrEP.

I think for some of our staff without a PrEP Coordinator, they felt like well, I can't really talk about PrEP or advocate for it that much because there's no one to hold it and they don't want to hold it. Some people, without a PrEP Coordinator, feel like 'I don't want to open that box and then have to deal with all of these other responsibilities.' So folks maybe felt a little less willing to really go there without the added support.
Finally, similar to theme 2 (i.e., Provider's experience with PrEP initiation and/or monitoring after the launch of PrEP-OI), providers often noted their general peace of mind and reduced anxiety due to their trust in the PC's abilities for organized and thorough panel management.

4-PrEP-OI's potential role in changing other practices in the clinic:
Providers noted several indirect impacts of PrEP-OI. This included a general increase in PrEP awareness because the PCs served as a constant visual reminder to keep PrEP at the forefront of the clinician's and staff's minds. PCs increased the provider's comfort level with discussions about PrEP, sex practices, and STI self-swabbing.

I would definitely say that the issue is more in the forefront of things that I think about when addressing health maintenance issues with our patients. I think that is true about the presence of a PrEP coordinator, because it breaks down so many barriers to getting this to happen. I don't know whether it's a psychological thing that I feel now it's easier to do and so I'm more likely to bring it up with patients.
Additionally, the increased contact with patients in general was noted to be a gateway to the provision of other primary care services beyond PrEP, such as vaccinations and other healthcare maintenance.
Biggest thing is getting people back in. Because then PrEP is the gateway for primary care and once we get somebody in, we can also be like, oh these are the other screenings that are recommended that we can do today since we're already drawing your blood, so we'll do ton of vaccination.
There was noticeably a more thorough sexual health history intake, patient and provider education on STI self-swabbing, and increased STI testing. Some providers noted that through PrEP-OI they had been educated about conducting appropriate testing for chlamydia and gonorrhea, from only urine testing to three-site screening (urine, pharyngeal, and rectal).

I think because of [PC] and that [clinician's] presentation
, we probably before only tested for urine gonorrhea/chlamydia, but then after the presentations: 'you should probably be testing separately rectally and orally or pharyngeally, and this is how you teach patients to do it.' Because number one, being told is one thing, but then having to teach patients how to do it and having that additional training and support and answering questions and making sure patients are comfortable doing that is a whole other hurdle. So having [PC] there has definitely helped with that. Because before her we probably only did urine, maybe vaginal, doubt that we did much rectal or oral/pharyngeal, because we had no idea how to do it.

5-Requested modifications of the PrEP-OI services to improve use:
When asked about ways to improve the current PrEP-OI services, providers had few suggestions which mainly included strategies to increase the work hours and scope of work of the PC and increasing education for providers, clinic staff, and patients ( Table 4). One suggestion involved the expansion of the responsibilities of the PC to include care coordination for those living with HIV.
6-Strategies to increase the provider's PrEP offering and prescribing practices: When asked about how to increase PrEP prescribing in general, providers noted several options such as ways of increasing referrals via offering PrEP to all patients who test positive for STIs and reviewing STI registries to identify patients who have previously tested positive for STIs ( Table 4). Another option included the optimization of EHR use by creating dot-phrases (shortcuts to insert a predefined phrase that can be quickly summoned when typing an EHR note) as a reminder to the provider and staff to assess patient's PrEP interest. Providers also discussed the need for further training on active listening without judgement, recognizing and reducing implicit biases, universally offering PrEP to all patients, and developing youthfriendly health education.

Many of us have internal blind spots or biases. The epidemiology is primarily MSM [men who have sex with men], and that doesn't mean we don't pay attention to the other folks that may benefit from
PrEP, but it's hard to sometimes break out of those kinds of silos of thinking. I think trying to standardize workflows, like anytime somebody has chlamydia gonorrhea, when they come back for treatment, that also should be an automatic trigger for also talking about PrEP. It just should be routine.
Another recurring theme included the need to normalize PrEP to decrease stigma associated with PrEP use by offering PrEP to all patients (not just cis-gender MSM and transgender women who have sex with men) using a single question (i.e., "are you interested in hearing more about a pill that can prevent HIV?"), offering PrEP as part of primary care instead of a specialty "PrEP clinic" with "PrEP specialists," and further examining the clinic's gender and racial/ethnic health disparities. Finally, providers discussed the need for a PrEP "captain" (i.e., another provider with more PrEP experience) to help other providers with PrEP education and clinical consultations.
It seems like we're disconnected in terms of our knowledge about how to go about making PrEP and PEP more universal and nothing special, like just a part of something we do. I think 7-Best ways to support providers when new PrEP formulations become available: Finally, participants were asked about how they could best be supported to prescribe new PrEP formulations (e.g., injections, implants, etc.) upon availability. Many noted that they would like to receive algorithms and guidelines similar to those available for oral contraceptives or other chronic conditions (such as diabetes or hypertension). This algorithm would identify a basic PrEP regimen and circumstances for using alternative regimens along with advantages and disadvantages of each option. Providers requested that these guidelines be available through their EHRs, especially when requesting an electronic consultation (i.e., e-consult). In addition to training and educational opportunities for providers, other suggestions included training the PCs to support providers in this decision-making process and making the PC positions permanent.
[PC] definitely has made life easier for the providers, and we very much appreciate having him around. He can establish a different kind of relationship with the client than we have, so I think it just helps primarily with adherence, and adherence is the most important thing as far as I'm concerned. I think it's really important that that be a permanent position. Now it would be hard to imagine our clinic without him. Every clinic should have a PrEP coordinator.

Discussions
In this paper, we report facilitators and barriers to implementation of a PrEP panel management strategy for increasing PrEP use in a large safety-net health system. Shortage of clinical space, medical mistrust, language barriers, education of providers and staff, patient outreach, limited lab hours, limited provider time, and provider comfort with PrEP were noted to be important factors to consider prior to implementation. However, after implementation, need for increased PC's work hours and scope of work; continuing education for providers, staff, and patients; and expansion of the responsibilities of the PC to taking a status neutral approach to HIV treatment and prevention were noted as ongoing issues to address. The factors reported pre-and post-implementation suggest that many of the gaps in PrEP implementation and potential benefits of the PrEP-OI intervention were not initially clear to providers. Providers reported that the PrEP-OI intervention addressed many of the (often unrecognized) barriers to PrEP implementation in a public health primary care setting. Similar discrepancies in PrEP implementation challenges have been reported in other health jurisdictions [24].
The lack of centralized care through a panel management strategy prior to PrEP-OI may have been responsible for the low number of patients on PrEP on the providers' panels. A panel management strategy would help to address a number of identified barriers to PrEP initiation. Additionally, from our quantitative surveys, it is clear that providers have reservations about asking about patients' sex practices, sexual partners' HIV status, and initiation of conversations around PrEP.
In comparing PrEP management before and after the implementation of PrEP-OI, it was clear that the intervention had impacted the entire PrEP continuum from uptake to persistence and increased provider perceptions of efficiency, capacity, and capability to prescribe and manage PrEP. In addition to PrEP-specific benefits, PrEP-OI also provided an opportunity to engage patients in other primary care services (e.g., vaccinations and laboratory monitoring for hepatitis C), increase provider comfort with more thorough sexual health history taking, and STI testing. Therefore, it may be possible that PrEP-OI can augment responses to other epidemics, such as syphilis and hepatitis C.
In aligning with requests from providers, we are examining ways to optimize the use of EHR to increase PrEP referrals and education. This includes developing dot-phrases (shortcuts to insert pre-defined data or text into an EHR note) that providers can incorporate into their existing dot-phrases (e.g., for general healthcare maintenance, sexual health risk screening, or STI treatment and follow-up) or create new ones regarding PrEP offering using a single question (i.e., "are you interested in hearing more about a pill that can prevent HIV?"). If the patient notes their interest in hearing more, the provider and staff can notify the patient that the clinic's PC will follow-up with them and route the patient's chart to the PC. These dotphrases serve as additional reminders to ask all patients receiving a general check-up and/or treatment for an STI, and can minimize the time allocation for PrEP discussions during a brief medical appointment. These EHR optimization strategies can also normalize PrEP and decrease PrEP stigma by universally asking all patients about their desire to reduce HIV risk. We are incorporating graphics on PrEP basics and various PrEP dosing strategies in different languages in the EHR for providers to use in after-visit summaries given to the patient. Our PCs are examining optimal ways of reviewing STI registries to capture those who have recently tested positive for an STI, and developing youth-friendly counseling points including how to pick up PrEP from a pharmacy, refill PrEP, and contact PC and clinic for any challenges.
Finally, with the availability of new PrEP formulations, providers requested algorithms similar to oral contraceptives, whereby a basic PrEP regimen would be identified and all options would be listed with pros and cons. We continue to provide education and updates to the PC, providers, and clinic staff, and develop education material for patients in different languages.
Historically, prior panel management strategies have used the services of a PrEP Navigator [14,15], as opposed to a PrEP Coordinator. Although these terms have not yet been fully defined, a PrEP Navigator's role is more in line with the navigation of health insurance benefits, risk reduction counseling, referral and linkage to a PrEP provider, or referral to other services (e.g., housing or mental health programs). In PrEP-OI [21], PCs provide the spectrum of PrEP services except signing PrEP prescriptions and consulting with patients in case of side effects or other clinical questions (i.e., activities requiring medical expertise). Therefore, in line with principles of task sharing, the vast majority of the activities associated with PrEP initiation and continuation can be achieved with the assistance of a PC. This allows for providers to be involved when medically necessary and to focus on other comorbidities and/or medical issues. We believe that the coordination of a patient's PrEP care would be more efficient, organized, and reduce cost when involving a panel management strategy such as PrEP-OI versus solely reliant on healthcare providers. Although we did not have a cost-effectiveness component for this study, studies of patient navigation-type services for other conditions have found them to be cost-effective [25].
Implementation of the PrEP-OI intervention will likely require that a jurisdiction identify sustainable sources of support. This includes funding to pay for the coordinators, as well as personnel support to supervise the program. Additionally, technology costs are needed to maintain and update the online panel management tool. The coordinator positions are a viable potential strategy for cities and states looking to meet the "prevent" pillar of the US national Ending the HIV Epidemic Initiative [26], for which substantive federal funding is being allocated. States and cities may also be able to incorporate the positions into local revenue streams. At the level of the individual clinic, capitated funding models, for which a clinic receives a set payment per patient assigned, may provide greater flexibility and create greater efficiencies than other insurance models because they incentivize delivery of services that prevent diseases that are costly to treat [27,28]. Adequate clinical supervision may involve weekly meetings, ongoing education and training, case reviews, and support to PCs dealing with challenging clinical cases.
Our study examined a PrEP intervention across the SFDPH primary care clinics; therefore, our results may not be generalizable to other cities or specialty clinics. At time of writing this paper, the PrEP-OI study is ongoing; therefore, we do not currently have quantitative data on PrEP initiations or longer-term follow-up data on PrEP retention and persistence. We used CDC guidelines [18] and other publications [19] to develop the PrEP-Rx risk assessment; however, these questions were not validated across all patient populations. Finally, we do not have data from the perspective of the patients or other stakeholders regarding PrEP-OI implementation.

Conclusion
In summary, our data reveal important findings regarding the benefits of a PrEP coordination program across the PrEP cascade of care, the need for ongoing education of providers, and measures to increase PrEP prescribing practices. Using this panel management task sharing strategy (including PrEP Coordinators and a web-based panel management tool), we believe we can increase PrEP uptake and persistence across clinical sites to further reduce HIV incidence and approach the goals for ending the HIV epidemic.