Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Opening the digital doorway to sexual healthcare: Recommendations from a behaviour change wheel analysis of barriers and facilitators to seeking online sexual health information and support among underserved populations

  • Julie McLeod ,

    Roles Conceptualization, Formal analysis, Investigation, Resources, Visualization, Writing – original draft, Writing – review & editing

    julie.mcleod@gcu.ac.uk

    Affiliation School of Health and Life Sciences, Glasgow Caledonian University, Glasgow, Scotland, United Kingdom

  • Claudia S. Estcourt,

    Roles Funding acquisition, Supervision, Writing – review & editing

    Affiliation School of Health and Life Sciences, Glasgow Caledonian University, Glasgow, Scotland, United Kingdom

  • Jennifer MacDonald,

    Roles Conceptualization, Methodology, Resources, Writing – review & editing

    Affiliation School of Health and Life Sciences, Glasgow Caledonian University, Glasgow, Scotland, United Kingdom

  • Jo Gibbs,

    Roles Funding acquisition, Writing – review & editing

    Affiliation Institute for Global Health, University College London, London, England, United Kingdom

  • Melvina Woode Owusu,

    Roles Funding acquisition, Project administration, Writing – review & editing

    Affiliation Institute for Global Health, University College London, London, England, United Kingdom

  • Fiona Mapp,

    Roles Resources, Writing – review & editing

    Affiliation Institute for Global Health, University College London, London, England, United Kingdom

  • Nuria Gallego Marquez,

    Roles Writing – review & editing

    Affiliation Institute for Global Health, University College London, London, England, United Kingdom

  • Amelia McInnes-Dean,

    Roles Writing – review & editing

    Affiliation Institute for Global Health, University College London, London, England, United Kingdom

  • John M. Saunders,

    Roles Writing – review & editing

    Affiliations Institute for Global Health, University College London, London, England, United Kingdom, UK Health Security Agency (UKHSA), London, England, United Kingdom

  • Ann Blandford,

    Roles Funding acquisition, Writing – review & editing

    Affiliation UCL Interaction Centre (UCLIC), University College London, London, England, United Kingdom

  • Paul Flowers

    Roles Conceptualization, Formal analysis, Funding acquisition, Resources, Supervision, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Psychological Science and Health, University of Strathclyde, Glasgow, Scotland, United Kingdom

Abstract

Background

The ability to access and navigate online sexual health information and support is increasingly needed in order to engage with wider sexual healthcare. However, people from underserved populations may struggle to pass though this “digital doorway”. Therefore, using a behavioural science approach, we first aimed to identify barriers and facilitators to i) seeking online sexual health information and ii) seeking online sexual health support. Subsequently, we aimed to generate theory-informed recommendations to improve these access points.

Methods

The PROGRESSPlus framework guided purposive recruitment (15.10.21–18.03.22) of 35 UK participants from diverse backgrounds, including 51% from the most deprived areas and 26% from minoritised ethnic groups. Using semi-structured interviews and thematic analysis, we identified barriers and facilitators to seeking online sexual health information and support. A Behaviour Change Wheel (BCW) analysis then identified recommendations to better meet the needs of underserved populations.

Results

We found diverse barriers and facilitators. Barriers included low awareness of and familiarity with online information and support; perceptions that online information and support were unlikely to meet the needs of underserved populations; overwhelming volume of information sources; lack of personal relevancy; chatbots/automated responses; and response wait times. Facilitators included clarity about credibility and quality; inclusive content; and in-person assistance. Recommendations included: Education and Persuasion e.g., online and offline promotion and endorsement by healthcare professionals and peers; Training and Modelling e.g., accessible training to enhance searching skills and credibility appraisal; and Environmental Restructuring and Enablement e.g., modifications to ensure online information and support are simple and easy to use, including video/audio options for content.

Conclusions

Given that access to many sexual health services is now digital, our analyses produced recommendations pivotal to increasing access to wider sexual healthcare among underserved populations. Implementing these recommendations could reduce inequalities associated with accessing and using online sexual health service.

Introduction

Over the past decade, the online delivery of sexual healthcare has increased, accelerated by the COVID-19 pandemic [14]. Such healthcare includes online postal self-sampling (OPSS) for sexually transmitted infection (STI) and blood borne virus (BBV) testing [e.g. 58]. More complex online clinical care pathways are also in development, such as the eSexual Health Clinic for accessing STI test results and treatment [9] and ePrEP for accessing HIV prevention medication, pre-exposure prophylaxis (PrEP) [10]. For many people, the initial steps to accessing sexual healthcare, both online and traditional (i.e., in-person/phone), are seeking sexual health information and support online [1115]. Our definition of seeking online sexual health information is inclusive, referring to searching for, finding, understanding, and applying information from the internet [e.g. 1416] typically found through search engines. Equally, regarding seeking online sexual health support, we refer to finding and using text-based interactions for answers to a range of sexual health queries. These include tools such as live chats and chatbots (synchronous communication with a trained professional (live chats) or with automatic responses (chatbots)) and email or short-messaging service (SMS) text exchange (asynchronous communication with a trained professional [e.g. 1722]). See S1 Table for a list of examples. Together, these two steps (seeking online sexual health information and support) form a digital doorway to wider sexual healthcare [2327].

Online sexual healthcare can overcome common barriers to accessing traditional sexual health services, offering privacy and convenience [e.g. 12, 28, 29]. However, many may struggle to access and use online sexual healthcare due to inequalities patterned by socio-economic demographics, such as gender, sexual identity, ethnicity, and socio-economic status [3, 3040] (i.e., underserved populations [41]). Further, for people to engage with and pass through the digital doorway to wider sexual healthcare, they require sufficient digital literacy (skills to perform tasks and solve problems in digital environments [42]) and health literacy (capability to understand, evaluate, and use information and services to make choices about health [43]). This complex intersection of socio-economic factors precluding access to healthcare for those who often bear a disproportionate burden of STIs [e.g. 44] illustrates how the provision of online sexual healthcare has the potential to widen inequalities amongst underserved populations.

To prevent widening inequalities in access to online sexual healthcare, it is vital to understand the barriers and facilitators to the digital doorway among underserved populations, theorise the factors that underpin barriers and facilitators, and then identify appropriate theoretically informed recommendations for change [45]. While some research regarding barriers and facilitators has been conducted, the existing literature base is outdated [4652] or uses exclusively quantitative methods [5359]. Thus, there is an absence of contemporary, in-depth research. Moreover, to our knowledge, there are no studies identifying evidence-based and theoretically informed recommendations for seeking online sexual health information and support among underserved populations. Therefore, using a behavioural science approach, we first aimed to identify barriers and facilitators to two key elements of the digital doorway: i) seeking online sexual health information and ii) seeking online sexual health support. Subsequently, we aimed to propose theory-informed recommendations to improve these two access points. We developed three research questions (RQs): RQ1) What are the barriers and facilitators to seeking online sexual health information among underserved populations?; RQ2) What are the barriers and facilitators to seeking online sexual health support among underserved populations?; and RQ3) What evidence-based and theoretically informed recommendations can be made to enhance seeking online sexual health information and support among underserved populations?

Methods

Design

A behaviourally focused cross-sectional exploratory qualitative approach, conducted as part of the SEQUENCE Digital Programme (https://www.sequencedigital.org.uk/).

Applying a behavioural lens

High quality applied behavioural science requires a considered understanding of the specific behaviour(s) that are intended to be changed by an intervention [45, 60]. Within the broad behavioural system of ‘accessing and using online sexual healthcare’ we identified seven distinct yet interconnected behavioural domains (see S1 Fig). Here, we focus on the first of these two domains that we consider to constitute the digital doorway: 1) seeking online sexual health information and 2) seeking online sexual health support.

Participants

Inclusion criteria were: 1) never ordered/used or struggled to order/use an STI self-sampling kit (to recruit participants of lower digital literacy); 2) aged 16+; 3) sexually active; 4) had phone and internet access to enable data collection; 5) lived in the UK; and 6) spoke English well enough to participate in an interview. Further, using PROGRESSPlus (PROGRESS: Place of Residence, Race/Ethnicity, Occupation, Gender/Sex, Religion, Education, Socio-economic Status, Social Network; Plus: e.g., Age, Sexual Orientation, Disability) [61, 62], we developed a sampling framework (see S2 Table) to purposefully recruit participants from a range of underserved populations. In line with Braun and Clarke [63], we did not seek to meet data saturation. Instead, prior to recruitment, a sample of 35 was agreed as appropriate to meet the sample targets and sufficient Information Power [64]. After 35 interviews, we reviewed the data and were satisfied that Information Power has been attained. See Table 1 for the characteristics and demographics of the final sample.

thumbnail
Table 1. Participant self-reported socio-economic demographic characteristics.

https://doi.org/10.1371/journal.pone.0315049.t001

Recruitment

Representatives from five regional National Health Service (NHS) Trusts/Boards (i.e., organisational areas), two non-governmental organisations (NGOs), and one community college across England and Scotland referred interested potential participants to the research team. One NGO served people with disabilities and learning difficulties, the other, people who identify as LGBTQI+ and Muslim. The community college served people with low educational attainment living in a deprived area. We then telephoned each referred participant to verify eligibility according to our inclusion criteria, screen them against the target sampling frame, collect demographics and information on internet use (see S3 Table), and schedule an interview (phone, video, or face-to-face). The sample was monitored closely throughout recruitment by checking the demographics of potential participants against the existing sample and target sampling frame. As sample targets were met, we selectively recruited only people of characteristics and demographics for which targets had not yet been met and liaised with NHS and NGO representatives about targeting relevant potential participants.

Materials

We composed a questionnaire-based assessment of eligibility to take part in the study, demographics (based on the PROGRESSPlus framework [61, 62]), and experience and skills using technology and the internet (S3 Table). In line with inclusive guidance [65, 66], the questions asked regarding socio-economic demographics, such as gender identity and ethnicity, were open questions to capture how participants self-identified.

We also developed an interview topic guide (S4 Table) and supporting visual aids (e.g., S2 Fig) to explore participants’ barriers (e.g., what makes it difficult, what are the drawbacks) and facilitators (e.g., what makes it easy, what are the benefits) to both seeking online sexual health information and support. Example topic guide questions were “What has made it difficult for you to search for sexual health information online?” and “What would make it easy for you to use an email or text service to get sexual health support online?”. Alongside the topic guide questions, we asked follow up questions to participants’ responses, for example, “You said that a barrier to searching for sexual health information online was privacy, can you tell me more about that?”. Barriers and facilitators could be either experiential (i.e., actually experienced) or hypothetical. The visual aids depicted the two behavioural domains of seeking online sexual health information and support. Respectively, these visual aids showed search engines with the typed words “sexually transmitted infection (STI) symptoms” for ‘seeking online sexual health information’ and examples of a sexual health live chat and SMS text exchange with a healthcare provider (HCP) for ‘seeking online sexual health support’.

Participant and patient involvement and engagement

For material development, we consulted public and patient involvement and engagement (PPIE) representatives (N = 12) of diverse ages, genders, ethnicities, sexual orientations, religions, and experiences of disability, learning difficulties, and digital STI healthcare. The representatives offered intersectional perspectives and advice on our questionnaire-based assessment of participant demographics and internet use (n = 5) and the interview topic guide and visual aids (n = 7) to be used within data collection. Consent to share PPIE representatives’ demographic information was not obtained.

Procedure

One-to-one participant-led semi-structured interviews (duration range 38–82 minutes, M = 60 minutes) were conducted remotely (video call n = 7, phone n = 23, or face-to-face n = 5, all by JMcL, between 15.10.21 and 18.03.22). Prior to the interview, we provided participants with an information sheet, consent form, and the visual aids by email or WhatsApp for remote interviews and hard copy for face-to-face interviews. At the beginning of the interview, for remote interviews, participants provided verbal informed consent, recorded (by JMcL) using an encrypted recorder, and for face-to-face interviews, participants provided written informed consent At the end of the interviews, all participants were offered a shopping voucher (value £30) and were provided with a list of sexual health resources (S5 Table) either by email, WhatsApp or hard copy.

Analysis

For RQs one and two, using NVivo (version 12), we conducted inductive thematic analysis at semantic level to identify barrier and facilitator themes for each of the behaviours, following Braun and Clarke’s [63] five steps (see Fig 1). First we familiarised ourselves with the data (step 1) then we systematically described data using brief summary barrier or facilitator statements (step 2). We then grouped similar summary statements to identify barrier and facilitator sub-themes (step 3) and grouped similar sub-themes to generate higher level barrier and facilitator themes, gaining insights into patterns across participant sub-groups (step 4). Finally, we reviewed the themes to ensure they matched the original quotes and finalised their names (step 5). Each of the steps were initially conducted by an experienced health psychology researcher (JMcL) then audited by an expert behavioural scientist (PF). Disagreements on the describing, grouping, and naming of themes were resolved through discussion until consensus was reached. An inter-disciplinary team of clinicians and clinical researchers, human computer interaction specialists, sociology researchers, and public health experts also had oversight of the analysis. Overall, the themes provide a rich description of what was learned from analysing the whole dataset, reflecting all participants. Insights into the sub-population patterning of barriers and facilitators has also been provided; however no formal analysis across participants groups was conducted for this (e.g., approaches such as framework analysis [67]).

thumbnail
Fig 1. The thematic analysis process, following Braun and Clarke’s [63] five steps, using examples from data for seeking online sexual health information.

https://doi.org/10.1371/journal.pone.0315049.g001

In line with Braun and Clark [63], thematic analysis was selected for the analysis, as it offered identification of patterns of important issues to participants, enabling us to determine the key barriers and facilitators to seeking online sexual health information and support across diverse underserved populations. Additionally, inductive analysis (i.e., themes are derived bottom up from the data without trying to fit it into a pre-existing coding frame or the researcher’s analytic preconceptions) was chosen, as the goal of the research was to specify participant-led barriers and facilitators. Neither the topic guide nor the analysis were approached with pre-conceived notions of the data or results. Further, semantic level analysis (i.e., themes are identified from the explicit or meanings of the data, not anything beyond what a participant has said) was selected as this offers an objective description of the data, rather than subjective interpretation of underlying assumptions or deeper meanings within the data.

For RQ three, using the BCW approach [45], barrier and facilitator themes were mapped onto appropriate components of the COM-B Model [68] (by JMcL and checked by PF). The COM-B model posits that behaviour is determined by ‘Capability’ (physical and psychological attributes of a person), ‘Opportunity’ (physical and social attributes of a person’s environment), and/or ‘Motivation’ (a person’s reflective and automatic mental processes). The COM-B components were then matched to relevant Intervention Functions (nine broad categories of potential interventions to change the capability, opportunity and/or motivation to engage in a behaviour) [45] (by PF, audited by JMcL and JMacD). Subsequently, we drew on our collective expertise and the Behaviour Change Technique Taxonomy version 1 (BCTTv1) [69] to operationalise the Intervention Functions into recommendations (conducted by PF and JM, audited by JMacD). The recommendations were reviewed by an interdisciplinary team including sexual health clinicians, public health researchers, and human computer interaction specialists. All BCW analyses were conducted by health psychology researchers who have completed the BCTTv1 training (https://www.bct-taxonomy.com/). Discrepancies in BCW coding were resolved through discussion between JMcL, PF and, latterly, JMacD.

Ethics

Written ethical approval for this study was granted by the East of England—Cambridge South Research Ethics Committee (REC) (reference 21/EE/0148) and Glasgow Caledonian University REC (reference HLS/NCH/20/045).

Results

Participants

Participants (N = 35) (see Table 1) ranged in age from 18–70 (M = 34 years) and were diverse, representing several underserved populations: 51% (n = 18) lived in the most deprived areas of the UK (as defined by the Index of Multiple Deprivation [70]); 51% (n = 18) had no higher (i.e., university) education; 40% (n = 14) were of a minoritised ethnic group, of which, five were from an ethnic group other than White; 23% (n = 8) did not speak English as their first language; 49% (n = 17) had a mental or physical illness or condition lasting 12 months or more; and 29% (n = 10) had a learning difficulty. The majority of participants reported owning a digital device (e.g., mobile phone or laptop) to access the internet (n = 30, 86%) and using the internet every day (n = 29, 83%) for a wide range of activities, most frequently, social media (n = 22, 63%), work including research (n = 17, 48%), streaming TV shows or videos (n = 10, 29%), searching the internet for information (n = 9, 26%), and checking news (n = 5, 14%) and emails (n = 5, 14%). Over half of the participants described themselves as having ‘high’ level skills using the internet (i.e., digital literacy) (n = 20, 57%), 12 reported ‘medium’ (34%), and 2 reported ‘low’ (6%). Over a third (n = 12, 34.3%) had never searched for any sexual health information online, none had ever used a live chat or email or text exchange service for getting sexual health support, and few had used other online sexual health services such as booking an appointment (n = 4, 11.4%) or ordering medication through a private (non-state-funded) clinic (n = 1, 2.9%). Moreover, the majority had never ordered a postal STI self-sampling kit (n = 24, 68.6%) and a few reported having tried and struggled to order (n = 3, 9%), or use (n = 7, 20%), a self-sampling kit for STIs and blood borne viruses. See S6 Table for an overview of participant data regarding experience and self-rated skills of using the internet.

RQ1) What are the barriers and facilitators to seeking sexual health information online among underserved populations?

Table 2 details the nine barrier and eleven facilitator themes to seeking online sexual health information, with indicative data extracts, and their corresponding COM-B components.

thumbnail
Table 2. Barrier and facilitator themes and corresponding COM-B components for seeking online sexual health information among underserved populations.

https://doi.org/10.1371/journal.pone.0315049.t002

Barriers to seeking online sexual health information.

Barrier themes relating to ‘Capability’ were ‘Lack of awareness’; ‘Lack of familiarity’; ‘Lack of knowledge of where to search’; and ‘Communication and understanding difficulties’. This cluster of barriers related to a lack of important knowledge about the existence of sexual health information and how to access and understand it. Regarding insights into sub-population patterning of barriers, it appeared that the barrier ‘Lack of awareness’ was noted despite self-reported high skills using the internet or amount of time spent on the internet. Additionally, ‘Lack of familiarity’ appeared to be of particular issue for those who self-reported as having lower digital literacy (e.g., had a self-perception of being, for example, a “tech dinosaur”). Further, ‘Communication and understanding difficulties’ appeared to be of particular concern amongst those who reported having a learning difficulty or those whose first language was not English.

The barrier theme relating to ‘Opportunity’ focussed on features of the digital environment: ‘Volume of information sources’ and ‘Lack of inclusivity and personal relevance’. This barrier provides a sense of how some people find seeking online sexual health information overwhelming whilst navigating search engine results and finding relevant information. In relation to insights into sub-population patterning of barriers, it appeared that issues with a ‘Lack of inclusivity and personal relevance’ was of particular concern for participants who identified as LGBTQIA+, were religious, or were an injecting drug user; for example, one such participant expressed the need for more information delineating the differences between STI symptoms and how the groin can be affected by injecting heroin.

Barrier themes relating to ‘Motivation’ were negative perceptions of online sexual health information: ‘Concerns about privacy’; ‘Concerns about credibility’; ‘Concerns about adequacy/inferiority (compared to in-person/phone)’. This cluster related to concerns about the internet as a source of sexual health information. In relation to insights into sub-population patterning of barriers, it appeared that ‘Concerns about privacy’ was of particular issue for those who identified as LGBTQIA+ and/or religious; for example, Muslim LGBTQIA+ participants whose family did not know they were LGBTQIA+ reported concerns about their family seeing their search history.

Facilitators to seeking online sexual health information.

Facilitator themes related to ‘Capability’ centred around knowledge: ‘Knowledge of how and for what to search’ and ‘Ability to determine credibility’. Regarding insights into sub-population patterning of facilitators, it appeared that ‘Knowledge of how and for what to search’ was particularly important among participants who reported lower skills using the internet, noting this as a particular facilitator to finding relevant information. Additionally, ‘Ability to determine credibility’ of information appeared to be particularly prominent among those who self-reported as having high skills using the internet.

Facilitator themes related to ‘Opportunity’ focussed on features of the digital environment, promotion, and help: ‘Credible information being easy to find’; ‘Video and audio options (alternative to text)’; ‘Simplicity of information and layout’; ‘Inclusivity and personal relevancy’; ‘Advertisements to raise awareness’; and ‘In-person assistance’. In relation to insights into sub-population patterning of facilitators, it appeared that ‘Credible information being easy to find’ was particularly important for those who self-reported as having lower skills using the internet. Additionally, the ‘Inclusivity and personal relevancy’ of information appeared to be particularly prominent among those who identified as LGBTQI+, religious, and injecting drug users. Similarly, ‘Video and audio options’ were of particular importance among those who reported having a learning difficulty. Further, ‘In-person assistance’ speaks to the need for help to seek online sexual health information, for example from a key worker or family member, among those who self-reported as having lower skills using the internet or with learning difficulties.

Facilitator themes relating to ‘Motivation’ were positive perceptions of online sexual health information: ‘Belief that information is credible’; ‘Beliefs about equal/increased privacy (compared to in-person/phone)’; and ‘Belief that online information is a good starting point’. No sub-population patterning of these facilitators were apparent.

RQ2) What are the barriers and facilitators to seeking online sexual health support among underserved populations?

Table 3 details eight barrier and eight facilitator themes to seeking online sexual health support (via a synchronous live chat or asynchronous email or SMS text exchange), with illustrative extracts, and corresponding COM-B components.

thumbnail
Table 3. Barrier and facilitator themes and corresponding COM-B components for seeking online sexual health support among underserved populations.

https://doi.org/10.1371/journal.pone.0315049.t003

Barriers to seeking online sexual health support.

Barrier themes relating to ‘Capability’ were: ‘Lack of awareness’ and Lack of familiarity’ with online text-based support. These themes revealed a lack of awareness of the existence of online sexual health support services and experience using digital technology and the internet for sexual health support. Regarding insights into sub-population patterning of barriers, it appeared that a ‘Lack of familiarity’ was of particular issue for those who self-reported has having lower skills using the internet.

Barrier themes relating to ‘Motivation’ were negative perceptions about digital sexual health support: ‘Concerns about confidentiality and anonymity’; ‘Concerns about the impersonal nature of online support’; ‘Concerns about understanding and communication’; ‘Concerns about online support meeting their needs’; ‘Concerns about chatbots and automated responses’; and ‘Concerns about response wait times’. Participants consistently reported that they would not use online support for sexual health that had any wait times (i.e., was not instantaneous) to receive a response, or if they would be speaking to a ‘chatbot’ with pre-set or automated responses instead of a person, particularly a trained professional. In relation to insights into sub-population patterning of barriers, it appeared that ‘Concerns about confidentiality and anonymity’ was of particular issue for those who identified as being LGBTQIA+, religious, or in a relationship; for example, those of a religious background noted concerns about parents or family members finding out they were sexually active. Additionally, ‘Concerns about understanding and communication’ appeared to be particularly important among those who had a learning difficulty or whose first language was not English.

No barriers corresponded to Opportunity.

Facilitators to seeking online sexual health support.

One facilitator theme related to ‘Capability’ was identified regarding knowledge: Familiarity with online text-based support services’. In relation to insights into sub-population patterning of facilitators, it appeared that ‘Familiarity with online text-based support services’ was of particular issue for those who self-reported as having lower skills using the internet.

Facilitator themes corresponding to ‘Opportunity’ related to advertisements, help, and features of the digital environment: Immediate responses’; ‘Clear quality and trustworthiness’; ‘Personal feel’; ‘Advertisements to increase awareness’; and’ In-person assistance’. Regarding insights into sub-population patterning of barriers, ‘In-person assistance’ illustrates the needs of participants who self-reported as having lower skills using the internet or those with a learning difficulty for help engaging and accessing online support.

Facilitator themes relating to ‘Motivation’ were positive perceptions on online sexual health support: ‘Beliefs about equal/increased privacy (compared to in-person/phone)’ and ‘Beliefs about online support meeting their needs’. No sub-population patterning of these facilitators were apparent.

RQ3) What evidence-based and theoretically informed recommendations can be made to enhance seeking online sexual health information and support among underserved populations?

The BCW analysis identified potentially useful Intervention Functions to assist underserved populations in seeking online sexual health information and support: ‘Education’, ‘Persuasion, ‘Training’, ‘Modelling’, ‘Enablement’, and ‘Environmental Restructuring’ (see S7 Table for definitions). From these Intervention Functions, we proposed a range of more specific recommendations outlined below. Tables 4 and 5 provide an overview of the BCW analysis of barriers and facilitators and proposed recommendations for online sexual health information and support, respectively.

thumbnail
Table 4. Intervention content from Behaviour Change Wheel to address barriers and facilitators to seeking sexual health information online.

https://doi.org/10.1371/journal.pone.0315049.t004

thumbnail
Table 5. Intervention content from behaviour change wheel to address barriers and facilitators to seeking online sexual health support.

https://doi.org/10.1371/journal.pone.0315049.t005

‘Education’ and ‘Persuasion’.

It may be critical to educate people from underserved populations, particularly those of lower digital literacy, that online sexual health information and support services exist, for example, through advertising online (e.g., via social media) and offline (e.g., via HCPs and NGOs), and persuade them to use these via endorsement by a range of credible professionals and peers. In particular, offline advertising will be crucial for reaching people of lower digital literacy. This education could be delivered via face-to-face interactions with service staff (e.g., HCPs and key workers), posters or leaflets, or posts on professional social media accounts (e.g., from HCPs or influencers) detailing where to search (i.e., search engines/NHS website), what to search for (i.e., key terms), and how to identify credible sources (i.e., key logos). It may also be important to inform people about the benefits and limits of online sexual health information and support and when in-person care should be sought i.e., that online information and support are appropriate for simple issues, such as symptom checking, finding clinics, booking appointments, and signposting, and not appropriate for complex healthcare, such as diagnosis. Further, education regarding the privacy and confidentiality of online sexual health information and support may be important, as well as promoting them as simple and easy to use, personal, synchronous with immediate responses, and not reliant on automated responses). It is critical that Education and Persuasion are delivered alongside Environmental Restructuring and Enablement to ensure online sexual health information and support are private/confidential and simple to use.

‘Training’ and ‘Modelling’.

Training opportunities for necessary skill acquisition could be part of all services that offer online information and support, particularly for those who self-reported as having lower skills using the internet or with learning difficulties. Specifically, this could involve step-by-step instructions on using search engines, identifying and typing key terms, determining source credibility, and understanding and applying information. Training could be delivered in the form of videos, posters or leaflets, or professional or peer-led tutorials. To ensure accessibility in relation to digital provision, audiovisual training options should be offered alongside text-based and training should be provided both in-person as well as online. It might also be critical to provide modelling of peers successfully using online sexual health information and support, such as showing videos or images of peers from underserved populations searching for sexual health information such as STI symptoms or using a sexual health live chat to discuss safe sex. Further, online sexual health information and support service providers could explore partnerships with NGOs for delivery of training.

‘Environmental Restructuring’ and ‘Enablement’.

Restructuring the online environment and enabling people from underserved populations to seek online sexual health information and support is essential. Particularly, it may be vital to ensure that online sexual health information and support services are clearly labelled as delivered by credible, trusted sources (i.e., NHS, registered charities). Further, such services should be designed to be simple to use, avoiding medical jargon and explaining terms when they must be used, particularly to support those who self-report as having lower skills using the internet and with learning difficulties. Additionally, enablement could involve providing a glossary of sexual health terms for examples of correct spelling and video and/or audio options for information. Online sexual information and support content could also be demonstrably tailored to a range of communities, such as gender, sexuality, and religious minoritised groups, and people who use injecting drugs. Further, in-person assistance could enable people of lower digital literacy and with learning difficulties to access and use sexual health information and support. Finally, online sexual health information and support service providers could ensure that any text-based interactions are synchronous (in real-time) and delivered by a trained professional, stating the name and training/qualifications of the professional involved.

Discussion

This study is the first to detail barriers and facilitators to seeking online sexual health information and support amongst underserved populations and propose specific recommendations to enable underserved populations to find and use online sexual health information and support. These findings can be applied to existing and novel online sexual health information and support services to improve access to this digital doorway to wider sexual health services.

Barriers and facilitators to passing through the digital doorway

Key barriers to people from underserved populations seeking online sexual health information and support were a lack of awareness of their availability and familiarity with using them; privacy concerns; and the perception of as inadequate to meet varied and complex sexual health needs and inferior to traditional information and support services (e.g., in-person appointment or phone call with a HCP). For seeking online sexual health information, specifically, barriers were navigating the overwhelming volume of information and different sources of and the perceived lack of inclusivity and relevance of information, particularly on government websites. For seeking online sexual health support, specifically, barriers were chatbots and automated responses; asynchronous communication; and wait times for responses.

Important facilitators to seeking online sexual health information and support were the perceived benefit of increased privacy compared to traditional services; the provision of video and/or audio options as alternatives to text; the presentation of information and support in a simple way–such as step by step and without jargon; and in-person assistance, for example, from key workers, family members, NGO staff, or GPs. For seeking online sexual health information, specifically, facilitators were inclusivity and personal relevancy of sexual health information, particularly for people from LGBTQI+ populations, religious backgrounds, and injecting drug users. For seeking online sexual health support, specifically, facilitators were synchronous communication; the perception of online support as acceptable for simple tasks such as appointment booking, general sexual health advice, and signposting to services; and delivery by qualified personnel.

An important consideration here is that none of the participants had ever used an online sexual health support service, despite their availability [e.g. 1722], thus these barriers and facilitators were exclusively hypothetical. Additionally, barriers and facilitators differed in intensity and nature among subgroups; for example, privacy and confidentiality concerns were expressed by most participants but for different reasons and thus would likely differ among those not represented in this study.

Some of the barriers and facilitators are novel to this study. To the authors’ knowledge, low awareness of online sexual health information and support has not been reported previously and was common, even among participants who reported using the internet ‘all the time’. Additionally, the perceived inferiority and inadequacy of online sexual health information compared to traditional, such as in-person or phone, sources of sexual health information was novel to this study. Further, the unanimous rejection of chatbots and automated responses for sexual health support, due to the perceived complexity of sexual health, was novel to this study. This is in contrast to previous research showing that chatbots for sexual health were overall perceived to be useful for ongoing care or anonymous sex education (by samples of largely white heterosexual adult women) [59, 71]. However, beliefs about the inferiority of online services may change, as generative artificial intelligence becomes more commonplace and trusted [72].

On the other hand, many of our barrier and facilitators findings are consistent with previous literature, offering a novel perspective from a diverse sample of underserved populations. Privacy benefits and concerns [38, 57, 71, 7375] and the value of video and audio options and simplicity [e.g. 29, 38, 75] have been previously reported amongst a range of populations. Further, the overwhelming volume of sources and information, need for inclusivity and personal relevancy of information, and preferences for online support to be delivered synchronously have been reported previously among sexual minority women [76] and African American youth [77], and young people [38, 78, 79]. Moreover, concerns about the adequacy of online information and support has been reported previously [71, 75, 80] and the acceptability of online support for simple tasks is in line with research regarding HCPs’ views of chatbots for sexual health [75]. Overall, the consistency of these findings with research with other populations indicates that addressing the barriers and enhancing the facilitators from this current study will improve online sexual health information and support for many beyond this sample.

Recommendations for opening the digital doorway to wider sexual healthcare

We identified a range of theory informed Intervention Functions to improve access to the digital doorway to wider sexual healthcare, including ‘Education’, ‘Persuasion’, ‘Training’, ‘Modelling’, ‘Environmental Restructuring’, and ‘Enablement’. First, advertising and promotion of services that provide online sexual health information and support and HCP’s endorsing online services and supporting patients to use them is vital (‘Education’ and ‘Persuasion’). Together, these findings resonate with wider research on telehealth per se [81], highlighting the importance of marketing and communication activities to increase awareness of online services to enable equitable access. Additionally, interventions could include online services offering audio-visual forms of communication, such as text-to-speech or cartoon animations. Moreover, our recommendations include the provision of inclusive and personally relevant information and support, such as information about sexual health relevant to those of diverse sexual and/or gender identities, religious backgrounds, and drug use (‘Environmental Restructuring’ and ‘Enablement’). This is in line with previous research showing that tailoring of information can positively influence acceptability of interventions and address barriers to care [8284]. Further, interventions could include training HCP’s on how to use and promote online sexual health services effectively, in line with previous research regarding reducing digital inequalities [81]. Further, professional endorsement of high-quality online services for sexual health information and support is also known to be important [85]. Such endorsements should stress the services’ credibility, useability, and details of its functionality (e.g., trained professional will interact in real time). Interventions could also include embedding optional training for service users regarding how to use online services (‘Training’ and ‘Modelling’).

Implications

Within intervention development, context is critical for the likely success of the intervention [45, 86, 87]. As such, while the findings of this study are solely derived from participants living in Scotland and England, we are confident that they should be transferable to countries with similar healthcare settings and digital infrastructure, such as other countries in the UK not represented in this sample (i.e., Northern Ireland and Wales) or Australia, Canada, and New Zealand. We are less confident about the transferability of the findings to low-and-middle-income countries, given the lack of public health and accessible sexual health infrastructure in some countries [88, 89]. Research is needed to explore the barriers and facilitators to seeking online sexual health information and support and to develop recommendations to overcome the barriers and enhance the facilitators for people from underserved populations in low-and-middle-income countries.

Regarding service specific operationalisation and implementation of our recommendations, intervention development guidance [86] highlights the centrality of involving of stakeholders to co-produce culturally appropriate real world intervention content and help secure their effective delivery, given their investment of time and resource. For improving online sexual health information and support for underserved populations, our BCW analysis has delivered the first step of stakeholder engagement, offering practical theory-and-evidence-based recommendations (i.e., Tables 4 and 5). However, for each recommendation, the operationalisation and implementation for specific settings requires thorough consideration by service providers and other relevant stakeholders (e.g., healthcare providers, public health organizations, NGOs, government health departments, digital health platform developers, legal and regulatory bodies, funders and donors, educational institutions, and media and communication experts). Such stakeholder engagement should also consider affordability, practicability, efficacy, acceptability, side-effects, and equity [45] and address the operationalisation of our proposed recommendations to ensure final intervention content aligns with local circumstances and their wider legislative socio-cultural contexts. This could also involve the use of implementation science tools, such as Normalisation Process Theory [87, 90, 91], to ensure relevant issues of context are rigorously considered for maximum likelihood of success.

Strengths

The PPIE activities with diverse representatives of underserved populations ensured the development of inclusive study materials that were fit for purpose. Moreover, our recruitment strategy of working with clinics and NGOs focussed on the recruitment of participants via in-person rather than online settings. This facilitated the recruitment of people who may struggle to use online sexual health services. In addition, use of the PROGRESSPlus framework enabled the recruitment of a diverse sample of people from a range of underserved populations whose needs are typically unmet by existing services and whose perspectives are often overlooked (e.g., minoritised sexual, ethnic, and religious groups, those living in the most deprived areas). The diversity of our sample supports the transferability of the findings to a wide range of people who may struggle to use existing online sexual health information and support services.

Further, our use of in-depth participant-led qualitative interviews and rigorous inductive thematic analysis conducted by trained and highly experienced qualitative researchers allowed for the collection of rich data and identification of important evidence-based barriers and facilitators to seeking online sexual health information and support. Moreover, the rigorous auditing of the thematic analysis by an experienced behavioural scientist and a larger inter-disciplinary team enabled the development of a comprehensive set of themes, many of which were found to be consistent with previous research. In line with Braun and Clarke [63, 92], we demonstrate a transparent and comprehensive account of the rigorous thematic analysis and subsequent BCW analysis which appropriately answered the research questions. In addition, use of the BCW enabled the development of theory informed recommendations for improvements to seeking online sexual health information and support. As the BCW draws on the cumulative learning from multiple theories of behaviour change [66], it enabled us to specify potentially useful intervention content beyond that suggested by our participants.

Limitations

We sought to recruit a diverse sample of people from underserved populations with low digital literacy. However, while the sample was highly diverse from a range of underserved populations, it remains unclear whether the sample accurately represented people of lower digital literacy. The data we collected indicated that participants experienced difficulties using online sexual health services. However, a small majority self-reported as having high internet skills based on regular use of the internet to complete simple and familiar online tasks (e.g., social media, video streaming). Thus, a limitation of this study was that we did not use a validated measure of digital literacy. Although measures were available [93, 94], none were suitable, as they were too long and too involved, thus had the potential to limit participant engagement with the study. Research is needed to develop a validated short scale measure of digital literacy.

Further, no formal validation of the themes generated from the thematic analysis was conducted. While approaches are available, there is debate and no consensus regarding the best approach for this in qualitative research [9597]. Additionally, in line with Braun and Clarke [63, 92], no inter-rater reliability of the thematic analysis was conducted, due to the highly reflexive nature of the analysis. Instead, a rigorous audit of the thematic analysis was conducted by a behavioural science expert and a broad inter-disciplinary team. However, the consistency of the barrier and facilitator themes identified in this study with previous research does suggest the reliability of the study and validity of the findings.

Moreover, the barriers and facilitators and subsequent recommendations presented here are based on the specific experiences of the participants recruited for this study and may not be generalisable across all underserved populations. However, the consistency in our barrier and facilitator findings with previous research with more specific populations suggests that the results of this study and the recommendations generated are transferrable and relevant for a broad range of underserved groups in the national settings mentioned above. Nonetheless, further research is needed to validate the findings in other contexts and confirm their applicability across diverse underserved populations. Lastly, as this study used the PROGRESSPlus framework for purposive sampling of people from diverse underserved populations, some specific demographic factors were not captured, such as urban/rural location and distance to sexual health services. Therefore, further research is needed for such underserved populations that were not included in this study.

Conclusion

This study identified key barriers and facilitators to seeking online sexual health information and support among a diverse sample of underserved populations. Our BCW analyses then suggested an array of potentially useful changes that could be made to reduce barriers and enhance facilitators to passing through this digital doorway and subsequently increase access to wider in-person and online sexual healthcare. Overall, our recommendations focus on adding to existing services in ways that enable used of them and educate, persuade, and offer accessible training to those from underserved populations. Recommendations include educate about the existence of online services that provide sexual health information and support; persuade people about their credibility; provide training, such as step-by-step instructions on how to seek information online and use online support and appraise the credibility of online information and support services; model peers successfully seeking information and using support services online; and enable use of them by ensuring they are inclusive and simple to use, including provision of providing a glossary of terms to assist with spelling for searches and communication and step-by-step instructions on how to seek information online and use online support. Ultimately, while online sexual health provision has the potential to extend access to healthcare for some, addressing the needs of underserved population outlined here is crucial to facilitate access to through the digital doorway to sexual healthcare and prevent the widening of health inequalities.

Supporting information

S1 Fig. An overview of seven interrelated elements of care within the behavioural system of accessing and using online sexual healthcare.

Thick yellow arrows indicate a non-sequential order, where the elements of care can occur in any order, e.g., getting sexual health information online can occur before or getting sexual health support online. Thick blue arrows indicate a sequential order, where a later element of care cannot precede an earlier domain, e.g., getting STI test result online must occur after getting a postal STI/BBV self-sampling kit online. Thin yellow arrows indicate that getting sexual health information or support online can occur at any point in the STI self-sampling and treatment pathway.

https://doi.org/10.1371/journal.pone.0315049.s001

(TIF)

S2 Fig. Second visual aid for online sexual health support seeking provided to every participant prior to the interview.

https://doi.org/10.1371/journal.pone.0315049.s002

(TIF)

S1 Table. A list of examples of online sexual health information and support services.

https://doi.org/10.1371/journal.pone.0315049.s003

(DOCX)

S2 Table. PROGRESSPlus informed target sampling frame developed prior to data collection and final sample targets met.

aSES = Socio-economic Status. bIMD = Index of Multiple Deprivation [70]. cBold = Target met or exceeded.

https://doi.org/10.1371/journal.pone.0315049.s004

(DOCX)

S3 Table. Socio-economic demographics and screening survey.

https://doi.org/10.1371/journal.pone.0315049.s005

(DOCX)

S5 Table. Sexual health resources information provided to each participant post interview.

https://doi.org/10.1371/journal.pone.0315049.s007

(DOCX)

S6 Table. Participant self-reported skills and experience using the internet.

aParticipant demographics for one participant were not obtained, table includes demographics for n = 34, except where participants did not wish to answer the question. Percentages are calculated for N = 35.

https://doi.org/10.1371/journal.pone.0315049.s008

(DOCX)

S7 Table. Intervention Functions and their definitions.

Adapted from Michie et al. [45].

https://doi.org/10.1371/journal.pone.0315049.s009

(DOCX)

Acknowledgments

We would like to thank the participants who took part in the study. We are also grateful to the following sexual health services and organisations for invaluable assistance with the study. We would like to thank Castle Circus Health Centre (Torbay & South Devon NHS Foundation Trust), Devon Sexual Health–Exeter & Barnstaple (Northern Devon NHS Foundation Trust), Mortimer Market Centre, Archway, Barnet and Buryfields Clinics (Central and North West London NHS Foundation Trust), Sandyford Clinic (Greater Glasgow & Clyde), and Sexual Health Sheffield (Sheffield Hospitals NHS Foundation Trust), for advertising the study to support with recruitment. We would also like to thank Hidayah LGBT and get2gether, for publicising the study to help with recruitment.

References

  1. 1. Tucker JD, Hocking J, Oladele D, Estcourt C. Digital sexually transmitted infection and HIV services across prevention and care continuums: Evidence and practical resources. Sex Health. 2022 Jun 16;19(4):278–85. pmid:35705515
  2. 2. Ong JJ, Estcourt C, Tucker JD, Golden MR, Hocking JS, Fairley CK. How should we deliver sexual health services in the 2020s? Sex Health. 2022 Aug 29;19(4):233–5. pmid:36031737
  3. 3. Gibbs J, Solomon D, Jackson L, Mullick S, Burns F, Shahmanesh M. Measuring and evaluating sexual health in the era of digital health: challenges and opportunities. Sex Health. 2022 Aug 16;19(4):336–45. pmid:35970766
  4. 4. Minichiello V, Rahman S, Dune T, Scott J, Dowsett G. E-health: potential benefits and challenges in providing and accessing sexual health services. BMC Public Health. 2013 Dec 30;13(1):790. pmid:23987137
  5. 5. Flowers P, Vojt G, Pothoulaki M, Mapp F, Woode Owusu M, Estcourt C, et al. Understanding the barriers and facilitators to using self‐sampling packs for sexually transmitted infections and blood‐borne viruses: Thematic analyses for intervention optimization. Br J Health Psychol. 2023 Feb 2;28(1):156–73. pmid:35918874
  6. 6. Flowers P, Vojt G, Pothoulaki M, Mapp F, Woode Owusu M, Cassell JA, et al. Using the behaviour change wheel approach to optimize self‐sampling packs for sexually transmitted infection and blood borne viruses. Br J Health Psychol. 2022 Nov 29;27(4):1382–97. pmid:35765821
  7. 7. Melendez JH, Hamill MM, Armington GS, Gaydos CA, Manabe YC. Home-Based Testing for Sexually Transmitted Infections: Leveraging Online Resources During the COVID-19 Pandemic. Sex Transm Dis. 2021 Jan;48(1):e8–10. pmid:33229964
  8. 8. Sumray K, Lloyd KC, Estcourt CS, Burns F, Gibbs J. Access to, usage and clinical outcomes of, online postal sexually transmitted infection services: a scoping review. Sex Transm Infect. 2022 Nov;98(7):528–35.
  9. 9. Estcourt CS, Gibbs J, Sutcliffe LJ, Gkatzidou V, Tickle L, Hone K, et al. The eSexual Health Clinic system for management, prevention, and control of sexually transmitted infections: exploratory studies in people testing for Chlamydia trachomatis. Lancet Public Health. 2017 Apr 1;2(4):e182–90. pmid:29253450
  10. 10. Kincaid R, Gibbs J, Dalrymple J, Henderson L, Frankis J, Estcourt C. Delivering HIV prevention medication online: Findings from a qualitative study exploring the acceptability of an online HIV pre-exposure prophylaxis (PrEP) care pathway among service users and healthcare professionals. Digit Health. 2023 Jan 30;9. pmid:38047162
  11. 11. Aicken CR, Estcourt CS, Johnson AM, Sonnenberg P, Wellings K, Mercer CH. Use of the Internet for Sexual Health Among Sexually Experienced Persons Aged 16 to 44 Years: Evidence from a Nationally Representative Survey of the British Population. J Med Internet Res. 2016 Jan 20;18(1):e14. pmid:26792090
  12. 12. Cassidy C, Bishop A, Steenbeek A, Langille D, Martin-Misener R, Curran J. Barriers and enablers to sexual health service use among university students: a qualitative descriptive study using the Theoretical Domains Framework and COM-B model. BMC Health Serv Res. 2018 Dec 24;18(1):581. pmid:30041649
  13. 13. Mapp F, Wellings K, Hickson F, Mercer CH. Understanding sexual healthcare seeking behaviour: Why a broader research perspective is needed. BMC Health Serv Res. 2017 Jul 6;17(1).
  14. 14. NHS. Find sexual health services [Internet]. [cited 2023 Aug 27]. Available from: https://www.nhs.uk/service-search/sexual-health.
  15. 15. Terrance Higgins Trust. HIV and sexual health [Internet]. 2024 [cited 2024 Sep 24]. Available from: https://www.tht.org.uk/sexual-health.
  16. 16. Brook. YOUR FREE & CONFIDENTIAL SEXUAL HEALTH & WELLBEING EXPERTS [Internet]. [cited 2023 Jun 15]. Available from: https://www.brook.org.uk/.
  17. 17. Brook. What can brook help you with today? [Internet]. 2023 [cited 2023 Apr 13]. Available from: https://www.brook.org.uk/help-advice/.
  18. 18. Planned Parenthood. Introducing Roo [Internet]. [cited 2024 Jun 10]. Available from: https://www.plannedparenthood.org/learn/roo-sexual-health-chatbot.
  19. 19. PositiveEast. ChattoPat Our sexual health chatbot [Internet]. [cited 2024 Jun 10]. Available from: https://www.positiveeast.org.uk/chattopat/.
  20. 20. NHS Sexual Health Hertfordshire. Chat sexual health [Internet]. [cited 2024 Jun 10]. Available from: https://www.sexualhealthhertfordshire.clch.nhs.uk/support/chat-sexual-health.
  21. 21. Embrace. Chat Sexual Health [Internet]. [cited 2024 Jun 10]. Available from: https://www.embracewolverhampton.nhs.uk/about-us/chat-sexual-health#:~:text=Text%20a%20sexual%20health%20nurse,Smear%20tests.
  22. 22. NHS. Sexual health live chat [Internet]. 2024 [cited 2024 Sep 24]. Available from: https://www.kentcht.nhs.uk/service/sexual-health/#:~:text=Phone%20or%20text%20us%20for,are%20recorded%20for%20quality%20purposes.
  23. 23. Brook Digital Front Door—Phase One: Evaluation Report [Internet]. Zoe Amar Digital. Zoe Amar Digital. 2022 [cited 2023 Sep 4]. Available from: https://www.brook.org.uk/wp-content/uploads/2023/03/Brook-Digital-Front-Door-Phase-1-Evaluation-Report-FINAL.pdf.
  24. 24. Bailey J, Mann S, Wayal S, Hunter R, Free C, Abraham C, et al. Sexual health promotion for young people delivered via digital media: a scoping review. Public Health Research. 2015 Nov;3(13):1–120.
  25. 25. NHS England. What does creating a ‘digital front door’ mean? [Internet]. 2022 [cited 2024 Jun 15]. Available from: https://digital.nhs.uk/blog/transformation-blog/2022/what-does-creating-a-digital-front-door-mean.
  26. 26. National Association of Primary Care. The Digital Front Door [Internet]. 2023 [cited 2024 Jun 15]. Available from: https://napc.co.uk/the-digital-front-door/#:~:text=So%2C%20what%20is%20a%20digital,app%20is%20a%20good%20example.
  27. 27. NHS England. Inclusive digital healthcare: a framework for NHS action on digital inclusion [Internet]. 2023 [cited 2024 Jun 15]. Available from: https://www.england.nhs.uk/long-read/inclusive-digital-healthcare-a-framework-for-nhs-action-on-digital-inclusion/.
  28. 28. Mills R, Mangone ER, Lesh N, Mohan D, Baraitser P. Chatbots to Improve Sexual and Reproductive Health: Realist Synthesis. J Med Internet Res. 2023 Aug 9;25:e46761. pmid:37556194
  29. 29. Courtenay T, Baraitser P. Improving online clinical sexual and reproductive health information to support self-care: A realist review. Digit Health. 2022 Jan 14;8:205520762210844.
  30. 30. Gann B. Transforming lives: Combating digital health inequality. IFLA Journal. 2019 Oct 7;45(3):187–98.
  31. 31. Helsper E. Inequalities in digital literacy: definitions, measurements, explanations and policy implications. In: Pesquisa sobre o uso das tecnologias de informação e comunicação nos domícilios brasileiros: TIC domicílios 2015 [Internet]. 2016 [cited 2023 Mar 1]. p. 175–85. Available from: https://eprints.lse.ac.uk/68329/.
  32. 32. Boutrin MC, Williams DR. What Racism Has to Do with It: Understanding and Reducing Sexually Transmitted Diseases in Youth of Color. Healthcare. 2021 Jun 4;9(6):673. pmid:34199974
  33. 33. Van Gerwen OT, Muzny CA, Marrazzo JM. Sexually transmitted infections and female reproductive health. Nat Microbiol. 2022 Aug 2;7(8):1116–26. pmid:35918418
  34. 34. Sinka K, Wilkinson G. Variation in outcomes in sexual and reproductive health in England: A toolkit to explore inequalities at a local level. [Internet]. Public Health England; 2021 [cited 2022 Nov 25]. p. 1–37. Available from: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/984393/SRH_variation_in_outcomes_toolkit_May_2021.pdf.
  35. 35. Wayal S, Hughes G, Sonnenberg P, Mohammed H, Copas AJ, Gerressu M, et al. Ethnic variations in sexual behaviours and sexual health markers: findings from the third British National Survey of Sexual Attitudes and Lifestyles (Natsal-3). Lancet Public Health. 2017 Oct;2(10):e458–72. pmid:29057382
  36. 36. Woodhall SC, Soldan K, Sonnenberg P, Mercer CH, Clifton S, Saunders P, et al. Is chlamydia screening and testing in Britain reaching young adults at risk of infection? Findings from the third National Survey of Sexual Attitudes and Lifestyles (Natsal-3). Sex Transm Infect. 2016 May;92(3):218–27. pmid:26290483
  37. 37. Neter E, Brainin E. eHealth Literacy: Extending the Digital Divide to the Realm of Health Information. J Med Internet Res. 2012 Jan 27;14(1):e19. pmid:22357448
  38. 38. Patterson SP, Hilton S, Flowers P, McDaid LM. What are the barriers and challenges faced by adolescents when searching for sexual health information on the internet? Implications for policy and practice from a qualitative study. Sex Transm Infect. 2019 Sep;95(6):462–7. pmid:31040251
  39. 39. McDaid L, Flowers P, Ferlatte O, Young I, Patterson S, Gilbert M. Sexual health literacy among gay, bisexual and other men who have sex with men: a conceptual framework for future research. Cult Health Sex. 2021 Feb 1;23(2):207–23. pmid:32118515
  40. 40. National Academies of Sciences Engineering and Medicine. Sexually Transmitted Infections: Adopting a sexual health paradigm. Vermund SH, Geller AB, Crowley JS, editors. Washington, D.C.: National Academies Press; 2021.
  41. 41. National Institute for Health and Care Research. Improving inclusion of under-served groups in clinical research: Guidance from INCLUDE project. 2022 [cited 2023 Aug 31]; Available from: https://www.nihr.ac.uk/documents/improving-inclusion-of-under-served-groups-in-clinical-research-guidance-from-include-project/25435.
  42. 42. Reddy P, Sharma B, Chaudhary K. Digital Literacy: A Review of Literature. Int J Technoethics. 2020 Jul 1;11(2):65–94.
  43. 43. Dodson S, Good S, Osborne RH. Health literacy toolkit for low- and middle-income countries: A series of information sheets to empower communities and strengthen health systems. [Internet]. New Delhi: World Health Organization, Regional Office for South-East Asia; 2015 [cited 2022 Dec 13]. Available from: https://www.who.int/publications/i/item/9789290224754.
  44. 44. Bardsley M, Wayal S, Blomquist P, Mohammed H, Mercer CH, Hughes G. Improving our understanding of the disproportionate incidence of STIs in heterosexual-identifying people of black Caribbean heritage: findings from a longitudinal study of sexual health clinic attendees in England. Sex Transm Infect. 2022 Feb;98(1):23–31. pmid:33514680
  45. 45. Michie S, Atkins L, West R. The behaviour change wheel: a guide to designing interventions. Silverback Publishing; 2014. 1–329.
  46. 46. Magee JC, Bigelow L, DeHaan S, Mustanski BS. Sexual Health Information Seeking Online: A Mixed-Methods Study Among Lesbian, Gay, Bisexual, and Transgender Young People. Health Education and Behavior. 2012 Jun;39(3):276–89. pmid:21490310
  47. 47. Barman-Adhikari A, Rice E. Sexual Health Information Seeking Online Among Runaway and Homeless Youth. J Soc Social Work Res. 2011 Jan;2(2):89–103. pmid:22247795
  48. 48. Fogel J, Fajiram S, Morgan P. Sexual Health Information Seeking on the Internet: Comparisons between White and African American College Students. Association of Black Nursing Faculty Foundation Journal (ABNFF). 2010;21(4):79–84. pmid:21117442
  49. 49. Buhi ER, Daley EM, Fuhrmann HJ, Smith SA. An Observational Study of How Young People Search for Online Sexual Health Information. Journal of American College Health. 2009 Sep 30;58(2):101–11. pmid:19892646
  50. 50. Lindley LL, Friedman DB, Struble C. Becoming Visible: Assessing the Availability of Online Sexual Health Information for Lesbians. Health Promot Pract. 2012 Jul 15;13(4):472–80. pmid:21677116
  51. 51. Mitchell KJ, Ybarra ML, Korchmaros JD, Kosciw JG. Accessing sexual health information online: Use, motivations and consequences for youth with different sexual orientations. Health Educ Res. 2014 Feb;29(1):147–57. pmid:23861481
  52. 52. Zhao S. Parental education and children’s online health information seeking: Beyond the digital divide debate. Soc Sci Med. 2009 Nov;69(10):1501–5. pmid:19765874
  53. 53. Yi YJ. Sexual health information-seeking behavior on a social media site: predictors of best answer selection. Online Information Review. 2018 Sep 13;42(6):880–97.
  54. 54. Shrestha R, Lim SH, Altice FL, Copenhaver M, Wickersham JA, Saifi R, et al. Use of Smartphone to Seek Sexual Health Information Online Among Malaysian Men Who Have Sex with Men (MSM): Implications for mHealth Intervention to Increase HIV Testing and Reduce HIV Risks. J Community Health. 2020 Feb 2;45(1):10–9. pmid:31375976
  55. 55. Diez SL, Fava NM, Fernandez SB, Mendel WE. Sexual health education: the untapped and unmeasured potential of US-based websites. Sex Educ. 2022 May 4;22(3):335–47.
  56. 56. Nikkelen SWC, van Oosten JMF, van den Borne MMJJ. Sexuality Education in the Digital Era: Intrinsic and Extrinsic Predictors of Online Sexual Information Seeking Among Youth. The Journal of Sex Research. 2020 Feb 12;57(2):189–99.
  57. 57. Behre J. Young Adults’ Online Sexual Health Information Seeking and Evaluating Skills: Implications for Everyday Life Information Literacy Instruction. Proceedings of the Association for Information Science and Technology. 2022 Oct 14;59(1):1–10.
  58. 58. Mohamad Shakir SM, Wong LP, Abdullah KL, Adam P. Factors associated with online sexually transmissible infection information seeking among young people in Malaysia: an observational study. Sex Health. 2019;16(2):158–71. pmid:30885292
  59. 59. Nadarzynski T, Bayley J, Llewellyn C, Kidsley S, Graham CA. Acceptability of artificial intelligence (AI)-enabled chatbots, video consultations and live webchats as online platforms for sexual health advice. BMJ Sex Reprod Health. 2020 Jul;46(3):210–7. pmid:31964779
  60. 60. Presseau J, McCleary N, Lorencatto F, Patey AM, Grimshaw JM, Francis JJ. Action, actor, context, target, time (AACTT): A framework for specifying behaviour. Implementation Science. 2019 Dec 5;14(1). pmid:31806037
  61. 61. O’Neill J, Tabish H, Welch V, Petticrew M, Pottie K, Clarke M, et al. Applying an equity lens to interventions: Using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. J Clin Epidemiol. 2014 Jan;67(1):56–64. pmid:24189091
  62. 62. Kavanagh J, Oliver S. Reflections on developing and using PROGRESS-Plus. Vol. 2, Cochrane. 2008.
  63. 63. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006 Jan;3(2):77–101.
  64. 64. Malterud K, Siersma VD, Guassora AD. Sample Size in Qualitative Interview Studies. Qual Health Res. 2016 Nov 10;26(13):1753–60.
  65. 65. Hughes JL, Camden AA, Yangchen T. Rethinking and Updating Demographic Questions: Guidance to Improve Descriptions of Research Samples. Psi Chi Journal of Psychological Research. 2016;21(3):138–51.
  66. 66. Slade T, Gross DP, Niwa L, McKillop AB, Guptill C. Sex and gender demographic questions: improving methodological quality, inclusivity, and ethical administration. Int J Soc Res Methodol. 2021 Nov 2;24(6):727–38.
  67. 67. Hecker J, Kalpokas N. The Guide to Thematic Analysis: Thematic Analysis vs. Framework Analysis [Internet]. ATLAS.ti20. [cited 2024 Sep 24]. Available from: https://atlasti.com/guides/thematic-analysis/thematic-analysis-vs-framework-analysis#:~:text=Thematic%20analysis%2C%20known%20for%20its,and%20a%20clear%20audit%20trail.
  68. 68. Michie S, van Stralen MM, West R. The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implementation Science. 2011 Dec 23;6(1):42. pmid:21513547
  69. 69. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The Behavior Change Technique Taxonomy (v1) of 93 Hierarchically Clustered Techniques: Building an International Consensus for the Reporting of Behavior Change Interventions. Annals of Behavioral Medicine. 2013 Aug 20;46(1):81–95. pmid:23512568
  70. 70. Consumer Data Research Centre. Index of Multiple Deprivation (IMD) [Internet]. 2022 [cited 2023 Sep 29]. Available from: https://data.cdrc.ac.uk/dataset/index-multiple-deprivation-imd.
  71. 71. Nadarzynski T, Puentes V, Pawlak I, Mendes T, Montgomery I, Bayley J, et al. Barriers and facilitators to engagement with artificial intelligence (AI)-based chatbots for sexual and reproductive health advice: a qualitative analysis. Sex Health. 2021 Nov 16;18(5):385–93. pmid:34782055
  72. 72. De Choudhury M, Morris MR, White RW. Seeking and sharing health information online. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York, NY, USA: ACM; 2014. p. 1365–76.
  73. 73. Flanders CE, Pragg L, Dobinson C, Logie C. Young sexual minority women’s use of the internet and other digital technologies for sexual health information seeking. Canadian Journal of Human Sexuality. 2017;26(1):17–25.
  74. 74. Martin S. Young people’s sexual health literacy: seeking, understanding, and evaluating online sexual health information [Internet]. University of Glasgow; 2017 [cited 2023 Jun 13]. Available from: https://theses.gla.ac.uk/id/eprint/8528.
  75. 75. Nadarzynski T, Lunt A, Knights N, Bayley J, Llewellyn C. “But can chatbots understand sex?” Attitudes towards artificial intelligence chatbots amongst sexual and reproductive health professionals: An exploratory mixed-methods study. Int J STD AIDS. 2023 Oct 3;34(11):809–16. pmid:37269292
  76. 76. Flanders CE, dinh ren n., Pragg L, Dobinson C, Logie CH. Young Sexual Minority Women’s Evaluation Processes of Online and Digital Sexual Health Information. Health Commun. 2021;36(10):1286–94. pmid:32323570
  77. 77. Dolcini MM, Catania JA, Cotto-Negron C, Canchola JA, Warren J, Ashworth C, et al. Challenges in Reach with Online Sexual Health Information Among African American Youth: Assessing Access and Engagement. Sexuality Research and Social Policy. 2019 Mar 8;16(1):12–21.
  78. 78. Flinn C, Koretsidou C, Nearchou F. Accessing Sexual Health Information Online: Content, Reasons and Practical Barriers in Emerging Adults. Youth. 2023 Jan 13;3(1):107–24.
  79. 79. Bennett C, Kelly D, Dunn C, Musa MK, Young H, Couzens Z, et al. ‘I wouldn’t trust it …’ Digital transformation of young people’s sexual health services: a systems-informed qualitative enquiry. BMJ Public Health. 2023 Dec 11;1(1):e000259.
  80. 80. Willoughby JF, Jackson K. ‘Can you get pregnant when u r in the pool?’: young people’s information seeking from a sexual health text line. Sex Educ. 2013 Jan;13(1):96–106.
  81. 81. Gallegos-Rejas VM, Thomas EE, Kelly JT, Smith AC. A multi-stakeholder approach is needed to reduce the digital divide and encourage equitable access to telehealth. J Telemed Telecare. 2023 Jan 22;29(1):73–8. pmid:35733379
  82. 82. Radix AE, Bond K, Carneiro PB, Restar A. Transgender Individuals and Digital Health. Curr HIV/AIDS Rep. 2022 Dec 1;19(6):592–9. pmid:36136217
  83. 83. Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull. 2007;133(4):673–93. pmid:17592961
  84. 84. Horvath KJ, Bauermeister JA. eHealth Literacy and Intervention Tailoring Impacts the Acceptability of a HIV/STI Testing Intervention and Sexual Decision Making Among Young Gay and Bisexual Men. AIDS Education and Prevention. 2017 Feb;29(1):14–23. pmid:28195779
  85. 85. Kanthawala S, Peng W. Credibility in Online Health Communities: Effects of Moderator Credentials and Endorsement Cues. Journalism and Media. 2021 Jul 6;2(3):379–96.
  86. 86. Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM, et al. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021 Sep 30;n2061. pmid:34593508
  87. 87. May C, Finch T, Rapley T. Normalization Process Theory. In: Handbook on Implementation Science. Edward Elgar Publishing; 2020.
  88. 88. Gottlieb SL, Low N, Newman LM, Bolan G, Kamb M, Broutet N. Toward global prevention of sexually transmitted infections (STIs): The need for STI vaccines. Vaccine. 2014 Mar 20;32(14):1527–35. pmid:24581979
  89. 89. Germain A, Sen G, Garcia-Moreno C, Shankar M. Advancing sexual and reproductive health and rights in low- and middle-income countries: Implications for the post-2015 global development agenda. Glob Public Health. 2015 Feb 7;10(2):137–48. pmid:25628182
  90. 90. Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010 Dec 20;8(1):63. pmid:20961442
  91. 91. May CR, Mair F, Finch T, MacFarlane A, Dworick C, Treweek S, et al. Development of a theory of implementation and integration: Normalization Process Theory. Implementation Science. 2009;4(29).
  92. 92. Braun V, Clarke V. One size fits all? What counts as quality practice in (reflexive) thematic analysis? Qual Res Psychol. 2021 Jul 3;18(3):328–52.
  93. 93. Litt E. Measuring users’ internet skills: A review of past assessments and a look toward the future. New Media Soc. 2013 Jun 24;15(4):612–30.
  94. 94. van Deursen AJAM, Helsper EJ, Eynon R. Development and validation of the Internet Skills Scale (ISS). Inf Commun Soc. 2016 Jun 2;19(6):804–23.
  95. 95. Mays N. Qualitative research in health care: Assessing quality in qualitative research. BMJ. 2000 Jan 1;320(7226):50–2.
  96. 96. Leung L. Validity, reliability, and generalizability in qualitative research. J Family Med Prim Care. 2015;4(3):324. pmid:26288766
  97. 97. Yardley L. Dilemmas in qualitative health research. Psychol Health. 2000 Mar;15(2):215–28.