Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Online sexual health survey implementation: Practical lessons from a comparative, mixed-methods analysis of 30 countries

  • Hanna Saltis ,

    Roles Conceptualization, Formal analysis, Methodology, Project administration, Writing – original draft, Writing – review & editing

    hanna.saltis@curtin.edu.au (HS); jdtucker@med.unc.edu (JT)

    Affiliations School of Population Health, Curtin University, Perth, Australia, Curtin University, Collaboration for Evidence, Research and Impact in Public Health, Curtin University, Perth, Australia

  • Fiorella Farje,

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    Affiliations International Centre for Reproductive Health, Department of Public Health and Primary Care, Faculty of Medicine and Health Sciences, University of Ghent, Gent, Belgium, Academic Network for Sexual and Reproductive Health and Rights Policy, Ghent University, Ghent, Belgium

  • Simukai Shamu,

    Roles Conceptualization, Formal analysis, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliations School of Public Health, University of the Witwatersrand, Johannesburg, South Africa, Research Unit, Centre for Evaluation of Public Health Interventions in Africa (CEPHIA), Pretoria, South Africa

  • Raquel Gomez,

    Roles Conceptualization, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Research Group Self-Regulation and Health, Institute for Health and Behaviour, Department of Behavioural and Cognitive Sciences, Faculty of Humanities, Education, and Social Sciences, University of Luxembourg - Campus Belval, Esch-sur-Alzette, Luxembourg

  • Johanna Schröder,

    Roles Formal analysis, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Institute for Clinical Psychology and Psychotherapy, Department of Psychology, Medical School Hamburg, Hamburg, Germany

  • Priya Kosana,

    Roles Conceptualization, Formal analysis, Writing – review & editing

    Affiliation Yale School of Public Health, Department of Epidemiology of Microbial Diseases, New Haven, Connecticut, United States of America

  • Sharyn Burns,

    Roles Supervision, Writing – review & editing

    Affiliations School of Population Health, Curtin University, Perth, Australia, Curtin University, Collaboration for Evidence, Research and Impact in Public Health, Curtin University, Perth, Australia

  • Jacqueline Hendriks,

    Roles Supervision, Writing – review & editing

    Affiliations School of Population Health, Curtin University, Perth, Australia, Curtin University, Collaboration for Evidence, Research and Impact in Public Health, Curtin University, Perth, Australia

  • Olivia Williams,

    Roles Writing – review & editing

    Affiliations School of Population Health, Curtin University, Perth, Australia, Curtin University, Collaboration for Evidence, Research and Impact in Public Health, Curtin University, Perth, Australia

  • Kristien Michielsen,

    Roles Formal analysis, Methodology, Supervision, Writing – review & editing

    Affiliations Academic Network for Sexual and Reproductive Health and Rights Policy, Ghent University, Ghent, Belgium, Institute for Family and Sexuality Studies, Department of Neurosciences, Faculty of Medicine, KU Leuven, Leuven, Belgium

  • Joseph D. Tucker

    Roles Formal analysis, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    hanna.saltis@curtin.edu.au (HS); jdtucker@med.unc.edu (JT)

    Affiliation School of Medicine, University of North Carolina, Chapel Hill, North Carolina, United States of America

Abstract

Online surveys are potentially useful for sexual and reproductive health. However, there are many persistent problems related to online sexual and reproductive health surveys. This study aims to understand online recruitment, dissemination and implementation as part of the International Sexual Health And REproductive health (I-SHARE) consortium online sexual health survey. This study used a mixed-methods, cross-sectional, multi-country design. We used survey data from the I-SHARE study and organised a separate implementation survey completed by I-SHARE country leads. A total of 24,004 participants in 30 countries responded to the I-SHARE survey. All countries implemented the I-SHARE survey online and most (n = 27, 90%) used convenience sampling. Social media promotion (n = 27, 90%), and partner organisations sharing (n = 21, 70%) were the most common recruitment methods. Twenty-nine countries responded to the implementation survey. We identified three themes related to online survey implementation: (1) Adaptation and flexibility highlighted research teams’ responsiveness to rapidly changing contexts; (2) Better together: Partnerships illustrated the importance of multi-sectoral collaboration; and (3) Same but different: the heterogeneity of countries captured the ongoing tension between creating a standardised tool while honouring countries’ unique socio-health climates and responses to the unfolding pandemic. This data demonstrates the potential for using online sexual health surveys in diverse settings. Our study suggests the need for greater consideration of bias related to communication, especially the digital divide, when designing and implementing online surveys.

Introduction

Online research implementation, dissemination and recruitment remain challenges for many researchers. The benefits and challenges of implementing online surveys are well-documented. They can reach large samples, are rapidly disseminated and can enhance anonymity [13]. They are cost-effective compared to in-person data collection methods [15]. They provide non-contact recruitment strategies for working with at-risk populations [3], and vulnerable groups [2]. However, online data is susceptible to sampling bias [1,2,6], lower generalisability [13,6,7], and the digital divide [8,9]. The digital divide refers to social inequities that prevent or limit access to the internet [8]. Differences in digital access may hinder equitable sexual health research and sampling rigour/integrity [2,68,10].

The efficacy of online methods such as social media in equitable research dissemination and recruitment is controversial. The debate is underpinned by data-sharing [3,1113] and other privacy issues [3,11,1318], and variable financial costs [12,13,1721]. Social media give researchers access to a diverse range of potential participants, with 5.07 billion users worldwide [22]. However, some studies suggest that surveys disseminated online, particularly through social media, may not reach vulnerable groups such as older [13,23] and less educated [24] populations, thus widening the digital divide. Indeed, those who experience the burden of sexual health inequalities are often less digitally literate [25]. Using social media to recruit such specific vulnerable, or otherwise hard-to-reach populations has achieved mixed results, e.g., [2,13,17,26,27]. Conversely, other studies show that social media can be feasible [18,19], acceptable [18], effective [16], cost-effective [16,19], and accessible [19] recruitment tools, which potentially close digital gaps.

It is essential to understand the efficacy of online recruitment methods such as social media amongst specific demographics in particular geographical contexts. However, there remains a lack of evidence to demonstrate its effectiveness when recruiting broad samples in diverse, multi-country, sociocultural contexts. This study aims to address this gap, comparing the recruitment methods and numbers of 30 countries that disseminated a sexual health survey in 2020, during the first year of the COVID-19 pandemic, all online, and largely through social media.

The International Sexual Health and Reproductive Health (I-SHARE) Study was established to assess sexual health behaviours and services during this pandemic. The conglomerate was comprised of researchers from 30 High- (HIC), middle- (MIC) and low-income countries (LIC) [28,29]. Like most research during the pandemic, the I-SHARE Study was disseminated and implemented online. The survey was designed to capture a broad cross-section of the adult population. Eligibility criteria were that respondents must be aged ≥18 years (though some countries included ethical provisions to enable younger people to participate), lived in a participating country, could read the survey language, could access the survey online and provide informed consent [28]. While this research was conducted in the COVID-19 context, the lessons learned may assist in helping recruit large, broad samples as well as vulnerable, hard-to-reach populations across a variety of socio-cultural and geopolitical contexts.

Materials and methods

Study design

This cross-sectional, multi-country study combined data from two sources. Data were sourced from the I-SHARE master data file. The original survey data was collected between 20 July 2020–15 February 2021 and examined participants’ demographics, experiences or changes in sexual and reproductive health and associated behaviours during COVID-19 lockdowns [28,29]. Further information about the original study is available in the I-SHARE Study protocol paper [28]. The present study analysed participants’ age, sex assigned at birth, and gender identity. In some countries, the variable gender was not included in the survey (see Table 1).

thumbnail
Table 1. Sociodemographic characteristics of the I-SHARE Study participants by country.

https://doi.org/10.1371/journal.pone.0346722.t001

As part of the I-SHARE consortium, the implementation research team designed and distributed a separate survey for the 30 in-country leads involved in I-SHARE, which was disseminated between June and August 2021. This survey collected closed-ended responses about recruitment, dissemination, implementation, and sampling methods. In-country leads also responded to open text fields asking about the challenges and successes they faced and their likely causes. They were asked to provide two lessons they learned through their experiences of implementation and dissemination during their participation in I-SHARE and to add any additional relevant information. Responses were recorded on Google Forms.

Analysis

Quantitative analysis.

Due to the exploratory nature and small sample size of this study, there was insufficient power to conduct inferential statistical analyses. As such, descriptive statistics, including frequencies and percentages, were used to assess demographics and the methodologies employed by various countries and were calculated in SPSS. One country was counted twice as they employed two different sampling techniques (convenience and population-based sampling), so percentages may not add to 100%.

Qualitative analysis.

Qualitative analysis of open-ended questions employed a phenomenological methodology, guided by social constructionist epistemology and an ecological model of health framework [30]. HS undertook the initial inductive, conventional content analysis [3133]. Open coding was conducted on meaning units (units of analysis), which were defined here as short phrases or sentences. Codes were created and managed in NVIVO software. Categories were established from the codes [32], and themes were further developed from these categories, depicted below (see Fig 1). To ensure rigour and trustworthiness, the authorship team met to discuss codes, categories, and themes. Themes and interpretation were reviewed closely by HS and JT and further refined. The authorship group were also invited to further comment and refine themes throughout the editing process. To enhance rigour and reduce the risk of bias, the codes, categories and themes were triangulated with the quantitative data. HS also engaged in a reflexive journaling process while analysing the codes.

thumbnail
Fig 1. Thematic map of content analysis. Note: Purple squares represent themes, orange boxes represent categories, and blue boxes contain example quotes.

https://doi.org/10.1371/journal.pone.0346722.g001

Ethics.

All I-SHARE partners obtained ethics approval from their university’s review board or ethics committee and signed a data-sharing agreement before inclusion in the multicounty analysis [28]. Participants in the study were given a detailed information form to read before commencing the survey and provided consent before commencing the survey [28,29]. Member-checking was carried out for the qualitative responses; each in-country lead whose quotes were used in this article gave written consent for these to be used. Quotes were de-identified on request.

Results

Quantitative results

Participation.

In total, 24,004 participants across 30 countries responded to the I-SHARE survey. The mean age of the respondents was 32.5 years, and most were female (66.9%, sex assigned at birth). The majority lived in (semi-)urban areas (77.0%). Demographic data were missing for some countries (see Table 1). All 30 in-country leads who were involved in the first wave of the I-SHARE study completed the implementation survey.

Implementation methods.

All countries implemented the I-SHARE survey online. Most countries employed convenience sampling (n = 28, 93.3%), and others used representative population-based sampling methods (n = 3, 10%). Four countries used incentives, including SGD$10 for all participants (Singapore), ₦200 phone cards (Nigeria), weekly draw prizes to win one of two AUD$50 gift cards (Australia), (10EGP) (Egypt) (see Table 2). Given the disparity between their participation numbers, and the type of incentive, a relationship between incentives and participation numbers cannot be established.

thumbnail
Table 2. Participating I-SHARE countries’ dissemination methods by sample size.

https://doi.org/10.1371/journal.pone.0346722.t002

Dissemination methods.

The most common recruitment method was promotion on social media (n = 27, 90%), followed by asking partner organisations to share the survey link (n = 21, 70%). Several countries used paid advertising on social media (n = 13, 43.3%). Twenty-six (90%) countries used Facebook, 19 (66%) used Instagram, 17 (59%) used WhatsApp, 15 (52%) used Twitter, and six (20%) used alternative social media platforms such as TikTok, LinkedIn, Reddit and We Chat (see Table 3).

thumbnail
Table 3. Social media platforms used by participating I-SHARE country and level of recruitment.

https://doi.org/10.1371/journal.pone.0346722.t003

Research teams that recruited fewer than 200 participants typically used only two recruitment methods. Those that recruited between 200 and 499 participants used 3–4 recruitment methods; the number of recruitment methods varied for countries with more than 500 participants. The team in Luxembourg used six methods, while the teams in Latvia (n = 1176) and Colombia (n = 2452) used five methods, Portugal’s team (n = 3323) used four methods while China (n = 827) and Denmark (n = 1001), used only one method (see Table 3).

Qualitative analysis

One country was excluded from the qualitative analysis, as they replied “N/A” to all open-ended questions. The country which used two different sampling techniques (convenience and population-based sampling) reported different challenges and successes, respectively, and was counted twice.

Content analysis.

Twenty-nine of the in-country leads responded to the open-ended questions in the survey and identified a range of challenges, successes, and lessons learned about online research dissemination and implementation throughout wave one of the I-SHARE Study. Three themes were derived from the data: (1) Adaptation and flexibility, (2) Better together: Collaboration and partnerships, and (3) Same but different: the homogeneity and heterogeneity of countries. A thematic map is provided below (see Fig 1).

Notably, two in-country leads who used population-based samples reported no challenges. One attributed this directly to using this sampling technique, stating, “There were not any [challenges] because, for the population-based sample, we used the research agency panel”. Conversely, three countries reported not reaching the minimum participation level (n = 200) for inclusion in a larger analysis. Possible reasons for these low numbers will be explored in theme three.

Adaptability and flexibility.

Most in-country leads discussed how online platforms allowed innovative adaptation to facilitate research dissemination and implementation. For example, Colombia’s lead stated, “it is possible to apply complex online surveys with high-quality standards.” Similarly, the Australian in-country lead noted that online surveys created easier, more targeted dissemination, “[paid] social media ads were easily disseminated. We were able to target different population groups.” The South African lead noted that “online platforms could be helpful for research during challenging times requiring social distancing.” Together, these examples highlight the utility of online surveys, particularly in a global context, as they are flexible and adaptable for diverse populations and global research teams within a rapidly evolving, unpredictable climate, without compromising data quality.

Despite these advantages, some countries’ leads expressed concerns about sample representativeness. Uruguay’s lead commented, “We could not…capture a sample that approximated the profiles of the general population...we achieved a sample of 673 participants.” Here, a compromise between rapid data collection from a large sample and a generalisable sample is evident. Botswana and Australia attempted to counteract demographic imbalances through paid, targeted social media advertising. Botswana’s in-country lead illustrated the importance of financial support in assisting in this type of dissemination, saying, “We got just over 400 responses in Botswana, the majority through [paid] social media promotion. Social media promotion without sponsored posts was not very successful...” Argentina’s lead said, “it would have been better if we could have paid

for a dissemination and tried to get a representative sample.” The in-country lead for the Czech Republic said, “our success is that we got a financial grant for the population-based sample, that made it much easier for us.” Thus, funding when recruiting online is essential as paid advertising increases opportunities to achieve a representative sample and target harder-to-reach populations. However, accessing funding may not always be achievable, particularly when data must be collected rapidly.

In-country leads with high response rates supplemented demographic deficits by using multiple methods. Portugal’s in-country lead highlights, “We tried to use different approaches (e.g., social media, university contacts, press releases to media, partnership with organizations in the field of sexual and reproductive health, etc.) and this had finally worked after a lot of investment and time.” Contrastingly, other high-recruiting countries used only one technique with a comparable effect. For example, Denmark’s in-country lead stated: “It was the first time our research group tried having a sample drawn and sending invitations through E-boks (a secure, online, Danish digital communications server that organisations can utilise to reach large groups). …this is an incredibly efficient way to recruit participants and we are currently using it in another study.” This flexibility and willingness to adapt to unprecedented circumstances can produce enduring, positive changes in research processes. Moreover, these examples highlight that either triangulating multiple methods or a dedicated singular method can be effective in off-setting sampling biases and countries may choose which is more suitable depending on their individual needs and resources.

Better together: Collaboration and partnerships.

Many in-country leads discussed the importance of partnerships and collaborations for successful recruitment and dissemination. Most mobilised their existing partnerships. Panama’s lead noted, “Due to this [pushback from conservatives], we moved away from institutional sharing to I-SHARE-Panama team member sharing and networked across the country this way.” Having existing external partnerships with people who support the research area was thus important in recruiting in the face of adversity.

Some countries, like Portugal’s team, established new key networks and reported success in having a large media company disseminate their research, “In more than one major newspaper - mostly using their social media platforms”, Portugal’s in-country lead also collaborated with their National Health Service, stating,

After a long wait, [the National Health Service] publicized the study in their social media and newsletter. …since their Facebook was one of the most seen in Portugal – the first place where the daily number of COVID cases were reported – we were able to reach a huge audience that helped to jump from around 1000 respondents to over 3000 in a question of days.

Findings from Portugal’s team suggest that government endorsement of sexual and reproductive health research may facilitate successful recruitment.

Similarly, France’s lead stated, “Few responses with Facebook and Instagram alone. We also struggled to recruit men. We were successful in recruiting when the link was shared by partner organisations (planned parenthood) or influential stockholders on Facebook.” Germany’s lead, reiterated this, saying “One popular feminist Instagram account posted the link. This resulted in a larger response in the end.” Taken together, it suggests that utilising pre-existing, large networks may be more useful than social media advertising.

Multiple collaborations were essential in recruiting larger participant numbers. Latvia recruited using social media and via more traditional media like television, and traditional methods such as advertisements, and invitation leaflets distributed in antenatal clinics, urological departments, and clinics for people living with HIV. Collaboration within the research team was also essential in driving recruitment. Latvia’s lead lauded their inclusion of young researchers, stating, “we involved young scientists – students and an obstetrics/gynaecology resident – it helped a lot for using social media, promoting the I-SHARE among young people and later during the qualitative research part.” The ability to diversify the research team expanded their skillset and, by extension, their recruitment methods. This, in conjunction with the use of multiple methods, ultimately led to greater recruitment numbers for Latvia.

Several teams acknowledged the support of the I-SHARE consortium as core to their positive experience, regardless of their participation numbers. As the lead for South Africa stated, “I must say - here in South Africa, we were not [as] successful as we wished, but obviously, the support received from the [I-SHARE] team was very instrumental. I greatly liked the collaborative efforts that brought colleagues from different parts of the world to make the study a reality. I believe it is an opportunity for long-term collaborations.” This demonstrates that partnership and collaboration amongst researchers on a global level provided a crucial support system during difficult times, as well as an opportunity for ongoing collaborations and relationships beyond crisis contexts.

Same but different: The homogeneity and heterogeneity of countries’ needs.

This theme captures the ongoing tension between creating a standardised tool while honouring countries’ unique socio-health climates and responses to the unfolding pandemic (see Fig 2). As the in-country lead for Italy noted, “Multicultural surveys are very engaging but also difficult. Variables to consider are enormous, and challenges may vary from country to country”.

thumbnail
Fig 2. A conceptual diagram of interconnected contexts affecting data collection during the I-SHARE study.

The contexts are embedded to demonstrate that each is intrinsically linked to and influences the other spheres.

https://doi.org/10.1371/journal.pone.0346722.g002

The leads from Egypt, Italy, and Malaysia discussed the content of the survey as a potential challenge for recruitment. Egypt’s in-country lead illustrates this, stating, “the survey is long and about sensitive issues as regards the Egyptian culture.” This highlights how reproductive and sexual health may be taboo and pose a cultural barrier to recruitment in some countries or regions.

In-country leads speculated about the impacts of their distinct pandemic circumstances on dissemination and implementation. The in-country lead for South Africa reflected on the difficulty of standing out amongst the proliferation of survey research, stating, “by the time we sent the survey out, the population had fatigue for COVID surveys, and the lockdown levels had changed a couple of times”. This captures the difficulties for researchers in responding in real-time to rapidly changing conditions and how such fluctuating conditions contributed to a sense of civil exhaustion, exacerbated by constant online engagement.

Similarly, in Australia, during the survey dissemination, COVID-19 cases and isolation restrictions varied considerably between States and Territories. Australia’s lead considered, “Recruitment may be easier when we are in a specific lockdown.” This suggests that survey uptake may depend on the perceived relevance and societal notions of COVID-19 risk and attitudes at different stages of the pandemic, which are likely influenced by infection rates and experiences of isolation measures. Likewise, the in-country lead for Lebanon reflected, “COVID-19 was a big challenge, and the economic and humanitarian crisis in the country made it impossible for people to get attracted to the survey.” This indicates that online survey completion is a low priority in comparison to navigating financial and other socio-ecological factors that would become more salient to individuals in certain contexts.

Inequities, inequalities, and barriers to survey access were observed in several countries. For example, Colombia’s in-country lead noted that “the recruitment of populations aged 35 + -- this population is less prone to use technology for giving personal information through this channel”. Crucially, this suggests that potentially, the voices of vulnerable populations may not be captured. This was reiterated by several other countries, including Mozambique, whose lead expressed concern that their sample was “limited to people who were literate and somewhat proficient in the use of the internet.” Discussion of these sampling challenges highlights existing inequities and invites researchers to reflect on strategies to include those invisible, vulnerable, and likely in need of the most aid to participate in online research.

Discussion

This study collates quantitative and qualitative data highlighting challenges and successes in using online research methods. Online survey design needs to consider the digital divide. Our data align with previous research highlighting the mixed utility of online surveys in reaching specific populations [1,3].

Most countries used online convenience sampling. The challenges that in-country leads named are consistent with research that suggests online convenience samples are less representative than other sampling methods [4,6]. In contrast, several research teams used online population-based sampling. These samples have greater generalizability compared to convenience sampling. The Natsal-COVID study in the UK achieved a quasi-representative sample using an online approach. Online population-representative panels are costly, requiring greater resources [1,3,6],

Our data suggest that online surveys may over-sample women compared to men. Paid social media may help to increase the representation of certain demographics in online samples (e.g., men) [20]. This is consistent with research on online recruitment strategies [e.g., 2,3,6,20,24]. Our findings suggest the need for communications expertise when designing online surveys [13].

This study highlighted that partnering with organisations and individuals who have large, followings may assist with recruitment. Previous research suggests that paid social media advertising may have low conversion rates when comparing reach to click-throughs to complete responses [18,20,21], and conversion costs can be more expensive than using influencers [21]. Our data suggest that partnerships with a trusted source, rather than advertisements, helped to address these challenges. This supports previous suggestions that involving key influencers and networks could enhance social media recruitment [21,34] compared to paid advertising [21].

This study supports evidence that utilising multiple engagement methods [13,35] can partially address the digital divide and increasing the likelihood of reaching under-served populations. Many vulnerable groups have poor access to the internet [25]. Alternative offline recruitment strategies are also needed to ensure researchers are reaching a range of vulnerable populations who may not be using social media.

For some countries, the taboo nature of sexual and reproductive health was perceived to impact recruitment. However, online surveys can enhance anonymity [13]. Researchers may want to highlight the increased privacy that surveys offer during recruitment to help allay potential participants’ fears of discussing sensitive content and encourage participation. Where culturally appropriate, having trusted sources such as government websites (like Portugal), partner organisations, traditional media (i.e., television and newspapers) share sexual health surveys, may help to normalize these discussions and further encourage participation.

Consortia act as a support network, consultancy, and sounding board [3638], and the collaborative approach of the I-SHARE network enabled discussions of shared and country-specific challenges and successes. Each team involved in the I-SHARE conglomerate was impacted by a complex combination of individual contextual factors, unique country environments, and the interests of the I-SHARE consortium (see Fig 2). The use of online meetings through Zoom allowed partnerships, collaboration, and problem-solving between diverse research teams from various countries and time zones. While it can be challenging to balance individual countries’ interests and the collective interest of members in the consortium [10], the I-SHARE consortium demonstrated that international collaboration based on open science principles is possible across diverse countries.

In-country leads speculated about specific factors that impacted their unique experience, for example, easing restrictions at the time of dissemination, surviving COVID-19, and survey fatigue. Similar barriers are identified in previous research [2,3,6,26,27,37]. Unique societal stressors and competing interests may make online surveys, especially those related to sexual health, feel less relevant [26]. Research teams should consider highlighting the importance of sexual and reproductive health to overall well-being when designing online surveys. Ensuring that surveys are not onerous or lengthy, and providing financial incentives, may also reduce potential survey fatigue, though these considerations should be balanced with the potential for increased risk of survey fraud (especially when providing incentives) and the ability to capture complex data [3].

The findings from this study suggest that to effectively utilise online surveys and social media for research dissemination and recruitment, researchers should have a clear plan for how to utilise resources effectively. If funds are available, considering the use of an online panel may be the most effective way to gain a representative sample through online means. If this is unavailable, researchers are encouraged to understand the needs of their target demographics and how best to reach them. Where possible, include consultation with social media experts to help with creating effective advertising content, and to help with increasing the value of paid advertising (i.e., conversions from reach to completed surveys). When targeting specific populations, using partner organisations and key influencers to share the research is an effective way to reach large groups, and to save on advertising costs. To ensure that the research is not contributing to the digital divide, consider triangulation of online advertising with more traditional methods of data collection and recruitment. Lastly, consider how the current socio-cultural and political climates might influence response rates and factor this into the dissemination and recruitment strategies.

Strengths and limitations

This study has several strengths, including the rigorous methodology of the I-SHARE study, and using data collected during the unfolding COVID-19 pandemic from multiple countries, and research teams. This study expands the literature by focusing on implementation and dissemination strategies from multiple, diverse countries that all used a similar survey instrument. Despite these considerable strengths, this study has some limitations.

First, the approach focused on the number of participants recruited as an indicator of effective implementation. In addition, to be eligible for inclusion in the ISHARE study, countries were required to meet the threshold of 200 participants, rather than a proportion of their population, and were not required to have a representative sample. However, there are few alternative metrics to gauge the relative effectiveness of surveys. Future studies should consider their potential pool of participants, and eligibility for inclusion should be based on a proportion of their national adult population. Second, the survey relied on self-reports from the primary in-country, chief investigators, and thus this study solely captures these individuals’ perspectives, though others on their research teams may have been well-positioned to comment on their implementation and dissemination strategies. Third, inferential statistical analysis was beyond the scope of this study. Future research should consider inferential analysis that accounts for contextual variables highlighted in this study. Finally, all teams that participated were able to join the consortium despite substantial competing COVID-19 and non-COVID-related demands. The authors speculate that consortium teams may have greater access to resources than other teams who did not join. Notwithstanding these limitations, the present study provided a novel examination of the utility of online surveys and social media dissemination and implementation strategies appropriate in diverse contexts.

Conclusions

This study shows how the utility of online surveys and social media recruitment and dissemination are responsive to sociocultural contexts, cultural events, and social consciousness. These methods were effective for recruiting larger numbers when done strategically. However, they also presented challenges for representativeness and access. Research teams in the I-SHARE network reported the positive influence of partnerships and collaboration and the support of the I-SHARE consortium in garnering success in this challenging climate. These methods were feasible in diverse settings, including many resource-constrained nations.

Acknowledgments

We would like to thank Gabriella Perotta, Roccio Murad and the broader I-SHARE consortium for their guidance and assistance with this research.

References

  1. 1. Hlatshwako TG, Shah SJ, Kosana P, Adebayo E, Hendriks J, Larsson EC, et al. Online health survey research during COVID-19. Lancet Digit Health. 2021;3(2):e76–e7.
  2. 2. Oliveri S, Lanzoni L, Petrocchi S, Janssens R, Schoefs E, Huys I, et al. Opportunities and challenges of web-based and remotely administered surveys for patient preference studies in a vulnerable population. Patient Prefer Adherence. 2021;15:2509–17. pmid:34848947
  3. 3. Singh S, Sagar R. A critical look at online survey or questionnaire-based research studies during COVID-19. Asian J Psychiatr. 2021;65:102850. pmid:34534919
  4. 4. Mullen PR, Fox J, Goshorn JR, Warraich LK. Crowdsourcing for online samples in counseling research. J Couns Dev. 2021;99(2):221–6.
  5. 5. Namey E, Guest G, O’Regan A, Godwin CL, Taylor J, Martinez A. How does mode of qualitative data collection affect data and cost? Findings from a quasi-experimental study. Field Methods. 2019;32(1):58–74.
  6. 6. Pierce M, McManus S, Jessop C, John A, Hotopf M, Ford T, et al. Says who? The significance of sampling in mental health surveys during COVID-19. Lancet Psychiatry. 2020;7(7):567–8. pmid:32502467
  7. 7. Willis A, Isaacs T, Khunti K. Improving diversity in research and trial participation: the challenges of language. Lancet Public Health. 2021;6(7):e445–6. pmid:34174997
  8. 8. Lai J, Widmar NO. Revisiting the digital divide in the COVID-19 era. Appl Econ Perspect Policy. 2021;43(1):458–64. pmid:33230409
  9. 9. Ruiu ML, Ragnedda M, Addeo F, Ruiu G. Investigating how the interaction between individual and circumstantial determinants influence the emergence of digital poverty: a post-pandemic survey among families with children in England. Inf Commun Soc. 2023;26(5):1023–44.
  10. 10. Jit M, Ananthakrishnan A, McKee M, Wouters OJ, Beutels P, Teerawattananon Y. Multi-country collaboration in responding to global infectious disease threats: lessons for Europe from the COVID-19 pandemic. Lancet Reg Health Eur. 2021;9:100221. pmid:34642675
  11. 11. Bour C, Schmitz S, Ahne A, Perchoux C, Dessenne C, Fagherazzi G. Scoping review protocol on the use of social media for health research purposes. BMJ Open. 2021;11(2):e040671. pmid:33574143
  12. 12. Gelinas L, Pierce R, Winkler S, Cohen G, Lynch HF, Bierer BE. Nonexceptionalism, research risks, and social media: response to open peer commentaries on “using social media as a research recruitment tool: ethical issues and recommendations”. AJOB. 2017;17(5):W1–3. pmid:28430072
  13. 13. Darko EM, Kleib M, Olson J. Social media use for research participant recruitment: integrative literature review. J Med Internet Res. 2022;24(8):e38015. pmid:35925655
  14. 14. Hubert C, Estrada F, Campero L, Heredia-Pi IB, Villalobos A, Suárez-López L, et al. Designing digital tools capable of reaching disadvantaged adolescents and improving their sexual health: a mexican experience. J Health Care Poor Underserved. 2021;32(2S):62–84.
  15. 15. Eruchalu CN, Pichardo MS, Bharadwaj M, Rodriguez CB, Rodriguez JA, Bergmark RW, et al. The Expanding Digital Divide: digital health access inequities during the COVID-19 pandemic in New York City. J Urban Health. 2021;98(2):183–6. pmid:33471281
  16. 16. Sanchez C, Grzenda A, Varias A, Widge AS, Carpenter LL, McDonald WM, et al. Social media recruitment for mental health research: a systematic review. Compr Psychiatry. 2020;103:152197. pmid:32992073
  17. 17. Archer-Kuhn B, Beltrano NR, Hughes J, Saini M, Tam D. Recruitment in response to a pandemic: pivoting a community-based recruitment strategy to Facebook for hard-to-reach populations during COVID-19. Int J Soc Res Methodol. 2022;25(6):797–808.
  18. 18. Folk JB, Harrison A, Rodriguez C, Wallace A, Tolou-Shams M. Feasibility of social media-based recruitment and perceived acceptability of digital health interventions for caregivers of justice-involved youth: mixed methods study. J Med Internet Res. 2020;22(4):e16370. pmid:32352388
  19. 19. Green H, Fernandez R, MacPhail C. Social media as a platform for recruitment to a national survey during the COVID-19 pandemic: feasibility and cost analysis. JMIR Form Res. 2021;5(7):e28656. pmid:34133315
  20. 20. Ali SH, Foreman J, Capasso A, Jones AM, Tozan Y, DiClemente RJ. Social media as a recruitment platform for a nationwide online survey of COVID-19 knowledge, beliefs, and practices in the United States: methodology and feasibility analysis. BMC Med Res Methodol. 2020;20(1):116. pmid:32404050
  21. 21. Fahey OB, Carr DJ, Ocean EM, Nittas V, Kane CP, Monti PM, et al. Black social media influencers engage higher percentages of Black gay and bisexual men in online outreach for HIV prevention research relative to paid ads. Digit Health. 2024;10:20552076241253758. pmid:38746875
  22. 22. Statista. Number of internet and social media users worldwide as of April 2024; 2024. Available from: https://www.statista.com/statistics/617136/digital-population-worldwide/
  23. 23. Bourchier L, Temple-Smith M, Hocking J, Bittleston H, Malta S. Engaging older Australians in sexual health research: SHAPE2 survey recruitment and sample. Sex Health. 2024;21(1):NULL. pmid:38071758
  24. 24. Bennetts SK, Hokke S, Crawford S, Hackworth NJ, Leach LS, Nguyen C, et al. Using paid and free Facebook methods to recruit Australian parents to an online survey: an evaluation. J Med Internet Res. 2019;21(3):e11206. pmid:30839282
  25. 25. Estcourt C. PL09 Digital sexual health: what we know and what we need to know for effective services. Sex Transm Infect. 2021;97(Suppl 1):A2–3.
  26. 26. Algarin AB, Cirilo A, Pitpitan EV, Gutierrez A, Horvath KJ, Smith LR. Implications and lessons learned while using social media advertisements to promote longitudinal social network study participation in Latino Men Who Have Sex with Men (LMSM): a brief report. J Urban Health. 2024;101(3):648–52. pmid:38625634
  27. 27. Bardach SH, Gibson AK, Rhodus EK, Jicha GA. Will “social distancing” lead to future “research distancing”: a reflection on COVID-19 impacts on Alzheimer’s disease research. Alzheimers Dement (N Y). 2020;6(1):e12045. pmid:32775600
  28. 28. Michielsen K, Larrson EC, Kågesten A, Erausquin JT, Griffin S, Van de Velde S, et al. International Sexual Health And REproductive health (I-SHARE) survey during COVID-19: study protocol for online national surveys and global comparative analyses. Sex Transm Infect. 2021;97(2):88–92. pmid:33082232
  29. 29. Toller Erausquin J, Tan RKJ, Uhlich M, Francis JM, Kumar N, Campbell L. The International Sexual Health and Reproductive Health during COVID-19 (I-SHARE) study: a multicountry analysis of adults from 30 countries prior to and during the initial coronavirus disease 2019 wave. Clin Infect Dis. 2022;75(1):e991–9.
  30. 30. Golden SD, Earp JAL. Social ecological approaches to individuals and their contexts: twenty years of health education & behavior health promotion interventions. Health Educ Behav. 2012;39(3):364–72. pmid:22267868
  31. 31. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107–15. pmid:18352969
  32. 32. Erlingsson C, Brysiewicz P. A hands-on guide to doing content analysis. Afr J Emerg Med. 2017;7(3):93–9. pmid:30456117
  33. 33. Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88. pmid:16204405
  34. 34. Roberts-Lewis SF, Baxter HA, Mein G, Quirke-McFarlane S, Leggat FJ, Garner HM, et al. The use of social media for dissemination of research evidence to health and social care practitioners: protocol for a systematic review. JMIR Res Protoc. 2023;12:e45684. pmid:37171840
  35. 35. Stadnick NA, Cain KL, Watson P, Oswald W, Ibarra M, Lagoc R, et al. Engaging underserved communities in COVID-19 health equity implementation research: an analysis of community engagement resource needs and costs. Front Health Serv. 2022;2:850427. pmid:36258685
  36. 36. Pratt B, Hyder AA. Governance of global health research consortia: sharing sovereignty and resources within Future Health Systems. Soc Sci Med. 2017;174:113–21. pmid:28024240
  37. 37. Sharma N, Vaish H. Impact of COVID - 19 on mental health and physical load on women professionals: an online cross-sectional survey. Health Care Women Int. 2020;41(11–12):1255–72. pmid:33021925
  38. 38. VanderZanden A, Langlois EV, Ghaffar A, Bitton A, Fifield J, Hirschhorn LR. It takes a community: a landscape analysis of global health research consortia. BMJ Glob Health. 2019;4(Suppl 8):e001450. pmid:31478019