Figures
Abstract
Aim
To explore the characteristics of online STI test users, and assess the frequency and factors associated with subsequent service use following a negative online STI test screen in individuals without symptoms.
Methods
One-year retrospective study of online and clinic STI testing within a large integrated sexual health service (Umbrella in Birmingham and Solihull, England) between January and December 2017. A multivariable analysis of sociodemographic and behavioural characteristics of patients was conducted. Sexual health clinic appointments occurring within 90 days of a negative STI test, in asymptomatic individuals who tested either online or in clinic were determined. Factors associated with online STI testing and subsequent clinic use were determined using generalized estimating equations and reported as odds ratios (OR) with corresponding 95% confidence intervals (CI).
Results
31 847 online STI test requests and 40 059 clinic attendances incorporating STI testing were included. 79% (25020/31846) of online STI test users and 49% (19672/40059) of clinic STI test takers were asymptomatic. Online STI testing was less utilised (p<0.05) by men who have sex with men (MSM), non-Caucasians and those living in neighborhoods of greater deprivation. Subsequent clinic appointments within 90 days of an asymptomatic negative STI test occurred in 6.2% (484/7769) of the online testing group and 33% (4960/15238) for the clinic tested group. Re-attendance following online testing was associated with being MSM (aOR 2.55[1.58 to 4.09]—MSM vs Female) and a recent prior history of STI testing (aOR 5.65[4.30 to 7.43] ‘clinic tested’ vs ‘No’ recent testing history).
Conclusions
Subsequent clinic attendance amongst online STI test service users with negative test results was infrequent, suggesting that their needs were being met without placing an additional burden on clinic based services. However, unequal use of online services by different patient groups suggests that optimised messaging and the development of online services in partnership with users are required to improve uptake.
Citation: Ayinde O, Jackson L, Phattey J, Ross JDC (2023) STI testing and subsequent clinic attendance amongst test negative asymptomatic users of an internet STI testing service; one-year retrospective study. PLoS ONE 18(2): e0281359. https://doi.org/10.1371/journal.pone.0281359
Editor: Habakkuk Yumo, ICF International Inc, UNITED STATES
Received: February 15, 2022; Accepted: January 22, 2023; Published: February 8, 2023
Copyright: © 2023 Ayinde et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data of the study are anonymized and published within the paper. The routine data that support the findings of this study are available from the University Hospitals Birmingham NHS Health Informatics, but restrictions apply to the availability of these data, which were used under ethics approval for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request depending on an individual permission from the UHB Research Governance Office (R&D@uhb.nhs.uk).
Funding: The author(s) received no specific funding for this work.
Competing interests: JDCR reports personal fees from Bayer and GSK Pharma, as well as ownership of shares in GSK Pharma and AstraZeneca Pharma; and is author of the UK and European Guidelines on Pelvic Inflammatory Disease; is a Member of the European Sexually Transmitted Infections Guidelines Editorial Board. He is an NIHR Journals Library Editor and associate editor of Sexually Transmitted Infections journal. He is an officer of the International Union against Sexually Transmitted Infections (treasurer), and a charity trustee of the Sexually Transmitted Infections Research Foundation (chair). OA, LJ, and JP declare no competing interests or funding. This does not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
Over the last decade, sexual health services have adopted innovative ways to increase testing and screening for sexually transmitted infections (STI) in response to a reduction in available resources [1]. Home-based STI self-sampling test kits available via web-based ‘online’ and pharmacy-based platforms provide an alternative to traditional face to face clinic services and can facilitate an increase in STI testing by detecting asymptomatic infections that would have otherwise remained undiagnosed [2–4] and reaching groups who have not previously been tested [4–7]. Online STI self-sampling kits have comparable diagnostic accuracy to samples collected by clinicians [8, 9], can reduce the time to test [5], relieve pressure on traditional clinics [10], and can be cost-effective when integrated with other sexual health services [11]. Also, from a user perspective home-based STI self-sampling can increase autonomy and control of the testing process, and reduce the self-perceived stigma of attending a sexual health clinic [12–14].
However, the benefits of online STI testing may be attenuated by a number of factors including limited uptake in high-risk groups, poor return rates of test kits, inequity in health or digital literacy of potential users, and increasing the pressure in an overstretched clinical service due to increased testing and follow up [9, 11, 15, 16]. Studies on online STI testing in the United Kingdom, suggest that a preference for online STI testing was associated with being female and Caucasian [2, 3, 6, 17]. Up to 60% of online STI kits requested are not returned [6, 11, 15] and non-return of kits was commoner in younger individuals, ethnic minorities (Black African/Caribbean or mixed-race), men, and those who were symptomatic at the time of testing [6, 15, 17]. Overall, this highlights the potential for reduced uptake of online based STI testing within certain high risk groups such as in men who have sex with men (MSM) and Black African/Caribbean ethnic groups.
In addition, assessing the value of online testing is dependent on a full understanding of the patient pathway including service utilisation after online self-sampling, for example, if patients’ needs are not met fully via the online service then they will re-attend the clinical service within a short period with an associated increase in costs and service pressure, and reduced satisfaction. To assess this requires longer term follow up to determine the frequency of reuse of sexual health services following online based STI testing, and evaluation of the factors associated with re-attendance. This is of particular relevance given the rapid expansion of online based STI testing following the COVID-19 pandemic. However, there is paucity of data on patient outcomes in the time period after online self-sampling. Therefore the objectives of this study were (i) to explore the characteristics of users of web-based and clinic based STI testing over a one-year time period, (ii) to assess the frequency of clinic attendance within 90 days following an online test request amongst asymptomatic online STI test users who tested negative, and (iii) to identify factors associated with subsequent sexual clinic attendance in this group.
Methods
Study design and data sources
Umbrella health offers free sexual health services for residents in Birmingham and Solihull, England. A retrospective cohort study of Umbrella STI testing service use was conducted as part of the ‘Understanding the costs and benefits of online screening and clinic-based screening for sexually transmitted infections (STIs): a case study of the Umbrella sexual health system in Birmingham’ project. Data on STI testing, sociodemographic, behavioural and symptom characteristics of patients who were tested for STIs at the sexual health clinic were extracted from the electronic patient record (EPR) (Excelicare®, AxSys Technology Ltd). The corresponding data for those requesting online STI testing were obtained from the Umbrella STI self-sampling kit request website (https://umbrellahealth.co.uk/self-sampling-kits/), the website associated database, and the EPR. On return of an online test kit, STI kit order details were transferred from the website database into the EPR with matching of the web database and EPR patient identification numbers. Data on test results and subsequent clinic attendance after baseline STI testing were then retrieved from the EPR.
Study inclusion and exclusion criteria
Participants were included if they were aged 16 years or over, and requested STI testing (chlamydia, gonorrhea, syphilis, HIV or hepatitis B) through the Umbrella online self-testing internet website or attended the sexual health clinic for STI testing between 1st of January 2017 and 31st of December 2017. For the online test cohort, participants were excluded if the requested test kits could not be matched to the participant’s online request identification number. In the clinic cohort, those attending clinic solely for aspects of sexual healthcare that could not be provided on the online testing website such as clinic attendance for contraceptives or advice were excluded.
Outcomes
Online STI testing completed.
This was defined as the request and return of a postal online STI self-sampling kit from the Umbrella STI testing internet website within the one-year study duration.
Clinic use following an asymptomatic online STI test.
This was defined as having booked an appointment to attend a sexual health clinic within 90 days of requesting an online STI test in an individual who:
- was asymptomatic and tested negative for all tests
- had received their test results
Clinic appointments booked after 31st of December 2017 were excluded. When multiple online test requests were booked within the 90-day period, only the latest request was included. The 90-day follow up period was chosen on the assumption that test users were likely to reuse sexual health services within a short period if their needs from an initial engagement were unmet, and to limit the risk of incorporating routine appointments as the guidelines at the time recommended that high risk STI groups retest 3-monthly [18].
Statistical analysis
Descriptive analyses were performed on demographic, behavioral and clinical data. Univariable and multivariable associations were estimated with generalized estimating equations to account for repeat use of the same testing service (online or clinic) during the study period. Odds ratios (ORs) and the corresponding 95% confidence intervals (CI) were used to estimate associations with the outcome variables (i) online STI testing completed, and (ii) clinic use following an asymptomatic online STI test. Due to the collinearity between the gender and sexuality variables, these variables were combined into a composite ‘gender /sexuality’ variable. To limit the risk of unmeasured confounding all variables including an interaction term for hepatitis B and gender /sexuality were included in the multivariable model. This was because MSM who test negative for hepatitis B were advised to attend clinic for hepatitis B vaccination. Statistical analyses on the utilization of online STI testing were stratified by symptom presentation at the time of test request, as symptomatic patients using the Umbrella sexual health service were encouraged to attend clinic for testing, and because data from England suggest that most (>75%) online STI test takers are asymptomatic [2–4]. No imputation was performed for missing data and case wise deletion for missing data was used in the regression models. Two-tailed tests were used and p values<0.05 were considered statistically significant. Statistical analyses were conducted using STATA 16 for Windows.
Ethical review and considerations
A ‘no objection to study’ was obtained from the University Hospitals Birmingham NHS Trust for the ‘Understanding the costs and benefits of online screening and clinic-based screening for sexually transmitted infections (STIs): a case study of the Umbrella sexual health system in Birmingham’ with project reference number RRK6031. Ethical review and approval for the ‘Understanding the costs and benefits of online screening and clinic-based screening for sexually transmitted infections (STIs): a case study of the Umbrella sexual health system in Birmingham’ project was also provided by the University of Birmingham’s Science, Technology, Engineering and Mathematics Ethical Review Committee with ethical review reference number–ERN_17–1065. As this was an analysis of routinely collected health information, patient consent was not required.
Results
Between January 1st 2017 and December 31st 2017, 164 015 clinic STI test records (gonorrhea, chlamydia, HIV, syphilis or hepatitis B) and 44 044 clinic attendances were identified. Of these, 3758 clinic attendances were excluded because there was no record of an STI test relating to these attendances. 227 clinic attendances were also excluded because test users were less than 16 years old. Therefore 40 059 clinic STI test attendances (33 812 of these were unique attendances and the rest from repeat attendances during the study period) were included in the analysis.
Similarly, 76 776 online STI test records (gonorrhea, chlamydia, HIV, syphilis or hepatitis B) were linked to 31 901 online STI test user requests. Of these, 54 online user requests could not be matched to an STI kit being sent out and were excluded. Therefore, 31 847 online user requests for STI test kits were included in the analysis. Of these, 31 846 had records of the symptom status at the time of test request. About half of the online STI test kits requested and sent out (14539/31847 [46%]) were not returned for processing. Of the 17 308 kits returned for processing 14 655 were unique kit requests and the rest were repeat requests within the study period.
19672/40059 (49%) of the clinic STI test attendances were from asymptomatic individuals and 25020/31846 (79%) of the online STI test request were from asymptomatic individuals.
Online STI testing preference
In Table 1, the socio-demographic and test characteristics of service users are presented with odds ratios comparing online and clinic patients who were tested for STIs, stratified by the presence or absence of symptoms. Amongst asymptomatic patients the odds for undertaking online STI testing were significantly lower amongst older adults (adjusted odds ratio—aOR 0.82[0.73 to 0.93] aged over 40 years vs 16 to 20 year), men (aOR 0.55[0.52 to 0.59] male vs female) or MSM (aOR 0.13[0.12 to 0.16] MSM vs female), those self-reporting non-Caucasian ethnicity (aOR 0.28 [0.25 to 0.31]—Asian vs Caucasian; aOR 0.25[0.23 to 0.27]—Black vs Caucasian), contacts of STIs (aOR 0.66[0.61 to 0.71]) and those with previous attendance at the clinic within the last three months (aOR 0.90 [0.84 to 0.96]). The odds for having had an online STI test was higher in those living in neighborhoods with less deprivation (aOR1.41 [1.32 to 1.51]; aOR 1.23 [1.13 to 1.34]—for Index of Multiple Deprivation [IMD] quintile 2 and 3 respectively compared to IMD quintile 1), and for being tested for gonorrhea and/or chlamydia (aOR 2.07 [1.74 to 2.47]).
Amongst symptomatic individuals who were tested, the odds for online STI testing were broadly similar to asymptomatic individuals, except that the odds for online STI testing was significantly higher for contacts of an STI (aOR 1.36[1.22 to 1.51]) Table 1.
Subsequent clinic use within 90 days of a negative online STI test in asymptomatic individuals
17308/31847 (54%) STI test kits were returned following an online test request, of which 3436/17308 [20%] individuals were symptomatic at the time of testing and 1303/17308 (8%) tested positive for at least one STI. 3249/17308 (19%) tests were ‘indeterminate’ or ‘not tested’ and in 1551/17308 (10%) there was no record of the patients having successfully received a notification of their test results–these patients were excluded from the analysis on subsequent clinic attendance. Overall, 7769/17308 (45%) online test kits returned and tested were from asymptomatic individuals who tested negative and had received test results.
The frequency of booking a clinic appointment within 90 days of having had an online asymptomatic STI screen and testing negative was 6.2% (484/7769—Table 2), with a median time to clinic booking of 34 days (interquartile range[IQR], 18 to 58 days), and with most appointments leading to a clinic attendance 410/484 (85%). The factors associated with a clinic appointment following a negative asymptomatic STI screen are presented in Table 3 and were significantly higher in those self-identifying as MSM (aOR 2.55 [1.58 to 4.09]—MSM vs Female), previously testing for STIs in the three months prior to the online test (aOR 5.65 [4.30 to 7.43] previous clinic STI testing vs ‘No’ prior STI testing; aOR 3.12[2.42 to 4.03]—previous home-based STI kit testing vs ‘No’ prior STI testing), and for online requested self-sample test kits collected from the clinic (aOR 1.98 [1.46 to 2.68]) or pharmacy (aOR 1.50 [1.03 to 2.20]) compared to test kits delivered by post to home addresses. Conversely, the odds of a subsequent clinic appointment were significantly lower in those living in neighborhoods with less deprivation (aOR 0.77 [0.60 to 0.98]; 0.69 [0.50 to 0.95]; 0.58 [0.36 to 0.91] for IMD quintile 2, 3 and 4 respectively compared to IMD quintile 1) and completing an online test for HIV and/or syphilis (aOR 0.74 [0.59 to 0.92]).
To help interpret the rate of clinic use following a negative online STI test, we also explored subsequent booking of a clinic appointment in those who had initially been tested in clinic. Of the 40 059 clinic attendees, 15 238 were asymptomatic at the time of testing and tested negative. For this group, the frequency of clinic appointment booking in the 90 days after attending clinic for asymptomatic STI tests and testing negative was 33% (4960/15238), with a median time to subsequent clinic appointment of 29 days (IQR- 14 to 57 days). 3191/4960 (64%) of clinic bookings resulted in clinic attendance—Table 4. The odds of booking a further clinic appointment within 90 days of having a negative STI screen in clinic was significantly higher in MSM (aOR 3.41 [2.97 to 3.92]), ethnic minorities—Asian (aOR 1.19 [1.05 to 1.35]), Black (aOR 1.15 [1.04 to 1.27]), and those attending clinic for testing within the preceding three months of testing (aOR 1.10[1.02 to 1.18]). The odds for booking a further clinic appointment were significantly lower with increasing age (aOR 0.80 [0.73 to 0.88]; aOR 0.80 [0.71 to 0.90]); 0.82 [0.71 to 0.94] for age intervals 21 to 30; 31 to 40, and over 40s compared to 16 to 20 years), living in neighbourhoods with less deprivation (aOR 0.89 [0.82 to 0.98]; aOR 0.88[0.78 to 0.99]; aOR 0.69 [0.59 to 0.80]; 0.69 [0.60 to 0.81] for IMD quintile 2, 3 and 4 respectively compared to IMD quintile 1), and previously tested for HIV and/or syphilis (aOR 0.76 [0.68 to 0.86])
Discussion
We provide data on the user characteristics of those undergoing online based STI testing and their subsequent rate of clinic attendance within a large patient cohort followed over 12-month study period. More online STI test users were asymptomatic (79%) compared to the clinic STI test users (49%). This is consistent with other studies where 79%-93% of online STI test service users were asymptomatic compared to 50%-69% of clinic STI test users [3, 4, 16, 17], probably reflecting guidance advising those with symptoms to attend clinic for a full evaluation or patient preference for a clinic appointment when symptoms are present. We explored the characteristics of STI test users and observed that regardless of the symptom status at the time of testing, specific STI risk groups such as MSM and those self-identifying as being of ‘Black ethnicity’ were significantly less likely to use the online STI test service, findings that are similar to some but not all previous studies [6, 16]. Concerns over the privacy of postal delivered STI self-sampling kits to homes where test users live with family or other people, and the perceived poorer user experience compared with the traditional face-to-face clinic testing may be of particular importance within ethnic and other minority groups [19]. Barnard et al [6] reported an increased uptake of online gonorrhoea and/or chlamydia testing in those self-identifying as MSM in some London boroughs, and it is possible that online test uptake may vary according to the specific characteristics of the online testing package or that geographic differences could exist. We found reduced utilisation of the online STI testing service amongst asymptomatic STI test users from the most socioeconomically deprived neighbourhoods. Evidence suggests that this may be linked to an increased risk of digital exclusion (reduced access to suitable IT hardware, costs of online access, limited digital skills [20]) or limited health literacy and lack of engagement [21]. There was, however, some inconsistency across socioeconomic categories with reduced use of online self-sampling also seen in the quintile with least deprivation, possibly reflecting the small proportions of these groups in our study and/or the lower STI risk associated with living in less deprived areas [22, 23]. Online based STI testing amongst symptomatic individuals was higher for those who were contacts of an STI, probably reflecting the local pathway used to expedite partner testing and treatment.
Nearly half (46%) of the online self-sampling test kits in our cohort were not returned for processing which is consistent with previous studies where the non-return rates vary from 14% [24] to 63% [25]. Low return rates could miss infections and increase the overall cost per diagnosis [11]. Certain behavioural and demographic characteristics are associated with test kit return [6, 15, 17] which are also likely to reflect difficulties in sample self-collection (especially blood), lack of clarity around the sampling procedure, and reduced confidence in the testing process [15, 16]. Recent guidance for the design of self-sampling kits in England has made recommendations on redesigning kits to improve patient usability, and to increase clarity and confidence by providing patients with additional information on the online testing procedure [26]. In addition, optimised messaging and easy access to support may help to increase test kit return [27] although further studies are needed to confirm potential benefits.
Online STI test users who test positive for an STI are referred to a clinic for confirmatory tests (for HIV or syphilis) and/or treatment [6, 12, 15, 17]. However, anecdotal evidence suggests that some asymptomatic online test takers attend clinic, despite receiving a negative test result, for additional reassurance and further advice. We assessed the frequency of clinic attendance following an asymptomatic online STI test and found that 6.2% (484/7769) of online STI test users who were asymptomatic at the time of STI testing and who tested negative, subsequently booked clinic appointments within 90 days of their test with almost half (45% [220/484]) of these appointments made within 30 days of testing. In comparison, the frequency of re-attendance in the corresponding asymptomatic patients who initially attended the clinic was more than five times higher (33% [4960/15238]) which most likely reflects a more complex initial clinical presentation and the need for follow-up. This suggests that the risk of ‘double dipping’ (utilising both online and face to face clinic services within a short time period) is small, especially as the factors associated with subsequent clinic use suggest that clinic re-attendance may often be appropriate, for example, MSM attending for HIV pre-exposure prophylaxis. The fact that these groups of patients reuse clinic services soon after online STI testing may also reflect the difficulties in self-sampling blood and can explain the lower uptake of online HIV/syphilis testing in this study, and further affect re-attendance rates particularly if individuals lack confidence in having provided adequate samples for testing. However, it is also possible that subsequent clinic attendance could be associated with unmet sexual health needs including sexual assault or need for specialist contraception advice [28, 29]. The economic case for online testing is supported by a low rate of re-attendance and the associated costs at an individual patient level [11]. However, the provision and increased accessibility of online testing may lead to an increase in overall service demand and activity which could increase service costs overall.
Our study has some potential limitations. The dataset is limited to attendees at a single large sexual health service which may limit its generalisability. However, Umbrella is one of the largest providers of online testing services in the UK and covers a diverse area with respect to individual demographics and sexual behaviours. The clinic STI testing cohort was limited to sexual health clinic attendees and does not include testing that occurred in general practices or other healthcare settings. This study was a retrospective analysis of routinely collected data, therefore the findings may be subject to unidentified selection bias including the exclusion of 3758 individuals in whom a specific STI test could not be linked to their clinic attendance. Data over a single one year time period was analysed resulting in an unequal follow up time period for included patients although the median time to re-attendance of around 30 days suggests that our findings remain valid. The data reported predates the COVID 19 pandemic and the impact of related changes in sexual healthcare delivery remains unclear. Finally, multiple statistical testing was performed without adjustment for multiplicity, which raises the possibility of spurious results and cautious interpretation is required.
In summary, we found that uptake of online testing services was reduced amongst individuals who were the most socio-economically deprived, in addition to MSM and ethnic minorities. However, subsequent clinic attendance following a negative online test rest was relatively uncommon (6%) suggesting that patient needs were being met without placing a large additional burden on clinic based services. As remote consultations and digital healthcare become more common, a greater understanding of the barriers and facilitators for online based testing are required to inform the development of optimised care pathways and specific interventions to ensure equality of access.
Supporting information
S1 Checklist. STROBE statement—checklist of items that should be included in reports of observational studies.
https://doi.org/10.1371/journal.pone.0281359.s001
(DOCX)
Acknowledgments
The authors thank James Pye, Aisha Diler for retrieving the study data from the electronic patient record and internet testing website database, and James Hodson for support with the statistical analysis.
References
- 1.
Robertson R, Wenzel L, Thompson J, Charles A. Understanding NHS financial pressures. How are they affecting patient care? London: The King’s Fund, 2017 March 2017. Report No.: ISBN978 1 909029 70 5.
- 2. Parry G, Clune M, De Sa J, Holdsworth G, Baraitser P. Who uses online services where? A comparison of online STI testing service use across England. Sexually Transmitted Infections. 2017;93.
- 3. Turner KM, Zienkiewicz AK, Syred J, Looker KJ, de Sa J, Holdsworth G, et al. Web-Based Activity Within a Sexual Health Economy: Observational Study. Journal of medical Internet research. 2018;20(3). pmid:29514776.
- 4. Baraitser P, De Sa J, Howroyd C, Holdsworth G, Syred J, Turner K, et al. Transforming sexual health systems through online services. Sexually Transmitted Infections. 2017;93.
- 5. Wilson E, Free C, Leyrat C, Baraitser P. Does internet-Accessed STI (e-STI) testing increase testing uptake for chlamydia and other STIs among a young population who have never tested? Secondary analyses of data from a randomised controlled trial. Sexually Transmitted Infections. 2019;95(8):569–74. pmid:31175210.
- 6. Barnard S, Baraitser P, Free C, Bakolis I, Turner KME, Looker KJ. Comparing the characteristics of users of an online service for STI self-sampling with clinic service users: A cross-sectional analysis. Sexually Transmitted Infections. 2018;94(5):377–83. pmid:29437985.
- 7. Spielberg F, Levy V, Lensing S, Chattopadhyay I, Venkatasubramanian L, Acevedo N, et al. Fully integrated e-services for prevention, diagnosis, and treatment of sexually transmitted infections: results of a 4-county study in California. American journal of public health. 2014;104(12):2313–20. pmid:25320878.
- 8. Lunny C, Taylor D, Hoang L, Gilbert M, Lester R, Krajden M, et al. Self-collected versus clinician-collected sampling for chlamydia and gonorrhea screening: A systemic review and meta-analysis. PLoS ONE. 2015;10(7). pmid:26168051.
- 9. Salow KR, Cohen AC, McGrath MR, Bristow CC, Klausner JD. Comparing mail-in self-collected specimens sent via United States Postal Service versus clinic-collected specimens for the detection of Chlamydia trachomatis and Neisseria gonorrhoeae in extra-genital sites. PLoS ONE. 2017;12(12). pmid:29240781.
- 10. Turner KME, Zienkiewicz A, Looker K, Barnard S, Syred J, Baraitser P, et al. Integration of clinic services with online sexually transmitted infection (STI) testing (SH:24) in camberwell, se London: Impact of active referral of asymptomatic testing online in 2016. Sexually Transmitted Infections. 2017;93.
- 11. Turner KME, Zienkiewicz A, Looker KJ, Syred J, Baraitser P. Online testing for sexually transmitted infections: A whole systems approach to predicting value. PLoS ONE. 2019;14(2). pmid:30794589.
- 12. Hottes TS, Farrell J, Bondyra M, Haag D, Shoveller J, Gilbert M. Internet-based HIV and sexually transmitted infection testing in British Columbia, Canada: opinions and expectations of prospective clients. Journal of medical Internet research. 2012;14(2). pmid:22394997.
- 13. Gilbert M, Thomson K, Salway T, Haag D, Grennan T, Shoveller J, et al. Differences in experiences of barriers to STI testing between clients of the internet-based diagnostic testing service GetCheckedOnline.com and an STI clinic in Vancouver, Canada. Sexually Transmitted Infections. 2019;95(2):151–6. pmid:29437984.
- 14. Fuller SS, Aicken C, Sonnenberg P, Shahmanesh M, Sutcliffe LJ, Estcourt CS, et al. What are young people’s perceptions of using electronic self-tests for STIs linked to mobile technology for diagnosis and care (eSTI2)? Sexually Transmitted Infections. 2013;89.
- 15. Manavi K, Hodson J. Observational study of factors associated with return of home sampling kits for sexually transmitted infections requested online in the UK. BMJ Open. 2017;7(10). pmid:29061625.
- 16. Banerjee P, Madhwapathi V, Thorley N, Radcliffe K. A service evaluation comparing home-based testing to clinic-based testing for HIV, syphilis and hepatitis B in Birmingham and Solihull. International Journal of STD & AIDS. 2020;31(7):613–8. pmid:32366180
- 17. Banerjee P, Thorley N, Radcliffe K. A service evaluation comparing home-based testing to clinic-based testing for chlamydia and gonorrhoea in Birmingham and Solihull. Sexually Transmitted Infections. 2017;93.
- 18. Clutterbuck D, Asboe D, Barber T, Emerson C, Field N, Gibson S, et al. 2016 United Kingdom national guideline on the sexual health care of men who have sex with men. International Journal of STD & AIDS. 2018:0956462417746897. pmid:29334885
- 19. Dodds C, Mugweni E, Phillips G, Park C, Young I, Fakoya F, et al. Acceptability of HIV self-sampling kits (TINY vial) among people of black African ethnicity in the UK: a qualitative study. BMC Public Health. 2018;18(1):499. pmid:29653536
- 20. Choi NG, Dinitto DM. The digital divide among low-income homebound older adults: Internet use patterns, eHealth literacy, and attitudes toward computer/Internet use. Journal of medical Internet research. 2013;15(5):e93–e. pmid:23639979.
- 21. Svendsen MT, Bak CK, Sørensen K, Pelikan J, Riddersholm SJ, Skals RK, et al. Associations of health literacy with socioeconomic position, health risk behavior, and health status: a large national population-based survey among Danish adults. BMC Public Health. 2020;20(1):565. pmid:32345275
- 22. Holtgrave DR, Crosby RA. Social capital, poverty, and income inequality as predictors of gonorrhoea, syphilis, chlamydia and AIDS case rates in the United States. Sexually transmitted infections. 2003;79(1):62–4. pmid:12576618.
- 23. Le Polain De Waroux O, Harris RJ, Hughes G, Crook PD. The epidemiology of gonorrhoea in London: a Bayesian spatial modelling approach. Epidemiology and Infection. 2014;142(1):211–20. Epub 2013/04/08. pmid:23561246
- 24. Koekenbier R, Hendriks A, Van Veen M, Van Leeuwen P. Optimizing care efficiency at the STI clinic: Using chlamydia home collection kits. Sexually Transmitted Infections. 2013;89.
- 25. Simons B, Jessen C, Rea L, Barnes M, Barnes P, Gaydos C. Providing discrete and reliable STD testing in alaska via a web-based at-home service. Sexually Transmitted Infections. 2013;89.
- 26.
Guidance for the design of self-sampling packs and associated support for self-sampling processes within Sexually Transmitted Infection and Blood Borne Virus testing, (2021).
- 27. Brown LJ, Tan KS, Guerra LE, Naidoo CJ, Nardone A. Using behavioural insights to increase HIV self-sampling kit returns: a randomized controlled text message trial to improve England’s HIV self-sampling service. HIV medicine. 2018;19(9):585–96. Epub 2018/07/02. pmid:29963766.
- 28. Day S, Singh GJ, Jones S, Kinsella R. Sexual assault reporting amongst users of online sexual health services. International Journal of STD and AIDS. 2020. pmid:33327897.
- 29. Chirwa M, Ume U, Hardie J, Nulty K, Jensen S, Day S, et al. Sexual risk profiles, and STI testing behaviour among users of a postal home sampling STI testing service (PHSSTs). Sexually Transmitted Infections. 2017;93.