Figures
Abstract
Background
Widespread use of at-home rapid COVID-19 antigen tests has been proposed as an important public health intervention to interrupt chains of transmission. Antigen tests may be preferred over PCR because they provide on-demand results for relatively low cost and can identify people when they are most likely to be infectious, particularly when used daily. Yet the extent to which a frequent antigen testing intervention will result in a positive public health impact for COVID-19 will depend on high acceptability and high adherence to such regimens.
Methods
We conducted a mixed-methods study assessing acceptability of and adherence to a daily at-home mobile-app connected rapid antigen testing regimen among employees of a US-based media company. Acceptability was assessed across seven domains of the Theoretical Framework of Acceptability.
Results
Among 31 study participants, acceptability of the daily testing intervention was generally high, with participants reporting high perceived effectiveness, intervention coherence, and self-efficacy; positive affective attitude; acceptable degree of burden and opportunity cost; and assessing the intervention as ethical. 71% reported a preference to test daily using an at-home antigen test than weekly employment-based PCR. Mean adherence to the 21-day testing regimen was 88% with 43% of participants achieving 100% adherence, 48% testing at least every other day, and 10% testing less than every other day.
Conclusions
Despite overall high acceptability and adherence, we identified three implementation challenges that must be addressed for frequent serial testing for COVID-19 to be implemented at scale and have a positive public health impact. First, users need guidance on how and when to adapt testing frequencies to different epidemiological conditions. Second, users and institutions need guidelines for how to safely store and share test results. Third, implementation of serial testing strategies must prioritize health equity and protect those most vulnerable to COVID-19.
Citation: Nguyen N, Lane B, Lee S, Gorman SL, Wu Y, Li A, et al. (2022) A mixed methods study evaluating acceptability of a daily COVID-19 testing regimen with a mobile-app connected, at-home, rapid antigen test: Implications for current and future pandemics. PLoS ONE 17(8): e0267766. https://doi.org/10.1371/journal.pone.0267766
Editor: Luisa Gregori, U.S. Food and Drug Administration, UNITED STATES
Received: April 13, 2022; Accepted: July 14, 2022; Published: August 8, 2022
Copyright: © 2022 Nguyen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Due to the potentially identifying and sensitive nature of the human subjects data, data are available via Globus upon reasonable request. Requests for the data set can be made to the Columbia University Institutional Review Board (irboffice@columbia.edu) who will respond to requests in consultation with the corresponding author.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors declare that they have no competing interests. NN, BL, MY, and KM are involved in completing clinical studies of the COVID-19 antigen test on behalf of BioMedomics Inc. for submission to the FDA. SL, SLG, HL, and NE were involved in the development of the paired mobile application which has been licensed to BioMedomics Inc. BioMedomics had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. This does not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
The use of at-home rapid COVID-19 antigen tests has been identified as an important public health intervention because such tests provide on-demand results for relatively low cost and can identify people when they are most likely to be infectious. Although antigen tests are not as sensitive as molecular tests like real-time PCR for detecting COVID-19, this limitation can be overcome by testing more frequently, including as often as daily. There is growing evidence from both modeling [1,2] and real-world studies [3–6] that antigen tests used frequently perform as well, and in some cases better at controlling the spread of COVID-19, than PCR administered less frequently.
Although antigen tests were developed relatively early in the pandemic, with the first at-home antigen test gaining Food and Drug Administration (FDA) approval for use in the United States (US) in December 2020 (Fig 1), they have been unavailable and underutilized for much of the pandemic in favor of more sensitive but also more expensive and time-consuming lab-based PCR tests [7]. In contrast, at-home antigen testing is a cornerstone in COVID-19 control measures in many European countries, including the UK and Germany, where such tests have been provided for free or at very low cost and have been widely used [7–9]. Recognizing the important role of at-home antigen tests, the Biden administration has taken a number of steps to significantly increase the availability and use of at-home antigen tests, including scaling up production of such tests; investing $2 billion to distribute free tests throughout the community; selling tests at cost; mailing free tests to households; and mandating tests be reimbursed through insurers [10–12]. These steps have the potential to dramatically increase the availability of and access to at-home antigen in the US.
Yet the extent to which a massive influx of at-home antigen tests to the American public will result in a positive public health impact will depend on whether and how the tests are used. To date, there is limited real-world data on the acceptability of at-home antigen testing, particularly when used serially, where they have been shown to be most effective. Previous implementation studies of numerous evidence-based interventions, particularly those requiring sustained participation and adherence, indicate that acceptability is critical to intervention uptake and success [13–15]. Even if at-home antigen tests become widely available, their public health impact will be limited if frequent testing is not acceptable and adopted at scale. To address this knowledge gap, we conducted a mixed-methods study informed by Sekhon’s Theoretical Framework of Acceptability (TFA) [16] to evaluate the acceptability of and adherence to a daily testing regimen among employees of a large media company in the US.
Methods
Research design
We conducted a mixed-methods observational study from February-June 2021 to examine factors that influenced the acceptability of and adherence to a serial testing regimen using a self-administered at-home rapid antigen test (“at-home antigen test”) in a workplace setting among employees at two divisions of The Walt Disney Company (“Disney”), a media company based in Southern California in the US. This mixed-methods acceptability study was nested within a larger parent study (N = 93) testing the effectiveness of a daily testing regimen using an at-home antigen-test against weekly testing with PCR at Disney. Participants in the parent study were mailed at-home COVID-19 antigen test kits to their home address and asked to self-test daily for 21 days and, as a condition of their employment, were also concurrently testing at least weekly for COVID-19 using PCR. In our nested acceptability study, after providing written informed consent, participants were asked to complete a one-time quantitative survey (N = 31), and a subset of participants contributed a one-time qualitative in-depth interview (N = 15) at the conclusion of 21 days of daily testing. Participants had a choice to complete both the quantitative survey and qualitative interview or just the survey. Participants who completed the survey were entered into a drawing for a $100 gift card, and participants who completed the interview received a $25 gift card. All study procedures were reviewed and approved by the Columbia University Irving Medical Center’s Institutional Review Board.
Recruitment and study population
Participants in the acceptability study were informed of the goals of the study and recruited from the parent study via email. To be eligible for the parent study, participants were 18 years of age or older; owned a smartphone; understood and read English; had not been diagnosed with COVID-19 in the past 90 days; had not received any COVID-19 vaccine doses at enrollment; and were willing to share their weekly PCR results. There were no additional inclusion criteria for the acceptability study aside from willingness to complete the quantitative survey and being at least 14 days into the parent. COVID-19 vaccinated employees were excluded because at the time of recruitment, vaccination was believed to provide strong protection against breakthrough infections.
At-home rapid antigen test and mobile app
Participants used an investigational at-home antigen test that is currently under review with the FDA for Emergency Use Authorization. Test results were available to participants after 15 minutes (for test details, see S1 Fig) The test also included a paired smart phone mobile application (mobile app) that had the following functions: provided step-by-step testing instructions; captured image of test result and automatically interpret result (positive, negative, invalid; securely store test result history; and transmit daily test result to the study team.
Data collection
Theoretical framework
The quantitative survey and in-depth interview questions were informed by Sehkon’s Theoretical Framework of Acceptability (TFA) [16]. The TFA defines intervention acceptability as a multi-faceted construct that reflects the extent to which people consider the health care intervention to be appropriate, based on anticipated or experienced cognitive and emotional responses to the intervention. The TFA consists of seven constructs which we adapted to measure the acceptability of the intervention: affective attitude, burden, perceived effectiveness, ethicality, intervention coherence, opportunity costs, and self-efficacy (Table 3).
Adherence to daily testing regimen
Participants submitted daily test results to the study team by scanning a picture of the test cassette using the mobile app.
Quantitative survey
Each of the TFA’s seven constructs of acceptability was evaluated by one to three statements which participants rated on a five-point Likert scale (strongly disagree = 1 to strongly agree = 5). As a global measure of acceptability, participants were also asked whether, if given a choice, they would prefer to test for COVID-19 using the current PCR regimen or test daily with an at-home antigen test. We measured sociodemographic factors, including age, race/ethnicity, sex, education, living environment, and financial stability. Participants self-administered the 20-minute survey using REDCap, a secure web platform for administering online surveys.
In-depth interview
We conducted in-depth interviews with participants to more deeply understand their current and previous COVID-19 testing experiences and the acceptability of the daily COVID-19 testing regimen. The interview guide was designed to assess the seven constructs in the TFA. Interviews were approximately 60 minutes long and conducted over Zoom by a team of four researchers experienced in qualitative interviewing (NN, BL, KM, and YW). Of the four researchers: two identified as Asian cis-gendered females, 1 White cis-gendered female, and 1 White cis-gendered male; all four lived in New York City. All four were employed by Columbia University, which made rapid turnaround PCR testing available as needed in addition to random surveillance testing, and all were also using at-home antigen tests in their personal lives. Interviews were summarized in debrief forms immediately after completing the interviews and were audiorecorded and transcribed by a paid transcription service.
Data analysis
Quantitative analysis.
We summarized participant characteristics by estimating mean, standard deviation, frequency and proportion for all categorical and continuous sociodemographic and health factor variables, respectively. Additionally, we estimated the mean, standard deviation, median, and interquartile range (IQR) for each TFA construct measure and also estimated the frequency and proportion of participants who stated that they strongly agreed or agreed with each statement. We calculated overall adherence by taking the number of submitted test results and dividing it by the 21 days of the study. We categorized adherence into three groups and estimated the number and proportion of participants per group: 100% (tested daily), 50%-99% (tested at least every other day), and <50% (tested less than every other day). Finally, we calculated the frequency and proportion of participants who stated they would prefer testing daily with a rapid antigen test versus their current PCR regimen if given the choice.
Qualitative analysis.
Interview transcripts were analyzed by a team of three researchers in Dedoose using Template Analysis, which is appropriate for studies using a priori themes and exploring perspectives of different groups in an organizational context [17]. We initiated data analysis with a top-down approach, using the seven constructs in the TFA to create an organizational template. One member of the research team created a preliminary codebook by reading through interview debrief forms and identifying subconstructs within each of the TFA constructs. With the seven TFA constructs listed as parent codes and the subconstructs as child codes, the initial codebook was applied to two interview transcripts in Dedoose. A second researcher then applied the preliminary codebook to two more interviews and the codebook was further discussed and refined. All three coders then re-coded the initial four interviews using the finalized codebook to maximize reliability across coders. The three coders then individually coded the remaining 11 interviews, meeting on an ad hoc basis to resolve coding questions, and using memos to note emerging themes. The coders generated code reports for each TFA construct, identified key quotes for each construct and subconstruct, and held team meetings to discuss emergent themes that conceptualized how each construct either directly or indirectly influenced acceptability and adherence. Lastly, we created quote matrices for each construct and subconstruct using the identified key quotes organized by emergent themes.
Results
Participant characteristics
Of the 63 eligible Disney employees, we enrolled 31 participants who completed the online survey, of whom 15 also agreed to an in-depth interview between February-June 2021 (Table 1, Fig 1). The 15 interview participants were similar to the overall sample of the survey, with regard to sociodemographic and health factors and adherence.
Adherence to daily testing regimen.
Mean adherence to the 21-day testing regimen was 88% (SD: 21%, Median 95%, IQR: 90%, 100%) with 43% of participants achieving 100% adherence, 48% achieving 50–99% adherence, and 10% achieving less than 50% adherence (Table 2).
Testing preference
Most participants (71%) reported that if given the choice, they would prefer to test for COVID-19 daily using an at-home antigen test than weekly using PCR, while 19% preferred PCR, and 10% preferred only testing when necessary (Table 2).
Acceptability of the daily testing regimen
Affective attitude.
Participants reported overall positive feelings about the intervention though only 58% agreed with the statement “I like using the test every day” (see Table 3 for mean and median Likert scale scores). The overwhelming feeling reported by participants was comfort and peace of mind (Table 4, Affective attitude 1). Testing negative gave them needed reassurance to go about their daily lives and participants reported feeling “liberated” to engage in everyday activities without fear of infecting others (Affective attitude 2, 3). Participants also described using the tests after engaging in a “high risk” activity or potentially being exposed to COVID-19 (Affective attitude 3). Notably, a small number of participants described significant anxiety due to living with someone who was immunocompromised; for these participants, the ability to test daily or on demand provided significant mental health benefits (Affective attitude 4).
For some participants who struggled to incorporate testing into their daily routine or who had difficulty using the mobile app to capture and interpret their test result, daily testing was more burdensome. In these cases, participants reported feeling dread when they remembered they still had to test or frustration at being repeatedly unable to scan in a test result through the mobile app (Burden 6, Opportunity cost 5).
Burden.
More than half of participants disagreed with the statements “it is inconvenient to use the self- test every day” (61%) (Table 3). Most participants describing daily self-testing as very convenient compared to other testing options they experienced (e.g., large drive-through testing events early in March/April 2020 or mandatory testing offered by their employer). Even among participants who had access to weekly on-site testing at their workplace, most preferred the daily antigen test. These participants overwhelmingly described testing daily as fast and easy often noting that daily self-testing took less time overall than weekly PCR testing (Table 4, Burden 1); that they didn’t mind daily testing because they could test on their own schedule and get the results quickly (Burden 2) or incorporate self-testing into other established routines (e.g., timing the 15-minute waiting period with a shower) (Burden 3); and that they did not find the daily swabs to be invasive (Burden 4). While some participants described mild discomfort from the daily swabbing, this was not a major burden.
In the minority were participants who acknowledged that while daily at-home antigen testing was more convenient than weekly PCR testing, they still preferred testing using PCR because of the mental energy required to self-administer the test (Burden 5). Other participants described difficulty incorporating testing into their daily routine and reported testing fatigue (Burden 6).
Self-efficacy.
Participants reported that the self-test was easy to learn to use (90%) and results easy to understand (100%) (Table 3). However, only half of participants (55%) stated that they developed a habit of testing for COVID-19 in their daily routine, with experiences adhering to daily testing varying widely across participants. While some participants reported feeling initially overwhelmed by the testing steps, nearly all reported mastering the steps after a few days of testing (Table 4, Self-efficacy 1, 2). Factors that supported daily adherence included developing strategies to streamline the testing process (Self-efficacy 2); incorporating the test into their daily routine (Self-efficacy 3, 4); and placing the test kit in a prominent location (Self-efficacy 3). In contrast, participants reported that changes to their daily routine and weekends were the greatest barrier to daily adherence (Self-efficacy 5, 6).
Opportunity cost.
Most participants strongly agreed with the statement: “It is easy for me to find a time to use the test every day” (68%) (Table 3). Nonetheless, time was often described as the biggest opportunity cost to testing daily (Table 4, Opportunity cost 1, 2). Some participants attempted to minimize the time cost by multi-tasking (Burden 3) or spreading out the time commitment by setting up their test kit the night before (Self-efficacy 3). However, others reported that efforts to multi-task resulted in more time spent testing because they would lead to mistakes like missing the results window during and having to repeat the testing process again (Opportunity cost 1, 2, 3). For other participants, access to strong internet and/or a good light source were additional opportunity costs to daily testing as the mobile app required a specific level of light to accurately interpret the test result (Opportunity cost 4, 5). Participants who struggled to upload a picture of their test result consequently described testing as a “daily hassle” and “frustrating”, negatively impacting their affective attitude about the testing regimen.
Ethicality.
Most participants agreed that it is ethical for an employer to require its employees to test regularly for COVID-19 (87%) (Table 3). However, a small minority believed that regular testing should be a personal choice (10%) and a significant portion of participants believe that sharing test results should be a personal choice (42%). Many participants articulated how working long hours near other coworkers necessitated the need for routine testing and saw mandatory testing as a practical approach to keeping the workplace safe (Table 4, Ethicality 1, 2). Specifically, many used Utilitarian arguments to justify mandatory testing, saying that the small loss of privacy and autonomy was justified for “the greater good” of workplace safety (Ethicality 3, 4, 5). Others went further, stating that routine testing helped them fulfil their personal responsibility to keep their workplace safe, noting that they “didn’t want to be transmitters” and that giving someone else COVID would be “an unacceptable thing” (Ethicality 6). In contrast, a small number of participants believed mandatory workplace testing was not ethical as it infringed upon individual liberties. While these participants were personally willing to test regularly through their employer, they believed that coercive tactics should not be used to keep the workplace safe (Ethicality 7).
While participants tended to feel strongly that requiring regular COVID-19 tests was either ethical or unethical, participants’ feelings about who should have access to test results and what this health information should be used for was more nuanced. Many agreed that test results should be reported to their employer to prevent the spread of infection should an employee test positive (Ethicality 8); however, some had concerns about who within their company should have access to results (Ethicality 9). Participants also had mixed feelings regarding whether COVID-19 test results should be shared with larger health organizations, such as state health departments or the Centers for Disease Control and Prevention (CDC). Most participants believed these were trusted entities and saw the benefit of sharing COVID-19 results for contract tracing, surveillance, and allocation of health services (Ethicality 10); however, this feeling was not universal, and some reported not trusting the CDC or worrying that the health department would limit their freedom if they tested positive (Ethicality 11, 12). Additionally, a small number of participants believed test results should stay within their employer due to concerns about health information privacy, including fears that their health information could be sold or compromised (Ethicality 13, 14). At the same time, many participants liked the idea of their test results being automatically reported to their employer or doctor through a mobile app, as this would eliminate the need for a third party to handle test results (Ethicality 15).
Coherence.
The majority of participants believed that testing for COVID-19 daily made sense to prevent the spread of COVID-19 at and beyond the workplace (77%) (Table 3). Support for daily testing was particularly strong for times when COVID-19 rates were increasing or high; in this context, regular testing was considered an effective and necessary strategy for monitoring infection rates and preventing COVID-19 transmission (Table 4, Coherence 1). Specifically, many participants believed the unique needs of the entertainment industry, which relies on non-replaceable people to fill specific roles, further necessitated a stricter approach to COVID-19 control to ensure that work would not be disrupted (Coherence 2). Many participants said they wish they had access to daily testing during the original peak of the pandemic in March and April of 2020 (Coherence 3).
While support for regular testing was near universal during times when risk of COVID-19 infection was perceived to be high (i.e., before vaccines were available, when rates of infection were still increasing), there was less agreement about when routine testing was no longer needed. Many participants thought it made sense to continue regular COVID-19 testing until there was more research available on the transmissibility of emerging COVID-19 variants and effectiveness of the COVID-19 vaccines (Coherence 5). Others preferred to listen to scientific recommendations from public health agencies to decide whether frequent testing made sense (Coherence 6). Some participants expressed increasing doubt that regular COVID-19 testing was still necessary given that vaccines were widely available to all adults and rates of COVID-19 in the workplace and surrounding community were very low (Fig 1). One participant in a managerial position used a cost benefit analysis to argue that frequent testing did not make sense from a financial perspective given the low positivity rates (Coherence 7). Many believed testing did not make sense for vaccinated populations, but that it may be an alternative for those who did not wish to become vaccinated (Coherence 8).
Perceived effectiveness.
Participants had high confidence in the effectiveness of a daily testing intervention with the majority reporting that they trusted the results of the at-home antigen test (81%) and nearly all expressing confidence that testing daily will keep the people they work with safe from COVID-19 (90%) (Table 3). Whether participants perceived the daily testing intervention would keep the workplace safe depended on three factors: 1) whether they trusted the test results, 2) whether they believed their co-workers would be willing and able to test daily, and 3) whether they believed frequent testing would introduce any unintended consequences. Although the antigen test used in the study had not yet received FDA approval and was only for use in research settings, nearly all participants reported trusting the results, citing trust in Columbia University (which helped develop the test in collaboration with a biotechnology company), trust in Disney (their employer) to provide a safe and effective test, and trust in experts/scientists (Table 4, Perceived effectiveness 1, 2). Other participants drew on previous experience using similar at-home tests (e.g., home pregnancy tests, glucose monitoring, maintaining swimming pool pH) as reasons for trusting the results (Perceived effectiveness 3). One participant noted that they trusted the daily antigen test result more than weekly PCR because the antigen test result reflected current COVID-19 status while the PCR result reflected a status from 24–48 hours ago and could give a false sense of security (Perceived effectiveness 4). In contrast, a different participant reported trusting the antigen test result less than PCR because they had heard from family and friends with medical training that antigen tests were not as accurate as PCR (Perceived effectiveness 5).
While participants were generally confident in their own ability to successfully use the at-home antigen test, they were less confident about their co-workers’ abilities, which they believed could undermine the effectiveness of the daily testing intervention. These concerns included not believing that their coworkers would obtain a sufficient swab sample and properly self-administer the test at home (Perceived effectiveness 6), believing that a test administered by a medical professional would be more accurate (Perceived effectiveness 7), and worry that the identity of the test taker and the test result could not be confirmed in a home setting (Perceived effectiveness 8). Finally, some participants raised concerns that a frequent testing regimen would lead to employees increasing risky behavior that could result in more COVID-19 transmission (Opportunity cost 9, 10).
Discussion
As the COVID-19 pandemic continues to evolve with the emergence of new variants [18,19], waning vaccine and natural immunity [20–22], advancements and setbacks in treatment options [23], and changing human behavior in response to these inputs [24,25], new strategies for controlling and adapting to COVID-19 are needed. The Delta and Omicron variants have brought heightened interest in at-home antigen self-testing and the Biden administration has responded with significant resources to rapidly increase the availability of antigen tests in the US beginning late January 2022. The extent to which this intervention will have a significant public health impact remains to be seen but will in part depend on whether, and if so, how, Americans will use these tests. However as of January 2022, to our knowledge no studies have examined the acceptability of self-testing for COVID-19, including serial testing regimens that have been shown most effective at detecting cases.
Our mixed-methods study on the acceptability of a serial testing regimen showed that daily testing using an at-home antigen COVID-19 test was acceptable in one employment context. Employees were willing and able to adhere to a daily testing regimen for up to 21 days, with 75% of participants achieving adherence 90% or greater. In addition to reporting overall high acceptability and adherence, our study identified three key implementation challenges that must be addressed for antigen tests to reach their full public health potential.
First, there is a significant need for educational campaigns to build lay user trust in the accuracy of at-home antigen tests and knowledge around when and how to use them, including how to act on test results [26]. Of the seven constructs that comprise acceptability, coherence and perceived effectiveness were most salient and determined whether participants ultimately felt it “was worth it” to test for COVID-19 daily. Importantly with respect to coherence, participants expressed a willingness to tolerate burden (inconvenience, invasiveness), opportunity costs (time), threats to ethicality (loss of privacy) associated with daily testing when they perceived the threat of COVID-19 to be high (high coherence), but indicated that given testing fatigue, this tolerance would not last forever. In the face of declining cases and universal access to vaccination among adults, participants saw a time in the then near future when this testing frequency would no longer be necessary, rendering the intervention less acceptable. As shown in Fig 1, the study was implemented right before the emergence of the Delta variant when case numbers were decreasing, vaccination eligibility was extended to study participants, and the fear of COVID was palpably receding in the public domain and among our study participants. Respondents reported that daily at-home testing made less sense at this moment in the epidemic than it had one month earlier when case numbers were rising and vaccinations were not yet approved. These findings highlight that people’s tolerance for testing intensities change based on their changing perceptions of risk. Users urgently need clear public health guidance around when and how frequently to use at-home antigen tests under different epidemiological conditions, including specific guidance around on- and off-ramps to different testing intensities [27].
We also found that trust in the accuracy of the at-home antigen test was key to whether participants perceived that the intervention would be effective. While most participants reported trusting the results of the test, this trust was primarily grounded in trust in the institutions providing this test and not in scientific evidence supporting test accuracy. Yet given that antigen tests will be distributed and used outside of the employment context, educational campaigns are needed to build trust in the tests, including by increasing lay user knowledge about the accuracy of antigen tests for detecting when users are most infectious and able to transmit to others. Increasing user literacy around antigen testing for COVID-19 may be particularly important given emerging mixed evidence about the performance and accuracy of antigen tests with the Omicron variant, including concerns about tests being less sensitive [28–31] and slower to detect COVID-19 in the nose compared to other sites [32], which may erode trust in antigen tests and impact acceptability and adherence to testing regimens. This work will need to be ongoing and responsive to emerging information with each new variant and delivered across all communities to ensure that scale up antigen testing does not exacerbate existing health disparities [7,33].
Second, we wish to highlight that any frequent testing campaign will generate an enormous amount of sensitive health data and there is currently no existing universal infrastructure for routinely capturing or reporting this information to relevant health authorities, health care providers, or institutions (e.g., employers, schools). The lack of a universal recording and reporting system for at-home antigen test results that are test brand agnostic creates numerous challenges including 1) potentially biased statistics around COVID-19 infection rates due to millions of home antigen test results not being reported, with implications for public health surveillance and resource allocation [34–36]; 2) sharing of COVID-19 test results through non-secure channels (e.g., text messages, emails) providing opportunities for privacy breaches [37–39]; and 3) challenges for the delivery of anti-viral treatments for COVID-19 within three days after symptom-onset for maximum benefit, due to the lack of guidance on whether a positive home antigen test can be used to qualify for treatment [40,41]. In our study, testing data was captured securely and systematically using a mobile app that recorded and interpreted the test result for the user; these data were only shared with the study team, but the app could be further developed to support secure sharing with other entities. Most participants in our study found the app to be acceptable, however using this app was not without challenges, and some participants experienced significant difficulty using the app daily due to lack of internet or smart phone operating system too old to support the app. In a less technology savvy population, comfort with smart phone technology may also be a significant barrier. Further, while nearly all participants were comfortable with tests results being shared with the research team and their employer, they expressed significant concern about results being shared with health or government entities aside from their own provider.
Anticipating potentially more dangerous pandemics in the near future, the Biden administration has developed a five-pillar plan for pandemic preparedness that includes “transforming our medical defense [through] dramatically improving diagnostics” (Pillar 1) and “ensuring situational awareness about infectious disease threats for both early warning and real-time monitoring” (Pillar 2) [42]. A connected at-home antigen test that could accurately capture tests results and share them with government and health authorities in real time would address both pillars, however significant work remains to be done to build public trust and acceptability in such a system [43]. Within the current pandemic, anecdotally, antigen test results are already being informally shared with institutions like schools and employers to support strategies like “test to stay” (testing to remain after exposure) and “test to return” (testing to end isolation or return after infection). To our knowledge, there has been little to no research done on how these results are currently being shared or stored; guidelines for best practices are urgently needed.
Finally third, given that the COVID-19 and future pandemics may disproportionally and negatively affect low-income and marginalized communities, it is essential that serial testing interventions in the workplace and elsewhere be employed in ways that put equity at the forefront. Mandatory workplace testing policies have the potential to both protect the most vulnerable, front-line employees, but if instituted without proper protections, can also create negative unintended consequences that may disproportionately burden vulnerable populations. The acceptability of a daily testing regimen in this study population was likely influenced by the employment context, including already established norms around routine COVID-19 testing, and job security and benefits (e.g., health insurance, dedicated paid COVID-19 sick leave) available to participants in our study who were all employed full-time. Although we anticipated and probed for worries about job security or loss of income due to testing positive for COVID-19, hypothesizing that this could reduce acceptability and adherence to the intervention, no participants reported such concerns. Possibly because of their job security, participants also almost universally believed that mandatory COVID-19 testing in the workplace was ethical. In other employment contexts with less job and income protection, mandatory serial testing may be much less acceptable and could have harmful unintended consequences.
Conclusion
Our study contributed to the knowledge gap around the implementation of serial at-home rapid antigen testing regimens. This is the first study to our knowledge to evaluate the acceptability of a serial COVID-19 testing regimen with a connected test in an employment context and report on adherence to the intervention. Our study advanced the Theoretical Framework of Acceptability by developing quantitative measures of acceptability and identifying three critical barriers to the successful implementation of rapid antigen testing as a public health intervention.
There were also a number of limitations. The study was implemented at a time of relatively low COVID worry as the number of cases was falling steeply and vaccines offered a promise of durable protection. This epidemiological context along with the COVID-19 vaccine exclusion criterion impacted our ability to enroll a larger number of study participants and the relatively small sample size limits the generalizability of the findings and our ability to reach saturation. Therefore, results should be interpreted with the small sample in mind. However, low accrual highlighted that context is an understudied component of acceptability causing acceptability to vary across time. Generalizability may also be limited by the fact that the small study was conducted in Southern California in a politically liberal area with high support for COVID precautions and within a stable employment context. Participants were all fully employed at a large company (Disney), and race, education, and SES are not representative of the broader US population. Thus, findings may not be generalizable to other contexts, including other countries or epidemiological contexts, or populations. The relatively high adherence to the intervention we report is likely an artifact of the study context and selection bias based on willingness to enroll in the parent daily testing study and participate in in-depth interviews about the experience; we would expect adherence to be lower in the real world. Finally, we only looked at serial testing in an employment setting, although serial testing has now been rolled out in other contexts. Additional studies are needed to build the evidence-base about the acceptability of and adherence to serial-testing regimens to evaluate their public health contribution to interrupting transmission.
Supporting information
S1 Fig.
To test for COVID-19, participants completed the following steps show in in the instructions below: (1) swabbed anterior nares of each nostril (i.e., shallow swab); (2) placed the swab in a plastic tube and added drops of buffer solution; (3) swirled the swab inside the tube with the buffer solution and squeezed the tube to mix the buffer solution with the swab; (4) discarded the swab and placed a dropper cap on the tube containing the buffer solution; (5) squeezed drops of the buffer solution onto a test cassette (6) waited 15 minutes to read the test result (1 line = negative, 2 lines = positive).
https://doi.org/10.1371/journal.pone.0267766.s001
(DOCX)
Acknowledgments
We wish to acknowledge David D. Ho, MD and Glenn Braunstein, MD for their roles in designing and facilitating the implementation of the parent study, The Walt Disney Company for their partnership in the parent study, and BioMedomics Inc. for providing the COVID-19 antigen tests used in the parent study.
References
- 1. Larremore DB, Wilder B, Lester E, Shehata S, Burke JM, Hay JA, et al. Test sensitivity is secondary to frequency and turnaround time for COVID-19 screening. Sci Adv. 2021;7. pmid:33219112
- 2. Ricks S, Kendall EA, Dowdy DW, Sacks JA, Schumacher SG, Arinaminpathy N. Quantifying the potential value of antigen-detection rapid diagnostic tests for COVID-19: a modelling analysis. BMC Med. 2021;19: 1–13. pmid:33685466
- 3. McKay SL, Tobolowsky FA, Moritz ED, Hatfield KM, Bhatnagar A, LaVoie SP, et al. Performance Evaluation of Serial SARS-CoV-2 Rapid Antigen Testing During a Nursing Home Outbreak. Ann Intern Med. 2021;174: 945–951. pmid:33900791
- 4. Smith RL, Gibson LL, Martinez PP, Ke R, Mirza A, Conte M, et al. Longitudinal Assessment of Diagnostic Test Performance Over the Course of Acute SARS-CoV-2 Infection. J Infect Dis. 2021;224: 976–982. pmid:34191025
- 5. Surasi K, Cummings KJ, Hanson C, Kate Morris M, Salas M, Seftel D, et al. Effectiveness of Abbott BinaxNOW Rapid Antigen Test for Detection of SARS-CoV-2 Infections in Outbreak among Horse Racetrack Workers, California, USA—Volume 27, Number 11—November 2021—Emerging Infectious Diseases journal—CDC. Emerg Infect Dis. 2021;27: 2761–2767. pmid:34469287
- 6. Paltiel AD, Zheng A, Walensky RP. Assessment of SARS-CoV-2 Screening Strategies to Permit the Safe Reopening of College Campuses in the United States. JAMA Netw open. 2020;3. pmid:32735339
- 7.
Dawson L, Kates J. Rapid Home Tests for COVID-19: Issues with Availability and Access in the U.S. In: Kaiser Family Foundation [Internet]. 2021 [cited 2 Feb 2022]. https://www.kff.org/report-section/rapid-home-tests-for-covid-19-issues-with-availability-and-access-in-the-u-s-issue-brief/.
- 8. Crozier A, Rajan S, Buchan I, McKee M. Put to the Test: Use of Rapid Testing Technologies for COVID-19. BMJ. 2021;372.
- 9.
GOV.UK. Order coronavirus (COVID-19) rapid lateral flow tests. 2022 [cited 2 Feb 2022]. https://www.gov.uk/order-coronavirus-rapid-lateral-flow-tests.
- 10.
The White House. Fact Sheet: The Biden Administration to Begin Distributing At-Home, Rapid COVID-19 Tests to Americans for Free. 2022 [cited 2 Feb 2022]. https://www.whitehouse.gov/briefing-room/statements-releases/2022/01/14/fact-sheet-the-biden-administration-to-begin-distributing-at-home-rapid-covid-19-tests-to-americans-for-free/.
- 11.
The White House. Press Briefing by White House COVID-19 Response Team and Public Health Officials. 2021 [cited 2 Feb 2022]. https://www.whitehouse.gov/briefing-room/press-briefings/2021/10/06/press-briefing-by-white-house-covid-19-response-team-and-public-health-officials-60/.
- 12.
The White House. President Biden’s COVID-19 Plan. 2021 [cited 2 Feb 2022]. https://www.whitehouse.gov/covidplan/.
- 13. Balas E, Boren S. Managing Clinical Knowledge for Health Care Improvement. Yearb Med Inform. 2000;1: 65–79. pmid:27699347
- 14. Grant J, Green L, Mason B. Basic research and health: a reassessment of the scientific basis for the support of biomedical science. Res Eval. 2003;12: 217–224.
- 15. Morris ZS, Wooding S, Grant J. The answer is 17 years, what is the question: Understanding time lags in translational research. J R Soc Med. 2011;104: 510–520. pmid:22179294
- 16. Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: An overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017. pmid:28126032
- 17.
King N. Doing Template Analysis. Qual Organ Res Core Methods Curr Challenges. 2017; 426–450.
- 18. Viana R, Moyo S, Amoako DG, Tegally H, Scheepers C, Althaus CL, et al. Rapid epidemic expansion of the SARS-CoV-2 Omicron variant in southern Africa. Nature. 2022. pmid:35042229
- 19. Lewnard JA, Hong VX, Patel MM, Kahn R, Lipsitch M, Tartof SY. Clinical outcomes among patients infected with Omicron (B.1.1.529) SARS-CoV-2 variant in southern California. Nat Med. 2022.
- 20. Rössler A, Riepler L, Bante D, von Laer D, Kimpel J. SARS-CoV-2 Omicron Variant Neutralization in Serum from Vaccinated and Convalescent Persons. N Engl J Med. 2022. pmid:35021005
- 21. Cele S, Jackson L, Khoury DS, Khan K, Moyo-Gwete T, Eg Al Ly HT, et al. Omicron extensively but incompletely escapes Pfizer BNT162b2 neutralization. Nature. 2021;602: 654–656. pmid:35016196
- 22. van der Straten K, Guerra D, van Gils MJ, Bontjer I, Caniels TG, van Willigen HDG, et al. Mapping the antigenic diversification of SARS-CoV-2. MedRxiv Prepr. 2022 [cited 3 Feb 2022].
- 23. Annavajhala MK, Mohri H, Wang P, Nair M, Zucker JE, Sheng Z, et al. Emergence and expansion of SARS-CoV-2 B.1.526 after identification in New York. Nature. 2021;597: 703–708. pmid:34428777
- 24. Schneider CR, Dryhurst S, Kerr J, Freeman ALJ, Recchia G, Spiegelhalter D, et al. COVID-19 risk perception: a longitudinal analysis of its predictors and associations with health protective behaviours in the United Kingdom. J Risk Res. 2021;24: 294–313.
- 25. Qin H, Sanders C, Prasetyo Y, Syukron M, Prentice E. Exploring the dynamic relationships between risk perception and behavior in response to the Coronavirus Disease 2019 (COVID-19) outbreak. Soc Sci Med. 2021;285. pmid:34388619
- 26. Woloshin S, Dewitt B, Krishnamurti T, Fischhoff B. Assessing How Consumers Interpret and Act on Results From At-Home COVID-19 Self-test Kits: A Randomized Clinical Trial. JAMA Intern Med. 2022 [cited 21 Feb 2022]. pmid:35099501
- 27. Peeling RW, Heymann DL, Teo Y-Y, Garcia PJ. Diagnostics for COVID-19: moving from pandemic response to control. Lancet. 2022;399: 757–768. pmid:34942102
- 28. Adamson B, Sikka R, Wyllie AL, Premsrirut P. Discordant SARS-CoV-2 PCR and Rapid Antigen Test Results When Infectious: A December 2021 Occupational Case Series. MedRxiv Prepr. 2022 [cited 3 Feb 2022]. https://www.medrxiv.org/content/10.1101/2022.01.04.22268770v1.
- 29. Schrom J, Marquez C, Pilarowski G, Wang G, Mitchell A, Puccinelli R, et al. Direct Comparison of SARS-CoV-2 Nasal RT-PCR and Rapid Antigen Test (BinaxNOW™) at a Community Testing Site During an Omicron Surge. Ann Intern Med. 2022;175: 682–690. pmid:35286144
- 30.
FDA. Omicron Variant: Impact on Antigen Diagnostic Tests (As of 12/28/2021). 2021 [cited 3 Feb 2022]. https://www.fda.gov/medical-devices/coronavirus-covid-19-and-medical-devices/sars-cov-2-viral-mutations-impact-covid-19-tests#omicronvariantimpact.
- 31. Bekliz M, Adea K, Alvarez C, Essaidi-Laziosi M, Escadafal C, Kaiser L, et al. Analytical sensitivity of seven SARS-CoV-2 antigen-detecting rapid tests for Omicron variant. MedRxiv Prepr. 2021 [cited 3 Feb 2022]. https://www.medrxiv.org/content/10.1101/2021.12.18.21268018v1.
- 32. Marais G, Hsiao N, Iranzadeh A, Doolabh D, Enoch A, Chu C, et al. Saliva swabs are the preferred sample for Omicron detection. MedRxiv Prepr. 2021 [cited 3 Feb 2022].
- 33. Bilal U, Tabb LP, Barber S, Diez Roux A V. Spatial Inequities in COVID-19 Testing, Positivity, Confirmed Cases, and Mortality in 3 U.S. Cities: An Ecological Study. Ann Intern Med. 2021;174: 936–944. pmid:33780289
- 34.
McLaughlin K. Growing use of home COVID-19 tests leaves health agencies in the dark about unreported cases. In: PBS News Hour [Internet]. 2021 [cited 23 Feb 2022]. https://www.pbs.org/newshour/health/growing-use-of-home-covid-19-tests-leaves-health-agencies-in-the-dark-about-unreported-cases.
- 35.
Kasakove S. At-Home Covid Tests Raise Questions About Accurately Counting Cases. In: The New York Times [Internet]. 2021 [cited 23 Feb 2022]. https://www.nytimes.com/2021/12/30/us/at-home-rapid-covid-tests-cases.html.
- 36. Jean S, Burnham C-AD, Chapin K, Garner OB, Pai NP, Turabelidze G, et al. At-Home Testing for Infectious Diseases: The Laboratory Where You Live. Clin Chem. 2022;68: 19–26. pmid:34969103
- 37.
Brennan Center for Justice. Evaluating the Privacy of Covid-19 At-Home Tests. 2021 [cited 3 Feb 2022]. https://www.brennancenter.org/our-work/analysis-opinion/evaluating-privacy-covid-19-home-tests.
- 38.
U.S. Equal Employment Opportunity Commission. What You Should Know About COVID-19 and the ADA, the Rehabilitation Act, and Other EEO Laws. 2021 [cited 3 Feb 2022]. https://www.eeoc.gov/wysk/what-you-should-know-about-covid-19-and-ada-rehabilitation-act-and-other-eeo-laws.
- 39. Ribeiro-Navarrete S, Saura JR, Palacios-Marqués D. Towards a new era of mass data collection: Assessing pandemic surveillance technologies to preserve user privacy. Technol Forecast Soc Change. 2021;167: 120681. pmid:33840865
- 40.
CDC. Self-Testing. 2022 [cited 3 Feb 2022]. https://www.cdc.gov/coronavirus/2019-ncov/testing/self-testing.html.
- 41. Wroe EB, Seung KJ, Baker BK, Farmer PE. Test and treat: a missing link in the global fight against COVID-19. Lancet Glob Heal. 2022;10: e181–e182. pmid:34953515
- 42.
The White House. American Pandemic Preparedness: Transforming Our Capabilities. 2021.
- 43. Kadam R, White W, Banks N, Katz Z, Dittrich S, Kelly-Cirino C. Target Product Profile for a mobile app to read rapid diagnostic tests to strengthen infectious disease surveillance. PLoS One. 2020;15. pmid:31995628