Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Relative contribution of COVID-19 vaccination and SARS-CoV-2 infection to population-level seroprevalence of SARS-CoV-2 spike antibodies in a large integrated health system

  • Tyler C. Chervo,

    Roles Conceptualization, Formal analysis, Methodology, Writing – original draft

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Eric P. Elkin,

    Roles Conceptualization, Formal analysis, Methodology, Writing – review & editing

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Joshua R. Nugent,

    Roles Conceptualization, Formal analysis, Methodology, Writing – review & editing

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Emily Valice,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Laura B. Amsden,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Isaac J. Ergas,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Julie R. Munneke,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Monica Flores,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Gina N. Saelee,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Crystal A. Hsiao,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Jeffery M. Schapiro,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation The Permanente Medical Group, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Charles P. Quesenberry,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Douglas A. Corley,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliations Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America, The Permanente Medical Group, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Laurel A. Habel,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  • Lawrence H. Kushi,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America

  •  [ ... ],
  • Jacek Skarbinski

    Roles Conceptualization, Funding acquisition, Methodology, Supervision, Writing – original draft

    jacek.skarbinski@kp.org

    Affiliations Division of Research, Kaiser Permanente Northern California, Oakland, California, United States of America, The Permanente Medical Group, Kaiser Permanente Northern California, Oakland, California, United States of America, Department of Infectious Diseases, Oakland Medical Center, Kaiser Permanente Northern California, Oakland, California, United States of America, Physician Researcher Program, Kaiser Permanente Northern California, Oakland, California, United States of America

  • [ view all ]
  • [ view less ]

Abstract

Background

Understanding the relative contributions of SARS-CoV-2 infection-induced and vaccine-induced seroprevalence is key to measuring overall population-level seroprevalence and help guide policy decisions.

Methods

Using a series of six population-based cross-sectional surveys conducted among persons aged ≥7 years in a large health system with over 4.5 million members between May 2021 and April 2022, we combined data from the electronic health record (EHR), an electronic survey and SARS-CoV-2 spike antibody binding assay, to assess the relative contributions of infection and vaccination to population-level SARS-CoV-2 seroprevalence. EHR and survey data were incorporated to determine spike antibody positivity due to SARS-CoV-2 infection and COVID-19 vaccination. We used sampling and non-response weighting to create population-level estimates.

Results

We enrolled 4,319 persons over six recruitment waves. SARS-CoV-2 spike antibody seroprevalence increased from 83.3% (CI 77.0–88.9) in May 2021 to 93.5% (CI 89.5–97.5) in April 2022. By April 2022, 68.5% (CI 61.9–74.3) of the population was seropositive from COVID-19 vaccination only, 13.9% (10.7–17.9) from COVID-19 vaccination and prior diagnosed SARS-CoV-2 infection, 8.2% (CI 4.5–14.5) from prior diagnosed SARS-CoV-2 infection only and 2.9% (CI 1.1–7.6) from prior undiagnosed SARS-CoV-2 infection only. We found high agreement (≥97%) between EHR and survey data for ascertaining COVID-19 vaccination and SARS-CoV-2 infection status.

Conclusions

By April 2022, 93.5% of persons had detectable SARS-CoV-2 spike antibody, predominantly from COVID-19 vaccination. In this highly vaccinated population and over 18 months into the pandemic, SARS-CoV-2 infection without COVID-19 vaccination was a small contributor to overall population-level seroprevalence.

Introduction

By the end of January 2022, the United States has recorded over 75 million cases of coronavirus disease 2019 (COVID-19) and over 900,000 deaths [1]. Antibodies that can neutralize severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), the virus that causes COVID-19, can be generated either through SARS-CoV-2 infection or COVID-19 vaccination. A number of studies have reported high SARS-CoV-2 seroprevalence in the United States, but few studies have provided a detailed analysis of spike antibody seropositivity after vaccination and infection, differential seropositivity by demographic and clinical factors, or documented seropositivity over time.

In addition, seropositivity ascertainment may be biased by misclassification, and few studies have used multiple data sources (e.g., detailed electronic health records (EHR) and patient surveys) to comprehensively assess seropositivity in the population. Some studies have focused on easily accessible subsets of the population such as blood donors or commercial laboratory samples, which may not generalize well to other populations [24]. In addition, despite numerous studies from the pre-vaccination era relatively few studies have been conducted when COVID-19 vaccines have been widely available [5].

To address these gaps, we conducted six serial population-based cross-sectional serosurveys in a large integrated health system in California and combined data from the electronic health record (EHR) on COVID-19 vaccination and diagnosed SARS-CoV-2 infection, self-report of COVID-19 vaccination and SARS-CoV-2 infection on an electronic survey, and SARS-CoV-2 spike antibody binding assay test results to assess SARS-CoV-2 spike antibody seroprevalence over time. In addition, we examined the relative contributions of COVID-19 vaccination and SARS-CoV-2 infection to overall seroprevalence, identified demographic and clinical factors associated with seropositivity after COVID-19 vaccination or SARS-CoV-2 infection, and assessed the agreement between EHR, survey and SARS-CoV-2 spike antibody testing to ascertain COVID-19 vaccination and SARS-CoV-2 infection status.

Materials and methods

Setting

Kaiser Permanente Northern California (KPNC) is a large, integrated healthcare system that serves >4.5 million people in northern and central California. KPNC health plan members receive almost all preventive health services, including COVID-19 vaccination, and clinical care (e.g., SARS-CoV-2 diagnostic testing and treatment) within a closed network that includes 210 medical offices and 21 hospitals. KPNC provides health insurance and health care services to over 30% of the population within the counties in which KPNC has a physical presence. The demographic and socioeconomic characteristics of KPNC members closely approximate the region’s diverse demographics and includes patients with Medicare, Medicaid, and commercial insurance [6].

Study design, sampling, recruitment, and SARS-CoV-2 serological testing

We conducted six serial population-based cross-sectional studies that combine EHR clinical data, participant self-report from an electronic survey, and SARS-CoV-2 spike antibody testing to estimate SARS-CoV-2 spike antibody seroprevalence. For each wave of data collection, we developed a sampling frame of all KPNC members aged ≥7 years with active membership status for at least two months prior to the sampling date. We excluded persons who: 1) were known to be deceased on sampling date; 2) were known to have declined contact for all future studies at KPNC; 3) were previously sampled to participate in this study; 4) had no known email address on file; 5) were aged <18 years and did not have an identified parent or guardian in the EHR.

Using the sampling frame above, we selected six independent samples for six recruitment waves and sampling dates: Wave 1 (May 3rd, 2021), Wave 2 (May 25th, 2021), Wave 3 (July 29th, 2021), Wave 4 (September 8th, 2021), Wave 5 (October 12th, 2021), Wave 6 (December 20th, 2021). For each wave, we sampled 11,370 eligible persons using stratified random sampling with strata defined as age group in years (7–17, 18–44, 45–64, 65+) and race/ethnicity (white, Latinx/Hispanic, Asian, Black, other) combinations with selection probability proportional-to-size in all strata except Black persons. We oversampled Black persons in all age group strata three-fold to increase the sample size for this population. All activities involving human subjects were reviewed and ethically approved by the KPNC Institutional Review Board.

All sampled persons received up to three recruitment emails inviting them to participate in the survey. Persons who agreed to participate completed an electronic survey on demographics, COVID-19 prevention measures, self-reported vaccination status, and prior SARS-CoV-2 testing and infection. All persons who agreed to participate had a blood sample drawn for SARS-CoV-2 antibody testing at their local KPNC facility. Serology assays were conducted at our regional laboratory using the Diasorin Liaison SARS-CoV-2 S1/S2 IgG test which has been found to have a specificity of 98.9% and a sensitivity of 96.2% [7,8]. This assay is used clinically in the KPNC health system, which provides a binary (positive/negative) result for the presence of SARS-CoV-2 spike binding antibody. Blood draws for each wave occurred during the following time periods: Wave 1 (May 2021–August 2021; median May 5, 2021), Wave 2 (June 2021 –September 2021; median June 26, 2021), Wave 3 (August 2021 –February 2022; median August 27, 2021), Wave 4 (September 2021 –January 2022; median September 28, 2021), Wave 5 (October 2021 –February 2022; median October 30, 2021), and Wave 6 (January 2022 –April 2022; median January 24, 2022).

Objectives and variable definitions

The primary objective was to estimate the prevalence of anti-SARS-CoV-2 spike binding antibody seropositivity and assess the relative contributions of COVID-19 vaccination, diagnosed SARS-CoV-2 infection, and undiagnosed SARS-CoV-2 infection to overall population-level seroprevalence in our healthcare system. Diagnosed SARS-CoV-2 infection was based on having at least one of the following: a positive SARS-CoV-2 nucleic acid amplification test (NAAT) or antigen test in the EHR, a COVID-19 diagnosis in the EHR in absence of a positive lab result due to reporting a positive test, or self-report of COVID-19 in the survey. Undiagnosed SARS-CoV-2 infection was defined as a positive spike antibody test among participants with no COVID-19 vaccination or diagnosed SARS-CoV-2 infection. The secondary objectives were: 1) to assess factors associated with seropositivity among persons vaccinated for COVID-19; 2) identify agreement between EHR and patient reported vaccination and infection status.

We assessed receipt of all doses of COVID-19 vaccines BNT162b2 [Pfizer/BioNTech], mRNA-1273 [Moderna/National Institutes of Health] or Ad.26.COV2.s [Janssen] prior to blood collection date in the EHR. Vaccination information was obtained from the EHR or from the California Immunization Registry; all vaccine providers in the state are required to report vaccine administration within 24 hours of administration. COVID-19 vaccination status was classified as: 1) Completed primary series, which includes persons who received one dose of Ad.26.COV2.s or 2 doses of BNT162b2 or m-RNA-1273; 2) Completed primary series plus an additional dose, which includes persons who completed a primary series and received at least one addition dose of any COVID-19 vaccine (Ad.26.COV2.s, BNT162b2 or m-RNA-1273); 3) Other, which includes persons who received one dose of either BNT162b2 or m-RNA-1273, another vaccine product, or an unapproved combination of vaccines; 4) unvaccinated, which includes persons who have not received any COVID-19 vaccine. COVID-19 vaccination and SARS-CoV-2 infection were assessed via self-report in the survey using the question “Have you received a COVID-19 vaccine?” and “Have you ever been diagnosed with COVID-19?”, respectively.

Other variables of interest included demographic characteristics (age, sex, race/ethnicity), body mass index, Charlson comorbidity index score [9] and individual Charlson comorbidities. Individual Charlson comorbidity categories were reclassified into the following: 1) atherosclerotic cardiovascular disease includes persons with prior myocardial infarction, congestive heart failure, peripheral vascular disease, and prior cerebrovascular event; 2) diabetes includes persons with diabetes with and without end-organ damage; 3) cancer includes persons with solid tumor with localized or metastatic disease, or leukemia and lymphoma.

Weighting

Sampling weights were calculated as the inverse of the probability of selection within a given age and race strata. We adjusted for non-response bias by calculating a response weight defined as the inverse of the probability of having completed the survey and SARS-CoV-2 spike antibody testing. This probability was calculated using the “SuperLearner” package for the R programming language [10], which evaluates several candidate algorithms for model fitting and creates a weighted ensemble model from these candidate algorithms. The variables used in non-response weighting were recruitment wave, age group, sex, race/ethnicity, geographic area, Charlson comorbidity index score category, preferred language, body mass index category, COVID-19 vaccination status and prior SARS-CoV2 infection in the EHR. Non-response weights were normalized to the size of the eligible sampled population and trimmed such that the maximum trimmed weight was the 99th percentile of the untrimmed weights. The final weight used in the analysis was the product of the sampling weight and the non-response weight.

Statistical methods

To estimate the prevalence of anti-SARS-CoV-2 spike antibody seropositivity in northern and central California, we calculated weighted frequencies and 95% confidence intervals (CIs). Contributions to population-level seroprevalence from prior infection, vaccination, or both were calculated as the percent of persons who tested positive for anti-SARS-CoV-2 spike antibodies and were in one of the above categories (ex. Antibody positive and has only been vaccinated). We assessed whether anti-SARS-CoV-2 seropositivity varied by levels of select demographic and clinical characteristics by performing a Chi-square test with Rao & Scott’s correction [11]. To assess seropositivity among persons vaccinated for COVID-19, we used a modified log-Poisson regression with robust standard errors [12] to estimate the adjusted prevalence ratio of anti-SARS-CoV-2 antibodies by age group, sex, race/ethnicity, Charlson comorbidity index score, chronic obstructive pulmonary disease, chronic kidney disease, atherosclerotic cardiovascular disease, cancer, diabetes, body mass index category, COVID-19 vaccination doses, product and months since last vaccine dose. Concordance between EHR and survey ascertainment of COVID-19 vaccination and SARS-CoV-2 infection was assessed by calculating unadjusted percentages. A two-sided p-value less than 0.05 is considered to be statistically significant. All analyses were performed in R version 4.0.2.

Ethics statement

The study was approved by the KPNC Institutional Review Board [IRB # 1655522]. Written consent was obtained for all participants in this study.

Results and discussion

Of 3.5 million eligible KPNC members, we sampled 11,300 people per wave for a total of 67,800 people; of these sampled persons, 67,108 were found to be eligible during recruitment and 4,319 (6.4%) persons agreed to participate and completed the electronic survey and SARS-CoV-2 spike antibody testing (S1 Fig). Significant differences between respondents and non-respondents in each wave included recruitment wave, age group, sex, race/ethnicity, geographic area, Charlson comorbidity index score category, body mass index category, COVID-19 vaccination status and prior SARS-CoV2 infection in the EHR with standardized mean differences >0.20 (S1 Table). After applying non-response weights, the standardized mean differences between respondents and non-respondents across all characteristics were <0.20 except for combination of prior COVID-19 vaccination and SARS-CoV-2 infection at time of serology testing (0.28).

Across all six waves of data collection, 20% were aged 65+ years or older, 56% were female, 6.0% Black, 19% Hispanic, and 64% had a Charlson comorbidity index score of 0 (Table 1). In all, 75% had received COVID-19 vaccination only, 7.2% had received COVID-19 vaccination and had a diagnosed SARS-CoV-2 infection, 5.0% had prior diagnosed SARS-CoV-2 infection only and 13% had no COVID-19 vaccination or diagnosed SARS-CoV-2 infection. Overall, 69% had completed a primary COVID-19 vaccination series and 9.8% had completed a primary series and an additional dose; 45% received BNT162b2 (Pfizer/BioNTech) and 32% received mRNA-1273 (Moderna/NIH).

thumbnail
Table 1. Characteristics of eligible persons and prevalence of SARS-CoV-2 spike antibody positivity in in Kaiser Permanente Northern California, May 2021—April 2022.

https://doi.org/10.1371/journal.pone.0303303.t001

Across all six waves, 87.5% had detectable SARS-CoV-2 spike antibody, with a range of 83.3% in Wave 1 (median test date May 5, 2021) to 93.5% in Wave 6 (median test date January 24, 2022). We found differences in seroprevalence by age group (e.g., aged 7–17 years 63.3% versus aged 65+ years 94.1%) and race/ethnicity (Black 80.6% versus Asian 94.3%). Seroprevalence was higher among persons who received COVID-19 vaccination only (99.0%) versus persons with prior diagnosed SARS-CoV-2 infection only (88.5%). Among persons who had no prior COVID-19 vaccination or diagnosed SARS-CoV-2 infection, 12.7% had detectable SARS-CoV-2 spike antibody.

Within our healthcare system, from May 2021 to April 2022, SARS-CoV-2 infection incidence peaked in August 2021 (during circulation of the Delta variant; B.1.617.2) and January 2022 (during circulation of the Omicron variant; B.1.1.529) (Fig 1, panel A) and the percentage of all persons in our health system who received at least one COVID-19 vaccination increased from 38% in May 2021 to 70.4% in February 2022 (Fig 1, panel B). COVID-19 vaccination was the main driver of increasing seroprevalence in our healthcare system (Table 2). The contribution to population level seroprevalence by people with diagnosed SARS-CoV-2 infection increased from 8.3% in Wave 1 to 22.1% by Wave 6. Overall, only a small percentage had undiagnosed SARS-CoV-2 infection (positive spike antibody test among participants with no COVID-19 vaccination or diagnosed SARS-CoV-2 infection) (e.g., 2.9% in wave 6).

thumbnail
Fig 1.

Panel A. COVID-19 cases diagnosed in Kaiser Permanente Northern California June 2021 –February 2022 by week. Panel B. Percentage of Kaiser Permanente Northern California members who have received at least one COVID-19 vaccine May 2021 –February 2022. Panel C. Relative contributions of COVID-19 vaccination, and diagnosed and undiagnosed SARS-CoV-2 infection to population-level prevalence of anti-SARS-CoV-2 spike protein antibody by recruitment wave, May 2021 –April 2022. The dashed line in Panel C represents the average level of seroprevalence across the study’s duration. Note: COVID-19 vaccination based on electronic health record or self-report on survey. Diagnosed SARS-CoV-2 infection was defined as a positive SARS-CoV-2 nucleic acid amplification test (NAAT) or antigen test recorded in the EHR or self-report of COVID-19 in the survey. Undiagnosed SARS-CoV-2 infection was defined as a positive spike antibody test among participants with no COVID-19 vaccination or diagnosed SARS-CoV-2 infection. COVID-19 vaccination status was classified as: 1) Completed primary series, which includes persons who received one dose of Ad.26.COV2.s or 2 doses of BNT162b2 or m-RNA-1273; 2) Completed primary series plus an additional dose, which includes persons who completed a primary series and received at least one addition dose of any COVID-19 vaccine (Ad.26.COV2.s, BNT162b2 or m-RNA-1273); 3) Other, which includes persons who received one dose of either BNT162b2 or m-RNA-1273, another vaccine product, or an unapproved combination of vaccines.

https://doi.org/10.1371/journal.pone.0303303.g001

thumbnail
Table 2. Relative contributions of COVID-19 vaccination, and diagnosed and undiagnosed SARS-CoV-2 infection to population-level prevalence of anti-SARS-CoV-2 spike protein antibody by recruitment wave in Kaiser Permanente Northern California, May 2021—April 2022.

https://doi.org/10.1371/journal.pone.0303303.t002

We assessed factors associated with detectable SARS-CoV-2 spike antibodies among persons who received a complete primary COVID-19 vaccination series with or without an additional dose and who had no prior diagnosed SARS-CoV-2 infection (Table 3). Overall, 99% had detectable SARS-CoV-2 spike antibodies. Factors significantly associated with detectable SARS-CoV-2 spike antibodies among vaccinated persons were Asian race (adjusted prevalence ratio [aPR] 1.01; CI 1.00–1.01) and Black race (aPR 1.01; CI 1.01–1.02) relative to White race and having completed a primary COVID-19 vaccination series plus an additional dose relative to having completed a primary series only (aPR 1.01; CI 1.00–1.02).

thumbnail
Table 3. SARS-CoV-2 spike antibody seropositivity and factors associated with seropositivity among persons with SARS-CoV-2 spike protein seropositivity among persons who completed at least a COVID-19 primary vaccination series and had no history of diagnosed SARS-CoV-2 infection, Kaiser Permanente Northern California, May 2021—January 2022.

https://doi.org/10.1371/journal.pone.0303303.t003

Model adjusting for age group in years, sex, race/ethnicity, charlson comorbidity index score, chronic obstructive pulmonary disease status, chronic kidney disease status, atherosclerotic cardiovascular disease status, cancer status, diabetes status, body mass index category, COVID-19 vaccination series in the EHR, COVID-19 vaccination product in the EHR, and months since vaccination.

For ascertainment of COVID-19 vaccination status and prior diagnosed SARS-CoV-2 infection, the EHR and patient self-report had 99.1% agreement for COVID-19 vaccination and 97.1% for prior infection (Table 4). However, the EHR only identified 74.4% of diagnosed prior infections (sensitivity) compared to the survey using self-report as the gold standard. For ascertainment of prior SARS-CoV-2 spike antigen exposure as measured by SARS-CoV-2 spike antibody testing, spike antibody test results had 98.5% agreement with EHR or patient self-report of COVID-19 vaccination or prior diagnosed infection (Table 5).

thumbnail
Table 4. Concordance of data from electronic health record and patient self-report on electronic survey for COVID-19 vaccination and prior diagnosed SARS-CoV-2 infection status in Kaiser Permanente Northern California, May 2021—April 2022 (N = 4,220).

https://doi.org/10.1371/journal.pone.0303303.t004

thumbnail
Table 5. Concordance of COVID-19 vaccination and diagnosed SARS-CoV-2 infection status and SARS-CoV-2 spike antibody results in Kaiser Permanente Northern California, May 2021—April 2022 (N = 4,319).

https://doi.org/10.1371/journal.pone.0303303.t005

Conclusions

In this series of six cross-sectional population-based serosurveys with linked EHR and self-reported survey data in a large integrated health system in California, we found that by the end of our sixth recruitment wave in April 2022, 93.5% of persons were seropositive for spike antibody, with prior COVID-19 vaccination only being the main contributor (68.5%), followed by diagnosed SARS-CoV-2 COVID-19 vaccination and diagnosed SARS-CoV-2 infection (13.9%) and diagnosed SARS-CoV-2 infection only (8.2%); undiagnosed SARS-CoV-2 infection among unvaccinated persons contributed a small proportion to population level seroprevalence (2.9%). Among persons without prior diagnosed infection who have received at least a primary COVID-19 vaccination series, 99% had detectable SARS-CoV-2 antibodies with minimal differences among sub-groups (e.g., 99.2% among person who received primary series only and 99.9% among person who received a primary series plus an additional dose).

Numerous seroprevalence studies have been conducted to date [2,1316]. Similar to this study, others [14,16] conducted in California around the time of our study period have found high levels of seroprevalence with >90% of persons seropositive for spike antibody by early 2022 due to exposure to COVID-19 vaccination or SARS-CoV-2 infection. Similarly, to other studies, we found that vaccination was the main driver of population-level seroprevalence, but that by April 2022 a substantial percentage of the population had a history of SARS-CoV-2 infection (25%). Although, we did not conduct testing for SARS-CoV-2 infection with nucleocapsid antibody testing, we were able to identify a small percentage of persons who have undiagnosed SARS-CoV-2 infection among those with no recorded or self-reported SARS-CoV-2 infection or vaccination. The estimated fraction of undiagnosed infections has varied across studies, with one US population-based study from early in the pandemic finding an undiagnosed seropositivity rate of 4.6% by mid-July 2020 [17]. Another study conducted in California June–August 2020 estimated that only 31% of infections had been reported to the California Department of Public Health [13]. By the end of our study period, we found that the overall weighted seropositivity among persons without EHR confirmed or self-reported COVID-19 vaccination or SARS-CoV-2 infection to be 12.6%, though we note that we could not identify the prevalence of undiagnosed infections among vaccinated persons. The combined changes in the availability of COVID-19 testing over time and increasing transmissibility of SARS-CoV-2 variants will change the proportion of infections that go undiagnosed over time and further studies of this type, including among vaccinated persons, are important to estimating this proportion.

The rise of new variants of SARS-CoV-2 made noticeable changes to the contribution of COVID-19 vaccination and prior SARS-CoV-2 upon the emergence of the “Omicron” variant of SARS-CoV-2. During recruitment waves one and two, the dominant SARS-CoV-2 variant began transitioning from the “Alpha” variant to the “Delta” variant of SARS-CoV-2 [18]. Despite the increased immune evasiveness of this variant, including evasiveness to vaccine-derived antibodies [19], we did not see a large increase in contributions due to prior SARS-CoV-2 infection or “hybrid immunity” from COVID-19 infection plus prior SARS-CoV-2 infection. This observation held through recruitment waves three through five. However, after the emergence of the Omicron variant in late 2021 [18], we observed a substantial increase in contributions from these categories. In recruitment wave six in which the median blood draw date occurred around January 2022, contributions to population level immunity from prior SARS-CoV-2 infection and COVID-19 vaccination plus prior SARS-CoV-2 infection more than doubled. These findings show that even in a population with high pre-existing levels of population immunity, highly immune evasive variants of SARS-CoV-2 are still capable of causing a substantial number of new infections.

Seroprevalence was high among most demographic groups, except for children aged 7–17 years; this likely represents lower COVID-19 vaccination rates as recommendations for COVID-19 vaccination lagged for children compared to adults. In addition, seropositivity was lower among Black Americans (80.6%) compared with Asian Americans (94.3%) suggesting racial/ethnicity disparities in COVID-19 vaccination rates since vaccination is the major driver of seroprevalence in our healthcare system. Other research has shown disparities in COVID-19 vaccine uptake by race due to a variety of causes [20,21], Addressing disparities in vaccine uptake among different race/ethnic groups will contribute to reducing disparities in COVID-19 morbidity and mortality [22].

Seropositivity among persons who received COVID-19 vaccination was very high (99%) overall and minimal differences were noted by demographic or clinical characteristics. The commercially available assay used in this study is highly sensitive and seropositivity after vaccination is almost uniformly high. However, these binding antibody assays might not correlate with viral neutralization assays or accurately predict protection from future SARS-CoV-2 infection or severe COVID-19 and thus have limited clinical utility for assessing vaccine effectiveness.

Lastly, we found high levels of agreement between EHR and patient self-report via survey to ascertain prior COVID-19 vaccination or diagnosed SARS-CoV-2 infection as well as agreement between EHR or self-reported prior SARS-CoV2 spike antigen exposure and spike antibody test results. Given the transition in COVID-19 surveillance with ever greater reliance on EHR data to monitor COVID-19 vaccination or SARS-CoV-2 infections to guide policy decisions, this study provides reassurance that EHRs can be used for SARS-CoV-2 disease monitoring. These findings are comparable to other studies that have evaluated the concordance of EHR and survey data for SARS-CoV-2 infection [23].

This study has several limitations. First, we only used spike antibody testing, which can be positive after either COVID-19 vaccination or SARS-CoV-2 infection but did not use an antibody test targeting the nucleocapsid antigen that can be used to detect SARS-CoV-2 infection alone. This has limited our ability to detect the full set of undiagnosed SARS-CoV-2 infections, particularly among vaccinated persons, and thus our estimate of persons with undiagnosed SARS-CoV-2 infection across the duration of the study is likely an underestimate. Second, although we have used standard population-based sampling and weighting methods, our overall response rate is modest and thus the respondent population may not be representative of the general population. This was mitigated in part by use of detailed EHR data on all sampled persons to create non-response weights. Additionally, some patients experience with SARS-CoV-2 may have made them more likely to remember an infection than others, which could potentially bias the results of the study.

In conclusion, we found that by the end of our study, 93.5% of persons were seropositive for spike antibody with the majority of seropositivity coming from COVID-19 vaccination. Seroprevalence was high among all groups except children aged 7–17 years, and almost all persons had detectable SARS-CoV-2 spike antibodies after COVID-19 vaccination. Within our healthcare system, COVID-19 vaccination was the main contributor to overall population-level seroprevalence.

Supporting information

S1 Fig. Sampling, inclusions, and exclusions from the Kaiser Permanente Northern California member population May 2021—December 2021 that lead to the creation of our study population.

To be eligible for sampling, members needed to be enrolled in Kaiser Permanente Northern Calfornia membership for at least two months prior to the sampling date, be at least 7 years old on the sampling date, not listed in the “Do not contact” file for study participation, and had not been invited to a previous to a previous Kaiser Permanente Northern California COVID-19 serology study. Wave 1 only included English speaking members.

https://doi.org/10.1371/journal.pone.0303303.s001

(PDF)

S1 Table. Characteristics of the eligible Kaiser Permanente Northern California (KPNC) population May 2021—April 2022 and non-respondent sampled population compared to respondent population before and after weighting.

https://doi.org/10.1371/journal.pone.0303303.s002

(DOCX)

Acknowledgments

All authors contributed to conceptual ideas and contributed to methodology. TCC, EPE, JRN contributed to formal analysis; TCC, JS contributed to writing and original draft preparation; All authors contributed to writing, reviewing, and editing the manuscript; JS supervised the work. The authors are grateful to all Kaiser Permanente members without whom this study would not have been possible.

References

  1. 1. CDC. COVID Data Tracker. In: Centers for Disease Control and Prevention [Internet]. 28 Mar 2020 [cited 12 Jun 2023]. Available: https://covid.cdc.gov/covid-data-tracker.
  2. 2. Jones JM. Estimates of SARS-CoV-2 Seroprevalence and Incidence of Primary SARS-CoV-2 Infections Among Blood Donors, by COVID-19 Vaccination Status—United States, April 2021–September 2022. MMWR Morb Mortal Wkly Rep. 2023;72. pmid:37262007
  3. 3. Li Z, Lewis B, Berney K, Hallisey E, Williams AM, Whiteman A, et al. Social vulnerability and rurality associated with higher SARS-CoV-2 infection-induced seroprevalence: a nationwide blood donor study, United States, July 2020 –June 2021. Clin Infect Dis Off Publ Infect Dis Soc Am. 2022; ciac105. pmid:35137014
  4. 4. Clarke KEN. Seroprevalence of Infection-Induced SARS-CoV-2 Antibodies—United States, September 2021–February 2022. MMWR Morb Mortal Wkly Rep. 2022;71. pmid:35482574
  5. 5. Wiegand RE, Deng Y, Deng X, Lee A, Meyer WA, Letovsky S, et al. Estimated SARS-CoV-2 antibody seroprevalence trends and relationship to reported case prevalence from a repeated, cross-sectional study in the 50 states and the District of Columbia, United States—October 25, 2020–February 26, 2022. Lancet Reg Health–Am. 2023;18. pmid:36479424
  6. 6. Davis AC, Voelkel JL, Remmers CL, Adams JL, McGlynn EA. Comparing Kaiser Permanente Members to the General Population: Implications for Generalizability of Research. Perm J. 2023;27: 87–98. pmid:37170584
  7. 7. DiaSorin Inc. LIASON SARS-CoV-2 S1/S2 IgG—Instructions for use. [cited 28 Jun 2023]. https://www.fda.gov/media/137359/download.
  8. 8. Ainsworth M, Andersson M, Auckland K, Baillie JK, Barnes E, Beer S, et al. Performance characteristics of five immunoassays for SARS-CoV-2: a head-to-head benchmark comparison. Lancet Infect Dis. 2020;20: 1390–1400. pmid:32979318
  9. 9. Charlson M, Szatrowski TP, Peterson J, Gold J. Validation of a combined comorbidity index. J Clin Epidemiol. 1994;47: 1245–1251. pmid:7722560
  10. 10. van der Laan MJ, Polley EC, Hubbard AE. Super Learner. Stat Appl Genet Mol Biol. 2007;6. pmid:17910531
  11. 11. Rao JNK, Scott AJ. On Chi-Squared Tests for Multiway Contingency Tables with Cell Proportions Estimated from Survey Data. Ann Stat. 1984;12: 46–60.
  12. 12. Zou G. A modified poisson regression approach to prospective studies with binary data. Am J Epidemiol. 2004;159: 702–706. pmid:15033648
  13. 13. Lamba K, Bradley H, Shioda K, Sullivan PS, Luisi N, Hall EW, et al. SARS-CoV-2 Cumulative Incidence and Period Seroprevalence: Results From a Statewide Population-Based Serosurvey in California. Open Forum Infect Dis. 2021;8: ofab379. pmid:34377733
  14. 14. Mehrotra ML, Lim E, Lamba K, Kamali A, Lai KW, Meza E, et al. CalScope: Monitoring Severe Acute Respiratory Syndrome Coronavirus 2 Seroprevalence From Vaccination and Prior Infection in Adults and Children in California May 2021–July 2021. Open Forum Infect Dis. 2022;9: ofac246. pmid:35855959
  15. 15. Adams C, Horton M, Solomon O, Wong M, Wu SL, Fuller S, et al. Health inequities in SARS-CoV-2 infection, seroprevalence, and COVID-19 vaccination: Results from the East Bay COVID-19 study. PLOS Glob Public Health. 2022;2: e0000647. pmid:36962725
  16. 16. Mehrotra M. CalScope Wave 2 Findings. [cited 29 Jun 2023]. https://www.cdph.ca.gov/Programs/CID/DCDC/CDPH%20Document%20Library/COVID-19/CalScope/Wave2Findings.pdf.
  17. 17. Undiagnosed SARS-CoV-2 seropositivity during the first 6 months of the COVID-19 pandemic in the United States. [cited 22 Jun 2023].
  18. 18. Lambrou AS. Genomic Surveillance for SARS-CoV-2 Variants: Predominance of the Delta (B.1.617.2) and Omicron (B.1.1.529) Variants—United States, June 2021–January 2022. MMWR Morb Mortal Wkly Rep. 2022;71. pmid:35143464
  19. 19. Mlcochova P, Kemp SA, Dhar MS, Papa G, Meng B, Ferreira IATM, et al. SARS-CoV-2 B.1.617.2 Delta variant replication and immune evasion. Nature. 2021;599: 114–119. pmid:34488225
  20. 20. Siegel M, Critchfield-Jain I, Boykin M, Owens A, Muratore R, Nunn T, et al. Racial/Ethnic Disparities in State-Level COVID-19 Vaccination Rates and Their Association with Structural Racism. J Racial Ethn Health Disparities. 2022;9: 2361–2374. pmid:34713336
  21. 21. Malik AA, McFadden SM, Elharake J, Omer SB. Determinants of COVID-19 vaccine acceptance in the US. EClinicalMedicine. 2020;26: 100495. pmid:32838242
  22. 22. Dada D, Djiometio JN, McFadden SM, Demeke J, Vlahov D, Wilton L, et al. Strategies That Promote Equity in COVID-19 Vaccine Uptake for Black Communities: a Review. J Urban Health. 2022;99: 15–27. pmid:35018612
  23. 23. Johnson RK, Marker KM, Mayer D, Shortt J, Kao D, Barnes KC, et al. COVID-19 Surveillance in the Biobank at the Colorado Center for Personalized Medicine: Observational Study. JMIR Public Health Surveill. 2022;8: e37327. pmid:35486493