Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Monovalent mRNA XBB.1.5 vaccine effectiveness against COVID-19 hospitalization in Quebec, Canada: Impact of variant replacement and waning protection during 10-month follow-up

  • Sara Carazo ,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Validation, Writing – original draft, Writing – review & editing

    sara.carazo@inspq.qc.ca (SC); charles-antoine.guay.med@ssss.gouv.qc.ca (CAG)

    Affiliations Biological risks unit. Institut national de santé publique du Québec, Quebec City, Quebec, Canada, Department of social and preventive medicine, Faculty of medicine, Laval University, Quebec City, Quebec, Canada, Centre Hospitalier Universitaire (CHU) de Québec–Université Laval Research Center, Quebec City, Quebec, Canada

  • Danuta M. Skowronski,

    Roles Conceptualization, Methodology, Supervision, Writing – review & editing

    Affiliation Communicable Diseases and Immunization Services, BC Centre for Disease Control, Vancouver, British Columbia, Canada

  • Nicholas Brousseau,

    Roles Investigation, Validation, Writing – review & editing

    Affiliations Biological risks unit. Institut national de santé publique du Québec, Quebec City, Quebec, Canada, Department of social and preventive medicine, Faculty of medicine, Laval University, Quebec City, Quebec, Canada, Centre Hospitalier Universitaire (CHU) de Québec–Université Laval Research Center, Quebec City, Quebec, Canada

  • Charles-Antoine Guay ,

    Roles Investigation, Validation, Writing – review & editing

    sara.carazo@inspq.qc.ca (SC); charles-antoine.guay.med@ssss.gouv.qc.ca (CAG)

    Affiliations Department of social and preventive medicine, Faculty of medicine, Laval University, Quebec City, Quebec, Canada, Centre de Recherche de l’Institut Universitaire de Cardiologie et de Pneumologie de Québec, Quebec City, Quebec, Canada, Department of community health sciences, Faculty of medicine and health sciences, Sherbrooke University, Sherbrooke, Canada

  • Chantal Sauvageau,

    Roles Methodology, Validation, Writing – review & editing

    Affiliations Biological risks unit. Institut national de santé publique du Québec, Quebec City, Quebec, Canada, Department of social and preventive medicine, Faculty of medicine, Laval University, Quebec City, Quebec, Canada, Centre Hospitalier Universitaire (CHU) de Québec–Université Laval Research Center, Quebec City, Quebec, Canada

  • Étienne Racine,

    Roles Methodology, Validation, Writing – review & editing

    Affiliations Biological risks unit. Institut national de santé publique du Québec, Quebec City, Quebec, Canada, Department of social and preventive medicine, Faculty of medicine, Laval University, Quebec City, Quebec, Canada, Centre Hospitalier Universitaire (CHU) de Québec–Université Laval Research Center, Quebec City, Quebec, Canada

  • Denis Talbot,

    Roles Methodology, Writing – review & editing

    Affiliations Department of social and preventive medicine, Faculty of medicine, Laval University, Quebec City, Quebec, Canada, Centre Hospitalier Universitaire (CHU) de Québec–Université Laval Research Center, Quebec City, Quebec, Canada

  • Iulia Gabriela Ionescu,

    Roles Investigation, Validation, Writing – review & editing

    Affiliation Biological risks unit. Institut national de santé publique du Québec, Quebec City, Quebec, Canada

  • Judith Fafard,

    Roles Writing – review & editing

    Affiliation Laboratory of Quebec Public Health, Institut national de santé publique du Québec, Sainte-Anne-de-Bellevue, Quebec, Canada

  • Rodica Gilca,

    Roles Investigation, Validation, Writing – review & editing

    Affiliations Biological risks unit. Institut national de santé publique du Québec, Quebec City, Quebec, Canada, Department of social and preventive medicine, Faculty of medicine, Laval University, Quebec City, Quebec, Canada, Centre Hospitalier Universitaire (CHU) de Québec–Université Laval Research Center, Quebec City, Quebec, Canada

  • Jonathan Phimmasone,

    Roles Formal analysis, Methodology, Writing – review & editing

    Affiliation Biological risks unit. Institut national de santé publique du Québec, Quebec City, Quebec, Canada

  • Philippe De Wals,

    Roles Investigation, Validation, Writing – review & editing

    Affiliations Biological risks unit. Institut national de santé publique du Québec, Quebec City, Quebec, Canada, Department of social and preventive medicine, Faculty of medicine, Laval University, Quebec City, Quebec, Canada, Centre Hospitalier Universitaire (CHU) de Québec–Université Laval Research Center, Quebec City, Quebec, Canada

  • Gaston De Serres

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Supervision, Validation, Writing – review & editing

    Affiliation Department of social and preventive medicine, Faculty of medicine, Laval University, Quebec City, Quebec, Canada

Abstract

Background

Vaccine formulations targeting contemporaneous subvariants have been developed to respond to SARS-CoV-2 virus evolution. Updated monovalent COVID-19 vaccines targeting the Omicron XBB.1.5 variant (XBB-vaccines) were administered in the province of Quebec, Canada, during 2023 autumn and 2024 spring vaccination campaigns. Our objective was to evaluate mRNA XBB-vaccine effectiveness (VE) against COVID-19 hospitalizations among adults aged ≥60 years overall during a ten-month follow-up period, by subvariant predominant period, and by time since vaccination.

Methods

We conducted a test-negative case-control study using Quebec population-based administrative data. Specimens collected from individuals aged ≥60 years tested at an acute-care hospital from October 2023 to August 2024 were considered test-positive cases if hospitalized for COVID-19, or controls if test-negative for SARS-CoV-2. Vaccination was defined by receipt of at least one mRNA XBB-vaccine (autumn or spring) dose. Subvariant predominant periods were defined according to whole-genome sequencing data from provincial laboratories: XBB or EG.5 and subvariants (XBB period), BA.2.86, JN.1 or subvariants (JN period), and KP.2 or KP.3 and subvariants (KP period). Multivariable logistic regression analyses estimated VE relative to several comparator groups, primarily those last-vaccinated in 2022, by subvariant period, by time since XBB-vaccination and by number of XBB-vaccine doses (KP period).

Results

Participants overall and by XBB, JN and KP periods included: 5532 (4.9%) test-positive cases (1321, 1838 and 1372, respectively) and 108473 (95.1%) test-negative controls (12881, 53414 and 28595, respectively); 14584 specimens were collected during periods of subvariant cocirculation. By subvariant period, 3322 (25.8%), 27041 (50.6%) and 15401 (53.9%) controls, respectively, were considered XBB-vaccinated. Overall VE was 30% (95%CI:24–35) and by XBB, JN or KP period: 54% (95%CI:46–62), 23% (95%CI:13–32) and 0% (95%CI:-18–15), respectively. During each subvariant period, the hospitalization risk was reduced only during the first four months post-vaccination.

Conclusions

Among individuals aged 60 years or older, mRNA XBB-vaccination provided meaningful, albeit limited to first four months post-vaccination, protection against COVID-19 hospitalization due to XBB, JN and KP subvariants. Better vaccines are needed to effectively protect older adults against COVID-19 hospitalizations.

Introduction

SARS-CoV-2 viruses continue to evolve, leading to unpredictable worldwide transitions in lineage predominance, mainly driven by emerging subvariants with features of higher transmissibility and/or immune escape [1]. Vaccine formulations targeting contemporaneous subvariants have been developed to respond to virus evolution. Updated monovalent COVID-19 vaccines targeting the Omicron XBB.1.5 variant (XBB-vaccines) were approved in Canada and the USA in September 2023 [2,3] and administered during 2023 autumn and 2024 spring vaccination campaigns in the province of Quebec, Canada.

Studies evaluating XBB-vaccination have reported early incremental effectiveness (compared to not receiving the XBB-vaccine) of 50–70% to reduce COVID-19 hospitalization risk, but lower protection of 23–54% following replacement of XBB descendants by the Omicron JN.1 sublineage [49]. These studies, however, only included the first three to five months following vaccination campaigns and could not inform duration of protection thereafter. In addition, none assessed vaccine effectiveness (VE) against severe outcomes (i.e., hospitalization or death) associated with subsequently emergent Omicron KP.2 and KP.3 subvariants, which became the predominant circulating lineages by May 2024 [10].

In Quebec, XBB-vaccination was recommended to individuals at high risk of severe outcomes, including older adults aged ≥60 years, who account for the majority of COVID-19 hospitalizations [11]. Using Quebec population-based administrative data, we evaluated effectiveness of mRNA XBB.1.5 vaccination against hospitalizations for COVID-19 from October 2023 to August 2024 among adults aged ≥60 years overall, by period of subvariant predominance, and by time since XBB-vaccination.

Methods

Study design and population

This population-based test-negative case-control study utilizing specimens tested for SARS-CoV-2 at any acute-care hospital in the province of Quebec, compared the XBB-vaccination status of test-positive cases (COVID-19 hospitalizations) with test-negative controls (hospitalized or not). Nucleic acid amplification tests (NAAT) were included if conducted among adults aged ≥60 years who presented in acute-care hospitals with COVID-19 symptoms from October 29, 2023 (epi-week 2023−44) to August 17, 2024 (epi-week 2024−33). Test-positive cases were those with a positive NAAT result and a hospital admission due to COVID-19 within 0–6 days after their test and lasting ≥24 hours. Test-negative controls were those with a negative NAAT result. Analyses are specimen-based: individuals could contribute multiple tests to the analysis.

Procedures

In Quebec, a dose of mRNA XBB-vaccine was recommended for adults aged ≥60 years and other high-risk groups during the autumn campaign commencing September 29, 2023, for long-term care facilities (LTCF) and other congregate living facilities and October 10, 2023 for general population [11]. Influenza and COVID-19 vaccines were offered simultaneously to individuals targeted for both vaccines. A 2024 spring dose of XBB-vaccine (available from April 1, 2024) was recommended for persons aged ≥80 years, those living in LTCF or private homes for older people and immunocompromised individuals [12].

Subvariant identification during the study period was based on whole-genome sequencing of randomly selected specimens among all SARS-CoV-2 positive NAAT. We defined subvariant periods based on >60% predominance reported by these laboratories [13]. In general, XBB subvariants replaced BQ.1 subvariants and were predominant in Quebec starting February 2023. Accordingly, the XBB period spanned from epi-week 2023−44 to 2023−48, during which 69% to 91% of weekly sequenced specimens were XBB and subvariants (18% to 34%) or EG.5 and subvariants (49% to 60%). The JN period spanned from epi-week 2023−52 to 2024−17, during which weekly sequenced specimens that were identified as BA.2.86, JN.1 or subvariants represented 64% to 100% of all specimens. The KP period spanned from epi-week 2024−20 to 2024−33 (end of the study), during which 61% to 80% of weekly-sequenced specimens were KP.2 and subvariants (5% to 19%), or KP.3 and subvariants (38% to 69%) (Fig 1).

thumbnail
Fig 1. Provincial respiratory viruses and SARS-CoV-2 subvariant circulation, doses of XBB-vaccine administered among study participants, and SARS-CoV-2 tests performed in acute-care hospitals by epidemiological week.

Abbreviations: V3-XBB to V7-XBB, XBB-vaccine administered as dose 3 to dose 7. Note 1: Subvariants included as XBB/EG.5 detection: XBB, XBB.1.16, XBB.1.5, XBB.1.9, EG.5.1, HK.3, HV.1; as JN.1 detection: JN.1, BA.2.86; as KP.2/3 detection: KP.2, KP.3, KP.3.1.1, KP.3.1.4. Note 2: XBB-vaccine coverage represents at least one dose of XBB-vaccine among test-negative controls.

https://doi.org/10.1371/journal.pone.0325269.g001

As previously described [14], information on all NAATs for SARS-CoV-2 is centralized in Quebec’s provincial laboratory database. For each NAAT, the reason for testing is documented and, despite some evolution in reporting instructions over time, the code for tests conducted in acute-care hospitals (emergency room or inpatient) due to symptoms compatible with COVID-19 has remained unchanged since 2020. Using a unique personal identifier, we merged this provincial laboratory database with the population-based provincial immunization registry, the hospitalization administrative database and the provincial chronic disease surveillance database [15]. Data were accessed on August 26, 2024.

The primary exposure (XBB-vaccination) was defined as receipt of at least one dose of XBB-vaccine administered at any time throughout the study period (autumn and/or spring campaigns). During the KP period, exposure could include one (autumn or spring) or two (autumn and spring) XBB-vaccine doses, assessed in primary analysis combined but also explored separately stratified by number of XBB-vaccine doses. Time since vaccination was determined as months since last XBB-vaccine administration. Three comparison groups were used: a) latest vaccination with an ancestral mRNA monovalent or bivalent booster vaccine dose received during Quebec’s prior vaccination campaign from July to December 2022 (MV/BV-vaccinated); b) non-XBB vaccination, regardless of the number or timing of previous doses, but excluding individuals having received a non-XBB dose less than 182 days prior to specimen collection (non-XBB-vaccinated); or c) unvaccinated individuals (unvaccinated).

Prior infection was defined as a documented positive SARS-CoV-2 NAAT before October 20, 2023, and ≥90 days before the specimen collection date. We did not have information on the results of rapid antigen detection tests, broadly used since 2022.

We excluded tests from individuals living in a LTCF because their hospital referral criteria differ from those in the general population, and from immunocompromised individuals identified in the chronic disease surveillance database. We additionally excluded tests: a) of specimens collected within seven days prior to a positive test (probable false negative results), or within 90 days after a positive test (compatible with prolonged SARS-CoV-2 shedding); b) with negative results collected within 15 days after a negative test, to include a single test by respiratory episode; c) of individuals with XBB-vaccination <7 days or non-XBB vaccination <182 days before specimen collection; d) of individuals with invalid vaccination dates or intervals, or who received more than seven vaccine doses or were vaccinated only with non-mRNA vaccines; and e) positive tests done in the emergency room that were not followed by hospital admission.

Statistical analyses

We used logistic regression models to derive adjusted odds ratios (OR) and their 95% confidence intervals (95% CI) comparing the odds of XBB-vaccination among positive-test hospitalized cases versus negative-test controls. Estimated VE was calculated as (1 – adjusted OR)*100. We estimated incremental XBB-VE when the comparator was the MV/BV-vaccinated group (main analysis) or alternatively the non-XBB-vaccinated group. Absolute XBB-VE was estimated when the comparator was the unvaccinated group.

All models were adjusted for sex, age group (60–69, 70–79 and ≥80 years), residence (home, private homes for older people), epi-week of specimen collection, chronic respiratory disease, chronic heart disease, cancer, obesity, neurological disease and multimorbidity (at least two chronic diseases) [15].

Waning and subvariant-specific estimates were examined by stratifying by subvariant period, time since XBB-vaccination (one- and two-month intervals) and by four-week calendar periods. Other stratified analyses explored the effect of age, the number of XBB doses during the KP period and hybrid prior infection.

Statistical analyses were performed using SAS (version 9.4).

Ethical considerations

This study was conducted under the legal mandate of the Quebec National Director of Public Health and thus participant consent was waived. It was approved by the ethics committee of the Centre de Recherche du Centre Hospitalier Universitaire du Québec-Université Laval. Analyses were based on anonymized administrative records.

Results

Study population

From the 167,373 NAAT performed among adults aged ≥60 years at acute-care hospitals during the study period, 53,368 (31.9%) tests were excluded: 3,575 (2.1%) for individuals living in LTCF and 10,863 (6.5%) for immunocompromised, 7,621 (4.6%) specimens collected within seven days prior or 90 days after a positive test, 17,672 (10.6%) within 15 days after a negative test, and 6,058 (3.6%) with an excluded vaccination-test interval, more than seven doses, non-mRNA vaccines or invalid dates (S1 Fig in S1 File). We also excluded 7,579 (4.5%) positive-test cases because not hospitalized after ER consultation.

Among the 114,005 NAAT included, 5,532 (4.9%) were from COVID-19 hospitalized cases: 1,321 (23.9%) during the XBB period, 1,838 (33.2%) during the JN period, 1,372 (24.8%) during the KP period and 1,001 (18.1%) during periods of subvariant cocirculation.

Among cases, 2,665 (48.2%) were female, the median age was 80 years (interquartile range (IQR): 73–87), 2,895 (52.3%) were 80 years or older and 4,230 (76.5%) had multimorbidity. Among controls, 55,861 (51.5%) were female, the median age was 77 years (interquartile range (IQR): 69–84), 43,790 (40.4%) were 80 years or older and 77,444 (71.4%) presented with multimorbidity. Sex, age and multimorbidity distribution by case and control status were similar in each subvariant period (Table 1).

thumbnail
Table 1. Characteristics of test-participants included in period and overall analyses.

https://doi.org/10.1371/journal.pone.0325269.t001

By successive XBB, JN and KP subvariant period, 3,322 (25.8%), 27,041 (50.6%) and 15,401 (53.9%) controls were XBB-vaccinated, respectively. Vaccination was associated with older age and multimorbidity (Table 1, S1-S3 Tables in S1 File). Among controls, median time since XBB-vaccination increased by successive subvariant period, from 22 days (IQR: 15–32), to 3 months (IQR: 2–5), to 7 months (IQR: 6–8), respectively. Control XBB-vaccine coverage during the last week of March 2024, before the 2024 spring XBB-vaccination campaign, was 52.8% overall: 37.5%, 53.5% and 61.9%, respectively, for 60–69, 70–79 and ≥80 years. The latter estimates are comparable to population vaccine coverage on April 1, 2024 among Quebec adults: 36.4%, 54.2% and 60.7%, respectively, for 60–69, 70–79 and ≥80 years (Fig 1) [16]. Control vaccine coverage of the spring dose at the end of the study period (August 2024, week 33) was 10.4%, among whom 70.7% had also received an autumn XBB-vaccine dose. A similar proportion of XBB-vaccinated cases (1,636 (77.0%)) and controls (40,463 (77.6%)) had also received an influenza vaccine (S1-S3 Tables in S1 File).

In each subvariant period, a higher proportion of controls than cases had a documented NAAT-confirmed SARS-CoV-2 infection prior to the study period (Table 1). A recent documented infection that occurred between May and October 2023 was more frequent among MV/BV-vaccinated (16%) than among XBB-vaccinated participants (7%), suggesting a possible association between recent infection and delayed vaccination (S2 Fig in S1 File).

Estimated VE

Relative to MV/BV-vaccination, global XBB-VE against COVID-19 hospitalization was 30% (95%CI:24–35): highest during the XBB period at 54% (95%CI:46–62), lower during the JN period at 23% (95%CI:13–32), and with no protection observed during the KP period (VE = 0%; 95%CI:-17–15), when 9.7% of XBB-vaccinated had received 2 doses (Table 2). Estimated VE was similar when compared with non-XBB-vaccinated or with unvaccinated participants, suggesting lack or low residual protection from vaccination prior to the 2023 autumn campaign.

thumbnail
Table 2. XBB-vaccine effectiveness against COVID-19 hospitalization relative to different comparison groups, by subvariant period.

https://doi.org/10.1371/journal.pone.0325269.t002

Stratification for time since XBB-vaccination showed that significant protection against hospitalization was only observed during the first four months post-vaccination for each subvariant period (Fig 2, S4 Table in S1 File). It was higher during the first two months post-vaccination during XBB (VE = 55%; 95%CI:46–62), JN (VE = 23%; 95%CI:9–36) and KP periods (VE = 60%; 95%CI:39–74). As XBB predominance ended epi-week 2023−48, time-since-vaccination beyond two months could not be evaluated. During the JN period, observed VE was 17% (95%CI:-9−36) at five to six months and −5% (95%CI:-160−57) at seven months post-vaccination. During the KP period, effectiveness decreased with time reaching 3% at seven to eight months post-vaccination. After standardisation for time since vaccination during the KP period, a second XBB-dose was associated with similar protection to a single XBB-vaccination through the 4th month post-vaccination, mainly reflecting spring doses (Table 3).

thumbnail
Table 3. XBB vaccine effectiveness against COVID-19 hospitalization relative to monovalent or bivalent vaccination in 2022, by number of XBB-doses during the KP period.

https://doi.org/10.1371/journal.pone.0325269.t003

thumbnail
Fig 2. XBB-vaccine effectiveness against COVID-19 hospitalization relative to monovalent or bivalent vaccination in 2022, by time since XBB-vaccination and subvariant period.

Note: Logistic regression model comparing XBB-vaccinated participants at two-month intervals from vaccination with participants last vaccinated with an ancestral monovalent or a bivalent vaccine from July to December 2022 and adjusted for sex, age group, chronic conditions, place of residence and epi-week (2-week periods for the time since vaccination analyses).

https://doi.org/10.1371/journal.pone.0325269.g002

When stratifying by calendar time, XBB-vaccination was associated with a 50% reduction in COVID-19 hospitalization risk during the first eight weeks of the study period (November and December 2023), decreasing to 30% in January 2024 and to no protection from February to August 2024 (Fig 3). This rapid loss of protection was contemporaneous with increased median time since vaccination, subvariant replacement, and low uptake of the spring dose (Fig 1).

thumbnail
Fig 3. XBB-vaccine effectiveness against COVID-19 hospitalization relative to monovalent or bivalent vaccination in 2022, by calendar time (four epi-week periods).

* XBB, XBB.1.5, XBB.1.9, XBB.1.16, eG.5.1, HK.3, HV.1. ** JN.1, BA.2.86. *** KP.2, KP.3, KP.3.1.1, KP.3.1.4. Note: Logistic regression model comparing XBB-vaccinated participants with participants last vaccinated with an ancestral monovalent or a bivalent vaccine from July to December 2022 and adjusted for sex, age group, chronic conditions, place of residence and two epi-week periods.

https://doi.org/10.1371/journal.pone.0325269.g003

In subgroup analyses, XBB-vaccination among individuals with prior NAAT-confirmed infection compared to MV/BV-vaccinated regardless prior infection was associated with higher point estimates of VE than main global estimates during each subvariant period (74%, 41% and 6% vs. 54%, 23% and 0%, respectively) (S5 Table in S1 File). Overall and subvariant-specific VE estimates were unexpectedly lower for 60- to 69-year-olds than for older groups, but differences decreased in analyses restricted to the first two months post-XBB-vaccination (S6 Table in S1 File).

Discussion

During a ten-month period of follow-up, XBB-vaccinated adults aged 60 years or older had an estimated 30% reduction in their risk of COVID-19 hospitalization. Restricted to the first two months post-vaccination, VE was 55% during the XBB period, 23% during the JN period and 60% during the KP period, but effectiveness waned over time, with minimal to no protection demonstrated beyond fourth months, regardless of the subvariant.

Prior published studies have reported relative XBB-VE of 53% to 67% against hospitalization related to XBB lineages. These estimates mostly reflect short-term protection, as XBB/EG.5 subvariant predominance was overtaken by JN subvariants by the end of 2023 [5,6,8,10,17,18]. Studies evaluating VE against hospitalizations during both XBB and JN periods showed lower relative protection of 35% to 54% against JN sublineages [4,5,9,19], persisting when comparing similar intervals since vaccination. Waning protection during the JN period was not observed in most studies reporting a four- or five-month post-vaccination follow-up [7,9,20,21], while one study reported waning protection against JN-lineage hospitalization from 33% at <3 months post-vaccination to 23% at 3–5 months [5].

Our data are consistent with the literature for XBB and early JN periods, but our ten-month follow-up spanning the spring 2024 dose allowed us to show that shortly after vaccination, VE was similarly high against XBB (55%) and KP (60%) sublineages, with lower estimate against JN (23%) sublineage. It declined over the following few months with no protection found past five to six months post-XBB-vaccination. Comparable waning effectiveness had been reported for bivalent BA.1 or BA.4/5 vaccines administered in autumn 2022 [4,19,22,23]. Moreover, broadly similar effectiveness was observed for the bivalent BA.4/5 and the XBB vaccines in England, where both formulations were offered during the 2023 autumn campaign [19]. Immunological studies have also shown similar dynamics; a significant increase in neutralizing antibodies against multiple subvariants induced by bivalent or monovalent booster vaccines but waning within three months [24]. Together with our results, this suggests that waning of vaccine immunity might account for more of the observed loss of protection over time than sublineage shift. The similarity of XBB-VE estimates with each of the three comparator groups (MV/BV-vaccinated, non-XBB-vaccinated and unvaccinated) also suggests that there was absence or little residual protection in individuals vaccinated more than six months prior to the autumn 2023 campaign, as reported in studies from the USA and England [8,19].

Our study has several limitations. The lack of individual-level genome sequencing might have led to some misclassification in the sublineage-specific estimates, mainly during the KP period where 20% to 30% of analyzed specimens were JN sublineages. Residual confounding is possible if unmeasured determinants of vaccine-seeking behaviour are associated with COVID-19 testing and hospitalization risk. Among our participants with documented prior infection (⁓20%), a SARS-CoV-2 infection in September or October 2023 was twice as frequent among MV/BV-vaccinated than among XBB-vaccinated. VE would be underestimated if individuals with increased immunity due to a recent SARS-CoV-2 infection had delayed or avoided XBB-vaccination [25]. Its impact should be small in the context of limited proportion with recent infections and myriad other reasons for non-vaccination but may partially explain the unexpected high VE within two months post-vaccination during the KP period, where delayed (spring) XBB-vaccine receipt as first XBB-dose might have been associated with a recent prior infection. Hybrid immunity conferred by prior infection and vaccination have been previously associated with the highest protection against COVID-19 severe outcomes [14,26]. In the context where most mild COVID-19 infections are no longer documented or NAAT-confirmed, and most people have experienced at least one prior infection, our overall results reflect the incremental XBB-VE over the current (but unknown) population immunity conferred by prior infection. In our sensitivity analyses, those with documented NAAT-confirmed prior infection and vaccination (hybrid immunity) had higher VE than the overall estimates for XBB (74% vs 54%) and JN periods (41% vs 23%), but similarly low for the KP period (6% vs −0.5%), all compared to MV/BV-vaccination in 2022. This may indicate a substantial proportion of previously uninfected individuals in the overall analysis, in line with Canadian seroprevalence studies showing that, by September 2023, almost 30% of adults aged 60 years or older did not have antibodies against the nucleocapsid protein indicating prior SARS-CoV-2 infection [27]. To our knowledge, these are the first data on hybrid protection conferred by prior infection and XBB-vaccination.

We adjusted for the main determinants of COVID-19 hospitalizations, but we did not have information on factors such as ritonavir-boosted nirmatrevil use, frailty, race and ethnicity which might influence vaccination uptake and disease severity. Depletion-of-susceptible bias may arise when infection rates differ between vaccinated and unvaccinated populations, potentially creating a spurious decrease in VE over time [28]. Although vaccination status might influence contacts especially within certain high-risk groups, the impact of this bias alone could not explain the observed waning, as shown in previous epidemiological studies [29]. XBB and influenza vaccine coadministration might potentially underestimate XBB-VE in test-negative designs [30,31]. Even if we did not have information on influenza results to evaluate its impact, the circulation of SARS-CoV-2 and influenza overlapped only during the JN period in Quebec [32], and we found a similar proportion of influenza-vaccinated among XBB-vaccinated cases and controls, suggesting a limited impact of this bias on our conclusions. Despite these limitations, our conclusions seem robust as shown by results using different comparators and by the time-dependant waning gradient for both JN and KP periods acknowledging wide CI.

This end-of-season study presents a comprehensive portrait of the evolution of the protection conferred by XBB-vaccination at a population level, first reporting sublineage-specific estimates during predominant KP circulation and the first VE estimates associated with two XBB-vaccine doses. Our results align with other reported XBB-VE estimates up to five-months post-vaccination [4,5,7,19] and extends them to a ten-month follow-up including three predominant circulating sublineages finding minimal to no protection beyond the fourth post-vaccination month. Further studies will be necessary to corroborate our conclusions. Moreover, our study leads to several important public health considerations related to ongoing COVID-19 vaccination programs including their timing; their likelihood of success in the context of suboptimal VE, short duration of protection, and ultimately vaccination fatigue; and the need to pursue better COVID-19 vaccines. Unlike influenza, COVID-19 is not a seasonal winter disease. Worldwide, each new COVID-19 wave is linked to a variant shift regardless of the time of the year [1,10]. Therefore, timing COVID-19 vaccination campaigns along that for influenza might be operationally preferable, but not yet optimal with respect to impact. With only short-lasting protection, vaccination only once per year leaves individuals unprotected for much of the time, but more doses lead to vaccine fatigue, with current vaccine coverage as low as 14% for the spring dose among ≥80-year-olds [16]. Finally, despite their high VE and remarkable impact at the beginning of the pandemic, we are now at a stage where mRNA vaccines are showing only modest protection lasting a few months against even severe outcomes like hospitalization, with a recurring need for update to address the emergence of new variants. While exploring the reasons for this dramatic change in the performance of mRNA vaccines we urgently need to determine if other vaccine technologies may yield better and longer-lasting benefits in the current context.

In the meantime, we conclude from our observations that the XBB formulation of mRNA COVID-19 vaccines provided meaningful, albeit limited and short-lived, protection against hospitalization due to XBB, JN and KP sublineages in individuals aged ≥60 years.

Supporting information

S1 File. Supporting information.

Contains Figure S1 (Flowchart), Figure S2 (Positive tests prior to vaccination), Table S1 (Characteristics of participants, XBB period), Table S2 (Characteristics of participants, JN period), Table S3 (Characteristics of participants, KP period), Table S4 (XBB-VE by time since vaccination), Table S5 (XBB-VE among participants with prior infection) and Table S6 (XBB-VE by age).

https://doi.org/10.1371/journal.pone.0325269.s001

(PDF)

Acknowledgments

We would like to thank Ella Diendere (Institut national de santé publique du Québec) for her support to provide data on SARS-CoV-2 lineages circulation in Québec.

References

  1. 1. Markov PV, Ghafari M, Beer M, Lythgoe K, Simmonds P, Stilianakis NI, et al. The evolution of SARS-CoV-2. Nat Rev Microbiol. 2023;21(6):361–79. pmid:37020110
  2. 2. Health Canada. Health Canada authorizes Pfizer-BioNTech COVID-19 vaccine targeting the Omicron XBB.1.5 subvariant. Accessed 2024 October 9. https://www.canada.ca/en/health-canada/news/2023/09/health-canada-authorizes-pfizer-biontech-covid-19-vaccine-targeting-the-omicron-xbb15-subvariant.html
  3. 3. U.S. Food and Drug Administration. FDA takes action on updated mRNA COVID-19 vaccines to better protect against currently circulating variants. Accessed 2024 October 9. https://www.fda.gov/news-events/press-announcements/fda-takes-action-updated-mrna-covid-19-vaccines-better-protect-against-currently-circulating
  4. 4. Lin D-Y, Du Y, Xu Y, Paritala S, Donahue M, Maloney P. Durability of XBB.1.5 vaccines against omicron subvariants. N Engl J Med. 2024;390(22):2124–7. pmid:38810167
  5. 5. Ma KC, Surie D, Lauring AS. Effectiveness of updated 2023–2024 (monovalent XBB.1.5) COVID-19 vaccination against SARS-CoV-2 Omicron XBB and BA.2.86/JN.1 lineage hospitalization and a comparison of clinical severity—IVY Network, 26 hospitals, October 18, 2023–March 9, 2024. Clin Infect Dis. 2024.
  6. 6. Monge S, Humphreys J, Nicolay N, Braeye T, Van Evercooren I, Holm Hansen C, et al. Effectiveness of XBB.1.5 monovalent COVID-19 vaccines during a period of XBB.1.5 dominance in EU/EEA countries, October to November 2023: a VEBIS-EHR network study. Influenza Other Respir Viruses. 2024;18(4):e13292. pmid:38654485
  7. 7. Tartof SY, Slezak JM, Puzniak L. Effectiveness of BNT162b2 XBB vaccine against XBB and JN.1 sublineages. Open Forum Infect Dis. 2024;11(7):ofae370.
  8. 8. Tartof SY, Slezak JM, Frankland TB. Estimated effectiveness of the BNT162b2 XBB vaccine against COVID-19. JAMA Intern Med. 2024;184(8):932–40.
  9. 9. Caffrey AR, Appaneal HJ, Lopes VV, Puzniak L, Zasowski EJ, Jodar L, et al. Effectiveness of BNT162b2 XBB vaccine in the US veterans affairs healthcare system. Nat Commun. 2024;15(1):9490. pmid:39488521
  10. 10. GISAID, via CoVariants.org (2024) – with major processing by our world in data. SARS-CoV-2 sequences by variant, Aug 24, 2024. Available at: https://ourworldindata.org/grapher/covid-variants-bar. Accessed 2024 October 9.
  11. 11. Comité sur l’immunization du Québec. Administration de doses de rappel du vaccin contre la COVID-19: recommandations pour l’automne 2023. Quebec, QC: Institut national de santé publique du Québec; 2023. Accessed 2024 September 15. https://www.inspq.qc.ca/sites/default/files/2023-08/3367_doses-rappel-vaccin-covid-19-automne-2023.pdf
  12. 12. Comité sur l’immunisation du Québec. Vaccination contre la COVID-19: recommandations pour le printemps 2024. Quebec, QC: Institut national de santé publique du Québec; 2024. Accessed 2024 September 15. https://www.inspq.qc.ca/sites/default/files/2024-03/3471-vaccination-covid-19-printemps-2024.pdf
  13. 13. Institut national de santé publique du Québec. Données sur les variants du SRAS-CoV-2 au Québec. Accessed 2024 October 9. https://www.inspq.qc.ca/covid-19/donnees/variants
  14. 14. Carazo S, Skowronski DM, Brisson M, Sauvageau C, Brousseau N, Fafard J, et al. Effectiveness of previous infection-induced and vaccine-induced protection against hospitalisation due to omicron BA subvariants in older adults: a test-negative, case-control study in Quebec, Canada. Lancet Healthy Longev. 2023;4(8):e409–20. pmid:37459879
  15. 15. Simard M, Boiteau V, Fortin É, Jean S, Rochette L, Trépanier P-L, et al. Impact of chronic comorbidities on hospitalization, intensive care unit admission and death among adult vaccinated and unvaccinated COVID-19 confirmed cases during the Omicron wave. J Multimorb Comorb. 2023;13. pmid:37143739
  16. 16. Institut national de santé publique du Québec. Données de vaccination contre la COVID-19 au Québec. Accessed 2024 October 9. https://www.inspq.qc.ca/covid-19/donnees/vaccination
  17. 17. DeCuir J, Payne AB, Self WH, et al. Interim effectiveness of updated 2023–2024 (monovalent XBB.1.5) COVID-19 vaccines against COVID-19–associated emergency department and urgent care encounters and hospitalization among immunocompetent adults aged ≥18 years — VISION and IVY networks, September 2023–January 2024. MMWR Morb Mortal Wkly Rep. 2024;73(8):180–8.
  18. 18. Lee JA, Jang H, Ahn SM, Seong JE, Kim YK, Sohn Y, et al. Estimates of vaccine effectiveness of the updated monovalent XBB.1.5 COVID-19 vaccine against symptomatic SARS-CoV-2 infection, hospitalization, and receipt of oxygen therapy in South Korea - October 26 to December 31, 2023. Int J Infect Dis. 2024;148:107249. pmid:39307179
  19. 19. Kirsebom FCM, Stowe J, Lopez Bernal J, Allen A, Andrews N. Effectiveness of autumn 2023 COVID-19 vaccination and residual protection of prior doses against hospitalisation in England, estimated using a test-negative case-control study. J Infect. 2024;89(1):106177. pmid:38719110
  20. 20. Nunes B, Humphreys J, Nicolay N, Braeye T, Van Evercooren I, Holm Hansen C, et al. Monovalent XBB.1.5 COVID-19 vaccine effectiveness against hospitalisations and deaths during the Omicron BA.2.86/JN.1 period among older adults in seven European countries: a VEBIS-EHR network study. Expert Rev Vaccines. 2024;23(1):1085–90. pmid:39535047
  21. 21. Nguyen JL, Mitratza M, Volkman HR, de Munter L, Tran TMP, Marques C, et al. Effectiveness of the BNT162b2 XBB.1.5-adapted vaccine against COVID-19 hospitalization related to the JN.1 variant in Europe: a test-negative case-control study using the id.DRIVE platform. EClinicalMedicine. 2024;79:102995. pmid:39726669
  22. 22. Poukka E, Perälä J, Nohynek H, Goebeler S, Auranen K, Leino T, et al. Relative effectiveness of bivalent boosters against severe COVID-19 outcomes among people aged ≥ 65 years in Finland, September 2022 to August 2023. Euro Surveill. 2024;29(37):2300587. pmid:39268649
  23. 23. Kirsebom FCM, Andrews N, Stowe J, Ramsay M, Lopez Bernal J. Duration of protection of ancestral-strain monovalent vaccines and effectiveness of bivalent BA.1 boosters against COVID-19 hospitalisation in England: a test-negative case-control study. Lancet Infect Dis. 2023;23(11):1235–43. pmid:37453440
  24. 24. Lasrado N, Collier A-RY, Miller J, Hachmann NP, Liu J, Anand T, et al. Waning immunity and IgG4 responses following bivalent mRNA boosting. Sci Adv. 2024;10(8):eadj9945. pmid:38394195
  25. 25. Horne EMF, Hulme WJ, Keogh RH, Palmer TM, Williamson EJ, Parker EPK, et al. Challenges in estimating the effectiveness of 2 doses of COVID-19 vaccine beyond 6 months in England. Am J Epidemiol. 2024;193(1):227–31. pmid:37656609
  26. 26. Bobrovitz N, Ware H, Ma X. Protective effectiveness of previous SARS-CoV-2 infection and hybrid immunity against the omicron variant and severe disease: a systematic review and meta-regression. Lancet Infect Dis. 2023;23(5):556–67.
  27. 27. COVID-19 Immunity Task Force. Seroprevalence in Canada. 2024. Accessed 24 February 2025. https://www.covid19immunitytaskforce.ca/seroprevalence-in-canada/
  28. 28. Lipsitch M, Goldstein E, Ray GT, Fireman B. Depletion-of-susceptibles bias in influenza vaccine waning studies: how to ensure robust results. Epidemiol Infect. 2019;147:e306.
  29. 29. Andrejko KL, Pry JM, Myers JF, Mehrotra M, Lamba K, Lim E, et al. Waning of 2-Dose BNT162b2 and mRNA-1273 vaccine effectiveness against symptomatic SARS-CoV-2 infection accounting for depletion-of-susceptibles bias. Am J Epidemiol. 2023;192(6):895–907. pmid:36702469
  30. 30. Doll MK, Pettigrew SM, Ma J, Verma A. Effects of confounding bias in coronavirus disease 2019 (COVID-19) and influenza vaccine effectiveness test-negative designs due to correlated influenza and COVID-19 vaccination behaviors. Clin Infect Dis. 2022;75(1):e564–71. pmid:35325923
  31. 31. Skowronski DM, Zhan Y, Kaweski SE, Sabaiduc S, Khalid A, Olsha R, et al. 2023/24 mid-season influenza and Omicron XBB.1.5 vaccine effectiveness estimates from the Canadian Sentinel Practitioner Surveillance Network (SPSN). Euro Surveill. 2024;29(7):2400076. pmid:38362622
  32. 32. Institut national de santé publique du Québec. Surveillance de l’influenza et des infections respiratoires virales. https://www.inspq.qc.ca/sites/default/files/documents/influenza/20232024/2024-34.pdf?rapport=34