Figures
Abstract
The Sentinel Schools project was designed to monitor and evaluate the epidemiology of COVID-19 in Catalonia, gathering evidence for health and education policies to inform the development of health protocols and public health interventions to control of SARS-CoV-2 infection in schools. The aim of this study was to estimate the prevalence and incidence of SARS-CoV-2 infections and to identify their determinants among students and staff during February to June in the academic year 2020–2021. We performed two complementary studies, a cross-sectional and a longitudinal component, using a questionnaire to collect nominal data and testing for SARS-CoV-2 detection. We describe the results and perform a univariate and multivariate analysis. The initial crude seroprevalence was 14.8% (95% CI: 13.1–16.5) and 22% (95% CI: 18.3–25.8) for students and staff respectively, and the active infection prevalence was 0.7% (95% CI: 0.3–1) and 1.1% (95% CI: 0.1–2). The overall incidence for persons at risk was 2.73 per 100 person-month and 2.89 and 2.34 per 100 person-month for students and staff, respectively. Socioeconomic, self-reported knowledge, risk perceptions and contact pattern variables were positively associated with the outcome while sanitary measure compliance was negatively associated, the same significance trend was observed in multivariate analysis. In the longitudinal component, epidemiological close contact with SARS-CoV-2 infection was a risk factor for SARS-CoV-2 infection while the highest socioeconomic status level was protective as was compliance with sanitary measures. The small number of active cases detected in these schools suggests a low transmission among children in school and the efficacy of public health measures implemented, at least in the epidemiological scenario of the study period. The major contribution of this study was to provide results and evidence that help analyze the transmission dynamic of SARS-CoV-2 and evaluate the associations between sanitary protocols implemented, and measures to avoid SARS-CoV-2 spread in schools.
Citation: Ganem F, Bordas A, Folch C, Alonso L, Montoro-Fernandez M, Colom-Cadena A, et al. (2022) The COVID-19 Sentinel Schools Network of Catalonia (CSSNC) project: Associated factors to prevalence and incidence of SARS-CoV-2 infection in educational settings during the 2020–2021 academic year. PLoS ONE 17(11): e0277764. https://doi.org/10.1371/journal.pone.0277764
Editor: Omnia Samir El Seifi, Zagazig University Faculty of Human Medicine, EGYPT
Received: April 5, 2022; Accepted: November 3, 2022; Published: November 17, 2022
Copyright: © 2022 Ganem et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper.
Funding: This work was supported by the Health Department of the Government of Catalonia with no grant number. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. FG, AB, LG and ACC received a salary from the abovementioned funder.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The Coronavirus Disease 19 (COVID-19) outbreak began in Wuhan, China in December 2019 and rapidly became an international public health emergency. As of March 2022, there had been more than 470 million cases and 6 million deaths globally [1]. The first case of COVID-19 in Spain was confirmed on January 31, 2020, and in Catalonia on February 25 [2]. Until March 2022, the Catalan region had registered more than 2 million accumulated cases and more than 26,000 deaths [3].
At the beginning of the pandemic, in March 2020, it was estimated that 107 countries and 862 million children and young people were affected by the closure of schools, one of the public health measures aiming to reduce the transmission of SARS-CoV-2 [4]. However, this number increased to 1.57 billion students worldwide over the following months [5]. Many governments chose to close schools in response to the pandemic because it has previously been shown to be an effective non-pharmacological prevention measure in the control of other virus spread like influenza [4, 6] where children have had a significantly contribution [7–9]. Nevertheless, at the beginning of the current pandemic, data on the prevalence of COVID-19 in children was scarce due to low testing of the pediatric population [10] and the fact that parameters and evidence about COVID-19 occurrence in adults could not be extrapolated to children [11]. A great deal of effort was made to resolve this question.
Since the beginning of the pandemic, the contribution of children in the virus spread has been discussed [12]. People aged from 0 to 14 had a lower risk of SARS-CoV-2 infection compared to those of 15 to 64, additionally, among the infected, older people had more severe outcomes and reported higher mortality rates [4].
Despite estimates based in household secondary attack rates may be influenced due to several factors such as contact patterns, increased exposure, and symptomatic surveillance, which depends on the sensitivity of case detection, even several serological studies estimate highest prevalence among adults under 35 years [13, 14], it is known that children are not the main source of spread of the SARS.CoV-2 virus and therefore interventions based on this public can have an impact below expected [15, 16].
The impact of school closure could also cause social, economic and health problems, with emotional costs for children and young people considering the interruptions to other areas of activity in schools such as, nutrition, mental health, safety, and social assistance services [6, 13, 14, 17–19].
In Catalonia (7,739,758 inhabitants) the closure of the 5,492 schools on 13 March 2020 affected 1,582,478 students and 116,999 teaching staff. The schools were reopened on 14 September 2020, immediately after the school vacations, between June and August, remaining closed, therefore, for six months [20].
The current schools’ guidelines were developed by the Government of Catalonia based on SARS-CoV-2 indicators. They include early detection and isolation as well implementation of public health measures as natural ventilation of classrooms, stable coexistence groups (SCG or bubble groups) and targeted screening [21, 22], also monitoring COVID-19 risk factors, determinants, transmission dynamics, preventive measures compliance and outbreaks in the school to provide evidence to improve the safety of schools preventing further closures and their impact [4, 18, 23].
The COVID-19 Sentinel Schools Network of Catalonia (CSSNC) is a part of the COVID-19 monitoring and evaluation plan from the Health Department of Catalonia. The main objective is to monitor and evaluate the epidemiological situation of COVID-19 and its determinants in the educational setting, to gather evidence for the health policies aimed at the prevention and control of SARS-CoV-2 infection in schools and as a platform for other applied research projects. Currently, in 2022, the CSSNC includes 23 schools with 4,221 children and 1,140 staff from all over Catalonia, the study protocol has been previously published [24].
The aims of the CSSNC project (www.escolessentinella.org) include: the monitoring of biological markers; knowledge, attitudes and behaviors towards SARS-CoV-2 preventive measures; the identification of both facilitators and barriers to their implementation; and the monitoring of environmental indicators such as CO2, all together using a participatory research approach [24].
In this paper, to answer the question about the occurrence of COVID-19 among school-aged population, the main objectives are to estimate the prevalence and incidence of SARS-CoV-2 exposure and infections and to identify potential associated factors associated to them, among students and staff of the CSSNC during the academic year 2020–2021. Moreover, as a secondary objective, feasibility of a by-monthly testing strategy is also assessed.
Materials and methods
Study design and population
In this study, were included 2,007 students and 520 school staff (teaching and non-teaching staff, such as extracurricular education instructors and administrative personal) who previously signed the informed consent, from seven schools all over Catalonia. Although they are an opportunistic sample, epidemiological, and sociodemographic characteristics of the area, as well as type of school (public, private or chartered) were considered to assure heterogeneity. During the study period, we used two methodological approaches: a cross-sectional study to estimate SARS-CoV-2 prevalence, and a longitudinal study to calculate the COVID-19 incidence and evaluate the feasibility of the twice-monthly testing strategy.
The cross-sectional component included students aged 3–19 from preschool (3–5 year-old), elementary school (7–10 year-old), middle school (12–15 year-old), high school (16–17 year-old) and vocational training (17–19 year-old) and school staff.
For the longitudinal component, were included in a cohort of 1,424 participants, 983 students over 12 years-old and 441 school staff.
Data collection
The cross-sectional component was performed between February 22 and March 22, 2021, and the longitudinal component, were proceeded through 4 data collection rounds, between 6–19 April 2021, 20 April 2021 and 03 May 2021, 04 May 2021 and 18 May 2021 being the last round between 19 May 2021 and 02 June 2021 (Fig 1).
We collected nominal data from an online questionnaire but, when necessary, a paper form was used. Questions about demographic and economic characteristics, health status, knowledge, perceptions and behaviors related to COVID-19, control measures, pandemic impacts, previous SARS-CoV-2 infection, symptoms and contacts pattern as health indicators were included according to COSMO questionnaire [25]. In each longitudinal round, participants filled in an additional online epidemiological survey with information related to SARS-CoV-2 infection, suspected symptoms, exposures, and vaccine status during the previous 15 days.
Three different questionnaire models were designed one for school staff (questionnaire A); one for students under 16 years, which were answered by parents/guardian (questionnaire B) and one for students over 16 years (questionnaire C).
Secondary data about vaccine coverage and socioeconomic level was provided by the Agència de Qualitat I Avaluació Sanitàries de Catalunya (AquAS) through the Primary Care Services Information System (SISAP) and Data Analytics Program for Health Research and Innovation (PADRIS), which collect programmatic data from different sources. The variable socioeconomic level was based on the sanitary regions and was used to categorize the place of residences in tertiles (high, medium and low).
Biological samples were collected from all participants. A finger prick blood was collected to perform a rapid serological anti-SARS-CoV-2 IgM/IgG test to estimate the initial and final seroprevalence in February and June 2021 respectively. Saliva and nasal swab were collected twice a month to investigate the presence of SARS-CoV-2 RNA and SARS-CoV-2 antigens.
All results were uploaded to the electronic health record, and, become available to the participants normally within 48 hours of the sample collection.
Independent variables
Factors that could have impact in outcome were referred to as independent variables, that were tested to investigate the association with the SARS-CoV-2 infection. They were categorized in sociodemographic, health status, contact patterns, knowledge and perceptions and, preventive measures. Each variable was coded according to the type of the question asked in the questionnaire (Table 1).
Laboratory assays
A RT-PCR assay (Allplex SARS-CoV-2/FluA/FluB/RSV, Werfen, Korea) and a molecular assay based on the transcription mediated amplification assay (TMA) (Procleix SARS-CoV-2, Grifols, Barcelona, Catalonia, Spain) was conducted to detect SARS-CoV-2 RNA. The nasal swab samples for detection of SARS-CoV-2 antigen were processed using the Panbio COVID-19 Ag Rapid Test (Abbot, Chicago, IL, USA), following the manufacturer’s instructions, with a sensitivity of 93.3% (95% CI: 83.8–98.2%) and specificity of 99.4% (95% CI: 97.0–100%). For the anti-SARS-CoV-2 IgM/IgG test we used a rapid SARS-CoV-2 serological test (COVID-19 IgG/IgM Rapid Test Kit, Lambra, Madrid, Spain), following the manufacturer’s instructions, with sensitivities of 97.2% (IgG) and 87.9% (IgM), and specificities of 100% for both immunoglobulins, but following recommendations to the Public Health Protocol for COVID-19 [22], because of the low specificity of IgM antibodies and several reported cross-reactions with other non-specifics proteins, only IgG antibodies were used to assess the prevalence ofSARS-CoV-2.
The samples that SARS-CoV-2 were detected were stored in the sample collection C.0001145 located at the Vall d’Hebron Hospital Universitari (Barcelona, Spain) in the sample collection registered at the Instituto de Salud Carlos III register, Madrid, Spain.Saliva samples with positive SARS-CoV-2 results were frozen and stored at the IGTP-HUGTiP Biobank, Badalona, Catalonia, Spain, and maintained for two years.
Outcomes and case definitions
Our first outcome was previous exposure to SARS-CoV-2 virus. The case definition for positive, was any individual with a positive SARS-CoV-2 IgG antibodies detected by rapid test.
The second outcome was active SARS-CoV-2 infections. The case definition for positive was any individual, symptomatic or asymptomatic with a positive RT-PCR or RAT detected by the project team or detected and confirmed by RT-PCR or RAT performed by primary health care, during the follow-up period. We decided to include these self-reported documented infections because students and school staff with positive results started the isolation protocol and were no longer tested at school.
Data analysis
We calculated crude and adjusted prevalence for students of 2–20 years of age on the census in Catalan schools, adjusting for age and sex. For school staff, we only adjusted for sex and then by sensitivity and specificity of the tests. The differences between initial and final seroprevalence were only calculated for students from first grade of middle school or older and staff, using the McNemar test.
Descriptive analysis was performed, and the data were provided globally and stratified by educational stage when possible and presented considering sociodemographic and socioeconomic indicators; contact pattern; knowledge, behavior and perceptions of COVID-19 and health status. Frequency, measures of central tendency (mean and median) and dispersion (standard deviation and IQR) were calculated.
Univariate analysis was performed to investigate the association between independent variables and outcome, variables with p-value <0.050 were considered statistically significant. The prevalence ratio with 95% confidence interval (CI) were calculated using an adjusted Poisson model with robust error and adjustment for age, sex and school. The combined qualitative variables were compared using the McNemar test.
For the multivariate analysis, we proceeded an initial correlation graph (polychoric correlation) was constructed for each category of variables and of the pairs that had a correlation coefficient greater than 0.8 (in absolute value), only one of the variables was used for the analysis. To fit a multivariate model, we performed the analysis with stepforward and stepwise regression, ie. starting with the model with all variables, then removing them one by one and subsequently starting with an empty model adding the variables one by one. We used the same type of regression as for univariate models (GLM Poisson with robust errors). We selected variables by significance, R2 and AIC, and both models (stepforward and stepwise regression) gave us the same model with R2 0.184547 and AIC 1261.318, compatible with the set of behavioral variables included in the model. We checked the Goodness of fit for the multivariate model and observed that no overdispersion was found in the Poisson model.
To calculate the incidence rate for the at-risk population, we used the number of participants with a positive result in RT-PCR or RAT divided by person time at risk. For at risk of infection we excluded individuals with RT-PCR or RAT positive result in the previous 60 days before started the cohort. The denominator was defined as the sum of the time at risk of the 1,366 participants sampled during the cohort (950 students and 416 employees). Time at risk was defined for each participant, as the difference of time between the moment that they entered the study and the endpoint when they tested positive or, if they did not obtain any positive result, the last round that they were tested. The result was presented per 100 person-month.
In the longitudinal component, a univariate analysis was performed included the same variables that had been tested in the cross-sectional component, adding the information collected during the follow-up endpoints. These data were assessed using independent log binomial mixed models to calculate the Relative Risk (RR) with participant’s identifier as random effect and adjusting for age, sex and school. Due the low number of positives, a multivariate model for the longitudinal component was not proceed.
For the univariate analysis, a GLMM log binomial model with ID as random intercept was used to estimate the PR and RR of each variable of interest, by means of an adjusted measure and avoiding the confusion of the variables age, sex and school.
Two composite indicators were created to measure the participant’s knowledge of COVID-19: “perceived knowledge” and “factual knowledge” and another indicator to measure the “risk perception”. The “perceived knowledge” and “risk perception” were measured using a Likert 7-point scale, 1–4 scores were considered as low level of knowledge or low level of risk perception and 5–7 as high level. And “factual knowledge” was measured by a binary score composed of three aspects: people at risk, symptoms and means of transmission. The answers were counted, and we classified as high level of factual knowledge when more than 50% of answers were correct and 50% or less as low.
All analyses were carried out with R (version 4.1.0). Confidence intervals for incidence were obtained using the ‘epi.conf’ function from ‘epiR’ package The number of samples that should be tested to find a positive was calculated using Ene 3.0.
Ethics statement
The Foundation University Institute for Research in Primary Health Care Jordi Gol i Gurina (IDIAPJGol) approved the study on 17 December 2020 (code 20/192-PCV). Informed consent was obtained from school staff, parents for those children under 16 and alumni aged 16 or older. Participants were free to decline/withdraw consent at any time without providing a reason and without being subject to any resulting detriment.
Results
For participants students, except for the preschool, most participants were female (55%) overall. Regarding socioeconomic variables, 821 (41.7%) students’ fathers and 1,043 mothers (52.3%) have high levels of study or university qualifications, 1,705 (86.7%) of the students’ fathers and 1613 (81.0%) of the students’ mothers were employed in the study period (Table 2).
For school staff, mean [IQR] age was 43 [IQR 33–51], 410 (78.8%) were female, 418 (80.5%) had a high level of studies or university qualifications and 292 (56.2%) used their own car as the main means of transport. About 20% (104) had a comorbidity, the most common was asthma 23 (22.1%) and hypertension 21 (20.2%) (Table 3).
Regarding epidemiological data for SARS-CoV-2 exposure risk, for students, the most common place of contact with suspected or confirmed case was at the school, being 65 (65.0%) in preschool group for school staff, 122 (63.2%) reported having contact with a suspected or confirmed case at the school (Table 4).
Seroprevalence, univariate and multivariate analysis in the cross-sectional component
The baseline seroprevalence of SARS-CoV-2 IgG for students and school staff was, respectively, 14.8% (95% CI: 13.1–16.5) and 22% (95% CI: 18.3–25.8); adjusted for sensitivity and specificity it was 15.2% (95% CI: 13.5–17) and 22.6% (95% CI: 19–26.7) and the weighted seroprevalence was 14.5% (95% CI: 12–17.1) and 22.0% (95% CI: 21.2–22.8). The seroprevalence of SARS-CoV-2 IgG at the end of the longitudinal component for students over 12 years-old and staff was 18.4% (95% CI: 15.6–21.1) and 42.6% (95% CI: 37.7–47.5), adjusted for sensitivity and specificity it was 18.9% (95% CI: 16.2–21.9) and 43.8% (95% CI: 38.8–49.0) and the weighted seroprevalence was 19.7% (95% CI: 13.3–26.1) and 42.5% (95% CI: 0–92.4). The prevalence of active SARS-CoV-2 infection confirmed by RT-PCR or RAT at baseline was 0.7% (95% CI: 0.3–1.0) in students and 1.1% (95% CI: 0.1–2.0) in school staff. Weighted prevalence was 1% (95% CI: 0–2.1) and 1.1% (95% CI: 1–1.1). Self-reported documented infection of SARS-CoV-2 between February 2020 and March 2021 was 8.5% (95% CI: 7.3–9.8) for students and 7.1% (95% CI: 4.9–9.3) for staff. For students, when weighted by sex and age it was 8.2% (95% CI: 4.3–12.2) and for staff when weighted by sex it was 7.1% (95% CI: 5.9–8.4) (Table 5).
Among those participants who had two serological tests at baseline and at the end of the longitudinal component (round four), there was a significant increase in prevalence (p<0.001). The main differences were in the staff group (p-value <0,001), although there was also a no significant increase among students in vocational studies (Fig 2).
The variables included in the univariate analysis, for students and staff were presented into sociodemographic, health and behaviors and contact patterns categories. Indiscriminate changes in the employment situation (PR 1.43, CI 1.07–1.91) and improved the economic situation (PR 2.66 CI 1.18–6.00) regarding parents and school staff were positively associated with having been infected. The variable higher perceived knowledge was positively associated with the infection (PR 1.68 CI 1.05–2.68). The public health measure, avoiding crowded spaces was negatively associated with the infection (PR 0.65 CI 0.45–0.93) and a higher risk perception was positively associated (PR 1.49 CI 1.14–1.93) (Table 6).
In the case of contact patterns, having unspecific contact with suspected or confirmed COVID-19 case, (PR 2.76; CI 1.94–3.93) or contact at home (PR 2.17; CI 1.62–2.91) were positively associated with the infection, in contrast, contact at school, had a strongly negative association (PR 0.60 CI 0.45–0.80). Living with a health professional was not associated with infection (p-value = 0.262). (Table 7).
Catalonia, Spain, February-March 2021.
In the multivariate analysis, the same significance and trend among socioeconomic, health measures and contact patterns variables were observed (Table 8).
Incidence and univariate analysis at the longitudinal component
During the longitudinal component of the study, 45 new infections occurred (34 students and 11 staff), 11 of them identified by RT-PCR performed by the project team and 34 self-reported in by the participants. It is interesting to note that out of 11 RT-PCR positives identified in the study, only 1 (9%) was also detected by RAT.
The overall incidence was 2.73 (95% CI 1.991, 3.653) per 100 person-month, that is 2.887 (95% CI 1.999, 4.034) and 2.337 (95% CI 1.167, 4.182) per 100 person-month for students and staff, respectively.
The variables included in the univariate analysis were also categorized into sociodemographic and socioeconomic indicators, health status, and preventive compliance. There was a protective behavior associated with socioeconomic status, when comparing the highest level (high) in reference to the first tercile (low) (RR 0.25, 95% CI 0.06–0.96) for the COVID-19 infection (Table 9).
Sentinel schools project, Catalonia, Spain, April to June 2021.
Contact with a suspected or confirmed case of COVID-19, was a risk factor for infection (RR 6.44, 95% CI 3.15–13.19). When the contact occurred at home, the risk (RR 12.42, 95% CI 5.81–26.52) was higher than compared to school (RR 3.73, 95% CI 1.49–9.38) and other non-specific locations (RR 5.28, 95% CI 2.1–13.27).
We tested several sanitary measures that had been carried out in the last seven days before the survey and only avoiding close contact with someone who is infected or at risk (RR 0.38, 95% CI 0.15–0.97) and a wearing mask (RR 0.14, 95% CI 0.04–0.53) were associated, this is compatible with the also significant result of the variable contact with a suspected or confirmed cases of COVID-19.
We tested the feasibility of a twice a month RT-PCR testing strategy. Considering a prevalence of 0.07% and accuracy of 0.05) 1,258 participants should be tested to find one positive.
Discussion
In Switzerland, the “Ciao Corona” study, conducted in June/July 2020, October/November 2020, and March/April 2021 with 2,585 children, found 2.8% (95%CI 1.6–4.1%) SARS-CoV-2 IgG, IgM and IgA seroprevalence [26, 27]. In Germany, a study conducted during May and June 2020 founded 0.6% seroprevalence for students and school staff and 0.7% at the follow up, in September/October 2020 [28]. A population study carried out with children under 18 years of age in Catalonia found a lower seroprevalence than what we found in our study, of 4.4% between March and April 2020. This difference may reflect the difficulty of diagnosing asymptomatic youngers especially during the initial period of the pandemic, emphasizing the importance of active surveillance of school sentinel populations, for the timely detection of respiratory viruses [29].
As expected, in our study there was a significant increase in SARS-CoV-2 seroprevalence, in the school staff group, which can be explained by the increase of vaccination coverage. According to PADRIS data the vaccine coverage in school staff went from 78% and 0.6% in April 2021 to 84.3% and 35.6% in June 202, partly and fully vaccinated respectively. At the time of seroprevalence data collection in this study, vaccines were not approved for people under 18 years.
The prevalence of active SARS-CoV-2 infections detected by the project was low considering the overall prevalence and incidence from Catalonia during the same period [3, 20, 30, 31]. This suggests that public health strategies such as testing of symptomatic individuals and contact tracing efforts were effective at identifying an active infection at school, even the asymptomatic population [28]. Another study proceeded during in December 2020, in a high community transmission period in Switzerland [17] found, a positive PCR in none of the teacher and one child and Antigen positive test in 7 (1.1%) children and 2 (3.0%).
Considering detected and self-reported infections in our longitudinal study we found a low incidence of COVID-19 infections, consistent with other studies that have very similar results to ours [28, 32–34]. Also, there are studies suggesting that higher community incidence, diagnostic issues [30], demographic and economic aspects are determinants in the variation of different rates detected, as showed in these studies [16, 35, 36].
The association between socioeconomic status and SARS-CoV-2 infection was different depending on the period of data collection. First, at the beginning of the pandemic, improved economic situation was positively associated with having been infected. This could be explained by the fact that the most affected population were those who worked and travelled than those who were respecting the lockdown measures. Then, during the follow-up we observed a new trend where a higher infection risk was associated with lower economic status. This provides important clues to understanding the COVID-19 burden in different economic and demographic contexts [37]. Population-based studies found similar results where heterogeneity in incidence and mortality rates [32, 35, 36] were associated with socioeconomic status showing the importance of planning sanitary policies oriented to the territorial characteristics and specific inequities [38, 39], such as in a follow-up study in Brazil that found a high incidence in children living in a slum area [16].
At baseline, contact with suspected or confirmed cases, especially at home, was positively associated with SARS-CoV-2 infection, as observed in a study that found that physical distancing measures, including limited close contacts while school remained open, controlled SARS-CoV-2 transmission [40]. However, school contacts had a negative association with this outcome, showing how well-implemented sanitary protocols make the safe opening of schools possible, consistent with other studies that found an association between low transmission and, sanitary recommendations and preventive measures [6, 41].
In the longitudinal component analysis, all contact patterns were a risk factor, especially when contact was at home, consistent with previous studies that demonstrated an increased risk of infection associated with household contacts in Catalonia [15, 31, 42] and modeling studies that demonstrated an increased risk for infection in household contacts [43, 44]. Even contact tracing studies found no typical or frequent child-adult transmission [16, 45, 46] and a low contribution of children in the secondary cases [47, 48], which showed that children do not seem to be the main source of infection [11, 49].
Interestingly, contact with healthcare professionals was not associated with the infections in our study. Our hypothesis to explain that is the compliance of preventive measures at home when health care workers were exposed to risk situations, however, we need more studies to understand the role of HCW in this transmission model.
Perceived knowledge was positively associated with infection, which may indicate either knowledge acquired due to a previous infection, or the large amount of lay knowledge consumed by the young and indeed the general population [49, 50].
Knowledge of COVID-19 and risk perception may have been due to the occurrence of a previous infection, which would not explain the occurrence of a later infection. A high level of risk perception of exposure might indicate they understood the risks they had taken. Other studies also show that risk perceptions, behaviors and compliance with sanitary measures are associated with levels of knowledge [51–53].
As with other studies [15, 17, 47] our results reinforce that the transmission by children in the school setting did not appear to make a major contribution to the spread of the virus, especially for the youngest children. This supports the decision of many countries to keep schools open while following several public health measures and safety protocols to control the transmission of the virus. Our study also reinforces the idea that the strategy based on an active sentinel surveillance for detection of acute SARS-CoV-2 infections followed by isolation of bubble groups seems to be more effective in scenarios with susceptible groups and rapid transmission.
Approximately half of the target population agreed to participate and considering the difficult circumstances schools and families were experiencing because of the pandemic; we consider this proportion to be quite acceptable. As a matter of fact, it is similar to other studies where 75% and 25% of students and staff participated respectively [28] or with 49% of child participation [17].
Limitations
Although the overall participation rate in our study was 45.4%, it was proportionately higher among school staff (72%) than students (41%), this suggests that given the fact that higher sociodemographic heterogeneity (nationality, language, socioeconomic status) was higher among students than staff, some of these factors could have also influenced participation. There were no difficulties in implementing the study and all sentinel schools gave us excellent feedback for the associated activities.
Because of the sample of the schools and the participation rate, the study population may not be representative of all schools in Catalonia. Nevertheless, the heterogeneity of the included school’s information from different socioeconomical scenarios with a big enough study population. As a sentinel population approach, the objective of the CSSNC is not to extrapolate parameters, but to complement formal epidemiological surveillance systems by means of monitoring them steadily over time population studied. The data presented were gathered before the Omicron variant circulation and therefore our findings may not apply during the Spanish sixth wave or other future scenarios related to potential new variants and vaccine recommendations for children.
As a cross-sectional design, association should be interpreted with caution, without attributing causality. Variables such as distal characteristics must be interpreted differently from variables that can change over time such as knowledge, behavior, and contact patterns, which are influenced by the occurrence of the disease. Moreover, the acceptability, compliance, and prevention behaviors, may have been directly affected by the course of the pandemic.
There were some limitations to our longitudinal analysis as the small number of acute infections made impossible to apply a multivariate analysis. Also, with community public health measures occurring simultaneously with the schools’ own protocols it was difficult to evaluate these determinants separately. In addition, there was a poor distribution of confounders between groups, which can also have very different sizes, resulting in a loss of statistical power in a multivariate model.
Conclusions
This study offers a unique perspective on the prevalence and incidence of SARS-CoV-2 infection among students and school staff in Catalonia, an important result considering the difficulty of detecting the virus among asymptomatic young people, as well as regarding the compliance and effectiveness of public health measures implemented in these schools in the transmission of SARS-CoV-2.
The CSSNC demonstrated, for the first time in Spain, the feasibility of correlating individual socio-epidemiological data and data on the prevalence and incidence of SARS-CoV-2 in the school environment, even during the difficult acute period of the pandemic. Despite the high prevalence and community incidence of SARS-CoV-2 in Catalonia during the study period, this project found a low prevalence and incidence of active infections in the school population, suggesting that the prevention methods adopted by schools, together with other strategies of health care, such as testing and contact tracing, were effective in containing transmission in educational settings.
Monitoring of SARS-CoV-2 biological markers and their behavioral and structural determinants over time in sentinel schools is crucial to assess the situation of the COVID-19 pandemic and provide relevant information to inform guidelines and policies to increase safety among students and staff in school environments. Apart from identifying multilevel transmission determinants for SARS-CoV-2 among students and school staff, they may also be useful to describe the spread of other infectious diseases such as influenza and other respiratory viruses and facilitate healthier learning environments for all.
Acknowledgments
The authors would like to thank the Health Department and Department of Education of the Government of the Catalonia (Spain), the former Direcció General de Recerca i Innovació en Salut (DGRIS) and Institut Català de la Salut (ICS) that made this project possible, and all the health care professionals acting as a COVID-19 pandemic health taskforce in Catalonia. Also, we would like to specially thank the effort and dedication all the sentinel schools’ staff, students and families who participated in the project.
COVID-19 Sentinel Schools Network of Catalonia (CSSNC)
Principal investigators: Jordi Casabona (jcasabona@iconcologia.net) [Centre d’Estudis Epidemiològics sobre les Infeccions de Transmissió Sexual i Sida de Catalunya (CEEISCAT)-CIBERESP], and Josep Basora (Institut Universitari d’Investigació en Atenció Primària IDIAP Jordi Gol).
Project manager: Anna Bordas (CEEISCAT).
Technical committee: Jordi Casabona (CEEISCAT), Jordi Sunyer (ISGlobal), Pere Soler-Palacín (Hospital Universitari Vall d’Hebron), Rosina Malagrida (Living lab for Health, IRSICaixa) as Work Package coordinators. Cinta Folch, Pol Romano, Esteve Muntada, Anna Bordas, Fabiana Ganem, Andreu Colom-Cadena i Jordi Casabona (CEEISCAT), Mireia Gascón, Maria Subirana, Pau Majo, Jordi Sunyer (ISGlobal), Rosina Malagrida, Laia Vives (Living lab for Health, IrsiCaixa), Antonio Soriano (Hospital Universitari Vall d’Hebron), Josep Vidal (Gerència Territorial de la Catalunya Central, Institut Català de la Salut).
Microbiology laboratories: Tomàs Pumarola, Andrés Antón, Cristina Andrés, Juliana Esperalba, Albert Blanco (Hospital Universitari Vall d’Hebron), Ignacio Blanco, Pere-Joan Cardona, Maria Victoria González, Gema Fernández, Cristina Esteban (Hospital Universitari Germans Trias i Pujol)
Data Management and statistical analysis: Yesika Díaz, Lucia Alonso, Jordi Aceiton, Marcos Montoro (CEEISCAT).
Data Protection Officer and Technical Support: Esteve Muntada (CEEISCAT).
Communication manager: Pol Romano, Cristina Sànchez (CEEISCAT).
Field team: Maria Subirana, Pau Majo (ISGlobal), Jessica Fernández, Laia Vives (Living Lab for Health, IRSICaixa), Andreu Colom-Cadena, Isabel Martínez, Marina Herrero, Alba García, Juan Rus, Paula Ribas, Alba Blanco (CEEISCAT).
Community Pediatricians: Esperança Macià i Silvia Burgaya (CAP Manlleu), Mª Teresa Riera-Bosch, Elisabet Sola (EAP Vic Nord), Lidia Aulet, Maria Mendoza, Lidia Busquets (EAP Vic Sud), Xavier Perramon, Júlia Sebastià (EAP Eixample Dret), Ana Moreno (Cap Ripollet), Xavier Duran, Belen Pérez (EAP Can Gibert del Pla), Anna Gatell (Equip Territorial de Pediatria Alt Penedès), Maria Coma (Hospital Universitari Joan XXIII).
Epidemiology suveillance services: Marc Olivella, Irene Barrabeig, Ignacio Parrón, Mònica Carol, Núria Bes, Pere Godoy, Sofia Minguell, Maria Rosa Sala.
Department of Health: Ariadna Mas (Direcció Assistencial Atenció Primària, Institut Català de la Salut), Maria Antònia Llopis (Coordinació dels laboratoris de l’Institut Català de la Salut), Sandra Pequeño and Jacobo Mendioroz (Subdirecció general de Vigilància i Resposta a Emergències de l’Agència de Salut Pública de Catalunya), Laia Asso (Agència de Salut Pública de Catalunya) Aina Plaza, Montserrat Llavayol (Direcció Promoció de la Salut, Departament de Salut), and Carmen Cabezas (Secretaria Salut Pública).
Department of Education: Josep Gonzàlez-Cambray (Conseller d’Educació), Núria Mora (Secretaria de Transformació Educativa), Maria Neus Fornells (Gabinet del Conseller), Rut Ribas (Direcció general de l’alumnat).
References
- 1. Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis 2020;20:533–4. https://doi.org/10.1016/S1473-3099(20)30120-1 pmid:32087114
- 2. Coma E, Mora N, Méndez L, Benítez M, Hermosilla E, Fàbregas M, et al. Primary care in the time of COVID-19: Monitoring the effect of the pandemic and the lockdown measures on 34 quality of care indicators calculated for 288 primary care practices covering about 6 million people in Catalonia. BMC Fam Pract 2020;21:1–9. https://doi.org/10.1186/S12875-020-01278-8/FIGURES/3.
- 3.
Generalitat de Catalunya. Datos abiertos y COVID-19. Https://GovernobertGencatCat 2022. https://governobert.gencat.cat/es/dades_obertes/dades-obertes-covid-19/ (accessed March 21, 2022).
- 4. Viner RM, Mytton OT, Bonell C, Melendez-Torres GJ, Ward J, Hudson L, et al. Susceptibility to SARS-CoV-2 Infection among Children and Adolescents Compared with Adults: A Systematic Review and Meta-Analysis. JAMA Pediatr 2021;175:143–56. https://doi.org/10.1001/jamapediatrics.2020.4573 pmid:32975552
- 5. Yoon Y, Kim KR, Park H, Kim S, Kim YJ. Stepwise School Opening and an Impact on the Epidemiology of COVID-19 in the Children. J Korean Med Sci 2020;35. https://doi.org/10.3346/JKMS.2020.35.E414 pmid:33258334
- 6. Esposito S, Cotugno N, Principi N. Comprehensive and safe school strategy during COVID-19 pandemic. Ital J Pediatr 2021;47:6. https://doi.org/10.1186/s13052-021-00960-6 pmid:33422089
- 7. de Luca G, van Kerckhove K, Coletti P, Poletto C, Bossuyt N, Hens N, et al. The impact of regular school closure on seasonal influenza epidemics: A data-driven spatial transmission model for Belgium. BMC Infect Dis 2018;18. https://doi.org/10.1186/s12879-017-2934-3.
- 8. Cauchemez S, Valleron AJ, Boëlle PY, Flahault A, Ferguson NM. Estimating the impact of school closure on influenza transmission from Sentinel data. Nature 2008;452:750–4. https://doi.org/10.1038/nature06732 pmid:18401408
- 9. Kawano S, Kakehashi M. Substantial impact of school closure on the transmission dynamics during the pandemic Flu H1N1-2009 in Oita, Japan. PLoS One 2015;10. https://doi.org/10.1371/JOURNAL.PONE.0144839 pmid:26669757
- 10. Manivannan M, Jogalekar MP, Kavitha MS, Maran BAV, Gangadaran P. A mini-review on the effects of COVID-19 on younger individuals. Exp Biol Med 2021;246:293–7. https://doi.org/10.1177/1535370220975118 pmid:33210552
- 11. Escosa-García L, Aguilera-Alonso D, Calvo C, Mellado MJ, Baquero-Artigao F. Ten key points about COVID-19 in children: The shadows on the wall. Pediatr Pulmonol 2020;55:2576–86. https://doi.org/10.1002/ppul.25025 pmid:32790245
- 12. Bi Q, Wu Y, Mei S, Ye C, Zou X, Zhang Z, et al. Epidemiology and transmission of COVID-19 in 391 cases and 1286 of their close contacts in Shenzhen, China: a retrospective cohort study. Lancet Infect Dis 2020;20:911–9. https://doi.org/10.1016/S1473-3099(20)30287-5 pmid:32353347
- 13. Goldstein E, Lipsitch M, Cevik M. On the effect of age on the transmission of SARS-CoV-2 in households, schools, and the community. Journal of Infectious Diseases 2021;223:362–9. https://doi.org/10.1093/infdis/jiaa691 pmid:33119738
- 14. Keeling MJ, Tildesley MJ, Atkins BD, Penman B, Southall E, Guyver-Fletcher G, et al. The impact of school reopening on the spread of COVID-19 in England. Philosophical Transactions of the Royal Society B: Biological Sciences 2021;376. https://doi.org/10.1098/rstb.2020.0261 pmid:34053259
- 15. Soriano-Arandes A, Gatell A, Serrano P, Biosca M, Campillo F, Capdevila R, et al. Household Severe Acute Respiratory Syndrome Coronavirus 2 Transmission and Children: A Network Prospective Study. Clin Infect Dis 2021;73:e1261–9. https://doi.org/10.1093/CID/CIAB228 pmid:33709135
- 16. Lugon amella, Fuller T, Damasceno L, Calvet G, Cristina Resende P, Rocha Matos A, et al. SARS-CoV-2 Infection Dynamics in Children and Household Contacts in a Slum in Rio de Janeiro ARTICLE. Pediatrics 2021;148:2021050182. https://doi.org/10.1542/peds.2021-050182.
- 17. Kriemler S, Ulyte A, Ammann P, Peralta GP, Berger C, Puhan MA, et al. Surveillance of Acute SARS-CoV-2 Infections in School Children and Point-Prevalence During a Time of High Community Transmission in Switzerland. Front Pediatr 2021;9. https://doi.org/10.3389/fped.2021.645577 pmid:33796490
- 18. lo Moro G, Sinigaglia T, Bert F, Savatteri A, Gualano MR, Siliquini R. Reopening schools during the COVID-19 pandemic: Overview and rapid systematic review of guidelines and recommendations on preventive measures and the management of cases. Int J Environ Res Public Health 2020;17:1–21. https://doi.org/10.3390/ijerph17238839 pmid:33261208
- 19. López-Bueno R, López-Sánchez GF, Casajús JA, Calatayud J, Tully MA, Smith L. Potential health-related behaviors for pre-school and school-aged children during COVID-19 lockdown: A narrative review. Prev Med (Baltim) 2021;143. https://doi.org/10.1016/j.ypmed.2020.106349 pmid:33271236
- 20. Perramon A, Soriano-Arandes A, Pino D, Lazcano U, Andrés C, Català M, et al. Schools as a Framework for COVID-19 Epidemiological Surveillance of Children in Catalonia, Spain: A Population-Based Study. Front Pediatr 2021;9. https://doi.org/10.3389/fped.2021.754744 pmid:34568244
- 21.
Generalitat de Catalunya. Departament d’Educació. Gestió de casos de COVID-19 als centres educatius 2020:1–26.
- 22.
Generalitat de Catalunya. Departament de Salut. Procediment d’actuació enfront de casos d’infecció pel nou coronavirus SARS-CoV-2. 2020.
- 23. Zhang J, Litvinova M, Liang Y, Wang Y, Wang W, Zhao S, et al. Changes in contact patterns shape the dynamics of the COVID-19 outbreak in China. Science (1979) 2020;368:1481–6. https://doi.org/10.1126/science.abb8001 pmid:32350060
- 24. Bordas A, Soriano-Arandes A, Subirana M, Malagrida R, Reyes-Urueña JM, Folch C, et al. Study protocol for monitoring SARS-CoV-2 infection and its determinants in Catalonia (Spain): an observational and participatory research approach in a Sentinel Network of Schools. BMJ Open 2022;12:e055649. https://doi.org/10.1136/bmjopen-2021-055649 pmid:35078847
- 25. Betsch C, Wieler LH, Habersaat K. Monitoring behavioural insights related to COVID-19. The Lancet 2020;395:1255–6. https://doi.org/10.1016/S0140-6736(20)30729-7 pmid:32247323
- 26. Ulyte A, Radtke T, Abela IA, Haile SR, Braun J, Jung R, et al. Seroprevalence and immunity of SARS-CoV-2 infection in children and adolescents in schools in Switzerland: design for a longitudinal, school-based prospective cohort study. Int J Public Health 2020;65:1549–57. https://doi.org/10.1007/s00038-020-01495-z pmid:33063141
- 27. Ulyte A, Radtke T, Abela IA, Haile SR, Berger C, Huber M, et al. Clustering and longitudinal change in SARS-CoV-2 seroprevalence in school children in the canton of Zurich, Switzerland: Prospective cohort study of 55 schools. The BMJ 2021;372. https://doi.org/10.1136/bmj.n616.
- 28. Kirsten C, Unrath M, Lück C, Dalpke AH, Berner R, Armann J. SARS-CoV-2 seroprevalence in students and teachers: a longitudinal study from May to October 2020 in German secondary schools. BMJ Open 2021;11:49876. https://doi.org/10.1136/bmjopen-2021-049876 pmid:34112645
- 29. Burn Edward, Tebé Cristian, Fernandez-Bertolin Sergio, Aragon Maria, Recalde Martina, Roel Elena, et al. The natural history of symptomatic COVID-19 during thefirst wave in Catalonia. Nat Commun 2021;17:1–13.
- 30. Llupià A, Borràs-Santos A, Guinovart C, Utzet M, Moriña D, Puig J. SARS-CoV-2 transmission in students of public schools of Catalonia (Spain) after a month of reopening. PLoS One 2021;16:e0251593. https://doi.org/10.1371/journal.pone.0251593 pmid:33979410
- 31. Pollán M, Pérez-Gómez B, Pastor-Barriuso R, Oteo J, Hernán MA, Pérez-Olmeda M, et al. Prevalence of SARS-CoV-2 in Spain (ENE-COVID): a nationwide, population-based seroepidemiological study. The Lancet 2020;396:535–44. https://doi.org/10.1016/S0140-6736(20)31483-5 pmid:32645347
- 32. Choe YJ, Park Y-J, Kim E-Y, Jo M, Cho EY, Lee H, et al. SARS-CoV-2 transmission in schools in Korea: nationwide cohort study. Arch Dis Child 2021;0:1–5. https://doi.org/10.1136/archdischild-2021-322355 pmid:34857510
- 33. Tönshoff B, Müller B, Elling R, Renk H, Meissner P, Hengel H, et al. Prevalence of SARS-CoV-2 Infection in Children and Their Parents in Southwest Germany. JAMA Pediatr 2021;175:586. https://doi.org/10.1001/jamapediatrics.2021.0001 pmid:33480966
- 34. van Loon W, Theuring S, Hommes F, Mall MA, Seybold J, Kurth T, et al. Prevalence of SARS-CoV-2 Infections among Students, Teachers, and Household Members during Lockdown and Split Classes in Berlin, Germany. JAMA Netw Open 2021. https://doi.org/10.1001/jamanetworkopen.2021.27168.
- 35. Mena GE, Martinez PP, Mahmud AS, Marquet PA, Buckee CO, Santillana M. Socioeconomic status determines COVID-19 incidence and related mortality in Santiago, Chile. Science (1979) 2021;372. https://doi.org/10.1126/science.abg5298.
- 36. Riou J, Panczak R, Althaus CL, Junker C, Perisa D, Schneider K, et al. Socioeconomic position and the COVID-19 care cascade from testing to mortality in Switzerland: a population-based analysis. Lancet Public Health 2021;6:e683–91. https://doi.org/10.1016/S2468-2667(21)00160-2 pmid:34252364
- 37. Marí-Dell’Olmo M, Gotsens M, Pasarín MI, Rodríguez-Sanz M, Artazcoz L, Garcia de Olalla P, et al. Socioeconomic Inequalities in COVID-19 in a European Urban Area: Two Waves, Two Patterns. Int J Environ Res Public Health 2021;18:1256. https://doi.org/10.3390/ijerph18031256 pmid:33573323
- 38. Im Kampe EO, Lehfeld AS, Buda S, Buchholz U, Haas W. Surveillance of COVID-19 school outbreaks, Germany, March to August 2020. Eurosurveillance 2020;25. https://doi.org/10.2807/1560-7917.ES.2020.25.38.2001645.
- 39. Politi Julieta, Mario Martín-Sánchez Lilas Mercuriali, Blanca Borras-Bermejo Joaquín Lopez-Contreras, Vilella Anna, et al. Epidemiological characteristics and outcomes of COVID-19 cases: mortality inequalities by socioeconomic status, Barcelona, Spain, 24 February to 4 May 2020. Eurosurveillance 2021;26. https://doi.org/10.2807/1560-7917 pmid:34018483
- 40. Ingelbeen B, Peckeu L, Laga M, Hendrix I, Neven I, van der Sande MAB, et al. Reducing contacts to stop SARS-CoV-2 transmission during the second pandemic wave in Brussels, Belgium, August to November 2020. Eurosurveillance 2021;26. https://doi.org/10.2807/1560-7917.ES.2021.26.7.2100065.
- 41. Ehrhardt J, Ekinci A, Krehl H, Meincke M, Finci I, Klein J, et al. Transmission of SARS-CoV-2 in children aged 0 to 19 years in childcare facilities and schools after their reopening in May 2020, Baden-Württemberg, Germany. Eurosurveillance 2020;25. https://doi.org/10.2807/1560-7917.ES.2020.25.36.2001587.
- 42. Marks M, Millat-Martinez P, Ouchi D, Roberts C h., Alemany A, Corbacho-Monné M, et al. Transmission of COVID-19 in 282 clusters in Catalonia, Spain: a cohort study. Lancet Infect Dis 2021;21:629–36. https://doi.org/10.1016/S1473-3099(20)30985-3/ATTACHMENT/59270188-9308-4D12-9A13-4C1F5A58D3BB/MMC2.PDF pmid:33545090
- 43. Kim S, Kim Y-J, Peck KR, Jung E. School Opening Delay Effect on Transmission Dynamics of Coronavirus Disease 2019 in Korea: Based on Mathematical Modeling and Simulation Study. J Korean Med Sci 2020;35. https://doi.org/10.3346/jkms.2020.35.e143 pmid:32242349
- 44. Munday JD, Jarvis CI, Gimma A, Wong KLM, van Zandvoort K, Liu Y, et al. Estimating the impact of reopening schools on the reproduction number of SARS-CoV-2 in England, using weekly contact survey data. BMC Med 2021;19. https://doi.org/10.1186/s12916-021-02107-0 pmid:34503493
- 45. Yi S, Kim Y-M, Choe YJ, Ahn S, Han S, Park Y-J. Geospatial Analysis of Age-specific SARS-CoV-2 Transmission Patterns in Households, Korea. J Korean Med Sci 2021;36. https://doi.org/10.3346/jkms.2021.36.e63 pmid:33650338
- 46. Zimmerman KO, Akinboyo IC, Brookhart MA, Boutzoukas AE, McGann KA, Smith MJ, et al. Incidence and Secondary Transmission of SARS-CoV-2 Infections in Schools. Pediatrics 2021;147:e2020048090. https://doi.org/10.1542/peds.2020-048090 pmid:33419869
- 47. Ertem Z, Schechter-Perkins EM, Oster E, Berg P, Epshtein I, Chaiyakunapruk N, et al. The impact of school opening model on SARS-CoV-2 community incidence and mortality. Nat Med 2021;27:2120–6. https://doi.org/10.1038/s41591-021-01563-8 pmid:34707317
- 48. Park YJ, Choe YJ, Park O, Park SY, Kim Y-M, Kim J, et al. Contact Tracing during Coronavirus Disease Outbreak, South Korea, 2020. Emerg Infect Dis 2020;26:2465–8. https://doi.org/10.3201/eid2610.201315 pmid:32673193
- 49. Ismail SA, Saliba V, Lopez Bernal J, Ramsay ME, Ladhani SN. SARS-CoV-2 infection and transmission in educational settings: a prospective, cross-sectional analysis of infection clusters and outbreaks in England. Lancet Infect Dis 2021;21:344–53. https://doi.org/10.1016/S1473-3099(20)30882-3 pmid:33306981
- 50. Hatami H, Abbasi-Kangevari M, Malekpour M-R, Kolahi A-A. Knowledge, Attitudes, and Safety Practices About COVID-19 Among High School Students in Iran During the First Wave of the Pandemic. Front Public Health 2021;9. https://doi.org/10.3389/fpubh.2021.680514.
- 51. Lee M, Kang B-A, You M. Knowledge, attitudes, and practices (KAP) toward COVID-19: a cross-sectional study in South Korea. BMC Public Health 2021;21:295. https://doi.org/10.1186/s12889-021-10285-y pmid:33546644
- 52. Reuben RC, Danladi MMA, Saleh DA, Ejembi PE. Knowledge, Attitudes and Practices Towards COVID-19: An Epidemiological Survey in North-Central Nigeria. J Community Health 2021;46:457–70. https://doi.org/10.1007/s10900-020-00881-1 pmid:32638198
- 53. Shrestha A, Thapa TB, Giri M, Kumar S, Dhobi S, Thapa H, et al. Knowledge and attitude on prevention of COVID-19 among community health workers in Nepal-a cross-sectional study. BMC Public Health 2021;21:1424. https://doi.org/10.1186/s12889-021-11400-9 pmid:34281512