Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A deterministic compartmental model for the transition between variants in the spread of Covid-19 in Italy

  • Mario Saviano,

    Roles Conceptualization, Formal analysis, Investigation, Software, Validation, Visualization

    Affiliation Physics Department, Università degli Studi di Napoli ‘Federico II’, Napoli, Italy

  • Annalisa Fierro ,

    Contributed equally to this work with: Annalisa Fierro, Antonella Liccardo

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    annalisa.fierro@spin.cnr.it

    Affiliation Consiglio Nazionale delle Ricerche (CNR), Institute Superconductors, Oxides and other Innovative Materials and Devices (SPIN), Napoli, Italy

  • Antonella Liccardo

    Contributed equally to this work with: Annalisa Fierro, Antonella Liccardo

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Physics Department, Università degli Studi di Napoli ‘Federico II’, Napoli, Italy

Abstract

We propose a deterministic epidemic model to describe the transition between two variants of the same virus, through the combination of a series of realistic mechanisms such as partial cross immunity, waning immunity for vaccinated individuals and a novel data-based algorithm to describe the average immunological status of the population. The model is validated on the evolution of Covid-19 in Italy, during the period in which the transition between Delta and Omicron variant occurred, with very satisfactory agreement with the experimental data. According to our model, if the vaccine efficacy had been equal against Delta and Omicron variant infections, the transition would have been smoothed and the epidemic would have gone extinct. This circumstance confirms the fundamental role of vaccines in combating the epidemic, and the importance of identifying vaccines capable of intercepting new variants.

1 Introduction

About three years after the first wave of the Covid-19 epidemic broke out, our knowledge of the SARS-Cov2 virus has significantly increased, thanks to a vast research activity devoted to the comprehension of the characteristics of the virus from a genomic and immunological point of view (e.g. [14]), to the characterisation of the symptomatology induced by the virus (e.g. [5, 6]) and the related therapeutic approaches (e.g. [7]). At the same time an extensive literature, aimed at modelling the epidemic spreading, has been produced, proposing deterministic compartmental models (e.g. [811]), focusing on the geographic distribution of the epidemic by means of spatially explicit models (e.g. [1214]), including appropriate vaccination compartments (e.g. [1517]).

During this period the virus showed highly variable characteristics, with frequent mutations leading to the appearance of new variants. It also exhibited a waning immunity mechanism, i.e. the rapid decay of immunity, acquired both by contagion and vaccination, that has a crucial impact on the effectiveness of vaccines.

Starting from the wild variant, appeared in Wuhan at the end of 2019, the main variants followed over these years in the world were the Alfa variant (appeared in December 2020, soon becoming dominant), the Delta variant (appeared in India in October 2020, but becoming dominant during the summer 2021) and the Omicron variant (appeared in November 2021 and become dominant at the beginning of 2022), the latter being still dominant worldwide. The Omicron variant, appeared in Italy between late November and early December 2021, completely supplanted the Delta variant in a short time and led to a dramatic regrowth of infections.

Due to evolutionary pressure, a new variant of a pathogen will tend to spread and supplant a previous one if it is able to complete the infection cycle faster and thus can infect a large numbers of individuals compared to others [18]; if it is responsible for a less severe form of the disease (thus inducing infected subjects not to change their habits, for example, by isolating themselves); if it exhibits a fitness advantage because of mutations that permit to escape from both vaccine and natural infection immunity [19]; finally, if cross-immunity is in favour of the new variant, that is, if the immunity to the previous variant, acquired by recovering from the new variant, turns out to be more solid than vice versa. If there were no cross-immunity, two variants could coexist regardless of their degree of contagiousness.

Modelling the transition between a Covid variant and another is thus not an easy task, because it is governed by a series of factors: not only the previously mentioned cross-immunity, and waning immunity mechanism, but their interplay with the vaccination campaign and other technical and peculiar aspects of the virus.

About vaccinations, is also necessary to keep in mind that, since the beginning of the vaccination campaign in Europe (December 27, 2020 [20]), the EMA (European Medicines Agency) has authorised the administration of five different vaccines (Moderna, Pfizer / BioNTech, Jansen, AstraZeneca, Novavax) with different efficacy and different degree of waning immunity. Furthermore, in Italy, in the time period explored for this work, the vaccination campaign provided for a cycle consisting of three administrations interspersed with a period ranging from one to six months. It is therefore particularly challenging to properly modelize the immune coverage of such a heterogeneous population with respect to the vaccination status, that depends on who, when, with which vaccine and with how many doses has been immunised.

In this context, we propose a compartmental model to analyse the transition between two variants, that includes: a realistic mechanism of cross-immunity, the real trend of the vaccination campaign, the waning immunity mechanism, behavioural changes due to the increased risk awareness of the population in correspondence with increased active cases, and variations in the population mobility in specific time windows, all elements that turn out to be crucial for the correct description of the epidemic evolution. Furthermore, we developed an algorithm that allowed us to incorporate the effect of the vaccinal status evolution of the considered population as a whole, without the introduction of further compartments. The model is validated on the evolution of Covid-19 in Italy, during the period in which it reached its maximum peak of spread, the 2021/2022 autumn-winter season, reproducing the transition between Delta and Omicron variant with very satisfactory agreement with the experimental data.

A retrospective analysis has been performed to clarify the role that the different mechanisms have had in shaping the evolution of the epidemiological curve. We find that the most relevant mechanisms are the awareness mechanism, that induces individuals to increase/relax self-protective measures when the number of active cases increases/decreases, and the reduction of vaccine efficacy against the Omicron variant, without which the epidemic would have gone extinct, whereas the mobility variation have had only a minor effect on the total number of infections.

2 Materials and methods

In this section we introduce the compartmental model specifically built to analyse the evolution of Covid-19 in Italy, during the period in which the competition between the Delta and the Omicron variants was observed. In particular, starting from autumn 2021, with the definitive return of students in presence at school and the gradual reduction of smart working, the mobility of individuals has gradually returned to pre-pandemic values. In the late autumn the Omicron variant appeared, exhibiting a greater ability to evade both vaccine-provided immunity and that obtained from previous recoveries to different variants, as well as being inherently more contagious. Thus, in a short time, it completely supplanted the Delta variant, resulting in a decrease in the Rt index of the latter and in a greater contagiousness of the new variant. In the first phase, the Omicron variant was present in Italy mainly in the BA.1(.n) sub-lineages, however, in the period considered, other more contagious sub-lineages, such as BA.2(.n), began to spread causing a new growth in infections.

It should be noted that, before the appearance of the Omicron variant in addition to the Delta, other strains, such as the Beta and the Gamma, circulated in Italy. However, for the present work we will not contemplate their presence, as their impact on the incidence of the Covid-19 can be considered negligible.

2.1 The compartmental SEIJRD model

Our model includes six main epidemiological states: susceptible (S) (i.e. individuals that can contract the virus), exposed (E) (i.e. individuals that have been infected but are not yet infective), infected (I) (i.e. individuals that can transmit the virus), infected diagnosed (J), (i.e. infected individuals that received a positive swab test), removed (R) (i.e. previously infected individuals that recovered from the disease) and dead (D) (i.e. infected individuals that die). Furthermore, we split some of the compartments in the vaccinated and unvaccinated subgroups, indicated by the index j, with j = v, u (respectively vaccinated/unvaccinated), and according to the variant i = d, o (Delta/Omicron, respectively), from which they are possibly infected. The only exceptions concern the dead compartment (because they do not play any further role in the epidemic spreading) and the recovered individuals, that are separated only with respect to the variant, but not to the vaccination status, that is overcome by the immunity conferred by the infection.

In particular individuals are divided in the mutually exclusive classes reported in Table 1 according to their epidemiological status: the vaccinated and unvaccinated susceptible compartments, Sj(t), (with j = v, u); the exposed compartments, , (i.e. individuals that have been infected but are not yet infective), the infected compartments, , the diagnosed compartments, , referring with i = d, o to Delta and Omicron variants, respectively; the recovered compartment, Ri(t), from Delta and Omicron variant, with i = d, o, respectively (that includes both unvaccinated and vaccinated individuals); and finally the dead compartment, D(t) (that includes vaccinated and unvaccinated individuals, previously infected from Delta or Omicron variant). We do not consider demographic birth and (not related to the virus) death process.

It should be noted that, in order to avoid a proliferation of compartments, vaccinated individuals are not divided in relation to the number and types of vaccines received: the immune coverage associated with vaccinated individuals is obtained through an appropriate average process that takes into account the vaccination status of the population at each time (see Section 2.2).

The dynamics of the model (described by the flowchart in Fig 1) is obtained under the following assumptions (some of which underlying the usual deterministic compartment models):

  • The population is closed: new births or deaths not due to the epidemic are not contemplated. Since the time period considered for this work is only five months, it was decided to assume negligible phenomena of immigration/emigration and demographic changes.
  • Two variants of the virus, having different characteristics, circulate simultaneously in the population.
  • Vaccinated individuals exhibit lower susceptibility to the virus and lower risk of death. Other effects resulting from vaccines (such as slightly shorter recovery times) were deemed less relevant to the spread of the disease and therefore neglected.
  • Diagnosed infected individuals are subject to reduced mobility.
  • Death can only occur following a diagnosis. This hypothesis is the result of the implicit assumption that the deceased individuals have previously experienced a severe symptomatic picture and that this has certainly led them to the diagnosis of Covid-19.
  • The immunity provided by recovering from a specific variant is complete with respect to the same variant and cross-immunity is completely in favour of the new variant. From what is reported in [21], it appears that reinfections attributable to the Delta variant are very infrequent and that those attributable to the Omicron variant, although more likely, occur mainly in the time span ranging from three to twelve months from the previous infection. Therefore, given that the time period considered for this work is only five months and that the Omicron variant began to spread only in this period, it was decided to contemplate as possible reinfections only those due to Omicron variant and only for individuals previously recovered from the Delta variant.
  • Only susceptible individuals can receive the vaccine. Again, given the shortness of the time period explored, we assume that the number of vaccine administrations received by cured individuals can be considered negligible when compared to the number of administrations received by susceptible individuals, also taking into account that a recovered individual can receive the administration of a vaccine only after an appropriate time after recovery (at least 120 days [22]).

Under these assumptions, the evolution of the number of individuals (normalised to the total population) present in the various compartments is governed by the following system of ordinary differential equations: (1) whose variables and parameters are listed in Tables 1 and 2, respectively (superscripts u, v are used to distinguish unvaccinated from vaccinated individuals, while subscripts d, o differentiate the Delta from the Omicron variant).

2.2 Model parameters

In this section we will analyse the functional forms attributed to the parameters in Eq (1). Where possible, parameters have been set a priori (see Table 3); conversely, they have been obtained as fit parameters (see Table 4). Time is initialised to the first day of the considered time window (November 15, 2021), therefore, the variable t, will identify the time elapsed since that day.

  • Infection rates, αu(t). The infection rate for unvaccinated individuals is factorised as follows (2) where
    • are fit parameters (see Table 4);
    • the contact term αC(t) and the awareness term αA(t) are time dependent functions accounting for the number of contacts among individuals and the effect of preventive measures (imposed by institutions, or self-administrated), respectively.
    • αBA.2(t) is a time dependent function accounting for increased infectivity due to the emergence of new sub-lineages BA.2(.n).

    First, it should be noted that the ratio, , represents the probability that a contact between an unvaccinated individual and an infected with Omicron variant (in sub-lineages BA.1(.n)) results in an infection, compared to the same quantity evaluated for the Delta variant. With the values used for the parameters, and , shown in Table 4, the ratio, , is consistence within the errors with the value reported in Ref. [28].
    The term, αC(t), has been introduced to contemplate the time variation in contacts between individuals due to specific events. In the specific case, the recurrence of the Christmas holidays during the period analysed, certainly modified the type and frequency of close contacts among individuals. It is reasonable to assume that during Christmas holidays individuals are subject to a greater number of contacts, as well as to a diversification of the latter. In addition, it is likely that a climate of greater conviviality increases the likelihood that a contact results in an infection. To mimic such a temporary increase in the rate and proximity of contacts, we shape the term, αC(t), as a Gaussian function that takes values greater than one in the interval corresponding to the holidays. More specifically, a good adherence with experimental data was observed by modelling the term αC(t) as follows: (3) and giving the parameters Kc, tc, and τc the values in Table 4.
    The term, αA(t), called awareness term, was introduced to implement the effect of precautionary measures taken by individuals in relation to perceived risk. The use of functions to model awareness mechanisms is quite common for these types of models (see for example [29, 30]): as infections increase, it is reasonable to assume that a sense of concern spreads among the population and that health institutions adopt measures to contain the spread, for example through awareness campaigns (a similar mechanism is also introduced in [31]). Moreover, the higher the daily incidence/prevalence, the higher is the probability for susceptible individuals to get in contact with infected ones, and it is desirable that a individual, who knows to have been in contact with an infected one, even if not infected, reduce her/his mobility until the reception of a negative diagnosis.
    It is therefore clear that the term αA(t) must be constructed in such a way as to result in a decrease in infection rates in response to an increase in prevalence. In order to exhibit the functional form attributed to the term of awareness we introduce the following function of the generic variable x and the parameters m, c, w: (4) Given the w parameter a positive value, the function F(x;m, c, w) will be monotonic decreasing in the variable x and will assume maximum value 1, minimum value m and average value in position x = c. In addition, the width of the interval between the maximum and minimum value is proportional to w. A good adherence with the experimental data was observed by modelling αA(t) as a prevalence based function as follows: (5) (where Jtot(t) is the observed total prevalence) and assigning to the parameters tA, m, c, w the values shown in Table 4.
    The term, αBA.2(t), was introduced to implement an increase in the contagiousness of the Omicron variant due to the spread of BA.2(.n) sub-lineages. Denoted by χ(t) the relative (observed) incidence of sub-lineages BA.2(.n) and by ε the percentage increase in the contagiousness of these sub-lineages compared to BA.1(.n), the function αBA.2(t) can be well represented by the following relation (6) where ε is a fit parameter (see Table 4) and χ(t) was obtained from the interpolation of the data published by the Italian National Institute of Health (Istituto Superiore di Sanità -ISS) relating to the monitoring of coronavirus variants in Italy (see Table 5).
  • Infection rates, αv(t). Vaccine confers partial immunity to individuals, reducing the probability to get infected during a potentially contagious contact with an infected individual. The infection rates for vaccinated individuals can thus be related to the one for unvaccinated people through the following relations: (7) where the functions, and , represent the mean effectiveness, at time t, of immune coverage provided by vaccines, against Delta variant and Omicron variant infections, respectively. Clearly, the values assumed by these functions at time t depend on the vaccination status of the Italian population at the same time. It is thus necessary to give an explicit form to this dependency and then to evaluate the and evolution in the time period considered for this work. According to [35], the degree of immune coverage of an individual, depends on the types of vaccines received and the administration order. Therefore, in order to evaluate the mean daily effectiveness among individuals of the population, , one should in principle know when, in what combination, with what frequency and which vaccines each single individual received. Clearly these data are difficult to find and their size would result in a difficult processing.
    However, in Italy the administration of the AstraZeneca and Jansen vaccines were strongly inhibited due to reports of adverse reactions [3639], whereas the approval of the Novavax vaccine is subsequent [40] resulting, therefore, in a small number of administrations in the period considered. As a result, in Italy, the Pfizer and Moderna vaccines were mainly administered with a ratio of about 4:1 for Pfizer [41]: for this reason and for the fact that the efficacy of the Pfizer and Moderna vaccines are similar, we have decided to approximate the efficacy of all vaccines with the Pfizer one.
    For the calculation of and , we preliminary construct the following functions:
    • ni(t, τ): number of individuals who, at the day t, received the ith vaccine dose (and not yet the (i + 1) − th dose) τ days before;
    • ed/o, i(τ): mean efficacy of immune coverage against Delta/Omicron variant infections provided by the ith dose of vaccine at τ days from the administration (remember that the efficacy of vaccines against coronavirus infections is subject to the “waning” phenomenon, in other words, it tends to decay over time in a more or less pronounced way depending on the peculiar variant of the virus).

    The number of individuals who, up to the day t, have received i doses of vaccine, which we will indicate below with Ni(t), can be obtained through the following relationships: (8) From the functions just defined it is possible to derive and through the following relationships: (9) In other words, given the number of days elapsed since the start of the vaccination campaign t, the mean vaccine effectiveness over the whole Italian population at time t, , is evaluated as the weighted mean (with weights ni(t, τ)) of the efficacies, ed/o,i(τ), against Delta/Omicron variant infections provided by the i–th dose of vaccine at τ days from the administration, taking into account the waning immunity mechanism. The evaluation of the terms appearing in Eq (9) is demanded to S1 Appendix.
  • Vaccination rate, ΔV(t). Individuals are considered vaccinated if they received at least one vaccine administration. The parameter, ΔV(t), is thus constructed in such a way to reproduce the pattern of daily administration of first doses of vaccine, obtained by interpolating, the values n1(T, 0) provided by [37] in the time period considered.
  • Mortality rates, , , ,
    Following Refs. [25, 26], the efficacy of vaccines against fatal outcomes of the disease is very solid for both variants of the coronavirus, already from the second dose of vaccine. More specifically, individuals, who have received at least two doses of vaccine, are subject to a risk of death due to disease reduced by approximately 80% ÷ 100% (in relation to health status, lifestyle, gender and age) compared to non-vaccinated. Given that in the period considered for this work the fraction of vaccinated population, who received at least two doses of vaccine is always greater than 91%, it was decided to consider the following approximation (10) with . The rates of mortality of unvaccinated individuals, , , were instead used as fit parameters and their values, reported in Table 4, denote a mortality of Omicron variant infections reduced by approximately 60% compared to that from the Delta variant, similar to what is reported in [42].
  • Re-infection rate, ηdo(t)
    Following what is reported in [27], immunity against the Omicron infections, provided by a recovery to a different variant, is 56.0% (95% CI, 50.6—60.9) about 314 days after the first infection. Since this value is higher than the average efficacy provided by vaccines (calculated in S1 Appendix), it was decided to model the rate, ηdo(t), as follows: (11) with eR = 56.0% (see Table 3).
  • Recovery rates for detected infected individuals, δd and δo
    The recovery rates for detected infected individuals depend mainly on the time established by the Health Institutions to be allowed to do the healing swab (that was mandatory in Italy, during the period under investigation). Moreover, different regions acted according to different regulations, often subject to revisions. For these reasons, we chose to set δd(t) = δo(t) and to derive them from experimental data.
thumbnail
Table 5. Relative incidence of sub-lineages BA.2(.n) on the total incidence of the Omicron variants.

https://doi.org/10.1371/journal.pone.0293416.t005

3 Results

The model in Eq (1) is calibrated on the official data of the Italian outbreak from November 15 to April 4, 2022, reported daily by ISS and publicly available in [43] and has been solved using the Python SciPy libraries, with the functional forms of the parameters illustrated in Sect. 2.2 and the initial conditions reported in S2 Appendix. Input data and code are reported in [44]; simulation data in [45]. The parameters set a priori are listed in Table 3, and the best fit parameters in Table 4. The last one were obtained by minimising the χ-square with respect to the incidence experimental data, with the exception of the parameters ζ, that make also use of data on dead individuals. We perform a fit procedure on successive time windows. Indeed, different transmission parameters dominate in different time windows and, thus, the best-fit necessary to fix them are performed in progressively subsequent periods. The parameters are fixed, once and for all, in the period in which they are dominant, and maintained constant in the subsequent ones.

In this section, the predictions of our model are compared with the experimental data (normalised with respect to the number of inhabitants of the Italian population, assumed equal to 59.030.133 [46]), provided by the ISS [43]. In Figs 25, data for incidence, prevalence, cumulative numbers of recoveries and deaths are respectively plotted. Clearly the experimental data coincide with diagnosed infections, therefore, we evaluated the incidence as the sum of the incoming flows of the compartments (i = d,, o,,, j = u,, v); the prevalence as the sum of the individuals present in the compartments (i = d,, o,,, j = u,, v); the cumulative numbers of deaths and recovered as the integrals over time of flows leaving the compartments (i = d,, o,,, j = u,, v) and entering the compartment D, and the compartments Rd and Ro, respectively.

thumbnail
Fig 2. Comparison between the daily incidence predicted by the model and that observed experimentally.

https://doi.org/10.1371/journal.pone.0293416.g002

thumbnail
Fig 3. Comparison between the daily prevalence predicted by the model and that observed experimentally.

https://doi.org/10.1371/journal.pone.0293416.g003

thumbnail
Fig 4.

Main: Comparison between the cumulative number of recovered individuals (from November 15, 2021) predicted by the model (detected and total) and that observed experimentally. Inset: Fraction of undetected recovered individuals. Dashed line represents the mean value.

https://doi.org/10.1371/journal.pone.0293416.g004

thumbnail
Fig 5. Comparison between the cumulative number of deaths (from November 15, 2021) predicted by the model and that observed experimentally.

https://doi.org/10.1371/journal.pone.0293416.g005

It should be noted that the main result is the agreement between the experimental data and the model predictions on the incidence. The agreement on daily prevalence and recoveries is indeed further optimised, by virtue of the choice to derive the recovery rates for diagnosed individuals from the experimental data. Our predictions on cumulative number of deaths, plotted in Fig 5, are instead not in an equally good agreement with the experimental data, showing a slight overestimation at intermediate time and a slight underestimation at long time. We attribute this finding to the choice of fixing a time independent mortality rate for the Omicron variant (being the two disagreement regions both in the Omicron dominated period) within a model without any age-stratification. Indeed, fatality rates are highly dependent on the age of the infected individuals, being higher for elderly ones. Thus, by using a mortality rate not depending on time, we overestimate the deaths when the average age of infected individuals decreases (as it happened during the Omicron peak), and underestimate them when the average age increases (as in the final part of the epidemic curve). Looking at the ISS data on the distribution of the infected individuals among age-classes, we get confirmation of our conjecture. A model without an age stratification, as the present one, and with a time independent fatality rate cannot take in account this aspect.

The data provided in [43], related to the incidence, are not broken down in relation to the particular variant of the coronavirus. However, it is possible to have an indication of the relative incidence of the two variants from the periodic reports [32, 47, 48], provided by the ISS, monitoring the spreading of variants in Italy, where the findings of genomic sequencing (notified respectively on December 20, 2021, January 3 and 31, 2022) are given. From these data an estimation of the relative incidence of the Omicron variant, defined as the ratio between the number of sequences attributable to this variant and the number of total sequences, can be obtained. Compared with those provided by the model (see Table 6), they turn out to be in good agreement only when the relative incidence of the Omicron variant is close to one. This finding is not surprising since, in this limit, both estimates are more reliable. Indeed, in the first weeks, in which the Omicron variant appeared in Italy, the number of sequencing was extremely small and the sequences were not analysed homogeneously throughout the Italian territory, affecting in this way the estimate reliability. For instance, Omicron outbreaks could be undetected in some regions, where there were few or no sequencing. Also the model predictions (which neglects any territorial differences in the circulation of the variants) are less reliable in this limit, where the fluctuations between different regions are not negligible at all.

thumbnail
Table 6. Estimates of the relative incidence of the Omicron variant obtained from the ISS reports and the model.

https://doi.org/10.1371/journal.pone.0293416.t006

In Fig 6, the predicted trends for the incidence restricted to vaccinated and unvaccinated subjects, normalised with respect to the number of individuals belonging to these subgroups, are reported. This normalisation was carried out by fixing the size of the vaccinated population as the number of individuals, who at any time received at least one administration of vaccine (having as reference the data reported in [37]), and the size of the unvaccinated population as the remaining part. However, it should be specified that, according to the model, unvaccinated individuals from the Rd compartment can also contribute to the incidence of the vaccinated population through the flow (see Fig 1). However, for the sake of simplicity, it was decided to omit this flow since this affects only marginally the incidence, in the time window considered.

thumbnail
Fig 6.

Main: Trends (predicted by the model) of incidence in the vaccinated population and the unvaccinated population by number of individuals belonging to the two subgroups. Inset: ratio between unvaccinated and vaccinated incidence.

https://doi.org/10.1371/journal.pone.0293416.g006

Although it is no longer possible to make a comparison between the incidence of vaccinated and unvaccinated individuals predicted by the model and the corresponding experimental data (as they are no longer publicly available on the ISS website), the ratio between the incidences is consistent with the one calculated in [23], in the common time window between the two simulations (see inset of Fig 3 of the aforementioned article). Moreover, it is observed that the ratio between the unvaccinated/vaccinated incidences between the Delta dominated phase and the one dominated by the Omicron variant has undergone a significant reduction, consistent with the fact that there is a significant difference between the efficacy of the vaccines for the two variants.

Finally, it is interesting to compare the trend of the cumulative number of total recovered individuals with those recovered after a diagnosis: in this way it is possible to follow the invisible circulation of the virus. As shown in the Inset of Fig 4, our model, with the set of parameters chosen, predicts that the fraction of daily undetected recoveries varied in time with a mean value of 40% of infections run without resulting in a diagnosis, a maximum value of about 75%, corresponding to the period of Christmas holidays, and a minimum of about 20%, corresponding to the peak of incidence, due to the appearance of the Omicron variant. It should be stressed that the previous percentages strongly depend on the values of the model parameters, in particular the detection rate γ. However being such parameter constant, we expect the trend shown in Fig 4 to be representative of the experimental one.

To weigh the role that different mechanisms have had in conditioning the evolution of incidence, we considered different scenarios obtained by turning off the mechanism of awareness (scenario I), that of awareness together with that relating to the increase in contacts during the Christmas period (scenario II), and finally that of awareness together with that relating to the reduction of the effectiveness of vaccines against the Omicron variant (scenario III). Fig 7 shows the trend of incidence in each of the scenarios considered. We observe that the mechanism of awareness is crucial in containing the spread of the epidemic according to our model (see Table 7). If this mechanism had not come into play, the cumulative incidence in the time window considered would have increased by 67.5%. It is interesting to note that in scenario II, although there is no Christmas peak, there is a growth trend in the spring phase, realistically attributable to a lower immunity acquired by the population during the previous period. The effect on the cumulative incidence is an increase of 30.7% compared to the baseline simulation. From the analysis of scenario III, it is instead clear that, if the effectiveness of the vaccines had been equally valid against Omicron variant infections, the epidemic would have gone extinct. This circumstance confirms the fundamental role of vaccines in combating the epidemic, and the importance of identifying vaccines capable of intercepting new variants. Summarizing, we find that the most relevant mechanisms are the awareness mechanism, that induces individuals to increase/relax self-protective measures when the number of active cases increases/decreases, and the reduction of vaccine efficacy against the Omicron variant, without which the epidemic would have gone extinct, whereas the mobility variation have had only a minor effect on the total number of infections.

thumbnail
Fig 7. Comparison among the incidence in different scenarios.

https://doi.org/10.1371/journal.pone.0293416.g007

thumbnail
Table 7. Percentage variation in the cumulative incidence for different scenarios.

https://doi.org/10.1371/journal.pone.0293416.t007

It is also interesting to analyse the sensitivity of the model to small parameter perturbations. More specifically, we perturb the parameters reported in Table 3 (i.e. those whose values have been imposed a priori) and the values of the vaccine efficacy, , having as sensitivity indicators the variations in the cumulative numbers of diagnosed infections and deaths (which we indicate respectively with ΔJ and ΔD) over the entire period considered for this work. Tables 8 and 9 show the results of the above analysis.

thumbnail
Table 8. Sensitivity of the model with respect to change of 2% in parameters, shown in Table 3.

https://doi.org/10.1371/journal.pone.0293416.t008

thumbnail
Table 9. Sensitivity of the system with respect to variation of l 2% of the functions .

https://doi.org/10.1371/journal.pone.0293416.t009

In agreement with the fact that the Delta variant is less contagious, but significantly more lethal than the Omicron, perturbations of the parameters related to the Delta variant lead to ΔD variations more marked than the ΔJ. The opposite happens in the case of perturbations of the parameters related to the Omicron variant. Data in tables also show that the model appears to be more sensitive to perturbations of the parameters related to the Omicron variant, and particularly sensitive to perturbations of the detection rate, γo, and the vaccine efficacy, . These findings are even more evident in Figs 8 and 9, which show changes in the prevalence and in the cumulative number of deaths, in response to perturbations on the efficacy, , in the range . Changes in response to perturbations on the detection rate, γo, in the range [γo ⋅ 98%, γo ⋅ 102%], show trends that are perfectly comparable to the previous ones. From Fig 8, it is also clear that the sensitivity depends on the epidemiological situation, being more accentuated around the peak. In this phase, therefore, the error of any forecasts provided by the model would be particularly accentuated. A similar finding was observed in the Ref. [49].

thumbnail
Fig 8. Range of change in prevalence, in response to perturbation of in the region .

https://doi.org/10.1371/journal.pone.0293416.g008

thumbnail
Fig 9. Range of change in cumulative number of deaths, in response to perturbation of in the region .

https://doi.org/10.1371/journal.pone.0293416.g009

4 Discussion

The insurgence of new variants [50, 51] has been the subject of different multi-strain models, either formulated as network models [52, 53], or as deterministic compartmental models [54, 55].

Table 10 summarises the main characteristics of some models present in literature, compared to the one presented here. In particular, we focus on specific aspects such as the inclusion of some sort of cross-immunity mechanism, the modellization of the vaccination campaign, the inclusion of a waning immunity mechanism for vaccination induced immunity and the break down of the simulated data with respect to different strains, in order to analyse coexistence/transition processes. There are two crucial points in modelling the coexistence/transition between two different variants. The first one is the way in which the cross-immunity is treated (absent, partial, full cross-immunity), the second one is the way in which the immunity decay in time (if is permanent or not). Some papers opt for a full cross-immunity mechanism (i.e. the recovery from one of the two strains confers total immunity with respect to both the strains) [56, 57], however, the explicit transition from one variant to the other is rarely subject of analysis [57]. In particular, the last model focus on the transition occurred in Italy from the wild to the Alpha variant, the second one assumed to be more contagious than the first one, and becoming prevalent in April 2021, with a satisfactory agreement for the 2020 waves of epidemic, and lower accordance in the winter-spring 2020.

On the other hand, there are models, such as [58, 59], that do not include any mechanism of cross immunity, in which an individual, previously recovered from any of the two strains, becomes susceptible to both the strains, at constant rate. In particular, in [59] authors propose a compartmental model focused on the dynamics of the Omicron and Delta variants in the United States, which also includes vaccination at a constant rate. The paper reproduces with good agreement the experimental data regarding the cumulative daily cases, without discriminating between Delta and Omicron cases and consequently without actually analysing the transition between one variant and another. On the other hand, the lack of a mechanism of cross immunity makes it plausible a coexistence scenario between the two strains, as shown in Ref. [58].

One of the main novelties of the present work consisted in having explicitly modelized the transition between one variant and another, through a realistic mechanism of partial cross immunity. It is a fact that the occurrence of Omicron infection on individuals recovered from Delta variant is a much more likely event than vice versa. Our model realistically includes partial cross immunity in favour of the Omicron variant, which played an important role in letting it to supplant the Delta variant.

Secondly our model presents an innovative approach aimed at describing, in an efficient and compact way, the temporal evolution of the immune coverage of the entire population, due to the vaccination, which takes into account the timing and evolution of the vaccination campaign and the decay of immunity conferred by vaccines, without the need to introduce any additional compartment in the model.

A possible question that the reader could ask is: which aspects have been crucial for the correct reproduction of experimental data? Certainly the introduction of an awareness term was crucial to the success of the modelling, without this last term it would not have been possible to reproduce the steep descent observed in the prevalence after the peak. The crucial role of awareness in the rapid containment of the epidemiological curve is an element common to many other compartmental models, both stochastic (see for example [31]) and deterministic (see for example [23, 30]).

In the same way, to reproduce the abrupt phase of rise in prevalence, it was essential to introduce a function designed to model a significant increase of infection rates during the Christmas period, clearly due to a greater number of contacts between individuals. Therefore, our model emphasises the important role that the behaviour of individuals has on the evolution of diffusion.

This type of analysis presents some limitations. First of all, it should be stressed that, as in most of the compartmental models with more than 2 or 3 compartments, the set of parameters fixed by the model are not univocally identifiable. Actually, they are not observable parameters: the idea is to exhibit a reasonable set of parameters, that, within the specific model/formulation, allows to reproduce the epidemic evolution.

Some limitations concern the reliability of the experimental data used to validate the model. The symptomatic spectrum of Covid-19 is very wide and this circumstance, together with the great variability in the number of diagnostic tests carried out daily, has certainly meant that the incidence/prevalence observed is an underestimation of the real one: a completely asymptomatic infected individual certainly has a lower probability of being recognised compared with an individual experiencing a more severe symptomatic picture. This circumstance places a limit on the reliability of experimental data, which are used to test the model itself, since they describe only a part of the actual circulation of the virus. On the other hand the absence of information on comorbidities among the individuals who died could lead to an overestimation of death related to the epidemic.

Further limitation of the model, aimed however to avoid the proliferation of compartments, were those of not having considered the distribution by age groups of the population and different levels of severity symptoms. Any extension of the model to include the above aspects does not present conceptual difficulties and may be subject to future developments.

Because of its simplicity, the model can be easily extended to other transitions between different variants, to other countries and even to other infectious diseases with similar modes of contagion. Naturally, such an extension is subordinated to the availability of data concerning the vaccination status of the population and epidemiological data.

In future, it will be interesting to extend the stochastic models proposed in [60, 61] for the pandemic H1N1 to the spreading of Covid-19 during 2021–2022 autumn/winter: in this period indeed the almost total absence of mobility restrictions, which were instead present during the previous waves, would allow to apply the social contact hypothesis [62] in order to reproduce the epidemic spreading.

5 Conclusion

The aim of this work was to develop an epidemic model to describe explicitly the transition between two variants of the same virus. In particular we focused on the evolution of the Covid-19 in Italy, during the period in which the transition from the Delta to Omicron variant occurred, with the purpose to carry out a retrospective analysis and to understand and weigh the aspects that have most influenced the epidemic spreading. The model developed has proved to be able to reproduce, with a satisfactory agreement, the experimental data relating to the spread of the disease in the time window considered, identifying the moment in which the Omicron variant fully supplanted the Delta and the timing in which the transition occurred. A slight discrepancy in the early stages of the diffusion of the Omicron variant is most likely attributable to the fact that the baseline experimental data are affected by significant errors due to the smallness of the samples analysed and their geographical unevenness.

The retrospective analysis of the model emphasised the importance of a responsible behaviour of individuals, made evident by the deep increase of simulated cases in the absence of the awareness mechanism, as well as the importance of having vaccines capable of intercepting new variants.

Among the new elements of the present work, there are the introduction of a partial cross immunity mechanism and a specific function for the evolution of the vaccination status of the population, incorporating the mechanism of waning-immunity through a media process that has allowed to reduce the number of compartments necessary for the epidemic modelling.

Supporting information

S2 Appendix. The initial conditions, used for solving Eq (1), are reported.

https://doi.org/10.1371/journal.pone.0293416.s002

(PDF)

References

  1. 1. Kumar V, Doshi KU, Khan WH and Rathore AS, COVID-19 pandemic: mechanism, diagnosis, and treatment. Chem Technol Biotechnol 2021; 96: 299–308.
  2. 2. Gupta N, Kaur H, Yadav PD, Mukhopadhyay L, Sahay RR, Kumar A, et al. Clinical Characterization and Genomic Analysis of Samples from COVID-19 Breakthrough Infections during the Second Wave among the Various States of India. Viruses 2021, 13, 1782. pmid:34578363
  3. 3. Marik PE, Iglesias J, Varon J, Kory P. A scoping review of the pathophysiology of COVID-19. International Journal of Immunopathology and Pharmacology (2021) 35. pmid:34569339
  4. 4. Gong X, Khan A, Wani MY, Ahmad A, Duse A. COVID-19: A state of art on immunological responses, mutations, and treatment modalities in riposte. Journal of Infection and Public Health 16 (2023) 233–249. pmid:36603376
  5. 5. Struyf T, Deeks JJ, Dinnes J, Takwoingi Y, Davenport C, Leeflang MMG, et al. Signs and symptoms to determine if a patient presenting in primary care or hospital outpatient settings has COVID-19 disease. Cochrane Database of Systematic Reviews (2020) 7, CD013665. pmid:32633856
  6. 6. Dubowski K, Braganza GT, Bozack A, Colicino E, DeFelice N, McGuinn L, et al (2023) COVID-19 subphenotypes at hospital admission are associated with mortality: a cross-sectional study, Annals of Medicine, 55:1, 12–23. pmid:36444856
  7. 7. Raghav PK, Mann Z, Ahluwalia SK, Rajalingam R. Potential treatments of COVID-19: Drug repurposing and therapeutic interventions, Journal of Pharmacological Sciences (2023) 152 (1), 1–21. pmid:37059487
  8. 8. Giordano G, Blanchini F, Bruno R, Colaneri P, Di Filippo A, Di Matteo A et al. Modelling the Covid-19 epidemic and implementation of population-wide interventions in Italy. Nature Medicine 26: 855–860 (2020). pmid:32322102
  9. 9. Postnikov EB. Estimation of Covid-19 dynamics on a “back-of-envelope”: Does the simplest SIR model provide quantitative parameters and predictions? Chaos, Solitons and Fractals (2020); 135:109841. pmid:32501369
  10. 10. Wangping J, Ke H, Yang S, Wenzhe C, Shengshu W, Shanshan Y et al. Extended SIR Prediction of the Epidemics Trend of Covid-19 in Italy and Compared With Hunan, China. Front. Med. (2020); 7:169. pmid:32435645
  11. 11. Lopez LR, Rodo X. A modified SEIR model to predict the Covid-19 outbreak in Spain and Italy: simulating control scenarios and multi-scale epidemics. Results in Physics, 21 (2021), 103746. pmid:33391984
  12. 12. Bertuzzo E, Mari L, Pasetto D, Miccoli S, Casagrandi R, Gatto M et al. The geography of COVID-19 spread in Italy and implications for the relaxation of confinement measures. Nat Commun 11, 4264 (2020). pmid:32848152
  13. 13. Della Rossa F, Salzano D, Di Meglio A, De Lellis F, Coraggio M, Calabrese C et al. A network model of Italy shows that intermittent regional strategies can alleviate the COVID-19 epidemic. Nat Commun 11, 5106 (2020). pmid:33037190
  14. 14. Gatto M, Bertuzzo E, Mari L, Miccoli S, Carraro L, Casagrandi R et al. Spread and dynamics of the Covid-19 epidemic in Italy: Effects of emergency containment measures PNAS (2020); 117(19): 10484–10491. pmid:32327608
  15. 15. Giordano G, Colaneri M, Di Filippo A, Blanchini F, Bolzern P, De Nicolao G et al. Modeling vaccination rollouts, SARS-CoV-2 variants and the requirement for non-pharmaceutical interventions in Italy. Nat Med 27, 993–998 (2021). pmid:33864052
  16. 16. Antonelli E, Piccolomini EL, Zama F. Switched forced SEIRDV compartmental models to monitor COVID-19 spread and immunization in Italy. Infectious Disease Modelling, 7, 1–15 (2022). pmid:34786527
  17. 17. Massonnaud CR, Roux J, Colizza V, Crépey P. Evaluating COVID-19 Booster Vaccination Strategies in a Partially Vaccinated Population: A Modeling Study. Vaccines (2022) 10, 479. pmid:35335111
  18. 18. Mukherjee R, Satardekar R. Why are some coronavirus variants more infectious? J Biosci 46, 101 (2021). pmid:34785628
  19. 19. Plante JA, Mitchell BM, Plante KS, Debbink K, Weaver SC, Menachery VD. The variant gambit: COVID-19’s next move. Cell Host & Microbe (2021); 29 (4), 508–515. pmid:33789086
  20. 20. Istituto Superiore di Sanità (2020). National COVID-19 vaccination plan. https://www.epicentro.iss.it/en/vaccines/covid-19-vaccination-plan
  21. 21. Özüdoğru O, Bahçe YG, Acer Ö. SARS CoV-2 reinfection rate is higher in the Omicron variant than in the Alpha and Delta variants. Ir J Med Sci (2022). pmid:35711013
  22. 22. Ministero della Salute (2023) Vaccini anti Covid–19. https://www.salute.gov.it/portale/p5_1_2.jsp?lingua=italiano&id=255
  23. 23. Fierro A, Romano S, Liccardo A (2022) Vaccination and variants: Retrospective model for the evolution of Covid-19 in Italy. PLoS ONE 17(7): e0265159. pmid:35802624
  24. 24. Wu Y, Kang L, Guo Z, Liu J, Liu M, Liang W. Incubation Period of COVID-19 Caused by Unique SARS-CoV-2 Strains: A Systematic Review and Meta-analysis. JAMA Netw Open. 2022 Aug 1;5(8):e2228008. pmid:35994285
  25. 25. Yan VKC, Wan EYF, Ye X, Mok AHY, Lai FTT, Chui CSL et al. Effectiveness of BNT162b2 and CoronaVac vaccinations against mortality and severe complications after SARS-CoV-2 Omicron BA.2 infection: a case-control study. Emerg Microbes Infect. (2022), 11(1):2304–2314. pmid:35980089
  26. 26. Sheikh A, Robertson C, Taylor B. BNT162b2 and ChAdOx1 nCoV-19 Vaccine Effectiveness against Death from the Delta Variant. N Engl J Med. (2021), 385(23):2195–2197. pmid:34670038
  27. 27. Altarawneh HN, Chemaitelly H, Hasan MR, Ayoub HH, Qassim S, AlMukdad S et al. Protection against the Omicron Variant from Previous SARS-CoV-2 Infection. N Engl J Med (2022), 386:1288–1290 pmid:35139269
  28. 28. Lyngse FP, Mortensen LH, Denwood MJ et al. Household transmission of the SARS-CoV-2 Omicron variant in Denmark. Nat Commun 13, 5573 (2022). pmid:36151099
  29. 29. Musa SS, Qureshi S, Zhao S, Yusuf A, Mustapha UT, He D. Mathematical modeling of COVID-19 epidemic with effect of awareness programs. Infect Dis Model. 2021;6:448–460. pmid:33619461
  30. 30. Romano S, Fierro A, Liccardo A (2020) Beyond the peak: A deterministic compartment model for exploring the Covid-19 evolution in Italy. PLoS ONE 15(11): e0241951.
  31. 31. Fierro A, Liccardo A (2013) Lattice Model for Influenza Spreading with Spontaneous Behavioral Changes. PLoS ONE 8(12): e83641. pmid:24376727
  32. 32. Istituto Superiore di Sanità (2022). Stima della prevalenza delle varianti VOC (Variant Of Concern) e di altre varianti di SARS-CoV-2 in Italia. (Indagine del 31/01/2022). https://www.epicentro.iss.it/coronavirus/pdf/sars-cov-2-monitoraggio-varianti-indagini-rapide-31-gennaio-2022.pdf
  33. 33. Istituto Superiore di Sanità (2022). Stima della prevalenza delle varianti VOC (Variant Of Concern) e di altre varianti di SARS-CoV-2 in Italia. (Indagine del 07/03/2022). https://www.epicentro.iss.it/coronavirus/pdf/sars-cov-2-monitoraggio-varianti-indagini-rapide-7-marzo-2022.pdf
  34. 34. Istituto Superiore di Sanità (2022). Comunicato Stampa N°30/2022—Covid19: flash survey Iss, il 4 aprile Omicron al 100%, sottovariante BA.2 predominante. https://www.iss.it/web/guest/comunicati-stampa/-/asset_publisher/fjTKmjJgSgdK/content/comunicato-stampa-n%C2%B030-2022-%C2%A0covid19-flash-survey-iss-il-4-aprile-omicron-al-100-sottovariante-ba.2-predominante
  35. 35. Andrews N, Stowe J, Kirsebom F, Toffa S, Rickeard T, Gallagher E, et al. Covid-19 vaccine effectiveness against the Omicron (B. 1.1. 529) variant. N Engl J Med 2022; 386:1532–1546. pmid:35249272
  36. 36. Agenzia Italiana del Farmaco (2021) AIFA: sospensione precauzionale del vaccino AstraZeneca. https://www.aifa.gov.it/-/aifa-sospensione-precauzionale-del-vaccino-astrazeneca
  37. 37. Governo Italiano. Report Vaccini Anti COVID-19. https://www.governo.it/it/cscovid19/report-vaccini/
  38. 38. European Medicines Agency (2021). AstraZeneca’s COVID-19 vaccine: EMA finds possible link to very rare cases of unusual blood clots with low blood platelets. https://www.ema.europa.eu/en/news/astrazenecas-covid-19-vaccine-ema-finds-possible-link-very-rare-cases-unusual-blood-clots-low-blood
  39. 39. European Medicines Agency (2021). COVID-19 Vaccine Janssen: EMA finds possible link to very rare cases of unusual blood clots with low blood platelets. https://www.ema.europa.eu/en/news/covid-19-vaccine-janssen-ema-finds-possible-link-very-rare-cases-unusual-blood-clots-low-blood
  40. 40. Agenzia Italiana del Farmaco (2021). AIFA approva il vaccino Nuvaxovid (Novavax). https://www.aifa.gov.it/-/aifa-approva-vaccino-nuvaxovid
  41. 41. Agenzia Italiana del Farmaco. Farmacovigilanza su vaccini COVID-19. https://www.aifa.gov.it/farmacovigilanza-vaccini-covid-19
  42. 42. Lorenzo-Redondo R, Ozer EA, Hultquist JF. Covid-19: is omicron less lethal than delta? BMJ 2022;378:o1806. pmid:35918084
  43. 43. https://github.com/pcm-dpc/COVID-19 and https://github.com/owid/covid-19-data/tree/master/public/data/vaccinations.
  44. 44. https://doi.org/10.5281/zenodo.8131460
  45. 45. https://doi.org/10.5281/zenodo.7870430.
  46. 46. Istituto Nazionale di Statistica (2022). https://www.istat.it/it/files//2022/12/CENSIMENTO-E-DINAMICA-DEMOGRAFICA-2021.pdf
  47. 47. Istituto Superiore di Sanità (2021). Stima della prevalenza delle varianti VOC (Variant Of Concern) e di altre varianti di SARS-CoV-2 in Italia: beta, gamma, delta, omicron e altre varianti di SARS-CoV-2. (Indagine del 20/12/2021). https://www.epicentro.iss.it/coronavirus/pdf/sars-cov-2-monitoraggio-varianti-indagini-rapide-20-dicembre-2021.pdf
  48. 48. Istituto Superiore di Sanità (2022). Stima della prevalenza delle varianti VOC (Variant Of Concern) e di altre varianti di SARS-CoV-2 in Italia. (Indagine del 03/01/2022). https://www.quotidianosanita.it/allegati/allegato7474971.pdf
  49. 49. Fošnarič M, Kamenšek T, Žganec Gros J, Žibert J. Extended compartmental model for modeling COVID-19 epidemic in Slovenia. Sci Rep 12, 16916 (2022). pmid:36209174
  50. 50. Tao K, Tzou PL, Nouhin J et al. The biological and clinical significance of emerging SARS-CoV-2 variants. Nat Rev Genet 22, 757–773 (2021). pmid:34535792
  51. 51. Zhao Y, Huang J, Zhang L, Chen S, Gao J, Jiao H. The global transmission of new coronavirus variants. Environmental Research, 206, 112240 (2022). pmid:34688639
  52. 52. Sridhar A, Yağan O, Eletreby R, Levin SA, Plotkin JB, Poor HV. Leveraging A Multiple-Strain Model with Mutations in Analyzing the Spread of Covid-19. ICASSP 2021—2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada, 2021, pp. 8163-8167.
  53. 53. Yagan O, Sridhar A, Eletreby R, Levin SB, Plotkin J, Poor HV (2021) Modeling and Analysis of the Spread of COVID-19 Under a Multiple-Strain Model With Mutations. Harvard Data Science Review, (Special Issue 1).
  54. 54. Khyar O, Allali K. Global dynamics of a multi-strain SEIR epidemic model with general incidence rates: application to COVID-19 pandemic. Nonlinear Dyn. (2020); 102(1): 489–509. pmid:32921921
  55. 55. Massard M, Eftimie R, Perasso A, Saussereau B. A multi-strain epidemic model for COVID-19 with infected and asymptomatic cases: Application to French data. Journal of Theoretical Biology (2022); 545, 111117. pmid:35513167
  56. 56. Gonzalez-Parra G, Martínez-Rodríguez D, Villanueva-Micó RJ. Impact of a New SARS-CoV-2 Variant on the Population: A Mathematical Modeling Approach. Math. Comput. Appl. (2021); 26(2), 25.
  57. 57. Ramos AM, Vela-Pérez M, Ferrández MR, Kubik AB, Ivorra B. Modeling the impact of SARS-CoV-2 variants and vaccines on the spread of COVID-19. Commun Nonlinear Sci Numer Simul. (2021);102:105937. pmid:34188432
  58. 58. Arruda EF, Das SS, Dias CM, Pastore DH (2021) Modelling and optimal control of multi strain epidemics, with application to COVID-19. PLoS ONE 16(9): e0257512. pmid:34529745
  59. 59. Ngonghala CN, Taboe HB, Safdar S, Gumel AB (2023) Unraveling the dynamics of the Omicron and Delta variants of the 2019 coronavirus in the presence of vaccination, mask usage, and antiviral treatment. Applied Mathematical Modelling; 114, 447–465. pmid:36281307
  60. 60. Liccardo A, Fierro A (2013). A Lattice Model for Influenza Spreading. PLoS ONE 8(5): e63935 pmid:23717512
  61. 61. Liccardo A, Fierro A (2015). Multiple Lattice Model for Influenza Spreading. PLoS ONE 10(10): e0141065 pmid:26513580
  62. 62. Wallinga J, Teunis P, Kretzschmar M (2006). Using data on social contacts to estimate age-specific transmission parameters for respiratory-spread infectious agents. American Journal of Epidemiology 164: 936–944 pmid:16968863