Figures
Abstract
During epidemics people may reduce their social and economic activity to lower their risk of infection. Such social distancing strategies will depend on information about the course of the epidemic but also on when they expect the epidemic to end, for instance due to vaccination. Typically it is difficult to make optimal decisions, because the available information is incomplete and uncertain. Here, we show how optimal decision-making depends on information about vaccination timing in a differential game in which individual decision-making gives rise to Nash equilibria, and the arrival of the vaccine is described by a probability distribution. We predict stronger social distancing the earlier the vaccination is expected and also the more sharply peaked its probability distribution. In particular, equilibrium social distancing only meaningfully deviates from the no-vaccination equilibrium course if the vaccine is expected to arrive before the epidemic would have run its course. We demonstrate how the probability distribution of the vaccination time acts as a generalised form of discounting, with the special case of an exponential vaccination time distribution directly corresponding to regular exponential discounting.
Citation: Schnyder SK, Molina JJ, Yamamoto R, Turner MS (2023) Rational social distancing in epidemics with uncertain vaccination timing. PLoS ONE 18(7): e0288963. https://doi.org/10.1371/journal.pone.0288963
Editor: Jan Rychtář, Virginia Commonwealth University, UNITED STATES
Received: May 2, 2023; Accepted: July 7, 2023; Published: July 21, 2023
Copyright: © 2023 Schnyder et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting information files.
Funding: This work was supported by the Grants-in-Aid for Scientific Research (JSPS 221 KAKENHI) under Grants No. 17K17825 (JJM), 20H00129 (RY), 20K03786 (JJM), 222 20H05619 (RY), 22H04841 (SKS) and the SPIRITS 2020 grant of Kyoto University 223 (JJM). MST acknowledges the generous support of visiting fellowships from JSPS 224 Fellowship, ID L19547, and the Leverhulme Trust, Ref. IAF-2019-019, and the kind 225 hospitality of the Yamamoto group. Websites: JSPS: https://www.jsps.go.jp/english/ Leverhulme Trust: https://www.leverhulme.ac.uk/ The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Vaccination is often the most successful policy tool against highly infectious diseases [1, 2]. In the absence of an effective vaccine, a wealth of alternative interventions become necessary. For instance, social distancing can be employed to reduce contacts with potentially infectious individuals at a social and economic cost to the individuals and to society at large [3]. There are many possible approaches to studying such behaviour (for a broad overview, see the reviews [4–6]): The course of the epidemic and the behaviour of the population can be modelled using agent-based models [7–11] or compartmental mean field models [12], or on spatial [13, 14] or temporal networks [15, 16]. The behaviour of the population can either be imposed ad-hoc or, increasingly commonly, it is assumed to arise from the decisions made by rational actors [4, 5, 17–22], i.e. actors seeking to maximise an objective function with their actions. In centralised decision-making, a central planner, typically a government, is assumed to be able to direct population behaviour directly to target the global or social optimum of the utility. This is typically framed as an optimal control problem. In decentralised decision-making individuals seek to optimise their own utility functional in what represents an (economic) game. where they endogenously target a Nash equilibrium instead of a global utility maximum [17–19, 21, 23]. This is typically framed as a game theoretic problem [9, 18]. The Nash equilibrium typically has lower utility than the global utility maximum, since the self-interest of the individuals biases their decision-making away from full cooperation. This is known as a social dilemma [9, 24–26]. In the situation discussed in this manuscript, the social dilemma arises because the individual’s objective function focuses on their own fate only and cannot take into account additional infections caused by their own infectiousness. Intervention schemes can be used by a social planner to incentivise fully cooperative behaviour such that the Nash equilibrium comes into alignment with the global optimum [27–31].
What constitutes optimal or equilibrium behaviour is sensitive to the choice of objective function and to the parameters of the situation. The cost of infection, infectivity of the disease, effectiveness and cost of social distancing all play significant roles. Social distancing is typically costly, so that it cannot be carried out indefinitely. Since a population-scale vaccination event strongly impacts an epidemic, it is natural to ask how individuals should behave if they can expect such an event to occur. For the special case of when the future vaccination (or treatment) date is precisely known, equilibrium social distancing (of individuals) and optimal social distancing (enabled by a benevolent social planner) has already been investigated [17, 20]. In this situation social distancing behaviour will be the stronger the earlier the vaccination arrival.
However, vaccination timing is usually not known precisely, especially not far in advance. It is more realistic to assume that the vaccination development time follows a probability distribution. The simplest assumption is one where, for each unit time interval, the vaccination is equally likely to arrive [21]. In such a situation the surprising result was reported that vaccination has no discernible effect on the decisions made by individuals.
Here, in the present work, we relax the assumption of constant vaccine development probability per time and calculate equilibrium behaviour for more general vaccination arrival probability distributions. We study equilibrium decision-making in a differential game in which a representative individual makes decisions being exposed to an epidemic. The epidemic is modelled by a standard SIR type compartmental model. The individual’s decisions seek to optimise an objective function balancing infection and social distancing costs, while taking into account expectations about vaccination arrival timing. We calculate the arising equilibrium behaviour for all times on the condition that at any given time the vaccination has not yet arrived. When the vaccine does arrive, the behaviour returns to the pre-epidemic default behaviour as there is no longer any incentive to socially distance. We can also deal with the case where the probability distribution is updated, e.g. due to the arrival of improved information on the vaccine developmental delay. The state of the epidemic at this update time then serve as the initial conditions for an analysis following exactly the same methodology. We show that in the formalism of expected utility theory, the vaccination time distribution can be interpreted as a form of generalised discounting, with an exponential distribution yielding the standard exponential discounting. We find that result for sharp vaccination timing—that the earlier the vaccine can be expected to arrive, the stronger the social distancing will be—also holds for uncertain vaccination timing at the qualitative level. In addition, we find that, for a series of probability distributions of increasing sharpness, the social distancing becomes stronger, the more sharply peaked the distribution.
Since we concentrate on the rational decision-making taking place before the vaccination arrival, we do not investigate the complex situations that arise when the (costly) decision of whether or not to vaccinate (or receive other treatments) are under the control of individuals (this being called a vaccination game) [4, 5, 9, 18, 32–38] or a political decision maker [38–40], to be applied in an optimal manner over time [4, 36] and/or space [11, 41]. Vaccination games often play out over many epidemic seasons whereas we focus on a single epidemic season. Vaccination games represent social dilemma as well, with individuals who chose not to vaccinate profiting from the indirect protection provided by the vaccinated fraction of the population without having to take on the cost of the vaccination themself [4, 9, 34, 42]. In this work, vaccination is an exogenous event, being given to the whole population at once and for free. We also assume that the vaccine works perfectly. This is an idealisation, since vaccines in practice can work imperfectly and it is known that the effectiveness of a vaccine can have an effect on whether individuals decide to get vaccinated or not [9, 37, 43–47], thereby increasing the social dilemma’s strength. However, the inclusion of vaccine effectiveness would drastically complicate this study and thus lies outside the scope of this work. While our work could be generalised to include partially effective vaccines, we reserve these developments for future studies. We also neglect effects that represent a positive flux into the susceptible compartment, such as the loss of immunity in recovered people over time [28, 33], e.g. due to the emergence of new variants due to mutation [48], or a birth process [33, 47]. These effects can result in the existence of (multiple) stationary states [47, 49]. This and other complexities could be included in our approach in principle, such as multiple agent types with different risk and behaviour profiles [19, 50–53], seasonal effects [54], stochastic control [13, 55–58], or decentralised optimal behaviour via interventions orchestrated by a benevolent social planner [27–31]. We reserve these developments for future studies.
In the following sections, we first introduce the compartmental model for the disease, introduce a mean-field game framework for individual decision-making in an epidemic, provide a definition for the Nash equilibrium in our system, then calculate the equilibrium behaviour for known vaccination time, and finally generalise this result to arbitrary vaccination probability distributions.
Methods
Epidemic dynamics
In our model, the epidemic follows a standard SIR compartmentalised model [12]. The population is composed of susceptible, infected and recovered compartments. The recovered compartment is meant to include the fraction of fatalities. The sizes of the compartments evolve over time as
(1)
with initial values s(0) = 1 − i0 and i(0) = i0 at a time t = 0. Time derivatives are denoted with a dot. We measure time in units of the timescale of recovery from an infection, i.e. recovery rate = 1. The control in this system is given by the population averaged infectiousness k(t), which can be interpreted as the average number of new cases that would be caused by one infected individual in a fully susceptible population. We assume that the behaviour of the population determines k(t), so we will directly call it behaviour or control. In the absence of an epidemic, the population would exhibit a typical behaviour that corresponds to a default level of infectivity, κ* > 1. This value directly corresponds to the basic reproduction number R0. Social distancing behaviour is expressed in the model as a reduction of k away from κ*. This work is primarily concerned with calculating k(t) self-consistently for a range of vaccination arrival scenarios. We drop the equation for the recovered compartment r from here on, since its dynamics has no influence on the population behaviour.
Mean-field game gives rise to Nash equilibrium
In what follows, we derive the average behaviour of the population k(t) as a Nash equilibrium arising from a mean-field game [59, 60], directly following the framework set out by Reluga TC and Galvani AP [18]. We assume that the population consist of a large number of identical individuals and that the effect of any given individual’s behaviour on the outcome of the epidemic as a whole is negligible. The approach then focuses on one representative individual navigating the epidemic with the rest of the population being treated as an exogenous mean-field that evolves according to Eq 1. The individual responds with its own behaviour to the course of the epidemic which is in turn determined by the population’s behaviour. In a final step, the population behaviour is made to self-consistently arise from the individual’s behaviour. In detail:
The fate of the representative individual can be described as a series of discrete transitions from one compartment to the next, at random times. Instead of modeling these jumps, we calculate the expected probabilities ψj of said individual being in any of the compartments j ∈ s, i. The dynamic equations for the individual can be constructed as follows: In analogy to the SIR model, the individual is infected by coming in contact with the population compartment i and the infection rate depends on the probability of the individual being susceptible, ψs. We assume that the individual can choose a behaviour κ(t) that is distinct from the average population behaviour k(t) and that only κ(t) has a direct influence on the infection rate of the individual. The recovery process of the individual naturally involves ψi instead of i, so that we can write
(2)
with initial values ψs(0) = s(0) and ψi(0) = i(0).
The individual is assumed to be choosing a behaviour κ(t) that optimises a utility functional U = U(κ(t), k(t)). The notation exposes that the utility of the individual also depends on the population behaviour which is determining the course of the epidemic. If there is a Nash equilibrium in this system, it is given by a behaviour κ(t) that, if adopted by the population, the individual would have to select the same behaviour to optimise their utility
(3)
We can find the Nash equilibrium by calculating the individual behaviour κ(t) which maximises U for a given, exogenous population behaviour k(t). We then self-consistently assume that all individuals would choose to optimise their behaviour in the same way and that therefore the expected population behaviour is given by k = κ. For a deeper discussion of the approach, see Ref. [18].
In what follows, we will first analyse the situation in which the vaccination time is precisely known to individuals at the outset, before deriving the generalisation for vaccination time distributions.
Individual decision-making for known vaccination time
We analyse a simple stylised form for the individual utility U with discounted utility per time u (4)
(5)
Here, τecon is the economic discount time of an individual. The parameter α represents the cost per unit time of being infected, and can include a contribution from the cost of death. The parameter β parameterises the financial and social costs associated with an individual modifying their behaviour from the baseline infectivity κ*. We choose a quadratic form to ensure a natural equilibrium at κ = κ* in the absence of disease. We choose the units for the utility such that β = 1 without loss of generality. (All parameters and their values are given in Table 1) This general form of the objective function is also used in [20] with a somewhat different notation.
If vaccination occurs at tv, immediately all remaining susceptibles are vaccinated and can be counted as recovered, i.e. s(t > tv) = 0, and the remaining infectious recover exponentially. The utility cost of this recovery process after tv can be captured in a salvage term Uv. In other words, the salvage term represents the fact that it is still costly for an individual to be infected when the vaccination becomes available. We obtain, with the probability of being infected at vaccination time ψi(tv) = ψi,v (for the derivation, see section A in the S1 File)
(6)
(7)
Naturally, one can see that Uv → 0 for tv → ∞. It would be possible to modify the salvage term to include the effect of an imperfect vaccine that would then also depend on the fraction of susceptible individuals at vaccination s(tv).
The individual seeks to optimise the utility function Eq (6) by choosing a κ(t) while being subject to Eq (2). The population dynamics s(t), i(t) and behaviour k(t) are taken as exogenous. This constrained optimisation problem represents a standard optimal control problem [61]. Intending to exploit Pontryagin’s maximum principle, we formulate a Hamiltonian H. Using H, we derive equations for the adjoint values vs(t) and vi(t), which express the (economic) value of being in the given state at a given time, and which represent the Lagrange multipliers satisfying the constraints to the optimisation. In addition, we can calculate an expression for the optimal control. The Hamiltonian for the individual behaviour during the epidemic consists of the individual cost function Eq (5) and of the equations describing the dynamics of the probabilities of an individual being in one of the relevant compartments, Eq (2),
(8)
Then, the equations for the expected present values of being in states s and i are
(9)
The values are constrained by boundary conditions at the upper end of the integration interval of the utility derived from the vaccination salvage term,
(10)
The optimal control for an individual follows from
(11)
and reads
(12)
A Nash equilibrium occurs when all individuals, seeking to optimise their own objective function, would choose the same behaviour κ(t), in which naturally the average population behaviour would self-consistently also become k(t) = κ(t). Therefore s = ψs and i = ψi, and
(13)
Individual decision-making under uncertainty
Until now we had assumed that a perfect vaccine becomes available at a set time tv and that the objective function U yields the Nash equilibrium behaviour κ(t); now, we explicitly acknowledge the role of tv in the notation and write this utility function as U(κ, k, tv). However, the development schedule of vaccines is uncertain and it is more plausible to only assume knowledge of the probability distribution p(tv) of the vaccination timing. Thus, the expected individual utility under this uncertainty can be expressed as
(14)
with the Nash equilibrium behaviour κ(t) that which maximises
with k = κ imposed for self-consistency.
Naturally, the behaviour κ(t) is only optimal for as long as the vaccine has not actually become available. Immediately after the vaccination occurs the susceptible fraction drops to 0, and subsequently, the number of infections exponentially decays. In that case, social distancing becomes unnecessary.
Inserting the general form of the utility as defined above, Eq (6), we have
(15)
Note that Uv(tv) in general depends on the state of the ODEs at tv, i.e. s(tv), i(tv), ψs(tv), ψi(tv), etc., and therefore implicitly depends on the choice of k and κ as well. We drop this dependence from the notation for brevity.
In order to apply the standard framework for expected utility optimisation, the integral over t has to be the outer integral. By reversing the order of the integrals, see S1 Fig, we obtain
(16)
Defining the cumulative distribution function
(17)
we can write
(18)
Relabelling the dummy variable tv → t in the second integral, we obtain the averaged utility in a standard form
(19)
which can be optimised using the same approach used for the case of precisely known vaccination time. To facilitate numerical solution, we truncate the utility integral at an end time te and introduce a salvage term
which represents the expected contribution to the utility from the course of the epidemic after te
(20)
(21)
The latter expression can be evaluated using the asymptotic solution of the SIR model (see S1 File, section C)
(22)
where ψs/i,e = ψs/i(te) and it is convenient to introduce
(23)
(24)
Note that Ue → 0 for te → ∞. We always choose the end time to be far longer than the duration of the epidemic so that the results become independent from it, typically te = 200.
The (present value) Hamiltonian is
(25)
Inserting our typical utility, Eqs (4) and (5), and assuming perfect vaccination, Eq (7), we get
(26)
and values defined by
(27)
with boundary conditions
(28)
The Nash equilibrium control follows from
which we solve for κ
(29)
Assuming that all individuals of the population decide in the same way, the average population behaviour becomes k = κ, from which follows that s = ψs and i = ψi,
(30)
The result is well defined as long as 1 − C(t) < 0, i.e. as long as vaccination is not certain to have happened. After certain vaccination κ = κ*.
Finally, in the Nash equilibrium, the utility captured by the salvage term can be more simply calculated as
(31)
The optimisation problem under vaccination uncertainty is thus given by the SIR equations of Eqs (1), (27), (28) and (30)). The latter three equations replace Eqs (9), (10) and (13), respectively. Direct comparison reveals that the vaccination probability distribution plays the role of generalised discounting, where the standard exponential discounting term is amended by combinations of integrals over p(t) and C(t).
Special distributions of vaccination times
First, we want to confirm that the new formalism reduces to the previous one for precisely known vaccination time: For p(tv) = δ(t − tv), we have 1 − C(t) = 1 for t ≤ tv and = 0 otherwise. As expected, the utility then reduces back to its original form .
We now go further and consider a class of probability distributions defined by
(32)
with exponent n and decay time τ, see Fig 1. By changing n we can tune across a range of distributions, from an exponential distribution (n = 0) to more sharply peaked distributions at larger values of n, see Fig 1. For these distributions the expectation value of vaccination time is given by
(33)
A) The distributions studied in this work, see Eq (32) with expected vaccination time 〈tv〉 = (n + 1)τ for n = 0, 1, 10, 40, for arbitrary τ. The higher the n, the more strongly peaked the distribution, with n = 0 yielding an exponentially decaying function with its peak at t = 0. B) The corresponding cumulative distribution functions, as defined by Eq (17).
Previously, we pointed out that vaccination uncertainty plays the role of a generalised form of discounting. For and C(t) = C0(t) = 1 − exp[−t/τ], this reduces further to standard exponential discounting: With the utility integrand u including a discounting factor
as given in Eq (5), the utility function becomes
(34)
with
(35)
see S1 File, section C. This can be simplified further by introducing a new discounting time
and a modified cost of infection
, obtaining
(36)
which yields boundary conditions for the values
(37)
These have the same form as the original equations, Eqs (5) to (7), except for the salvage term
and the boundary conditions for the economic value vs(te). This small difference is usually negligible and vanishes when te is chosen much larger than the duration of the epidemic, since ie is decaying exponentially for long times, see S1 File, section C. The cutoff time te was introduced only for numerical convenience. In order to accurately represent the full vaccination distribution p(t) we choose te = 200, large enough that it has no discernible effect on the dynamics. In this case one can then safely assume that vs(te) ≈ 0 and the value boundary conditions also become equivalent to the case of standard exponential discounting. Except for extremely small values of τ, one can then also safely approximate
.
Results
Individual decision-making for known vaccination time
We numerically solve the resulting set of equations, Eqs (1), (9), (10) and (13) with i0 = 3 ⋅ 10−8, with a standard forward-backward sweep approach [61]. We ignore economic discounting by setting τecon → ∞.
We show the Nash equilibrium behaviours and corresponding courses of the epidemic for a range of vaccination times tv in Fig 2A–2C. We choose here a cost of infection of α = 400, for which equilibrium social distancing slows down the duration of the epidemic from about 10 disease generations, assuming no behavioural modification, (see S3 Fig and Ref. [30]) to about 50 if there is no expectation of a vaccination (see curve labeled “no vax” in Fig 2A). The peak of the epidemic occurs after 5–10 disease generations. The “no-vax” behaviour is also observed if the vaccine is expected to arrive far later than the course of the epidemic, e.g. see the data for tv = 100.
A) Nash equilibrium behaviour k for a range of sharp vaccination times tv, as given in the legend of panel C). The behaviour is insensitive to tv for large values and indistinguishable from the behaviour if the vaccination is not expected to occur. When tv is comparable to or shorter than the duration of the epidemic without vaccination, equilibrium behaviour exhibits strong social distancing. The corresponding courses of the epidemic are shown in panel B for the susceptibles and C for the infected. D-F) Nash equilibrium behaviour k and course of the epidemic assuming that the vaccination arrival time is exponentially distributed, p = p0(t), see Eq (32), with an expected vaccination time 〈tv〉, see panel F for legend. The behaviour and corresponding course of epidemic arising from the assumption that vaccination will not occur are shown as gray solid lines. This is calculated from the case for precisely known vaccination time tv but with tv → ∞. G-I) Nash equilibrium behaviour k and course of the epidemic assuming that the vaccination arrival time is distributed according to p1, see Eq (32). See panel I for legend. Other parameters: infection cost α = 400 and no economic discounting, τecon → ∞.
The Nash equilibrium generically yields lower utility than the social optimum, in which fewer people get infected and the epidemic has a shorter duration, see S3 Fig for an example. The social optimum can be derived by assuming that the whole population’s behaviour k can be directed as a whole and that individuals are not free to choose otherwise. The corresponding utility is then defined at the population level and arises as a sum over all the utilities of all individuals in the population. See S1 File, section E, for further details.
If the vaccine arrives earlier, it begins to influence equilibrium decision-making, with social distancing becoming the more pronounced the earlier the vaccination is known to occur, see Fig 2A–2C. The observed behaviour is quite similar to earlier results, see [17, 20]. The main difference is given by our different choice of parameters: the high baseline infectivity κ* and higher cost of infection α lead to stronger social distancing which is gradually relaxed over a long time.
The equilibrium behaviour is especially sensitive to values of tv that are shorter than the duration of the “no-vax” rational epidemic course, indicating that it is not rational to further prolong the duration of the epidemic to hold out for the arrival of vaccine. We can conclude that the vaccination is only of relevance to the population if it is expected to happen on a shorter timescale than the duration of the epidemic itself. The same conclusion qualitatively holds for the social optimum as well, see S4 Fig.
Having established this result, we can now investigate how equilibrium behaviour is modified if the precise vaccination time is unknown.
Individual decision-making for vaccination time distributions
The results discussed here are numerical solutions of Eqs (1), (23), (24), (27), (28) and (30) with i0 = 3 ⋅ 10−8 via the same standard forward-backward sweep approach [61] as used for the sharp vaccination timing. In practice, however, we find that it is necessary to first introduce a rescaling of the economic values to avoid problems with numerical divergences, see S1 File, section D for details. We stress again that we calculate the equilibrium behaviour given a certain vaccination probability distribution p(t) for any given time t on the condition that vaccination has not yet occurred at that time. A vaccinated individual would exhibit behaviour κ = κ*. To facilitate comparison of the results for different probability distributions with each other, we present the results with respect to the expected vaccination time 〈tv〉 = (n + 1)τ and not τ directly.
In contrast to the cases when there is a precisely known vaccination time, Fig 2A–2C, the equilibrium behaviour for p = p0 varies more smoothly with 〈tv〉, see Fig 2D–2F. It is however still qualitatively similar—smaller 〈tv〉 results in stronger social distancing. Even for very large 〈tv〉, e.g. 〈tv〉 = 100, we observe increased social distancing with respect to the no-vaccination case owing to the fact that the vaccination probability distribution at early times is non-zero. We also note that even for t > 〈tv〉, i.e. when the vaccination event is overdue, there still exists an incentive to social distance more strongly than in the no-vaccination scenario. For p(t) = p1(t), the results are qualitatively similar to those for p0, see Fig 2G–2I, even though the probability distribution looks quite different, exhibiting a peak. The same is true for p10 and p40, see S2 Fig for a side-by-side comparison. Qualitatively similar trends are observed for the social optimum as well, see S4 Fig.
It stands to reason that the sharper peaked the probability distribution is, the closer the behaviour would match the situation in which the vaccination time is precisely known. This effect can be clearly observed in the expected number of vaccinations , see Fig 3A and 3B. For a sharp vaccination time tv, this quantity is given by s(tv) directly. For the studied vaccination distributions, we observe that the more weakly varying the distribution is, i.e. the smaller n is, the more smoothly 〈s(tv)〉 depends on 〈tv〉. For n = 10, the outcome already closely matches the case of sharp vaccination timing, and for n = 40 the difference becomes negligible in this representation. Similarly, the smaller n is, the more smooth is the increase in the infection peak maxt(i(t)) with expected vaccination time, see Fig 3C. Particularly high infection peaks are expected when the vaccination is certain to arrive outside of the expected duration of the epidemic, i.e. for large 〈tv〉 and large n.
A) We show the vaccinated fraction of the population s(tv) for the equilibrium solution if the vaccination is known to occur at a precise tv in grey. The later the vaccination time, the smaller s(tv) becomes. For comparison, we are showing the expected number of vaccinations, given by the expectation value of the susceptible compartment, 〈s(tv)〉 as a function of the expected vaccination time 〈tv〉 for the a range of vaccination arrival distributions pn. These data follow the same qualitative trend as for certain vaccination timing, but the sharper the probability distribution (the higher the n), the more closely the result approaches the case of certain vaccination at t = tv. B) We show 〈s(tv)〉 as a function of 〈tv〉 again, but as a heat map for a greater range of probability distributions pn. Brighter colours indicate higher 〈s(tv)〉. Note the nonlinear increase of n on the y-axis. C) Relatedly, we show the peak of infections maxt(i(t)) as a heat map as function of the expected vaccination time 〈tv〉 for the same range of vaccine arrival distributions pn as in B). Brighter colours indicate higher maxt(i(t)). The sharper the probability distribution pn (the higher the n), the sharper is the increase in the infection peak maxt(i(t)) with expected vaccination time. Particularly high infection peaks are expected when the vaccination is certain to arrive outside of the expected duration of the epidemic, i.e. for large 〈tv〉 and large n.
Noting that all studied distributions yield (almost) the same 〈s(tv)〉 at 〈tv〉 = 20, we chose to compare the corresponding equilibrium behaviour directly, see Fig 4. Given the strongly different underlying probability distributions, the equilibrium behaviour has to be quite different to achieve a similar value of expected vaccinations: The more sharply peaked the vaccination distribution, the more stringent the observed social distancing is. We observe that as before, the behavior at n = 10 and n = 40 are close matches to the one for sharp vaccination timing. However, social distancing remains significant well past the expected vaccination time.
A) Nash equilibrium behaviour k for a range of vaccination time distributions pn, as given in the legend of panel C, all with expected vaccination time 〈tv〉 = 20. For reference, we show the equilibrium behaviour if vaccination is not expected to occur (dashed line labelled “no vax”). Even though the expected vaccination time is similar, and the expected no. of vaccinations is (almost) the same, see Fig 3, we observe that significant social distancing occurs for longer durations with increasing sharpness n of the vaccination distribution. The corresponding courses of the epidemic are shown in panel B for the susceptibles and C for the infectious (the “no vax” case peaks at max(i) ≈ 0.1).
Conclusion and discussion
Here, we have shown how the expectation of a future vaccination event influences social distancing behaviour in an epidemic. The earlier the vaccination is expected to happen and the more precisely the timing of the vaccination is known, the stronger the incentive to socially distance. In particular, the equilibrium social distancing only meaningfully deviates from the no-vaccination equilibrium behaviour if the vaccine is expected with a high probability to arrive before the epidemic would have run its course under equilibrium social distancing.
As for the interpretation of our work in relation to previous works: In the special case of sharp vaccination timing, our results qualitatively reproduced the equilibrium results reported in [17, 20]. It had previously been reported for a scenario with uncertain vaccination arrival that there would be little equilibrium behavioural modification [21]. We believe that this can be explained as follows: the vaccination probability distribution in that work is modeled such that the vaccination arrival is equally likely for all times, resulting in severe uncertainty about the arrival time. In addition, the expected vaccination arrival time corresponds to the end of the epidemic under no-vaccination equilibrium social distancing. For such a situation we also find little additional social distancing as compared to the no vaccination equilibrium. (The authors do find that vaccination influences government policy.)
Finally, we have demonstrated that if the vaccination time is exponentially distributed, it can be absorbed into an exponential discounting term with the time scale given by the expected vaccination time and can be interpreted as such. In general, we propose that any uncertainty in the vaccination time be interpreted as a form of generalised discounting.
We believe these results provide meaningful guidance to people and policymakers for navigating epidemics. In particular, our work relates to how one should communicate vaccination development schedules. Since higher certainty about the vaccination arrival time during the epidemic leads to higher equilibrium social distancing, we suggest that such schedules should be communicated to the public as early and clearly as possible. In addition, it is important that vaccines are made available before the epidemic would have run its course under no-vaccination social distancing. Otherwise the vaccine itself does not serve as further incentive to the public for additional social distancing.
Supporting information
S1 Fig. Sketch of the area over which we integrate in Eq (15).
The integration area is marked in blue. For each fixed tv, we integrate t from 0 to tv. Alternatively, for fixed t, we can integrate tv from t to ∞.
https://doi.org/10.1371/journal.pone.0288963.s001
(TIF)
S2 Fig. Self-organised social distancing is the stronger the sooner the vaccination date is expected.
A-C) Nash equilibrium behaviour and course of the epidemic assuming that the vaccination arrival time is distributed as p = p10(t), see Eq (32), with an expected vaccination time 〈tv〉, see panel C for legend. The behaviour and corresponding course of epidemic arising from the assumption that vaccination will not occur are shown as grey solid lines. This is calculated from the case for precisely known vaccination time tv but with tv → ∞. D-F) Same as A-C but for vaccination time distribution p40, see Eq (32). Other parameters: infection cost α = 400, and no economic discounting, τecon → ∞.
https://doi.org/10.1371/journal.pone.0288963.s002
(TIF)
S3 Fig. Social optimum behaviour vs. Nash equilibrium behaviour vs. non-behavioural baseline
A) Population behaviours during an epidemic: The non-behavioural situation assumes that the pre-epidemic behaviour continues unchanged during the epidemic, k = κ* (blue). In contrast, Nash equilibrium behaviour k without vaccine arrival (black), and optimal behaviour (gold). The corresponding courses of the epidemic are shown in panel B for the susceptibles and panel C for the infected. Note that α = 100, here.
https://doi.org/10.1371/journal.pone.0288963.s003
(TIF)
S4 Fig. Optimal control for a range of vaccine arrival distributions.
A) Optimal behaviour k for a range of sharp vaccination times tv, as given in the legend of panel C). The behaviour is insensitive to tv for large values and indistinguishable from the behaviour if the vaccination is not expected to occur. When tv is comparable to or shorter than the duration of the epidemic without vaccination, optimal behaviour exhibits strong social distancing; in contrast to the Nash equilibrium, this then already occurs from t = 0 onward. The corresponding courses of the epidemic are shown in panel B) for the susceptibles and C) for the infected. D-F) Optimal behaviour k and course of the epidemic assuming that the vaccination arrival time is exponentially distributed, p = p0(t), see Eq (32), with an expected vaccination time 〈tv〉, see panel F) for legend. The behaviour and corresponding course of epidemic arising from the assumption that vaccination will not occur are shown as gray solid lines. This is calculated from the case for precisely known vaccination time tv but with tv → ∞. G-I) Optimal behaviour k and course of the epidemic assuming that the vaccination arrival time is distributed according to p1, see Eq (32). See panel (i) for legend. Other parameter: infection cost α = 100 and no economic discounting, τecon → ∞.
https://doi.org/10.1371/journal.pone.0288963.s004
(TIF)
Acknowledgments
The numerical code was written in Python. Figures were generated using the Matplotlib [62] Python library.
References
- 1. Roush SW, Murphy TV, Basket MM, Iskander JK, Moran JS, Seward JF, et al. Historical comparisons of morbidity and mortality for vaccine-preventable diseases in the United States. Journal of the American Medical Association. 2007;298(18):2155–2163. pmid:18000199
- 2. Keeling MJ, Moore S, Penman BS, Hill EM. The impacts of SARS-CoV-2 vaccine dose separation and targeting on the COVID-19 epidemic in England. Nature Communications. 2023;14(1):1–10. pmid:36765050
- 3. Yan Y, Malik AA, Bayham J, Fenichel EP, Couzens C, Omer SB. Measuring voluntary and policy-induced social distancing behavior during the COVID-19 pandemic. Proceedings of the National Academy of Sciences of the United States of America. 2021;118(16):1–9. pmid:33820846
- 4. Wang Z, Bauch CT, Bhattacharyya S, D’Onofrio A, Manfredi P, Perc M, et al. Statistical physics of vaccination. Physics Reports. 2016;664:1–113.
- 5. Chang SL, Piraveenan M, Pattison P, Prokopenko M. Game theoretic modelling of infectious disease dynamics and intervention methods: a review. Journal of Biological Dynamics. 2020;14(1):57–89. pmid:31996099
- 6. Verelst F, Willem L, Beutels P. Behavioural change models for infectious disease transmission: A systematic review (2010-2015). Journal of the Royal Society Interface. 2016;13(125). pmid:28003528
- 7. Ferguson NM, Cummings DAT, Fraser C, Cajka JC, Cooley PC, Burke DS. Strategies for mitigating an influenza pandemic. Nature. 2006;442(7101):448–452. pmid:16642006
- 8. Tildesley MJ, House TA, Bruhn MC, Curry RJ, O’Neil M, Allpress JLE, et al. Impact of spatial clustering on disease transmission and optimal control. Proceedings of the National Academy of Sciences of the United States of America. 2010;107(3):1041–1046. pmid:19955428
- 9.
Tanimoto J. Social Dilemma Analysis of the Spread of Infectious Disease. In: Evolutionary Games with Sociophysics. Springer, Singapore; 2018. p. 155–216. Available from: http://link.springer.com/10.1007/978-981-13-2769-8_4.
- 10.
Mellacher P. COVID-Town: An Integrated Economic-Epidemiological Agent-Based Model. Graz Schumpeter Centre; 2020. 23.
- 11. Grauer J, Löwen H, Liebchen B. Strategic spatiotemporal vaccine distribution increases the survival rate in an infectious disease like Covid-19. Scientific Reports. 2020;10(1):1–10.
- 12. Kermack WO, McKendrick AG. A contribution to the mathematical theory of epidemics. Proceedings of the Royal Society of London Series A, Containing Papers of a Mathematical and Physical Character. 1927;115(772):700–721.
- 13. Lorch L, De A, Bhatt S, Trouleau W, Upadhyay U, Gomez-Rodriguez M. Stochastic Optimal Control of Epidemic Processes in Networks. 2018;.
- 14. Chandrasekhar AG, Goldsmith-Pinkham P, Jackson MO, Thau S. Interacting regional policies in containing a disease. Proceedings of the National Academy of Sciences of the United States of America. 2021;118(19):1–7. pmid:33906950
- 15. Holme P, Saramäki J. Temporal networks. Physics Reports. 2012;519(3):97–125.
- 16. Holme P, Masuda N. The basic reproduction number as a predictor for epidemic outbreaks in temporal networks. PLoS ONE. 2015;10(3):1–15. pmid:25793764
- 17. Reluga TC. Game Theory of Social Distancing in Response to an Epidemic. PLoS Comput Biol. 2010;6(5):e1000793. pmid:20523740
- 18. Reluga TC, Galvani AP. A general approach for population games with application to vaccination. Math Biosci. 2011;230(2):67–78. pmid:21277314
- 19. Fenichel EP, Castillo-Chavez C, Ceddia MG, Chowell G, Parra PAG, Hickling GJ, et al. Adaptive human behavior in epidemiological models. Proc Natl Acad Sci. 2011;108(15):6306–6311. pmid:21444809
- 20.
Makris M, Toxvaerd F. Great Expectations : Social Distancing in Anticipation of Pharmaceutical Innovations; 2020. 2097. Available from: https://www.repository.cam.ac.uk/handle/1810/315201.
- 21. Eichenbaum MS, Rebelo S, Trabandt M. The Macroeconomics of Epidemics. Review of Financial Studies. 2021;34(11):5149–5187.
- 22. Ovi MA, Nabi KN, Kabir KMA. Social distancing as a public-good dilemma for socio-economic cost: An evolutionary game approach. Heliyon. 2022;8(11):e11497. pmid:36411893
- 23. McAdams D. Nash SIR: An Economic-Epidemiological Model of Strategic Behavior During a Viral Epidemic. Covid Economics. 2020;
- 24. Dawes RM. Social Dilemmas. Annual Review of Psychology. 1980;31(1):169–193.
- 25. Arefin MR, Kabir KMA, Jusup M, Ito H, Tanimoto J. Social efficiency deficit deciphers social dilemmas. Scientific Reports. 2020;10(1):1–9. pmid:32999303
- 26. Jusup M, Holme P, Kanazawa K, Takayasu M, Romić I, Wang Z, et al. Social physics. Physics Reports. 2022;948:1–148.
- 27. Toxvaerd F. Rational Disinhibition and Externalities in Prevention. International Economic Review. 2019;60(4):1737–1755.
- 28. Rowthorn R, Toxvaerd F. The optimal control of infectious diseases via prevention and treatment. University of Cambridge; 2020. 2027.
- 29.
Bethune ZA, Korinek A. COVID-19 infection externalities: trading off lives vs. livelihoods. Cambridge, MA: National Bureau of Economic Research; 2020. 27009.
- 30.
Schnyder SK, Molina J, Yamamoto R, Turner MS. Rational social distancing policy during epidemics with limited healthcare capacity. under review. 2022;
- 31. Aurell A, Carmona R, Dayanikli G, Laurière M. Optimal Incentives to Mitigate Epidemics: A Stackelberg Mean Field Game Approach. SIAM Journal on Control and Optimization. 2022;60(2):S294–S322.
- 32. Bauch CT, Galvani AP, Earn DJD. Group interest versus self-interest in smallpox vaccination policy. Proceedings of the National Academy of Sciences of the United States of America. 2003;100(18):10564–10567. pmid:12920181
- 33. Bauch CT, Earn DJD. Vaccination and the theory of games. Proceedings of the National Academy of Sciences of the United States of America. 2004;101(36):13391–13394. pmid:15329411
- 34. Reluga TC, Bauch CT, Galvani AP. Evolving public perceptions and stability in vaccine uptake. Mathematical Biosciences. 2006;204(2):185–198. pmid:17056073
- 35. Chen F, Toxvaerd F. The economics of vaccination. Journal of Theoretical Biology. 2014;363:105–117. pmid:25111844
- 36.
Toxvaerd F, Rowthorn R. On the management of population immunity. University of Cambridge; 2020. 2080.
- 37.
Tanimoto J. Sociophysics Approach to Epidemics. Singapore: Springer Singapore; 2021.
- 38. Hill EM, Prosser NS, Ferguson E, Kaler J, Green MJ, Keeling MJ, et al. Modelling livestock infectious disease control policy under differing social perspectives on vaccination behaviour. PLOS Computational Biology. 2022;18(7):e1010235. pmid:35834473
- 39. Moore S, Hill EM, Dyson L, Tildesley MJ, Keeling MJ. Modelling optimal vaccination strategy for SARS-CoV-2 in the UK. PLoS Computational Biology. 2021;17(5):1–20. pmid:33956791
- 40. Moore S, Hill EM, Dyson L, Tildesley MJ, Keeling MJ. Retrospectively modeling the effects of increased global vaccine sharing on the COVID-19 pandemic. Nature Medicine. 2022;28(11):2416–2423. pmid:36302894
- 41. Tildesley MJ, Savill NJ, Shaw DJ, Deardon R, Brooks SP, Woolhouse MEJ, et al. Optimal reactive vaccination strategies for a foot-and-mouth outbreak in the UK. Nature. 2006;440(7080):83–86. pmid:16511494
- 42. Kabir KMA. How evolutionary game could solve the human vaccine dilemma. Chaos, Solitons and Fractals. 2021;152:111459.
- 43. Wu B, Fu F, Wang L. Imperfect vaccine aggravates the long-standing dilemma of voluntary vaccination. PLoS ONE. 2011;6(6). pmid:21687680
- 44. Shim E, Galvani AP. Distinguishing vaccine efficacy and effectiveness. Vaccine. 2012;30(47):6700–6705. pmid:22944629
- 45. Kuga K, Tanimoto J. Which is more effective for suppressing an infectious disease: Imperfect vaccination or defense against contagion? Journal of Statistical Mechanics: Theory and Experiment. 2018;2018(2).
- 46. Augsburger IB, Galanthay GK, Tarosky JH, Rychtář J, Taylor D. Voluntary vaccination may not stop monkeypox outbreak: A game-theoretic model. PLoS Neglected Tropical Diseases. 2022;16(12):1–29.
- 47. Augsburger IB, Galanthay GK, Tarosky JH, Rychtář J, Taylor D. Imperfect vaccine can yield multiple Nash equilibria in vaccination games. Mathematical Biosciences. 2023;356(December 2022):108967. pmid:36649795
- 48. Schwarzendahl FJ, Grauer J, Liebchen B, Löwen H. Mutation induced infection waves in diseases like COVID-19. Scientific Reports. 2022;12(1):1–11. pmid:35688998
- 49. Reluga TC. An SIS epidemiology game with two subpopulations. Journal of Biological Dynamics. 2009;3(5):515–531. pmid:22880898
- 50.
Acemoglu D, Chernozhukov V, Werning I, Whinston MD. Optimal targeted lockdowns in a multi-group SIR model. National Bureau of Economic Research; 2020. 27102. Available from: http://www.nber.org/papers/w27102.
- 51. Prem K, Cook AR, Jit M. Projecting social contact matrices in 152 countries using contact surveys and demographic data. PLOS Computational Biology. 2017;13(9):e1005697. pmid:28898249
- 52. Huang CI, Crump RE, Brown PE, Spencer SEF, Miaka EM, Shampa C, et al. Identifying regions for enhanced control of gambiense sleeping sickness in the Democratic Republic of Congo. Nature Communications. 2022;13(1):1–11. pmid:35304479
- 53. Tildesley MJ, Vassall A, Riley S, Jit M, Sandmann F, Hill EM, et al. Optimal health and economic impact of non-pharmaceutical intervention measures prior and post vaccination in England: a mathematical modelling study. Royal Society Open Science. 2022;9(8). pmid:35958089
- 54. He D, Dushoff J, Day T, Ma J, Earn DJD. Inferring the causes of the three waves of the 1918 influenza pandemic in England and Wales. Proceedings of the Royal Society B: Biological Sciences. 2013;280 (1766). pmid:23843396
- 55.
Yong J, Zhou XY. Stochastic controls: Hamiltonian systems and HJB equations. vol. 43. Springer Science & Business Media; 1999.
- 56. Tottori T, Kobayashi TJ. Memory-Limited Partially Observable Stochastic Control and Its Mean-Field Control Approach. Entropy. 2022;24(11):1–27. pmid:36359688
- 57. Tottori T, Kobayashi TJ. Forward-Backward Sweep Method for the System of HJB-FP Equations in Memory-Limited Partially Observable Stochastic Control. Entropy. 2023;25(2). pmid:36832575
- 58. Tottori T, Kobayashi TJ. Decentralized Stochastic Control with Finite-Dimensional Memories: A Memory Limitation Approach. Entropy. 2023;25(5):1–26. pmid:37238546
- 59.
Bensoussan A, Frehse J, Yam P. Mean Field Games and Mean Field Type Control Theory. Springer; 2013.
- 60.
Carmona R, Delarue F. Probabilistic Theory of Mean Field Games with Applications I. Springer; 2018.
- 61.
Lenhart S, Workman J. Optimal Control Applied to Biological Models. Chapman and Hall/CRC; 2007.
- 62. Hunter JD. Matplotlib: A 2D Graphics Environment. Computing in Science & Engineering. 2007;9(3):90–95.