The epidemiology of dengue fever is characterized by highly seasonal, multi-annual fluctuations, and the irregular circulation of its four serotypes. It is believed that this behaviour arises from the interplay between environmental drivers and serotype interactions. The exact mechanism, however, is uncertain. Constraining mathematical models to patterns characteristic to dengue epidemiology offers a means for detecting such mechanisms. Here, we used a pattern-oriented modelling (POM) strategy to fit and assess a range of dengue models, driven by combinations of temporary cross protective-immunity, cross-enhancement, and seasonal forcing, on their ability to capture the main characteristics of dengue dynamics. We show that all proposed models reproduce the observed dengue patterns across some part of the parameter space. Which model best supports the dengue dynamics is determined by the level of seasonal forcing. Further, when tertiary and quaternary infections are allowed, the inclusion of temporary cross-immunity alone is strongly supported, but the addition of cross-enhancement markedly reduces the parameter range at which dengue dynamics are produced, irrespective of the strength of seasonal forcing. The implication of these structural uncertainties on predicted vulnerability to control is also discussed. With ever expanding spread of dengue, greater understanding of dengue dynamics and control efforts (e.g. a near-future vaccine introduction) has become critically important. This study highlights the capacity of multi-level pattern-matching modelling approaches to offer an analytic tool for deeper insights into dengue epidemiology and control.
The fluctuations of multi-serotype infectious diseases are often highly irregular and hard to predict. Previous theoretical approaches have attempted to disentangle the drivers that may underlie this behaviour in dengue dynamics with variable success. Here, we examine the role of such drivers using a pattern-oriented modelling (POM) approach. In POM, multiple patterns observed at different scales are used to test a model’s proficiency in capturing real-world dynamics. We examined dengue models with combinations of cross-immunity, cross-enhancement, seasonal fluctuations in the transmission rate, and with sensitivity analyses of asymmetric transmission rates between serotypes as well as the possibility for four subsequent heterologous infections. We demonstrate the ability of POM to model dynamical drivers that have gone unnoticed in single pattern or synthetic likelihood approaches. Further, our results present a determining role of seasonality in the selection and operation of these processes in governing dengue dynamics, in particular when full, heterologous immunity is assumed to occur after a secondary infection. We show that this structural model uncertainty can have important practical significance, as demonstrated by the differences in control efforts required to disrupt transmission. These results highlight the importance of localised model selection and calibration using multiple data-matching, as well as taking explicit account of model uncertainty in predicting and planning control efforts for multi-serotype diseases.
Citation: ten Bosch QA, Singh BK, Hassan MRA, Chadee DD, Michael E (2016) The Role of Serotype Interactions and Seasonality in Dengue Model Selection and Control: Insights from a Pattern Matching Approach. PLoS Negl Trop Dis10(5): e0004680. https://doi.org/10.1371/journal.pntd.0004680
Editor: Samuel V. Scarpino, Santa Fe Institute, UNITED STATES
Received: July 3, 2015; Accepted: April 11, 2016; Published: May 9, 2016
Copyright: © 2016 ten Bosch et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: QAtB acknowledges a graduate student fellowship from the Eck Institute for Global health; EM acknowledges the joint financial support of the Office of the Vice President for Research (OVPR) and the Eck Institute for Global Health, the University of Notre Dame, for completing this work. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
With a 30-fold increase in incidence over the last five decades, dengue poses an increasing threat to about two thirds of the world population . Dengue, caused by a group of viruses belonging to the Flavivirus genera, circulates in four major serotypes (DENV 1–4) , and manifests in a wide spectrum of clinical forms, from subclinical to classic dengue fever to the more serious forms of the disease, namely, dengue haemorrhagic fever (DHF) and dengue shock syndrome (DSS). In the absence of treatment, dengue can be highly fatal in subjects with DHF or DSS, with a case-fatality rate of 15%, which may be reduced to 1% with adequate medical intervention . Despite on-going efforts, no effective antiviral drugs are available against the disease and the potential impact of the recently licenced vaccine has yet to be determined. This limits control efforts primarily to vector control .
Dengue dynamics are characterized by highly seasonal, multi-annual fluctuations, with replacement of serotypes occurring at varying intervals. An example of these patterns arising in a newly emerging dengue setting is illustrated in (Fig 1) [5,6]. This is thought to result from a complex interplay between environmental factors, vector ecology and host-pathogen dynamics . Various hypotheses have been proposed to uncover the main drivers of dengue dynamics and to reveal how such drivers interact among themselves to govern infection and disease patterns in the field. Emphasis has been on unravelling the roles that cross-immunity (CI), cross-enhancement between serotypes, and seasonal variation in the transmission rate, play in capturing the complex dynamics of dengue . Cross-enhancement is believed to be caused by antibody-dependent enhancement (ADE), where heterotypic antibodies facilitate cell entry through the formation of virion-antibody complexes, ultimately leading to increased viral titers upon secondary infection [9,10]. This is thought to result in increased susceptibility to a secondary heterologous infection and, upon these secondary infections, in a more serious form of disease and increased infectiousness. Enhanced disease severity is however believed to have minor impact on the dynamics as the proportion of DHF and DSS cases is substantially small (1% of confirmed cases ). By contrast, including sufficiently high levels of enhanced infectiousness or susceptibility (60–130%) in simulation models has been found to induce asynchronous outbreaks of different serotypes [12,13], an outcome which has been indicated to underlie the manifestation of the 3–5 year epidemic cycles observed for dengue dynamics in Thailand [14,15]. Decomposing ADE into both enhanced infectiousness and susceptibility has further been shown to mimic this effect at lower, more realistic values of ADE, while also reducing the magnitude of oscillations to more plausible levels and decreasing the risk of stochastic extinction . Similarly, relaxing the common assumption of complete immunity after two heterologous infections results in asynchronous, multi-annual outbreaks at lower levels of ADE and R0 . While most modelling endeavours have assumed serotypes to have identical characteristics, allowing for a small amount of asymmetry in the transmission rate is found to increase serotype persistence in the presence of ADE . Furthermore, the inclusion of short-lived cross-immunity in models was found to be sufficient to reproduce the observed out-of-phase, irregular oscillations and 3-year cycles [18–21]. An alternative hypothesis has been proposed by Lourenço et al., who demonstrated that spatial segregation between human hosts and its vectors can be sufficient to capture the semi-regular dengue patterns observed, even in the absence of immune interactions . By contrast, to mimic the distinct seasonal signature of dengue dynamics, the incorporation of seasonal forcing into the vector population dynamics or transmission rate has been found to be essential [19,22,23].
Weekly number of confirmed dengue fever cases with circulating serotypes in Trinidad and Tobago over the period 1997–2009.
The above results hint at the complexity of dengue transmission and suggest that multiple mechanisms could underlie disease dynamics in any particular site. A key question in understanding dengue dynamics and control, therefore, is how best to use observed data in order to identify the processes governing the transmission of the disease in a given location. Recently, there has been increasing recognition that for complex systems, such as dengue, model matching to single or a few patterns is not sufficient to narrow down the range of possible explanatory mechanisms , and that matching to multiple patterns observed at various scales and hierarchical levels is required for identifying the mechanisms that generate such patterns, and hence are likely to be key elements of the system’s structure. Tying ecological models to multiple system patterns concurrently may also aid in detecting the right level of complexity and improve the predictive ability of such models for replicating local dynamics . Methods such as Pattern Oriented Modelling (POM) allow for such a multi-scope approach by facilitating the design, selection, and calibration of models of complex systems [25–30].
This study applied a POM approach to modelling global dengue infection data in order to determine whether the above proposed mechanisms related to serotype interactions and seasonal forcing of the transmission rate were able to explain all of the observed dynamical patterns in the field. We further used the modelling results to investigate the vulnerability of dengue to interruption in transmission as a result of vector control, and examined how such vulnerability was related to the identified processes governing disease transmission. We demonstrate that model selection is largely driven by the seasonality of the system, with CI being a preferred mechanism in the case of low, and ADE in the case of highly seasonal transmission regimes. At similar levels of transmission rate, resistance to control efforts was found to increase in dengue systems with CI. The results highlight the utility of the POM approach for detecting and fitting of appropriately structured disease transmission models based on observed data. In addition, they also reveal challenges in structural and parameter identifiability that would remain unnoticed when guided by individuals patterns used in isolation.
The patterns in the reported dengue case data
Five characteristic dengue patterns were used to filter out unrealistic model structures and reduce parameter uncertainty. The patterns were selected to reflect the breadth of characteristics used in single pattern matching approaches [12,15,16,18,22], include strong and weak patterns that are common across endemic regions and those which are relatively stable over time and encompass different levels of organization . The patterns (i.e. mean duration between peaks, multi-annual fluctuations, frequent replacement of one circulating serotype by another, serotype co-dominance and asynchronous serotype cycling) were derived from literature describing dengue case data and serotype epidemiology from different endemic regions across the world [5,6,31–42]. The observed patterns are described in Table 1.
We used a deterministic Susceptible-Infected-Recovered (SIR) modelling framework to describe the circulation of four different dengue serotypes (DENV1-4) in a population . The full system of ordinary differential equations is shown in (Fig 2). The model consists of 26 compartments, each of which represents a fraction of the population. The population size is modelled to be stationary; hence births and deaths occur at an equal rate (μ). New-borns are assumed to be immunologically naïve to all serotypes and are born into the class of susceptibles (S). Although the presence of maternal antibodies is shown to affect the risk of infection, the impact on the overall dynamics is believed to be minimal and thus not taken into consideration . Susceptibles become primarily infected by serotype i (Ii) at rate βSIi and αTRANSβSIji proportional to the number of primarily and secondarily infectious individuals respectively. The parameter αTRANS>1 indicates enhanced transmissibility of secondarily infected individuals. A seasonal change in the transmission rate (β(t)) is incorporated through a sinusoidal function with a forcing period of one year: β(t) = β0(1−β1 cos(2πt)) where β0 indicates the mean transmission rate and β1 the strength of seasonal fluctuation and t time in years. The transmission rate (β(t)) is assumed to be equal across serotypes. Individuals remain infectious for a period of 1/γ. After recovery from a primary infection, individuals become immune to all serotypes (Ci) for a period 1/ρ after which they move to the partially immune stage (Pi). The P-class individuals are assumed to experience full immunity against the serotype i and enhanced susceptibility (αSUS>1) to all other serotypes. They acquire secondary infection (Iij) at rates αSUSβPiIj and αTRANSαSUSβPjIkj proportional to the number of cases respectively primarily and secondarily infectious to a different serotype (with k≠j and j≠i). The duration of the infectious period is assumed to be equal upon secondary and primary infection. To account for imported cases and prevent the ODE-models to simulate unrealistically low levels of infections, individuals (susceptible or partially immune) can also acquire infection through an infectious contact with an individual from an external population at rate βδ, where δ signifies the import rate . As tertiary and quaternary infections are rarely observed , we assume that after recovery from a secondary infection, individuals become life-long immune to all serotypes. An adaptive time step fourth and fifth -order Runge-Kutta solver was used with initial conditions for I1-4 1x10-7, 2x10-7, 3x10-7 and 4x10-7 and . All other state variables were initialized at zero. The implementation of the model, as well as the analysis of its simulation results were carried out in the Matlab, version 2014b (www.mathworks.com).
The circles represent the infection related states: susceptible (S), infectious (I), cross-immune (C), partially susceptible (P) and recovered (R), solid arrows depict the transition from one state to another and the dashed arrows indicate transmission. Parameters are described in Table 3. Simulations are based on a four serotype (DENV1-4) model, where i, j and k denote primary (first subscript) or secondary (second subscript) infection with DENV1-4. The full system consists of 26 compartments. For simplicity, the flowchart for one serotype is shown.
In this analysis we assume the following hypotheses (see Table 2). H1: The most parsimonious hypothesis is represented by the base-model with neither ADE (αSUS = 1 and αTRANS = 1) nor CI (individuals upon recovery from primary infection go straight to the P-class). H2: The base-model with CI. H3: The base-model with enhanced susceptibility, further referred to as ADE (αSUS>1 and αTRANS = 1). H4: H3 with CI. H5: The base-model with both enhanced susceptibility and transmissibility (i.e. ADEx2 with αSUS>1 and αTRANS>1) but no CI. H6: H5 with CI. In all models, an annual seasonal forcing in the transmission rate is assumed.
Defining dengue characteristics in simulated data
The variables that we estimated from the simulated data to contrast the dynamics of each model against the characteristics of dengue dynamics are: 1) Mean inter-peak period; 2) Presence of a multi-annual signal; 3) Duration of serotype replacement; 4) Intensity of single-serotype emergence; and 5) Serotype phase-locking.
The mean inter-peak period (MIPP) is defined as:, where Y is the number of years analysed and N the number of peaks occurring during that period. To ensure comparability of the simulated estimates with reported observations on the inter-epidemic period, peaks were defined to have a minimum proportion of infectious people of 1/4000. To assess the presence of significant multi-annual signals in addition to the near yearly MIPP, a spectral density approach was used. To reduce the confounding effect of very low amplitude fluctuations, the time series were smoothed using a moving average filter. The power spectral density of the smoothed time series was assessed with the Welch’s overlapped segment averaging estimator . To evaluate the significance of the periodic signals, the signals were compared to the null-continuum. The null-continuum is a greatly smoothed version of the raw periodogram, encapsulating the underlying shape of the distribution of variance over frequency . A signal was assessed to be significant if the lower bound of the 90% confidence interval of the raw periodogram exceeded the null continuum . The duration of serotype replacement is defined as the mean number of years before a dominant serotype during a peak is replaced by another serotype in a subsequent peak. The intensity of single serotype emergence (ε) was defined as by Recker et al. : where N defines the number of peaks occurring during the analysed number of years, the prevalence of the dominant serotype and the prevalence of the serotype with the second-highest peak. Model runs with either complete co-dominance (ε<0.01) (i.e. there are multiple serotypes present at any point in time) or complete single serotype dominance (ε>0.99) were omitted. Lastly, serotype phase-locking here is defined as the perfect synchronization of serotypes and is detected by comparing the MIPP of serotype i to the aggregated MIPP. Simulations in which MIPP = MIPPi are discarded based on the presence of perfect phase-locking.
Data-model pattern matching
To determine which of the hypotheses or models capture the observed dengue dynamics and at which parameter values, we used a pattern oriented modelling approach (Fig 3) [25–28]. Model performance was assessed based on the extent to which a model captured all the 5 characteristics of dengue simultaneously, as defined above (Table 1). Models were assessed using the following steps. First, Latin hypercube sampling  was employed to select a sample of Ω (= 5,000) parameter vectors from a conjoint parameter distribution, encompassing the transmission rate (β0), the level of seasonal forcing or seasonality (β1) and, depending on the model, a combination of enhanced susceptibility (αSUS), enhanced transmissibility (αTRANS) and the rate of loss of CI (ρ) (Table 3). Uncertainty in the values of these parameters was addressed by assigning uniform distributions from their ranges deemed realistic according to literature (Table 3). The resulting ensemble of models (Model 1–6 with Ω parameter vectors) was run for 1400 years. The model outputs for the last 400 years were considered to determine whether the model mimicked all five dengue characteristics (a model is assumed to match a characteristic if the simulated response falls within the range of that characteristic pattern given in Table 1). The resulting set of passing (good) parameters G (where G ⊂ Ω) was retained as a multivariate distribution for further analysis.
A set of 6 alternative models are identified and compared with respect to their ability to replicate patterns observed in dengue case data. Each model is run for a set of 5,000 different parameter combinations, sampled from plausible parameter ranges using Latin hypercube sampling. The resulting patterns from each simulation are compared to the observed patterns. The parameter sets that match all 5 patterns of interest are assembled into the passing parameter set, which forms the input for model comparison and the examination of model behaviour.
To assess the impact of simplifying model assumptions on pattern-matching, we repeated the POM exercise for two distinct scenarios. One, we allowed for transmission rates to be uneven between serotypes (the asymmetric model). More specifically, serotype-specific transmission rates were drawn from a normal distribution with standard deviation 0.15 . Two, we used a model variant that allows for four heterologous infections prior to acquiring complete immunity (the 4-infection model, equations are provided in S1 Text ).
Parameter sensitivity and identifiability
We used logistic regression to assess the sensitivity of pattern-matching (binary response variable) to the parameters (independent variables). We normalised the independent variables on a 0 to 1 scale to obtain comparable regression coefficients: coefficients larger than|3| indicate strong sensitivity while parameters with small coefficients (<<|1|) have little impact on the model matching the patterns . Two-way interactions were included in the construction of the logistic regression models: logit(p) = b0+b1β0+b2β1+b3αSUS+b4αTRANS+b5ρ+interactions, with p being the probability of a pattern-match, b0 the intercept and b1-n the regression coefficients.
Additionally, the identifiability of each of the parameters was examined using a principal component analysis (PCA) [54,55]. The identifiability of a parameter is a function of dependence, prior uncertainty and the model’s sensitivity to the parameter and defines how well one can estimate a parameter. We assessed the parameter identifiability for the full model (ADEx2+CI), using its passing distribution (G). First, the variance-covariance matrix(Σ)was constructed from the log-transformed G. Next, the principal components (PCs) were derived from Σ. The PCs of Σ define the 5-dimensional ellipsoid that approximates the population of passing parameter values. The eigenvalues (λi) denote the respective radii and the eigenvectors representing how much each parameter contributes to the direction of each radius. As such, λi gives an indication of the variance explained by the ith PC. The overall variance of all PCs was defined as , thus the proportion of the total variation in G that was explained by the ith PC is was estimated by: We interpret these results as follows: A smaller λi indicates that the model is more sensitive to changes in the direction described by the ith component, whereas a larger λi signifies that the model is less sensitive to changes in the direction of the component. Parameters contributing most to a large λi are responsible for a big portion of the variation in the parameter space and are thus considered less identifiable.
Vulnerability to disruption in dengue transmission
We examined the vulnerability of the models to sudden reductions in the transmission rate that may be brought about by vector control. The models were run for all parameter sets in G for a burn-in period of 1000 years after which the system was perturbed by a reduction in the transmission rate (i.e. β0 is reduced by 90%) for a control period of w weeks per year. We varied w from 1 week to 52 consecutive weeks, starting at the valley of the sinusoidal function, which mimics the onset of the rainy season. After the control period of w weeks, β0 returns to its original value. These control runs were performed for 30 years after the burn-in period. The intervention of w weeks was assumed to be successful if no more than one peak occurred over the time-course of the model simulation. We assessed the probability of control for model i, where i represents 1 to 6, by calculating the proportion of Gi presenting successful control as a function of the number of weeks the transmission was disrupted. Here, with being the number of parameter vectors out of Gi that showed successful control for model i given w weeks of interruption in transmission. A composite average (Pw) for each control period w was derived by weighing the individual probability values of the models by the sizes of their passing parameter distributions (Gi), such that:.
Lastly, we estimated the values of the basic reproduction rate (R0) for each of the parameter vectors in G to assess the relation between transmission potential and the models’ vulnerability. The R0 of the model was derived using the next generation method [56–58] (Proof provided in S2 Text) and is defined as: , where β0 defines the transmission rate, 1/γ the duration of the infectious period and 1/μ the average life expectancy of the human host .
We compared the ability of six 2-infection models to reproduce the main characteristics of dengue epidemiology listed in Table 1. Table 4 shows the proportions of parameter sets for which the models were able to capture the dengue dynamics by reproducing the five characteristics, either all simultaneously (values in bold) or each individually. Each of the six models investigated in this study was capable of simultaneously reproducing the five patterns of dengue dynamics, albeit at different proportions of the parameter space. The percentage indicates how robustly a model could replicate the patterns across the parameter space. While each pattern, independent of the others, could be reproduced at a relatively high probability, the simultaneous reproduction of all five patterns was found to occur rarely. In general, one would expect models with increasing complexity to perform better than simpler models. Indeed, the full model performed best overall (10.98%). However, here, the base-model was found to perform nearly as good as the second best model (i.e. the ADE+CI model); the respective overall proportions were similar in magnitude (5.54% versus 5.76%). Both the CI- and ADE-only models performed poorly, with overall proportions of 1.16% and 2.02%, respectively. The model with the decomposed ADEs approximately performed twice as well as either of these two models.
The performance of each model can also be examined by their ability to reproduce each characteristic separately. In this case, the base-model generally performed worse than the other models, yet it appeared to be equally proficient at simultaneous reproducing all characteristics or patterns as the ADE+CI-model, a more complex model than the base-model. While the MIPP is best captured by the base- and ADE-model (Table 4), all other characteristics demonstrate preference to the models that include CI. The model’s proficiency to reproduce the multi-annual signal however interferes with its ability to capture the seasonal signature in the MIPP (Table 4). As such, the POM methodology appears to penalize for overly specialized model hypotheses.
Both the base-model and ADE-model are hampered in their performance by large regions of phase-locking (S1aEA and S1aEC Fig) and to a lower extent, complete single serotype dominance (S1aDA and S1aDC Fig). The parameter space in which phase-locking occurs is largely reduced by the addition of decomposed ADE as well as CI, which both induce irregular, asynchronous serotype circulation (S1aED and S1aEE Fig).
Asymmetric 2-infection models.
Relaxing the assumption of symmetry in transmission rates does not affect the level of overall fit of the base-model or any of the models with CI. However, models with ADE or decomposed ADE performed better upon the inclusion of asymmetry. Across all models, the parameter space at which complete serotype co-dominance occurred was reduced by the inclusion of asymmetric transmission rates. This co-dominance seemed to be a strong constraint on the ADE and ADEx2 models in the 2-infection case and is the reason for the markedly improved fit in the asymmetric case.
Symmetric 4-infection models.
The impact of the relaxing the assumptions of full immunity after the second heterologous infection is substantial. The simple CI-model performed far better than any other models, with a 10-fold increased performance relative to its 2-infection counterpart. In the 4-infection case, the performance of the full model was about twice better than the 2-infection case. This is largely due to reduced phase-locking in the 4-infection case . The phase-locking was the foremost restricting factor of the CI-model in the 2-infection case. The base-model in this case, however, showed a markedly reduced performance as a result of shortened time required for serotype replacement. This indicates that the permanent heterologous immunity only after two infections was the driver of the serotype interactions sufficient to result in desynchronized oscillations in the 2-infection base-model. The few fits (0.06% of 5000, see Table 4) of the base-model occur because of an additional implicit serotype interaction. Since no more than one infection is assumed to occur concurrently, this introduces short cross-immunity that lasts for the infectious period. Indeed, when we allowed for more than one infection in the 4-infection base-model, the out-of-sync oscillations disappear completely (S6 Fig).
Model calibration and selection
Fig 4 demonstrates the accepted parameter distributions (G) for the 2-infection models. While some parameters demonstrate broad distributions indicating limited uniqueness and abundant parameter interactions, others show clear preferential values and ranges that are sensitive to the structural components of the model. Overall it appears, as can be expected, that the more complex models fit the patterns at a wider parameter range.
Parameter distributions for passing parameter sets (G) for different model hypotheses (with ADE = antibody dependent enhancement, CI = cross-immunity) for (A) the transmission rate (β0), (B) seasonality (β1), (C) enhanced susceptibility (αSUS), (D) enhanced infectiousness (αTRANS), and (E) 1/duration of cross-immunity (ρ). The vertical lines depict the median values for each distribution with the colours indicating the corresponding model hypothesis.
Fig 4A shows that models with CI selected for relatively higher transmission levels relative to models with ADE only. For low transmission levels, the full model outcompeted all the other models, indicating that more complex models may be necessary to fit dengue dynamics at lower values of R0. These results are insensitive to the assumption of low levels of asymmetry in transmission rates (S2aA Fig). In contrast to this, the 4-infection models display similar fits at lower transmission levels (S2bA Fig).
Seasonality appeared to be the most prominent driver of model fit and selection in the 2-infection model (Fig 4B). Models with CI showed a marked shift towards lower seasonal forcing relative to the base-model. In fact, at low seasonality (β1<0.06) there is a strong preference for the inclusion of CI, as is especially notable from the elevated density levels of the ADE+CI and ADEx2+CI models. At high seasonality (β1>0.17) only the more complex models provided an adequate fit. At intermediate levels of seasonality (β1: 0.1–0.15) multiple models were equally proficient at replicating the dynamics, indicating a region of large model uncertainty. The model’s structural sensitivity to seasonality persisted when asymmetry in transmission rates was assumed (S2aB Fig). However, when we allowed for tertiary and quaternary infections, the medians and shapes of the passing parameter distributions for β1 were similar across the models (S2bB Fig).
The addition of CI to models with ADE results in higher levels of αSUS (Fig 4C), yet had minor impact on the median levels of αTRANS (Fig 4D). While previous publications suggested reduced estimates of αSUS and αTRANS upon the inclusion of decomposed ADE, analysis of the 2-infection model does not support this observation . We did, however, observe this pattern in the 4-infection and asymmetric 2-infection model (S2aD and S2bD Fig).
The inclusion of ADE to the models with CI profoundly affects the estimated duration of cross-immunity by allowing for the selection of a much wider range of ρ (Fig 4E). Whereas the CI-model by itself only captures the characteristics at durations of cross-immunity shorter than half a year, the inclusion of ADE allows for cross-immune periods of up to 2 years, which is in line with the previous estimates . Interestingly, in the case of 4-infection, the CI-only model performed well for a wider range of durations of cross-immunity, including estimates from Reich et al. .
The role of seasonality and cross-immunity
Exploring the behaviour of the models in terms of MIPP and duration of serotype replacement (Table 4) reveals as to why there are differences in model fits across the range of seasonal forcing (S1aAA–S1aAF and S1aCA–S1aCF Fig). Increased levels of seasonal forcing are associated with longer MIPP. Temporary CI introduces a lag before a secondary infection can be acquired and thus generates a necessary build-up time period during which susceptible individuals accumulate in sufficient number to fuel the next outbreak. Thus, while an increase in seasonal forcing is characterized by longer inter-epidemic periods, at similar levels of seasonal forcing, the models with CI demonstrate a longer MIPP than the models without CI (S1aAA–S1aAF Fig). This allows the CI-only models capture the characteristic MIPP at lower seasonal levels than the models with just ADE. At higher levels of seasonal forcing, CI contributes to MIPPs that are longer than are characteristic to dengue. This effect is less pronounced in the 4-infection models. The overall immune population is smaller in the 4-infection models and therefore of less influence on the frequency of outbreaks. The same can be observed for the duration of serotype replacement (S1aCA–S1aCF Fig). In contrast to CI, the inclusion of ADE to the model results in shorter cycles, thus successful fits are observed at higher levels of seasonal forcing (S1aAA–S1aAF Fig).
Lastly, we observe a prominent impact of seasonal forcing on the occurrence of phase-locking. S1aEA–S1aEF Fig demonstrate a threshold-like value of β1 above which the system is forced into synchronized serotype dynamics. This threshold is relatively stable across the simple model structures (see also Fig 4B) and unaffected by the value of R0. Only the addition of decomposed ADE disrupts this behaviour, thereby being a possible driver of irregular serotype behaviour at higher seasonal regions. These phase-locking thresholds are stable to some level of asymmetry in transmission rates (S1bEA–S1bEF Fig), however they completely vanish in the case of 4-infection models (S1cEA–S1cEF Fig).
Parameter sensitivity and identifiability
The logistic regression coefficients for the full-model given in Table 5 illustrate the differential roles each of the parameters play in explaining the dengue characteristics. β0 is found to be an important driver of the multi-annual signal. And in conjunction with β1 and αTRANS, it is the dominant factor for the absence of phase-locking. As can be expected, β1 is the main driver for reproducing a seasonal signature. The parameter for CI (ρ) interacts with β1 in reproducing this pattern and is thus also an important determining factor in fitting the MIPP. The R2-values for each of the regression models illustrate that the separate parameter values provide reasonable information about whether a characteristic is met or not. However, when assessing the simultaneous fit, the predictive power of the parameters is negotiated by interactions between the parameters and the separate characteristics. In particular the interactions between β1 and ρ govern simultaneous fitting (S3a Fig). These interactions are conserved when fitting the asymmetric 2-infection and symmetric 4-infection model (S3b and S3c Fig).
Strong, multi-level parameter interactions typically result in limited parameter identifiability. Indeed, the PCA reveals that, in particular the estimates for β1 and ρ are found to be little constrained by the characteristic patterns (Fig 5). The parameters β1 and ρ dominate the first two components, which explain the largest portion of the total variance in the passing parameter space (Gfull) (55%). While this observed lack of uniqueness may result from the limited influence the parameters have on replicating the dynamics and the substantial width of the criteria, complex interactions between patterns and parameters can also underlie this phenomenon. Indeed, as observed earlier, β1 and ρ are correlated with each other as well with other model parameters, which substantially impedes parameterization efforts (S3a Fig). Parameters β0, αSUS and αTRANS contribute equally to the smallest component, indicating that these are more constrained by the examined characteristics and the level of uncertainty and are less affected by dependence to other parameters (Fig 5). Allowing for asymmetry in transmission or tertiary and quaternary infections reduces the contribution of seasonality to the first component, leaving the duration of cross-immunity as the most important factor in explaining the variance in the passing parameter distributions (S5a and S5b Fig).
Principal component analysis of passing parameter space (G) of the full model (ADEx2+CI). The first component explains 30% of the total variance, the second 25%, the third 18% and fourth 16% and the 5th 11%. The pie charts show the contribution of the parameters to each component. β1 and ρ dominate the first component, indicating reduced identifiability. β0, αSUS and αTRANS dominates the fifth component and thus contribute most to the stiffest (i.e. most sensitive direction in the parameter space).
Vulnerability to disruption in dengue transmission
Fig 6 depicts the probability of achieving successful control (≤ 1outbreak in 30 years) as a function of w weeks of reduced transmission (e.g. due to implementation of vector control). The duration of control required to reach a desired probability of successful control can be used to quantify the level of resistance or vulnerability of a dynamical transmission system.
Probability of successful control (a maximum of 1 outbreak during 30 years) given the duration (weeks/year) of consecutive control (temporary reduction of transmission: β0(1–90%) for different model hypotheses (with ADE = antibody dependent enhancement, CI = cross-immunity). The probability is defined as the proportion of the passing parameter sets (Gi) that reach successful control. Here i refers to the six models, shown by the individual keys. The dotted line shows the mean probability across all models.
The inclusion of ADE or ADEx2 reduces the resistance of the model to perturbations (dark blue and pink lines), provided no CI is assumed (Fig 6). Including CI to the model offsets this effect and demonstrates a resistance profile similar to the base-model at longer control efforts, yet shows larger vulnerability at shorter durations of control. The exception is the full-model, which converges with the ADE-model at longer control durations.
The large resistance to control in the base-model is a consequence of the high values of R0 required for this model to meet the criteria (R0>2.2) (Fig 7A). At those levels of R0 the ADE-model demonstrates higher vulnerability to control as a result of decreased persistence (Fig 7C). The enhanced vulnerability of the ADE-model relative to the base-model as seen in Fig 6 is a consequence of low transmission rates. The inclusion of CI to either model enhances the resistance of the model especially at lower values of R0 (Fig 7D). Longer durations of cross-immunity are associated with greater resistance (S7DE Fig), while increased enhancement results in decreased resistance (S7CC and S7DC Fig).
Required duration (weeks/year) for achieving successful control is shown with respect to the basic reproduction number R0 (= β0/(γ+μ)) for the different model hypotheses: are base (A), CI (B), ADE (C), ADE+CI (D), ADEx2 (E), and ADEx2+CI (F), with ADE = antibody dependent enhancement, CI = cross-immunity.
This differential vulnerability is in part due to low infection persistence levels, a typical property of models with ADE only [12,15,23]. The addition of CI counters this effect with and without ADE (Fig 7C, 7D and 7F). This difference in infection persistence between CI and ADE systems, however, diminishes at high levels of seasonal forcing and R0. At these high transmission levels, both the models with CI (ADEx2+CI) and without CI (ADEx2) represent extreme fluctuations and long periods of non-persistent dynamics (S4aF and S4aG Fig). Thus, the differential model preference affects predicted control efforts more substantially in lower than higher seasonal scenarios.
We used a pattern-oriented modelling approach to test a range of multi-serotype models and parameter values for their ability to simultaneously replicate multiple dengue fever patterns derived from literature (Table 1) and case data from Trinidad and Tobago (Fig 1). Despite using such a multiple-pattern data fitting approach, we show that all the investigated model structures were effective at fitting each of the characteristic dengue patterns across some part of the model parameter space, suggesting the occurrence of equifinality, i.e. that observed infection patterns can be reproduced by more than one mechanism or combinations of mechanisms . This implies that there could be multiple acceptable models for describing globally observed dengue dynamics, none of which can easily be rejected and therefore should all be considered in assessing the mechanisms determining disease transmission [61–63]. Three major efforts that would help disentangle the dominant drivers of dengue are: 1) better estimates of model parameters, in particular the duration of cross-immunity and the strength of seasonal forcing; 2) improved understanding on the contribution of post-secondary infections to dengue transmission dynamics; and 3) additional, more detailed patterns, such as (i) time series of serotype-specific dengue cases and (ii) levels of sero-prevalence in populations. Some of these patterns may well differ across geographic regions.
Based on the sizes of the passing parameter distributions, a preference for the most complex 2-infection model was apparent (Table 4). Remarkably, the model that performs best across all models is the 4-infection model with CI only. This indicates that, in some instances, the use of multiple patterns for model selection can help filter out overly specialized models and fetch simple, more generalized models that perform better across different scales. Additionally, it helps reveal the impact of simplifying assumptions on model selection and parameterization, i.e. allowing for quaternary infections enables us to reveal a simpler model framework that outcompetes its 2-infection equivalent. Also, it sheds new light on the need for ADE in replicating dengue dynamics. The role of ADE is not supported when allowing quaternary and tertiary infections while it is preferred in the 2-infection case, with and without asymmetry in transmission rates.
The performance of the base-model is noteworthy, given that it does not include the explicit serotype interactions deemed necessary to replicate asynchronous serotype oscillations. However, there are two implicit serotype interactions that likely underlie this behaviour. First, in the 2-infection model, serotypes affect each other’s dynamics by causing complete immunity to all serotypes after recovery from the second infection. The observed collapse in model fit of the base-model when we allowed for tertiary and quaternary infections supports this hypothesis. However, the 4-infection base-model also generates desynchronized behaviour of serotypes albeit in a very sparse region of the parameter space. This may result from the other implicit serotype interaction as a result of constraining individuals from acquiring more than one infection at the same time. In other words, this second type of interaction arises because individuals infected with one serotype are cross-immune to the remaining serotypes for the duration of the infectious period. This interaction may be enough to underlie a few, sparse fits across the parameter space. Indeed, when the model is extended to include more than one concurrent infection, the out-of-sync oscillations observed in the 4-infection base-model disappear (S6 Fig).
An additional result revealed by the POM-approach is that model preference appears to be governed by the level of seasonal fluctuations. Namely, the support for models with CI is larger in low seasonal settings, whereas the inclusion of decomposed ADE is required to reproduce the observed dengue patterns in the presence of strong seasonal fluctuations (Fig 4B). However, when tertiary and quaternary infections are allowed, this pattern disappears and all models apart from the base-model reveal similar median values for seasonal forcing (S2bB Fig). Additionally, we observe that the estimates for the duration of cross-immune period differ markedly upon inclusion of ADE or when relaxing the two infection assumption. In fact, without the inclusion of ADE, the CI-only 2-infection model does not encapsulate the best estimate of the duration of the cross-immune period, as proposed by Reich et al. . The CI-model in the 4-infection framework, does meet the values estimated. These findings highlight that improved understanding of the extent to which post-secondary dengue infections contribute to overall dengue transmission, may greatly aid in disentangling the dominant drivers of dengue dynamics.
The public health importance of knowing the processes governing dengue transmission in a specific setting is highlighted by our results on achieving transmission interruption by vector control. The results indicated that the vulnerability of the models to disruption in transmission at equal levels of R0, was driven by the immune interactions incorporated in the model, with CI increasing resistance in low transmission settings, while ADE has the opposite effect. It is common practice to favour the most parsimonious model when the candidate models are equally efficient; however, the differences in model resistance we found here suggest that it is prudent to be extra cautious while making such a decision. Given their decisive role in selecting and quantifying the predominant mechanisms as well as determining the projected effects of interventions, in addition to R0-estimates, obtaining improved, localised estimates of seasonal forcing and the duration of cross-immunity should be prioritized towards better-informing modelling endeavours.
While efforts to disentangle the extent to which internal and external drivers influence the dynamics of multi-serotype systems have been made , adequately incorporating both the complex serotype interactions as well as the effects of coupling and decoupling between seasonal forcing and incidence remains an important issue. This is more so because long time series for serotype-specific incidence and vector abundance are scarce and case data are distorted by misclassification and underreporting. The core of the POM approach lies in the appreciation that single data patterns (e.g. multi-annual signals) usually do not contain enough information to unambiguously identify the mechanism generating such patterns; additional patterns from data are needed to fit several model responses simultaneously . As pointed out above, we have shown here that, even with sparse data and relatively wide criteria, POM can be a useful tool to distinguish between different conceptual models for capturing dengue dynamics and assessing their vulnerability to control.
While the use of multiple patterns enhances the process of model selection greatly, it is not always clear whether a model capable of replicating the observed patterns can react realistically to environmental perturbations. This may especially be pertinent here as the models are fitted to macroscopic data using the average behaviour of the dynamical system rather than lower level processes . While the proposed framework could be extended to incorporate additional, lower level patterns, such as serotype driven variation in disease severity, age-distributions of sero-prevalence, or age at first infection, these are likely to vary across regions and would greatly enhance the parameter dimension to be studied, diminishing the transparency and insights gained into the distribution and behaviour of model parameters which is our main focus. Similarly, matching to multiple patterns may not be sufficient to overcome the suspicion that the models demonstrate unrealistic resistance to control, as over 40 weeks of interrupted transmission is required to bring about an 80% probability of success (Fig 6). The import factor prevents the models from showing unviable dynamic behaviour that results from unrealistically low levels of infections innate to ODE-systems in general and especially prevalent in models with ADE(x2), yet also enhances the resistance of models. While the absolute levels of control are thus of limited practical use, the overall conclusion of differential resistance is found to persist across models with a lower import factor as well (S8 Fig), highlighting a fundamental challenge arising from structural model uncertainty.
The criteria derived and used in this work may be subjective. By basing the criteria on current literature and the available data and keeping the characteristics broad, we aimed to limit such subjectivity. By focussing on patterns that are common across endemic regions, the derived patterns are inherently weaker than for a localised approach, yet the outcomes are more generalizable. The broadness of the characteristics does lead to decreased uniqueness (as model fits to dengue patterns can be found across the entire parameter space)  and a wide range of model behaviours (S4a–S4c Fig) . To reduce subjectivity, we have used uniform distributions bounded by ranges informed by literature. For model calibration, too restricted ranges may underestimate the level of uncertainty around a parameter value, whereas in model selection, the proportion of passes is sensitive to the width of the range. Also, the comparison between the models with different numbers of sampled parameters has underlying difficulties. In more complex models, the passing parameter space may be underrepresented, giving rise to a local decrease in likelihood and wider parameter bounds . However, given the small number of parameters and large number of parameter combinations examined, the severity of under-sampling in this exercise is limited. Finally, caution should be taken in judging the likelihood of models based on the number of passes, as no correction is made for the differential complexity between the models.
The six models examined were chosen based on their proven performance in the literature [13,15,19]. However, the models contain some inherent limitations. The limited persistence typical in highly seasonal models with (decomposed) ADE may in part result from the lack of stochasticity in the model [12,23]. Serotype persistence is also believed to be affected by the assumed symmetry in transmission rate and or virulence between serotypes . We indeed observe less wild fluctuations upon the inclusion of asymmetry and a consequential increase in the fit of models with ADE (S4b Fig). Further, the inclusion of explicit vector dynamics has been found to increase the robustness of the system to changes in cross-immunity and ADE parameters, resulting in a larger parameter space with regular (1–2 year inter-epidemic periods) dynamics and moderate amplitude fluctuations . Therefore, including vector population dynamics may affect the quantitative conclusions of this study, especially when high seasonal fluctuations are assumed. The inclusion of explicit vector dynamics would further allow for a more quantitative assessment of required control efforts, which will be a focus of future work.
Lastly, no long-term variation in parameter values was taken into account. Yet, fertility rates have decreased and life expectancy has gone up in most dengue endemic countries over the last decades . Cummings et al. showed that a decrease in birth rate might result in a decrease in the force of infection and increase in the mean age of infection . The same authors also demonstrate that this demographic shift may have induced prolonged multiannual oscillations . Additionally, vector control has intensified over the years with varying success . The on-and-off vector control is likely to act as a distorting factor in the estimation of the role of seasonality, as the climate driven signal in the incidence data may be weakened by these control measures. Therefore, ignoring on-going control measures may have had some influence in our model selection and predictions. Further research will focus on disentangling the complex interplay of dengue dynamics with non-stationary factors such as intervention efforts, demography and climate.
With the expanding spatial spread of dengue and the increase of frequency and size of outbreaks, understanding dengue disease dynamics and the consequences of control efforts (e.g. a near-future vaccine introduction) has become critically important. Indeed, the present work stresses that ignoring model uncertainty in prediction exercises can skew the impact of vector control substantially. It also emphasizes that the wider use of improved data-model assimilation approaches, such as the POM method, could play a significant role in overcoming this problem.
S1 Fig. Outcome measures plane plots for the symmetric 2-infection (a), asymmetric 2-infection (b) and symmetric 4-infection model (c).
Analysis of the parameter space of each model structure (with ADE = antibody dependent enhancement, CI = cross-immunity) for seasonality (β1) and the basic reproduction number (R0). From top to bottom, outcomes are measured with respect to (A) mean inter-peak period, (B) presence of multi-annual signal (red = present, blue = absent), (C) duration of serotype replacement, (D) single serotype emergence and (E) absence of phase-locking (red = absent, blue = present).
S2 Fig. Model parameter distributions for the asymmetric 2-infection (a) and symmetric 4-infection model (b).
Parameter distributions for passing parameter sets (G) for different model hypotheses (with ADE = antibody dependent enhancement, CI = cross-immunity). The vertical lines depict the median values for each distribution with the colours indicating the corresponding model hypothesis.
S3 Fig. Correlation matrix full model for the symmetric 2-infection (a), asymmetric 2-infection (b) and symmetric 4-infection model (c).
Correlation between passing parameters in full model (ADEx2+CI) with red numbers depicting a significant correlation coefficient. The respective parameter distributions are shown on the diagonal.
S4 Fig. Qualitative comparison observed dengue case data and passing model simulations for the symmetric 2-infection (a), asymmetric 2-infection (b) and symmetric 4-infection model (c).
Qualitative comparison between observed dengue incidence data and model simulations at median levels of seasonal forcing. Dengue incidence data from Trinidad and Tobago (1997–2009) were duplicated for comparison with model simulations (A). The dotted vertical lines indicate the length of the original dataset. Other parameter values are derived at random from the passing parameter distribution G with: (a) the symmetric 2-infection model: (A)β0 = 344, β1 = 0.1, αSUS = 1, αTRANS = 1, ρ = NA (B), β0 = 204, β1 = 0.06, αSUS = 1, αTRANS = 1, ρ = 2.8 (C), β0 = 240, β1 = 0.11, αSUS = 1.28, αTRANS = 1, ρ = NA (D), β0 = 276, β1 = 0.05, αSUS = 1.64, αTRANS = 1, ρ = 2.0 (E), β0 = 228, β1 = 0.16, αSUS = 1.05, αTRANS = 2.23, ρ = NA (F) and β0 = 220, β1 = 0.12, αSUS = 1.61, αTRANS = 1.39, ρ = 2.37 (G) (b) asymmetric 2-infection model: (A)β0 = 252, β1 = 0.11, αSUS = 1, αTRANS = 1, ρ = NA (B), β0 = 384, β1 = 0.24, αSUS = 1, αTRANS = 1, ρ = 1.5 (C), β0 = 323, β1 = 0.26, αSUS = 2.23, αTRANS = 1, ρ = NA (D), β0 = 279, β1 = 0.3, αSUS = 1.86, αTRANS = 1.26, ρ = 2.0 (E), β0 = 228, β1 = 0.16, αSUS = 1.05, αTRANS = 2.23, ρ = NA (F) and β0 = 327, β1 = 0.30, αSUS = 1.16, αTRANS = 1.54, ρ = 2.35 (G) (c) symmetric 4-infection model: (A)β0 = 249, β1 = 0.07, αSUS = 1, αTRANS = 1, ρ = NA (B), β0 = 308, β1 = 0.29, αSUS = 1, αTRANS = 1, ρ = 1.26 (C), β0 = 161, β1 = 0.09, αSUS = 2.08, αTRANS = 1, ρ = NA (D), β0 = 188, β1 = 0.13, αSUS = 2.17, αTRANS = 1, ρ = 1.0 (E), β0 = 198, β1 = 0.17, αSUS = 1.12, αTRANS = 1.40, ρ = NA (F) and β0 = 125, β1 = 0.29, αSUS = 1.90, αTRANS = 1.68, ρ = 1.04 (G) (with β0 = mean transmission rate, β1 = seasonal forcing, αSUS = susceptibility enhancement, αTRANS = transmissibility enhancement, ρ = 1/duration of cross-immunity)
S5 Fig. Principal component analysis for the asymmetric 2-infection (a) and symmetric 4-infection model (b).
Principal component analysis of passing parameter space (G) of the full model (ADEx2+CI). The pie charts show the contribution of the parameters to each component.
S6 Fig. Comparative model simulations of 4-infection base-model with and without concurrent infections.
Model simulations at passing parameter sets of the 4-infection base-model without concurrent infections (top row) and with concurrent infection (bottom row). The colours indicate different serotypes. Parameter values are: (left)β0 = 249, β1 = 0.07, αSUS = 1, αTRANS = 1, ρ = NA (middle), β0 = 333, β1 = 0.07, αSUS = 1, αTRANS = 1, ρ = NA (right), β0 = 263, β1 = 0.14, αSUS = 1, αTRANS = 1, ρ = NA
S7 Fig. Vulnerability to control as a function of model parameters.
Required duration (weeks/year) for achieving successful control is shown with respect to fitted model parameters. Different model hypotheses are (from top to bottom): base (A), CI (B), ADE (C), ADE+CI (D), ADEx2 (E), and ADEx2+CI (F), with ADE = antibody dependent enhancement, CI = cross-immunity. Model parameters assessed are (from left to right): (A) the transmission rate (β0), (B) seasonality (β1), (C) enhanced susceptibility (αSUS), (D) enhanced infectiousness (αTRANS), and (E) cross-immunity (ρ).
S8 Fig. Effect of import factor on vulnerability to control.
Probability of successful control (a maximum of 1 outbreak during 30 years) given different durations (10, 20, and 30 weeks/year) of consecutive control (temporary reduction of transmission: β0(1−90%)for different model hypotheses (with ADE = antibody dependent enhancement, CI = cross-immunity). The probability is defined as the proportion of the passing parameter sets (Gi) that reach successful control. Here i refers to the six models, shown by the individual keys. The top row (A, B, and C) shows the results for the default import rate of 1e-10. The bottom row (D, E, and F) shows results for a decreased import rate of 1e-12. The probability of successful control for the Base-model and the CI-model in the default scenario are zero, as can also be seen in Fig 6.
S1 Table. Sensitivity analysis of model fits on all model parameterizations including interactions.
Logistic regression model coefficients with pattern match as binary response variables and the parameters (scaled 0–1) as independent variables. Red are high coefficient values (>|3|).
S1 Text. System of differential equations for 4-infection model.
We would like to thank the University of Notre Dame’s Center for Research Computation for high performance computation support, Vijay Gupta for his advice on the use of spectral density techniques, Sarah Lukens for her help in designing the principal component analysis and Alexandra Jilkine for verification of our initial simulation results of the 4-infection models.
Conceived and designed the experiments: QAtB EM BKS. Performed the experiments: QAtB BKS. Analyzed the data: QAtB EM BKS. Contributed reagents/materials/analysis tools: QAtB BKS EM DDC MRAH. Wrote the paper: QAtB EM BKS.
- 1. World Health Organization. Dengue guidelines for diagnosis, treatment, prevention and control. World Health Organization, 2009.
- 2. Calisher CH, Karabatsos N, Dalrymple JM, Shope RE, Porterfield JS, Westaway EG, et al. Antigenic relationships between flaviviruses as determined by cross-neutralization tests with polyclonal antisera. J Gen Virol. 1989;70: 37–43. pmid:2543738
- 3. Kalayanarooj S. Standardized clinical management: evidence of reduction of dengue haemorrhagic fever case-fatality rate in Thailand. Dengue Bull. 1999;23: 10–17.
- 4. Murrell S, Wu SC, Butler M. Review of dengue virus and the development of a vaccine. Biotechnol Adv. 2011;29: 239–247. pmid:21146601
- 5. Nisalak A, Endy TP, Nimmannitya S, Kalayanarooj S, Scott RM, Burke DS, et al. Serotype-specific dengue virus circulation and dengue disease in Bangkok, Thailand from 1973 to 1999. Am J Trop Med Hyg. 2003;68: 191–202. pmid:12641411
- 6. Campione-Piccardo J, Ruben M, Vaughan H, Morris-Glasgow V. Dengue viruses in the Caribbean. Twenty years of dengue virus isolates from the Caribbean Epidemiology Centre. West Indian Med J. 2003;52: 191–198. pmid:14649098
- 7. Cummings DAT, Irizarry RA, Huang NE, Endy TP, Nisalak A, Ungchusak K, et al. Travelling waves in the occurrence of dengue haemorrhagic fever in Thailand. Nature. 2004;427: 344–347. pmid:14737166
- 8. Andraud M, Hens N, Marais C, Beutels P. Dynamic Epidemiological Models for Dengue Transmission: A Systematic Review of Structural Approaches. PLoS one. 2012;7: e49085. pmid:23139836
- 9. Halstead SB. In vivo enhancement of dengue virus infection in rhesus monkeys by passively transferred antibody. J Infect Dis. 1979;140: 527–533. pmid:117061
- 10. Halstead SB. Dengue Antibody-Dependent Enhancement: Knowns and Unknowns. Microbiol Spectr. 2014;2.
- 11. Gubler DJ. Dengue and dengue hemorrhagic fever. Clin Microbiol Rev. 1998;11: 480. pmid:9665979
- 12. Cummings DA, Schwartz IB, Billings L, Shaw LB, Burke DS. Dynamic effects of antibody-dependent enhancement on the fitness of viruses. Proc Natl Acad Sci U S A. 2005;102: 15259–15264. pmid:16217017
- 13. Ferguson N, Anderson R, Gupta S. The effect of antibody-dependent enhancement on the transmission dynamics and persistence of multiple-strain pathogens. Proc Natl Acad Sci U S A. 1999;96: 790. pmid:9892712
- 14. Schwartz IB, Shaw LB, Cummings DA, Billings L, McCrary M, Burke DS. Chaotic desynchronization of multistrain diseases. Phys Rev E Stat Nonlin Soft Matter Phys. 2005;72: 066201. pmid:16486034
- 15. Recker M, Blyuss KB, Simmons CP, Hien TT, Wills B, Farrar J, et al. Immunological serotype interactions and their effect on the epidemiological pattern of dengue. P Roy Soc B-Biol Sci. 2009;276: 2541.
- 16. Wikramaratna PS, Simmons CP, Gupta S, Recker M. The effects of tertiary and quaternary infections on the epidemiology of dengue 2010; 5: e12347.
- 17. Mier-y-Teran-Romero L, Schwartz IB, Cummings DA. Breaking the symmetry: Immune enhancement increases persistence of dengue viruses in the presence of asymmetric transmission rates. J Theor Biol. 2013; 332: 203–210. pmid:23665358
- 18. Adams B, Holmes EC, Zhang C, Mammen MP Jr, Nimmannitya S, Kalayanarooj S, et al. Cross-protective immunity can account for the alternating epidemic pattern of dengue virus serotypes circulating in Bangkok. Proc Natl Acad Sci U S A. 2006;103: 14234–14239. pmid:16966609
- 19. Wearing HJ, Rohani P. Ecological and immunological determinants of dengue epidemics. Proc Natl Acad Sci U S A. 2006;103: 11802. pmid:16868086
- 20. Nagao Y, Koelle K. Decreases in dengue transmission may act to increase the incidence of dengue hemorrhagic fever. Proc Natl Acad Sci U S A. 2008;105: 2238–2243. pmid:18250338
- 21. Reich NG, Shrestha S, King AA, Rohani P, Lessler J, Kalayanarooj S, et al. Interactions between serotypes of dengue highlight epidemiological impact of cross-immunity. J R Soc Interface. 2013;10: 20130414. pmid:23825116
- 22. Lourenço J, Recker M. Natural, Persistent Oscillations in a Spatial Multi-Strain Disease System with Application to Dengue. PLoS Comput Biol. 2013;9: e1003308. pmid:24204241
- 23. Aguiar M, Ballesteros S, Kooi BW, Stollenwerk N. The role of seasonality and import in a minimalistic multi-strain dengue model capturing differences between primary and secondary infections: Complex dynamics and its implications for data analysis. J Theor Biol. 2011;289: 181–196. pmid:21907213
- 24. Grimm V, Railsback SF. Pattern-oriented modelling: a ‘multi-scope’ for predictive systems ecology. Philos T Roy Soc B. 2012;367: 298–310.
- 25. Spear R, Hornberger G. Eutrophication in Peel Inlet—II. Identification of critical uncertainties via generalized sensitivity analysis. Water Res. 1980;14: 43–49.
- 26. Hornberger G, Spear R. Eutrophication in Peel Inlet—I. The problem-defining behavior and a mathematical model for the phosphorus scenario. Water Res. 1980;14: 29–42.
- 27. Grimm V. Mathematical models and understanding in ecology. Ecol Model. 1994;75: 641–651.
- 28. Grimm V, Frank K, Jeltsch F, Brandl R, Uchmański J, Wissel C. Pattern-oriented modelling in population ecology. Sci Total Environ. 1996;183: 151–166.
- 29. Mitchell KM, Mutapi F, Savill NJ, Woolhouse ME. Explaining observed infection and antibody age-profiles in populations with urogenital schistosomiasis. PLoS Comput Biol. 2011; 7(10): e1002237. pmid:22028640
- 30. Mitchell KM, Mutapi F, Savill NJ, Woolhouse ME. Protective immunity to Schistosoma haematobium infection is primarily an anti-fecundity response stimulated by the death of adult worms. Proc Natl Acad Sci U S A. 2012;109: 13347–13352. pmid:22847410
- 31. Coudeville L, Garnett GP. Transmission Dynamics of the Four Dengue Serotypes in Southern Vietnam and the Potential Impact of Vaccination. PloS one. 2012;7: e51244. pmid:23251466
- 32. Thai KT, Cazelles B, Van Nguyen N, Vo LT, Boni MF, Farrar J, et al. Dengue dynamics in Binh Thuan province, southern Vietnam: periodicity, synchronicity and climate variability. PLoS Negl Trop Dis. 2010;4: e747. pmid:20644621
- 33. Cuong HQ, Vu NT, Cazelles B, Boni MF, Thai KT, Rabaa MA, et al. Spatiotemporal Dynamics of Dengue Epidemics, Southern Vietnam. Emerg Infect Dis. 2013;19(6): 945–953. pmid:23735713
- 34. Nishiura H. Mathematical and statistical analyses of the spread of dengue. Dengue Bull. 2006;30: 51.
- 35. Johansson MA, Dominici F, Glass GE. Local and global effects of climate on dengue transmission in Puerto Rico. PLoS Negl Trop Dis. 2009;3: e382. pmid:19221592
- 36. Mohd-Zaki AH, Brett J, Ismail E, L'Azou M. Epidemiology of Dengue Disease in Malaysia (2000–2012): A Systematic Literature Review. PLoS Negl Trop Dis. 2014;8: e3159. pmid:25375211
- 37. Limkittikul K, Brett J, L'Azou M. Epidemiological Trends of Dengue Disease in Thailand (2000–2011): A Systematic Literature Review. PLoS Negl Trop Dis. 2014;8: e3241. pmid:25375766
- 38. L'Azou M, Taurel A, Flamand C, Quénel P. Recent Epidemiological Trends of Dengue in the French Territories of the Americas (2000–2012): A Systematic Literature Review. PLoS Negl Trop Dis. 2014;8: e3235. pmid:25375627
- 39. Bravo L, Roque VG, Brett J, Dizon R, L'Azou M. Epidemiology of Dengue Disease in the Philippines (2000–2011): A Systematic Literature Review. PLoS Negl Trop Dis. 2014;8: e3027. pmid:25375119
- 40. L'Azou M, Brett J, Marsh G, Sarti E. Reviewing the Literature for Epidemiological Trends of Dengue Disease: Introduction to a Series of Seven National Systematic Literature Reviews. PLoS Negl Trop Dis. 2014;8: e3260. pmid:25375830
- 41. Dantés HG, Farfán-Ale JA, Sarti E. Epidemiological Trends of Dengue Disease in Mexico (2000–2011): A Systematic Literature Search and Analysis. PLoS Negl Trop Dis. 2014;8: e3158. pmid:25375162
- 42. Su GL. Correlation of climatic factors and dengue incidence in Metro Manila, Philippines. Ambio. 2008;37: 292–294. pmid:18686509
- 43. Chau TNB, Hieu NT, Anders KL, Wolbers M, Hieu LTM, Hien TT, et al. Dengue virus infections and maternal antibody decay in a prospective birth cohort study of Vietnamese infants. J Infect Dis. 2009;200: 1893–1900. pmid:19911991
- 44. Gibbons RV, Kalanarooj S, Jarman RG, Nisalak A, Vaughn DW, Endy TP, et al. Analysis of repeat hospital admissions for dengue to estimate the frequency of third or fourth dengue infections resulting in admissions and dengue hemorrhagic fever, and serotype sequences. Am J Trop Med Hyg. 2007;77: 910–913. pmid:17984352
- 45. Welch PD. The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE T Acoust Speech. 1967;15: 70–73.
- 46. Bloomfield P. Fourier analysis of time series: an introduction: John Wiley & Sons; 2004.
- 47. Recker M, Pybus OG, Nee S, Gupta S. The generation of influenza outbreaks by a network of host immune responses against a limited set of antigenic types. Proc Natl Acad Sci U S A. 2007;104: 7711. pmid:17460037
- 48. Stocki R. A method to improve design reliability using optimal Latin hypercube sampling. Comput Assis Mech Eng Sci. 2005;12: 393.
- 49. Gubler DJ, Suharyono W, Tan R, Abidin M, Sie A. Viraemia in patients with naturally acquired dengue infection. Bull World Health Organ. 1981;59: 623–630. pmid:6976230
- 50. Ferguson NM, Donnelly CA, Anderson RM. Transmission dynamics and epidemiology of dengue: insights from age–stratified sero–prevalence surveys. Philos T Roy Soc B. 1999;354: 757.
- 51. Lourenco J, Recker M. Viral and epidemiological determinants of the invasion dynamics of novel dengue genotypes. PLoS Negl Trop Dis. 2010;4: e894. pmid:21124880
- 52. Alfaro-Murillo JA, Towers S, Feng Z. A deterministic model for influenza infection with multiple strains and antigenic drift. Journal of Biological Dynamics 2013;7: 199–211. pmid:23701386
- 53. Kramer-Schadt S, Revilla E, Wiegand T, Breitenmoser U. Fragmented landscapes, road mortality and patch connectivity: modelling influences on the dispersal of Eurasian lynx. J Appl Ecol. 2004;41: 711–723.
- 54. Toni T, Welch D, Strelkowa N, Ipsen A, Stumpf MP. Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. J R Soc Interface. 2009;6: 187–202. pmid:19205079
- 55. Saltelli A, Ratto M, Andres T, Campolongo F, Cariboni J, Gatelli D, et al. Global sensitivity analysis: the primer: John Wiley & Sons; 2008.
- 56. Diekmann O, Heesterbeek J, Metz J. On the definition and the computation of the basic reproduction ratio R 0 in models for infectious diseases in heterogeneous populations. J Math Biol. 1990;28: 365–382. pmid:2117040
- 57. Van den Driessche P, Watmough J. Reproduction numbers and sub-threshold endemic equilibria for compartmental models of disease transmission. Math Biosci. 2002;180: 29–48. pmid:12387915
- 58. Diekmann O, Heesterbeek JAP. Mathematical epidemiology of infectious diseases: model building, analysis and interpretation. West Sussex: Wiley; 2000.
- 59. Billings L, Schwartz IB, Shaw LB, McCrary M, Burke DS, Cummings DAT. Instabilities in multiserotype disease models with antibody-dependent enhancement. J Theor Biol. 2007;246: 18–27. pmid:17270219
- 60. Von Bertalanffy L. General system theory: Foundations, development, applications: George Braziller New York; 1968.
- 61. Beven K. A manifesto for the equifinality thesis. J Hydrol. 2006;320: 18–36.
- 62. Singh BK, Savill NJ, Ferguson NM, Robertson C, Woolhouse MEJ. Rapid detection of pandemic influenza in the presence of seasonal influenza. BMC Public Health. 2010;10: 726. pmid:21106071
- 63. Pedersen EM, Stolk WA, Laney SJ, Michael E. The role of monitoring mosquito infection in the Global Programme to Eliminate Lymphatic Filariasis. Trends Parasitol. 2009;25: 319. pmid:19559649
- 64. Koelle K, Rodo X, Pascual M, Yunus M, Mostafa G. Refractory periods and climate forcing in cholera dynamics. Nature. 2005;436: 696–700. pmid:16079845
- 65. Topping CJ, Dalkvist T, Grimm V. Post-Hoc Pattern-Oriented Testing and Tuning of an Existing Large Model: Lessons from the Field Vole. PloS one. 2012;7: e45872. pmid:23049882
- 66. Spear RC. Large simulation models: calibration, uniqueness and goodness of fit. Environ Modell Softw. 1997;12: 219–228.
- 67. Beck M. Water quality modeling: a review of the analysis of uncertainty. Water Resour Res. 1987;23: 1393–1442.
- 68. Dilks DW, James RT. Parameter uncertainty in a highly parameterized model of Lake Okeechobee. Lake Reserv Manage. 2011;27: 376–389.
- 69. Hu K, Thoens C, Bianco S, Edlund S, Davis M, Douglas J, et al. The effect of antibody-dependent enhancement, cross immunity, and vector population on the dynamics of dengue fever. J Theor Biol. 2012; 319: 62–74. pmid:23206388
- 70. The World Bank. World Development Indicators 2011. Washington, D.C. USA; 2011.
- 71. Cummings DA, Iamsirithaworn S, Lessler JT, McDermott A, Prasanthong R, Nisalak A, et al. The impact of the demographic transition on dengue in Thailand: insights from a statistical analysis and mathematical modeling. PLoS Med. 2009;6: e1000139. pmid:19721696
- 72. Guzman MG, Halstead SB, Artsob H, Buchy P, Farrar J, Gubler DJ, et al. Dengue: a continuing global threat. Nat Rev Microbiol. 2010;8: S7–S16. pmid:21079655