Figures
Abstract
Predicting the specific magnitude and the temporal peak of the epidemic of individual local outbreaks is critical for infectious disease control. Previous studies have indicated that significant differences in spatial transmission and epidemic magnitude of dengue were influenced by multiple factors, such as mosquito population density, climatic conditions, and population movement patterns. However, there is a lack of studies that combine the above factors to explain their complex nonlinear relationships in dengue transmission and generate accurate predictions. Therefore, to study the complex spatial diffusion of dengue, this research combined the above factors and developed a network model for spatiotemporal transmission prediction of dengue fever using metapopulation networks based on human mobility. For improving the prediction accuracy of the epidemic model, the ensemble adjusted Kalman filter (EAKF), a data assimilation algorithm, was used to iteratively assimilate the observed case data and adjust the model and parameters. Our study demonstrated that the metapopulation network-EAKF system provided accurate predictions for city-level dengue transmission trajectories in retrospective forecasts of 12 cities in Guangdong province, China. Specifically, the system accurately predicts local dengue outbreak magnitude and the temporal peak of the epidemic up to 10 wk in advance. In addition, the system predicted the peak time, peak intensity, and total number of dengue cases more accurately than isolated city-specific forecasts. The general metapopulation assimilation framework presented in our study provides a methodological foundation for establishing an accurate system with finer temporal and spatial resolution for retrospectively forecasting the magnitude and temporal peak of dengue fever outbreaks. These forecasts based on the proposed method can be interoperated to better support intervention decisions and inform the public of potential risks of disease transmission.
Author summary
Dengue fever is a vector-borne disease transmitted by the Aedes aegypti mosquito and has become a global threat. The increased possibility of individual exposure to disease vectors due to human travel allowed for the rapid spread of dengue virus to new susceptible populations, ultimately resulting in severe febrile illness and substantial disease burden. Therefore, the integration of information on human movement into infectious disease prediction model will contribute to the prevention and control of infectious diseases. This study developed and retrospectively validated a forecasting system for predicting the spatial spread of dengue fever in Guangdong province, China, using population mobility and dengue fever incidence data. Compared with the local forecasting model designed for each individual city, the proposed system generated improved prediction performance with respect to the targets including peak time, peak intensity, and total incidence for retrospective forecasts of dengue fever epidemics in 12 cities of Guangdong province. The proposed method can be potentially adapted to predict other mosquito-borne infectious diseases.
Citation: Zeng Q, Yu X, Ni H, Xiao L, Xu T, Wu H, et al. (2023) Dengue transmission dynamics prediction by combining metapopulation networks and Kalman filter algorithm. PLoS Negl Trop Dis 17(6): e0011418. https://doi.org/10.1371/journal.pntd.0011418
Editor: Eric H. Y. Lau, The University of Hong Kong, CHINA
Received: May 18, 2022; Accepted: May 24, 2023; Published: June 7, 2023
Copyright: © 2023 Zeng et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: To protect the privacy of study participants, primary data are not publicly available. To access these data and/or to seek permission for its use, please contact the Data-center of China Public Health Science (https://www.phsciencedata.cn/Share/index.jsp) or email data@chinacdc.cn.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Dengue fever, a mosquito-borne infectious disease, is caused by four viral serotypes and mainly transmitted by Aedes albopictus and Aedes aegypti [1]. More than 390 million people worldwide are infected with the dengue virus each year, resulting in an estimated global cost of $8.9 billion (95% uncertainty interval 3.7–19.7) [2,3]. Infections of the disease in the Asia-Pacific region bear about three-quarters of the global dengue fever burden [4]. Predictions of the magnitudes and temporal peak of dengue epidemics in advance are crucial for planning and resource allocation for public health initiatives [5]. However, emerging studies on analyzing historical dengue outbreaks reveal a complex problem involving climate impacts, population changes caused by migration patterns, mechanistically complicated transmission rates, time-varying mosquito populations, and underreporting infections [6–14]. Although the factors mentioned above have been separately documented, it still remains unclear how to incorporate all these factors to improve the prediction performance of the magnitude and temporal peak of dengue epidemics.
In China, the outbreak of dengue fever varies greatly across cities and seasons. Specially, few cases were reported in low-disease periods. This means that the incidence of dengue is zero-inflated from a time-series perspective (S1 and S2 Figs). Previous studies have proposed that the use of the ensemble adjusted Kalman filter (EAKF) assimilation algorithm in conjunction with a compartmental model could solely capture the trend of local infectious disease transmission [15–20]. However, these models have not been able to track epidemics and outbreaks of dengue in terms of spatial transmission. Models only consider the time trend of dengue in a single geographic location. As previous research has pointed out, spatial diffusion is vital for understating the evolution of real-world complex dynamical transmission of mosquito-borne diseases, and human mobility plays an important role in the spatial spread of diseases [14,21]. Therefore, in order to more accurately track the spatial spread trend of dengue, a promising solution is to propose a novel meta-population network based on the previous SIR-EAKF model, which can not only consider the temporal epidemics of dengue but also track the spatial spread trend.
Additionally, limited by passive disease surveillance, difficulties in recording asymptomatic or mild dengue infections may lead to underreporting of infections [22]. Network dynamic models based on human mobility data can partially alleviate the bias [23]. For this reason, the study aims to construct metapopulation networks incorporating multiple factors (climate impacts, population changes caused by large spatial scale real-time human migration patterns, mechanistically complicated transmission rates, time-varying mosquito populations, and underreporting infections) for the forecasts of the magnitude and temporal peak of dengue epidemics, in which the filtering techniques iteratively update, or adjust model simulation estimates of the dynamic state.
Therefore, a combined forecast system based on metapopulation networks and the Kalman filter algorithm was developed to generate weekly real-time forecasts of dengue. As shown in Fig 1, the apparent spatial movement of dengue during the 2019–2020 epidemics was observed. Our results demonstrated that the posterior fitting captured the weekly dengue incidence and retrospectively validated the prediction accuracy of the model regarding to three targets including peak time, peak intensity, and total incidence for 21 cities in Guangdong province, China. The method exhibits an impressive performance in predicting dengue spread dynamics. In addition, the system was utilized to assimilate model-simulated outbreaks to obtain time-varying inferred values of the key parameters, which further verified the capability of the model’s parameter inference. This reliable dengue prediction approach can help design effective public health interventions to control and prevent dengue fever.
(A) Onset date of 21 prefecture-level cities in Guangdong province. (B) Mobile user flow between cities derived from mobile phone data. (C) The number of new cases of dengue fever per week (cross symbol) in each city. The solid line and shadow area are the posterior mean and 95% confidence interval (CI) of the metapopulation networks–EAKF fitting, respectively. (D) The daily average population movement between 21 prefecture-level cities in Guangdong province is based on mobile phone trajectory records. Base map sourced from the DIVA-GIS (https://www.diva-gis.org/gdata).
Materials and methods
Data sources
The current study involved assimilation and analysis of 21 prefecture-level cities to build a spatial-temporal prediction system for retrospective epidemic prediction. These cities in Guangdong province of southeastern China have long been plagued by frequent outbreaks of dengue fever [24].
The surveillance data of dengue cases from 2015 to 2020 were obtained from Guangdong Center for Disease Control and Prevention (Guangdong CDC). All cases were diagnosed according to the dengue fever diagnostic criteria issued by the Chinese Ministry of Health (WS216-2008) [25]. In particular, all the four dengue virus serotypes are included in the statistics and summarized by week. However, since there were too few observations of dengue fever during the 2015–2017 dengue epidemic seasons, we limited the retrospective prediction range to two consecutive dengue seasons from 2018 to 2020. Afterward, there are only sporadic cases in some cities (such as only 1 case in 2019 in Shanwei city and 6 cases in 2019 in Shaoguan city). From the perspective of time series analysis, these sporadic cases can basically be treated as random numbers. The number of cases is very sparse and it is difficult to model the disease transmission using existing methods. Therefore, 12 prefecture-level cities in 2019 were selected for retrospective prediction to ensure that the assimilation algorithm has enough dengue surveillance data for model calibration. In addition, according to the strategy in precious study to reduce the effect of filtering divergence [26], we also precisely defined the dengue season as the 19th week of the former year to the 20th week of the succeeding year.
Mosquito oviposition index (MOI) is currently widely used by Guangdong CDC for mosquito density monitoring. It is the percentage of Ae. albopictus positive ovitraps in all ovitraps collected from a specified area, and reflects the abundance of the adults [27,28]. Initially, the prediction model needs to obtain the time-varying time series of the mosquito population, so we used MOI data to quantify the natural birth rate of the mosquito population. We used a revised version of the birth rate calculation formula established by Chen [26]. Here, missing values were filled by data from surrounding cities, and subsequently a complete mosquito vector trend was provided. Because MOI data do not differ significantly among geographically bordering cities due to similar climatic conditions in Guangdong province, subtle fluctuations in time series might still be ignored by the data missing value filling method.
Daily ambient temperature for the same period was publicly available on the China Meteorological Data Sharing System (http://data.cma.cn/). The association between dengue virus reproduction in mosquito vector saliva and ambient temperature has been reported in previous studies [29], and this association has been expressed by a formula [30]. The function is listed as follows: (1) where T is the daily ambient temperature, and f(T) is the population transmission rate. This study used the same formula to estimate the probability of dengue virus transmission from mosquito bites based on meteorological data. Although observations from multiple monitoring stations in the same city may not be precisely identical, the differences are immaterial because the variables used in the study were obtained by calculating the average temperatures for each week in each city.
To assess intercity population migration, we analyzed all citizens’ mobile phone data which have been proven in previous studies to well estimate population mobility patterns [8,30]. In this study, we used data from the China Unicom, a company that operates domestic and international communications facilities, to study mobility patterns from 1 January to 31 December 2018. The China Unicom company holds about 19% of China’s market share [31] and is one of the three largest telecom operators in China, which has extensive geographic coverage. All data collection and processing were performed on the operator’s servers to protect users’ privacy during data pre-processing. Subsequently, the users’ cities were returned based on the cellular tower locations. We later performed further spatial and temporal data aggregation based on prescribed city geocodes. For each perfecture-level city, we represent the movement of individuals between cities as a bipartite network with time-varying edges, in which the weight of an edge between cities represents the number of visitors from that city to the next during a given day (S1 Video).
Because the retrospective predictions in this study included two consecutive dengue seasons from 2018 to 2020, it is assumed that both dengue seasons have the same pattern of population movement. In addition, the total resident population of each city was obtained separately from the statistical yearbook. Based on the above assumptions and data, the matrix of 2018–2020 daily human mobility was derived for subsequent model operations.
Metapopulation network
To retrospectively predict the spatial dissemination of dengue virus, we built metapopulation networks shown in Fig 2 that used disease monitoring data from multiple cities to flexibly generate spatial transmission patterns for reliable ensemble forecasts. The metapopulation model connects all cities using human movement. Therefore, the total population can be divided into several subpopulations, each of which represents human migration from the former region to the latter [32].
Blue and black rectangles represent mosquito and human subpopulations, respectively. The yellow compartments represent the proliferation of dengue virus in mosquitoes at the suitable temperature. The right chart shows the human movements structure of the crowd among the various subpopulation.
We overlay a standard mosquito-borne susceptible-infected-recovered (SIR) model modulated by local ambient temperature conditions [33] (S1 Text, temperature and mosquito vector-driven SIR model for dengue fever) on each human mobility network, in which each subgroup maintains its own susceptible (S), infectious (I) and removed (R) states. New infections occurred at all subpopulations, with the metapopulation movement network governing how subpopulations from different cities interact as they visit another one. In our previous study [26], we developed a dengue-specific model based on the characteristics of mosquito-borne transmission. The model consisted of different compartments corresponding to the disease stages of mosquitoes and humans in the subpopulation. According to the transmission characteristics of each compartment, we constructed differential equations, which incorporated the annual average time series of mosquito birth rate (μb(t)) and population transmission rate (τn(t)). The time-varying μb(t) and a fixed death rate (μd) can simulate the natural growth of mosquito population. The model parameter τn(t), estimated by temperature, can explain the probability of successful transmission of dengue virus after a mosquito bite. Afterward, the equations were integrated to obtain the dengue virus transmission between mosquitoes and humans in this thoroughly mixed population, yielding the number of susceptible, infected, and recovered individuals in mosquito population and human population at each time point, respectively (S1 Text, temperature and mosquito vector-driven SIR model for dengue fever). Consequently, we can fit compartmental models into each edge to better project how the dengue spreads within the subgroups.
From the structural point of view, we simulate irregular movement besides population mobile data. These individuals follow the Markov process and circulate among subpopulations, resulting in population exchange among all subpopulations. Our model assumed that the number of random visitors between cities is proportional to the average population movement between cities. More population mobility meant that there should be more solid links or other incentives to promote the communication of random travelers. To estimate random movement population, we assumed an adjustable parameter θ (random movement ratio), thus, the random visitors between two sites were given by the product of the average population movement and θ. The θ is regarded as a threshold at which the random movement is still progressing. Besides, all travelers flow directionally between cities every day, so the volume of travelers in opposite directions between two cities might be different in the origin-destination matrix in this study. When they flow into the destination, they will be allocated to different compartments according to their disease course. This population exchange exists between all paired cities. During the course of disease transmission, each individual may progress across the compartments, with the rate illustrated by these ordinary differential equations: (2) where , , and were the number of susceptible, infectious, and the total number of individuals in population movement from city k to n, where the subscripts H and M stood for the human (host) and mosquito, respectively. NnH represented the human population in city n. τn(t) is the population transmission rate at time t, β0 is the basic contact rate between humans and mosquitoes, τn(t)β0 is the contact rate between humans and mosquitoes at time t. D represented the infectious period, which defined how long the infectious individuals recovered from the disease. Since mosquito populations cannot move over long distances on a large scale, it was assumed that mosquito movement only occurred within each city, and there was no cross-city movement of mosquitoes. Here, we demonstrated a model developed to illustrate dengue virus transmission among mosquitoes: (3)
Here α was the random rate of dengue fever seeding into the local areas, U was the vertical infection rate constant over an outbreak. μb(t) is the mosquito birth rate at time t, μd is the mosquito death rate and is constant over an outbreak. These ordinary differential equations were integrated to calculate the number of new infections in each subpopulation, and the weekly number of new infections in city k was obtained by summing up the total number of subpopulations entering city k during that week.
Parameter inference
The metapopulation model can generate many spatial diffusion scenarios by changing the parameter θ which was the ratio of human mobility data to random visitors. Besides, by giving vast amounts of parameters D and β0, the model can capture enough outbreak scenarios in each subpopulation. So that the model can be used in conjunction with EAKF to infer key parameters of the model and generate ensemble predictions due to its flexibility. EAKF is a data assimilation technology developed by Anderson [34]. The advantages of the EAKF algorithm in assimilating confirmed case counts and updating parameters according to Bayes’ rule have been reported in previous studies [20,35]. Therefore, this data assimilation algorithm was also used in this study to assimilate the weekly incidence cases from CDC for continuous calibration of the model and parameters. In model training, the state variables and parameters in the dynamic model are calibrated repeatedly by existing dengue cases. Then the optimized model is integrated into the future to generate prediction. In practice, the popular trajectory set generated randomly is simulated to generate the probability distribution of prediction results.
The metapopulation system has a high dimensional state vector. In each subpopulation , six state variables: , and the number of new infections per week, SnM, InM, and newly infected mosquitoes were recorded simultaneously and parameters D (duration of infection), β0 (basic contact rate between humans and mosquitoes), and θ (random movement ratio) were shared for all subpopulations. For each data assimilation, the parameters and state variables recorded at the previous moment are calibrated by EAKF, a filtering algorithm for high dimensional systems using finite number of ensemble members. Then, they were used in the dynamics model integration for the epidemic prediction in subsequent moment. The above process was repeated until the end of a retrospective prediction period. After the assimilation, the variables and parameters in the dynamic model of infectious diseases have been calibrated iteratively. Finally, the state variables in each subpopulation were aggregated by city to obtain week-by-week summary data for each state variable with 300 ensemble members (S1 Text, data assimilation methods). Based on these summary data, point estimates were shown as posterior means and statistical uncertainties were shown as 95% prediction intervals.
To verify the accuracy of parameter inference, we examined whether key model parameters can be accurately recovered from synthetic outbreaks generated by models with known true values. Two synthetic dengue fever seasons with the same parameters were simulated by the metapopulation networks (except θ). To simulate a dengue fever outbreak close to the real situation, the simulated synthetic outbreaks were then generated by adding random observation errors (error variance (weekly infections2+100)/25) to the truth. Then, these synthetic error-laden observations were used to assimilate and estimate parameters in the combined system. Simultaneously, the parameter inference error is obtained by comparing the inferred parameter with the true value (S3 Fig). In addition, to further verify the stability of the model parameter inference performance, we also extended the number of simulations to ten times, and used the metapopulation model to perform parameter inference for these ten simulated outbreaks.
Retrospective forecasts
We generated 300 independent ensemble forecasts for each week during the dengue season from 2018 to 2020 using both the metapopulation model and the isolated SIR model (S1 Text, temperature and mosquito vector-driven SIR model for dengue fever). Turning to the initialization for crucial state vector, the initial conditions were drawn using a Latin hypercube sampling with the following ranges: , , SnM∈[NnM], InM∈[10−6,10−4], D∈[5,7], β0 = [0.01,0.1], θ∈[0,0.5], NnH = NnM, represented human migration form location k to location n derived from mobile phone data. The observed variable in each subpopulation was initiated as 0 because it could be fully determined by other state variables and parameters during model integration. All subpopulations share the same parameters D and θ. Besides, some state vectors were initialized with constant parameter: U = 0.25, α = 1/500000 and μd = 1/15 over the whole dengue seasons. For each subpopulation, the susceptible population, the infected population and observed incidence for both mosquitos and human were recorded in the state vector. We subsequently obtained prediction accuracy of predicted targets (peak week, peak intensity, and total incidence) relative to true values for 12 cities in Guangdong province. The remaining nine cities were excluded, as they were not well represented in the CDC dengue dataset due to the low number of dengue records (S1 and S2 Figs) [36]. In addition, since dengue outbreaks often begin in June and end in December of each year, a dengue season was defined as week 19 of each year to week 20 of the immediately following year in order to reduce the impact of filtering divergence caused by assimilating many zero-inflated data in the earlier stages of assimilation. (S4 Fig).
Results
As previously described, this study aimed to construct metapopulation networks using human mobility data to predict the spatial and temporal transmission trends of dengue viruses, and produce weekly real-time predictions of the magnitude and temporal peak of the epidemic. Initially, we selected dengue fever observations from 12 prefecture-level cities in Guangdong province in 2019 for assimilation and we publicly obtained the raw shape files from the DIVA-GIS (https://www.diva-gis.org/gdata), and generated the maps in this study. Among these dengue cases, we observed a significant spatial movement of dengue fever in 2019 (Fig 1A), with an earlier dengue epidemic in the Pearl River Delta and a temporal lag in other regions. In particular, in order to construct the metapopulation networks, we used the matrix of daily population migration data. We found that population movements were more numerous and frequent in the Pearl River Delta region based on mobility data (Fig 1B) and that most population movement events occurred between neighboring cities, while long-distance movements were quite rare (Figs 1D and S5). To verify the relationship between dengue epidemic and population movement, we used the empirical dynamic modeling (EDM) method [37] to reconstruct the dengue cases with 3 time series (mosquito vector MOI, temperature, and population movement). A detailed analysis of the relationship between these 3 time series and the occurrence of dengue fever had been performed, and the results showed that the 3 time series’ cross mapping skills were positive except for few cities (S6 Fig), suggesting that the time series of mosquito vector MOI, temperature, and population migration are positively correlated with incidence time series of dengue fever. Therefore, we employed the forecast system based on the metapopulation SIR model and EAKF algorithm to fit actual observed data of dengue cases in Guangdong in 2019 (S7 Fig for the 2018 forecast results). The forecast system produced posterior fitting of the epidemic shown in Fig 1C, and forecast results of all cities in Guangdong in 2019 for the whole year in week 10 were shown in S8 Fig. The posterior fittings well capture the epidemic curves. However, it is noteworthy that although the prediction model incorporating population movement data yields good posterior fitting, there is no definite causal relationship can be given between the spatial transmission of dengue and population migration.
In the next section of the research, we investigated whether key parameters could be accurately inferred from simulated synthetic epidemics. In Fig 3A and 3B, two such outbreaks were generated by the metapopulation networks with the same initial conditions and parameters except for the random movement index (A, θ = 0.05 and B, θ = 0.25). Afterward, we assimilated the simulated observations using the proposed system and obtained parameter inference results, and the posterior fitting generated by the system for assimilating simulated outbreaks were shown in S9 and S10 Figs. Fig 2 shows the average of 300 ensembles parameter inferences. The results show that these calibrated parameters have stabilized significantly around the true values after assimilating several weeks of observations. Only 6 cities were presented in the picture for clarity, and the complete results were presented in the Appendix (S11 Fig). At the same time, we calculated the relative error between the inferred and true values of the predicted target. These results suggest that the accuracy of the inference is not particularly sensitive to the initial conditions of the model. To further validate the stability of the model parameter inferences, we compared the prediction performance of the isolated SIR-EAKF model and the metapopulation SIR networks-EAKF system for 10 synthetic outbreaks, and the results were presented in the S12 Fig. Our analysis results demonstrated the stability of the metapopulation model in terms of parameter inference. In addition, the analysis results of simulated outbreaks showed that the combined model significantly outperformed the isolated model with respect to the prediction accuracy.
The metapopulation model generates the number of new infections per week in six cities (Guangzhou, Shenzhen, Foshan, Dongguan, Zhongshan, and Jiangmen). Except (A1) θ = 0.05 and (A2) θ = 0.25, both simulations were obtained under the same initial conditions. Different colors distinguish the epidemic curves of new cases in different cities. (B1: θ = 0.05; B2: θ = 0.25) Inference of the parameter D (infection duration) by the metapopulation network-EAKF fitting. The real blue line represents the real parameters used in the simulated epidemics, and the red dotted line represents the posterior mean in the data assimilation process. (C1: θ = 0.05; C2: θ = 0.25) The parameter β (contact rate) in the metapopulation model is inferred. (D1: θ = 0.05; D2: θ = 0.25) Inference of the parameter θ (random movement ratio) in the metapopulation model.
However, dengue cases tend to occur sporadically based on historical and theoretical experience. For the simulated dengue outbreaks, the metapopulation model simultaneously integrates dengue cases from multiple subpopulations and rounds the simulated values to integers. The rounding process may miss some scattered cases, resulting in a slight underestimation. Therefore, random numbers sampled from a Poisson distribution need to be added to the dengue outbreak simulations to obtain observations that are more consistent with real dengue outbreaks.
To assess the prediction accuracy of the model, we retrospectively predicted dengue cases in cities of Guangdong province in 2018–2020. The time series of dengue fever from 2015 to 2020 were shown in Fig 4A. Importantly, because the actual peak week and epidemic magnitude are unknown in real time, we assessed the forecast accuracy relative to the predicted peak week or epidemic magnitude in the prediction. We first defined the forecast accuracy for the peak week as the fraction of the average ensemble forecast within ±1 week from observations; the forecast accuracy for the peak intensity as the fraction of the average ensemble forecast within ±25% from observations; the forecast accuracy for the total incidence as the fraction of the average ensemble forecast within ±25% from observations. The average prediction accuracy of peak week, peak intensity, and total incidence of dengue fever in Guangdong province for the 2019–2020 dengue season were shown in Fig 4B, respectively. In addition, the predictions for the 2018–2019 dengue season were shown in S13 and S14 Figs. The horizontal axis of the graph represented the number of weeks ahead of the forecast. A positive forecast lead indicated that the starting week or peak week was expected to occur in the future, while a negative value meant that the starting week or peak week was expected to have passed. The accuracy of the combined model based on metapopulation networks and EAKF algorithm for predicting the peak week ten weeks in advance was more satisfactory. We also found that the model proposed in our study had higher prediction accuracy of infection, although results varied greatly across prefecture-level city. Specifically, we also summarized and compared the prediction accuracy of the two models for peak week in each city. We found that the established model outperformed the isolated model for most cities in the aspect of prediction accuracy. In particular, the proposed model demonstrated good prediction performance for most cities with leads of up to 10 weeks. Table 1 summarized the improvements in predictive accuracy for peak week, peak intensity, and total incidence and the statistical significance obtained from bootstrap analysis. The improvements were generally statistically significant indicating significantly improved prediction accuracy for peak week and total incidence. The prediction of peak intensity was relatively more challenging, but the prediction accuracy of the metapopulation model was still better than that of the isolated model, although the improvement in prediction accuracy at sporadic weeks was not statistically significant.
(A) The epidemic situation of dengue fever in Guangdong province. (B) The average prediction accuracy of three evaluation metrics (peak week, peak intensity, and total incidence) for metapopulation and isolated predictions across 21 cities in 2019. (C) The performance of prediction of peak week using metapopulation model compared with the isolated model in individual cities. Blue (orange) bars indicate that the metapopulation forecast is better (worse) in terms of the number of cities.
Our results show that the predicted number of dengue cases predicted by the model proposed in this study was closer to the true number of dengue cases and that the predictions of the ensemble forecast system were always correct when both models predicted simultaneously. From the perspective of model application, the SIR-EAKF system combined with population movement data can retrospectively infer the spatial spread of the virus. Further, surveillance data from different cities can be used by the model to simultaneously generate estimates of the outbreak magnitude, thus avoiding inaccurate local reporting data due to underreporting, which was beneficial for predicting both novel and currently existing viruses.
The above comparison of the prediction accuracy of the results was performed based on observations. However, these observations inherently contain a degree of randomness in the actual predictions. Therefore, researchers have viewed each observation as a single realization of a stochastic process [36]. To further validate the forecasting system, we evaluated the forecasting results by exploring the distribution of observations relative to the predicted values in each forecast. Specifically, when the observations were normally distributed around the predicted values with zero mean, the forecast provides a good estimate of the true value. Conversely, a bias in the prediction can be perceived when the mean error was not zero. Therefore, estimates of forecast inaccuracy were obtained by exploring the distribution of observations around the forecast. Fig 5 presents the distance distributions from the observed to the predicted values for the three indicators (peak week, peak intensity, and total incidence) for 12 prefecture-level cities in Guangdong province in 2019. We grouped the model-generated forecasts by forecast week from 6 weeks to 1 week (peak week, peak intensity, and total incidence) and then the distance distribution of the observed values relative to the predicted values under each category was plotted separately. The relative distances predicted by the two models for the predicted targets (peak weeks, peak intensity, and total incidence) are shown in the legends of Fig 5. Unlike the metapopulation networks, isolated forecasts were more sensitive to observation noise. As for the metapopulation networks, the identification of early signals of the epidemic was extracted from neighboring cities due to the introduction of population movement data, which greatly reduced the influence of the model from zero-inflated data. Meanwhile, most of the metapopulation networks in the results had a smaller mean bias, suggesting that the proposed model demonstrated a better prediction performance than isolated model. However, we found that early sporadic observations may affect the model and may cause the isolated model prediction system to incorrectly predict peak weeks, as indicated by the bias in the peak week prediction (Fig 5, top). For peak intensity and total incidence, the distribution of isolated model predictions tended to be positive skewed, especially for predicting total incidence (Fig 5, bottom), implying that the isolated model failed to capture the outbreak trajectory in low-disease periods.
Blue columns represent metapopulation forecasts, and orange columns represent isolated forecasts. The mean deviations of each distribution are displayed in legends of each subgraph and distinguished by color. (top) For peak forecasts with predicted leads of 5 to 6, 3 to 4, and 1 to 2 wk, the distributions of the peak week relative to the predicted value (x-axis is the observed peak week minus the predicted peak week) in 21 cities in 2019 are shown, both for metapopulation and isolated prediction. (middle and bottom) The same analysis for (middle) peak intensity and (bottom) total incidence, grouped by the predicted lead to peak week. The x-axis for middle (bottom) is the value of observed peak intensity (total incidence) minus predicted peak intensity (total incidence).
Discussion
Here we have developed and retrospectively validated an outbreak prediction system that can accurately predict the epidemic size and temporal peak of dengue fever. Given dengue infection cases and population movement data, the metapopulation network-EAKF system iteratively calibrated state variables and model parameters to provide accurate prediction results and accurately corrected model parameters in real time. By assimilating surveillance data from multiple cities, the metapopulation networks improved prediction accuracy for peak week, peak intensity, and total incidence of dengue outbreaks. Our models projected that there were 12, 9, and 10 cities with improved predictions of the predicted targets compared to baseline predictions made at each city individually, and these cities accounted for 100%, 75%, and 83.3% of the total number of cities predicted, respectively.
In this study, the isolated model in Guangzhou city is consistent with most of the work done by the SIR-EAKF theory [26]. The metapopulation network combined with population migration information can improve the prediction accuracy compared with the isolated model. These results appear to be consistent with other studies showing that human mobility has expanded the spatial range of transmission, leading to changes in the amount of contact between susceptible populations and infected mosquitoes [15,38–41]. Since this study includes the spatial network in the meta-population model, it can well solve the problem of dengue transmission from one city to another, which has not been solved in previous studies [17,20]. At the same time, our results confirm the view of Jeffrey Shaman [16], who believes that larger areas may be better predicted if they are divided into smaller geographical units. These issues need to be explored more comprehensively in the future to determine the optimal spatial scale at which dengue should be predicted.
This study represents the first attempt to establish a combined system based on metapopulation networks and Kalman filter using population mobility data. The system achieved good predictions of the spatial spread of dengue fever and retrospectively validated the improvement of the model over the baseline model through multiple validation methods. Given that the spatial network-based approach of our study relies only on dengue case count data routinely collected in most endemic countries, we anticipate that similar models could be applied in many other countries globally. In addition, since surveillance data of dengue fever were derived from a passive detection system, it was difficult to monitor mild patients [42,43] or asymptomatic patients [22,44], which may lead to underreporting bias. The prediction system proposed in this study can capture the signal of the occurrence of the epidemic in the early sporadic case period of dengue fever by absorbing surveillance data from multiple cities and give satisfactory predictions in advance, which can minimize the impacts of underreporting bias.
Nevertheless, our study has several major limitations. First, although the model uses mobile phone data provided by China Unicom to estimate population mobility data in Guangdong province, there was a certain proportion of children among dengue patients [45]. Thus, the information of these children or the elderly may not be recorded by mobile phone data, and there may be some underrecording of data records. However, a random mobile population parameter was added to our model to consider the random occurrence of population movements, which can avoid this bias to some extent. Next, this study examined the spread of dengue fever on a large scale based on population movements between cities. However, the study could not determine the subtle differences between the actual travel distance of individuals, the time spent in different locations, and the frequency of specific types of habitats (e.g., residential, entertainment, and business) [40]. Third, the question of whether population mobility or climatic factors were the only causes of differences in onset dates among cities cannot be resolved yet. However, the predictive accuracy of our model suggests that it broadly captures the relationship between mobility and transmission, and we thus expect our broad conclusions. For example, the metapopulation model has higher prediction accuracy in part because it can obtain signals from the population mobility network, but the isolated model cannot do that. It was hoped that work will stimulate clear causal relationship studies among these factors in further research. Forth, the significant change in human mobility following the lockdown in late January 2020 was not captured in our model. However, the dengue season had essentially ended in Guangdong province from January to May 2020. This time period had limited dengue cases with or without COVID and should have a limited impact on the overall results.
The prediction system developed in this study incorporated data assimilation algorithms that differ from previous disease-specific transmission dynamics, so it may be applied to the prediction of other infectious diseases. In recent decades, many new infectious diseases have emerged rapidly and spread globally, including influenza, Zika virus, chikungunya fever, Ebola virus, avian influenza, and coronavirus disease. Our forecast system naturally extends to other disease, mobility datasets, models, and algorithms that capture more aspects of real-world transmission, and these represent interesting directions for future work. In an increasingly interconnected world, providing policy-relevant and real-time information on when and where dengue outbreaks will occur, and how to effectively intervene, monitor, and clinically respond can provide useful evidence-based information for policy development and control coordination. The forecasting system proposed in this study combined complex ensemble population models, efficient data assimilation techniques, mobile phone data, large-scale climate data [46], mosquito density surveillance data [47,48], and dengue cases surveillance information at the prefectural city level, which can be performed in real time to generate forecasts of future disease transmission and magnitude. Accurate forecast of the intensity and temporal peak of infectious disease outbreaks discriminated among cities or regions within a country would provide greater lead time for preferential focus of mitigation and response resources to areas with more urgent need. In conclusion, the network structure exploration is helpful for targeting risk actors and tailoring prevention and control strategies. This study demonstrates the potential and challenges of spatio-temporal models in improving the understanding of dengue spatial transmission, and provides valuable empirical evidence for government public health departments to guide the refinement of vector control strategies.
Supporting information
S1 Text Method. The association of climate, mosquito vectors, and population movements with the occurrence of dengue fever, analysis of the intercity population mobility patterns, temperature and mosquito vector-driven SIR model for dengue fever, data assimilation methods, and references.
https://doi.org/10.1371/journal.pntd.0011418.s001
(DOC)
S1 Fig. Weekly dengue fever cases (cross-sign) in each city of Guangdong Province in 2018.
https://doi.org/10.1371/journal.pntd.0011418.s002
(TIF)
S2 Fig. Weekly dengue fever cases (cross-sign) in each city of Guangdong Province in 2019.
https://doi.org/10.1371/journal.pntd.0011418.s003
(TIF)
S3 Fig. Distribution of relative inference errors.
For θ = 0.05 (left) and θ = 0.25 (right), the relative error distribution of D, β, and θ in the 21st week was deduced by 300 independent estimations using the metapopulation model. Each estimate is the mean of the randomly selected 300 member sets.
https://doi.org/10.1371/journal.pntd.0011418.s004
(TIF)
S4 Fig. Dengue curve of 21 cities in Guangdong province from 2018 to 2020.
The retrospective forecast season is marked by grey areas.
https://doi.org/10.1371/journal.pntd.0011418.s005
(TIF)
S5 Fig. The distribution of movement in adjacent and non-adjacent cities.
https://doi.org/10.1371/journal.pntd.0011418.s006
(TIF)
S6 Fig. The association of climate, mosquito vectors and population movements with the occurrence of dengue fever.
(A) weekly observations of dengue fever, temperature, Mosquito Oviposition Index (MOI), and population movements for each prefecture-level city in Guangdong Province from 2018 to 2020. (B) Climate, population movement data and mosquito vector MOI index drive dengue incidence, and Cross mapping skills were calculated for each city in Guangdong.
https://doi.org/10.1371/journal.pntd.0011418.s007
(TIF)
S7 Fig. Posterior predictions of dengue fever in Guangdong province in 2018.
Weekly dengue fever cases (cross symbols) for each prefecture-level city. The solid lines and shaded areas are the posterior mean and 95% credible intervals (CI), respectively, of the metapopulation network-EAKF fit.
https://doi.org/10.1371/journal.pntd.0011418.s008
(TIF)
S8 Fig. Forecast of epidemic curves in 21 cities of Guangdong province in 2019.
The metapopulation model with 300 ensemble members is used. The yellow cross symbols indicate weekly observations. The solid red curves are average forecast trajectories, and the grey areas represent 95% prediction intervals.
https://doi.org/10.1371/journal.pntd.0011418.s009
(TIF)
S9 Fig. Inference of parameters in the metapopulation model.
Simulations were obtained under the same initial conditions, and the random movement parameter is set as θ = 0.05. Posterior mean estimates of weekly observation of new cases in metapopulation simulations are displayed for 21 cities separately. The solid line and shadow area are the posterior mean and 95% confidence interval (CI) of the metapopulation network-EAKF fitting, respectively. The red cross symbols indicate the synthetic observations used for data assimilation.
https://doi.org/10.1371/journal.pntd.0011418.s010
(TIF)
S10 Fig. Inference of parameters in the metapopulation model.
Simulations were obtained under the same initial conditions, and the random movement parameter is set as θ = 0.25. Posterior mean estimates of weekly observation of new cases in metapopulation simulations are displayed for 21 cities separately. The solid line and shadow area are the posterior mean and 95% confidence interval (CI) of the metapopulation network-EAKF fitting, respectively. The red cross symbols indicate the synthetic observations used for data assimilation.
https://doi.org/10.1371/journal.pntd.0011418.s011
(TIF)
S11 Fig. Inference of parameters in the metapopulation model.
(A and B) The metapopulation model generates the number of new infections per week in 21 cities. Except (A) θ = 0.05 and (B) θ = 0.25, both simulations were obtained under the same initial conditions. Different colors distinguish the epidemic curves of new cases in different cities. (C θ = 0.05; D θ = 0.25) Inference of the parameter D (infection duration) by the metapopulation network-EAKF system. The real blue line represents the real parameters used in the simulated epidemics, and the red dotted line represents the posterior mean in the data assimilation process. (E θ = 0.05; F θ = 0.25) The parameter β (contact rate) in the metapopulation system is inferred. (G θ = 0.05; H θ = 0.25) Inference of the parameter θ (random movement ratio) in the metapopulation model.
https://doi.org/10.1371/journal.pntd.0011418.s012
(TIF)
S12 Fig. Average forecast accuracy of peak week, peak intensity, and total incidence for pooled population and isolated forecasts.
Based on population movement, ambient temperature, and Mosquito Oviposition Index data from 21 cities in Guangdong, 10 synthetic outbreaks were generated using an ensemble population model. For each synthetic outbreak, weekly forecasts were made using 300-member ensembles.
https://doi.org/10.1371/journal.pntd.0011418.s013
(TIF)
S13 Fig. Average prediction accuracy for metapopulation and isolated predictions of peak week, peak intensity, and total incidence for the 2018 dengue fever season. y-axis scale indicates the proportion of accurate predictions in each group.
https://doi.org/10.1371/journal.pntd.0011418.s014
(TIF)
S14 Fig. Two forecast systems predicted the integrated epidemic curve of seven cities at week 10.
Two forecast systems predicted the integrated epidemic curve of seven cities in week 10. Research provides prediction methods using metapopulation model (A) and isolated model (B) prediction systems. Three hundred ensemble members are used in the forecast. 95% prediction intervals (PIs) are reported. The metapopulation forecast system well predicts the outbreak curve. Although the Isolated model captured seasonal targets such as peak week in a few locations, the overall epidemic curve is underestimated by isolated prediction.
https://doi.org/10.1371/journal.pntd.0011418.s015
(TIF)
S1 Table. The number of cases predicted by metapopulation and isolated model before peak week.
https://doi.org/10.1371/journal.pntd.0011418.s016
(DOCX)
S1 Video. Daily population movements among prefecture-level cities in Guangdong in 2018.
https://doi.org/10.1371/journal.pntd.0011418.s017
(MOV)
Acknowledgments
We thank the staff members at the hospitals, local health departments, and county-, district- and prefecture-level Centers for Disease Control and Prevention for their great assistance in coordinating data collection. We are also thankful to the staff of the China Unicom Company for their tremendous help in mobile phone data collection.
References
- 1. Sun H, Dickens BL, Richards D, Ong J, Rajarethinam J, Hassim MEE, et al. Spatio-temporal analysis of the main dengue vector populations in Singapore. Parasites & vectors. 2021;14(1):41. Epub 2021/01/13. pmid:33430945; PubMed Central PMCID: PMC7802191.
- 2. Amoa-Bosompem M, Kobayashi D, Itokawa K, Murota K, Faizah AN, Azerigyik FA, et al. Determining vector competence of Aedes aegypti from Ghana in transmitting dengue virus serotypes 1 and 2. Parasites & vectors. 2021;14(1):228. Epub 2021/05/01. pmid:33926510; PubMed Central PMCID: PMC8082837.
- 3. Shepard DS, Undurraga EA, Halasa YA, Stanaway JD. The global economic burden of dengue: a systematic analysis. The Lancet Infectious diseases. 2016;16(8):935–41. Epub 2016/04/20. pmid:27091092.
- 4. Rajarethinam J, Ong J, Neo ZW, Ng LC, Aik J. Distribution and seasonal fluctuations of Ae. aegypti and Ae. albopictus larval and pupae in residential areas in an urban landscape. PLoS neglected tropical diseases. 2020;14(4):e0008209. Epub 2020/04/21. pmid:32310960; PubMed Central PMCID: PMC7192508.
- 5. Rypdal M, Sugihara G. Inter-outbreak stability reflects the size of the susceptible pool and forecasts magnitudes of seasonal epidemics. Nature communications. 2019;10(1):2374. Epub 2019/05/31. pmid:31147545; PubMed Central PMCID: PMC6542824.
- 6. Badr HS, Du H, Marshall M, Dong E, Squire MM, Gardner LM. Association between mobility patterns and COVID-19 transmission in the USA: a mathematical modelling study. The Lancet Infectious diseases. 2020;20(11):1247–54. Epub 2020/07/06. pmid:32621869; PubMed Central PMCID: PMC7329287.
- 7. Schaber KL, Perkins TA, Lloyd AL, Waller LA, Kitron U, Paz-Soldan VA, et al. Disease-driven reduction in human mobility influences human-mosquito contacts and dengue transmission dynamics. PLoS computational biology. 2021;17(1):e1008627. Epub 2021/01/20. pmid:33465065; PubMed Central PMCID: PMC7845972.
- 8. Kiang MV, Santillana M, Chen JT, Onnela JP, Krieger N, Engø-Monsen K, et al. Incorporating human mobility data improves forecasts of Dengue fever in Thailand. Scientific reports. 2021;11(1):923. Epub 2021/01/15. pmid:33441598; PubMed Central PMCID: PMC7806770.
- 9. Gao J, Zhang HD, Guo XX, Xing D, Dong YD, Lan CJ, et al. Dispersal patterns and population genetic structure of Aedes albopictus (Diptera: Culicidae) in three different climatic regions of China. Parasites & vectors. 2021;14(1):12. Epub 2021/01/08. pmid:33407824; PubMed Central PMCID: PMC7789686.
- 10. Davis C, Murphy AK, Bambrick H, Devine GJ, Frentiu FD, Yakob L, et al. A regional suitable conditions index to forecast the impact of climate change on dengue vectorial capacity. Environmental research. 2021;195:110849. Epub 2021/02/10. pmid:33561446.
- 11. Lemanski NJ, Schwab SR, Fonseca DM, Fefferman NH. Coordination among neighbors improves the efficacy of Zika control despite economic costs. PLoS neglected tropical diseases. 2020;14(6):e0007870. Epub 2020/06/23. pmid:32569323; PubMed Central PMCID: PMC7332071.
- 12. Tuladhar R, Singh A, Banjara MR, Gautam I, Dhimal M, Varma A, et al. Effect of meteorological factors on the seasonal prevalence of dengue vectors in upland hilly and lowland Terai regions of Nepal. Parasites & vectors. 2019;12(1):42. Epub 2019/01/20. pmid:30658693; PubMed Central PMCID: PMC6339416.
- 13. Jia P, Liang L, Tan X, Chen J, Chen X. Potential effects of heat waves on the population dynamics of the dengue mosquito Aedes albopictus. PLoS neglected tropical diseases. 2019;13(7):e0007528. Epub 2019/07/06. pmid:31276467; PubMed Central PMCID: PMC6645582.
- 14. Wesolowski A, Qureshi T, Boni MF, Sundsøy PR, Johansson MA, Rasheed SB, et al. Impact of human mobility on the emergence of dengue epidemics in Pakistan. Proceedings of the National Academy of Sciences of the United States of America. 2015;112(38):11887–92. Epub 2015/09/10. pmid:26351662; PubMed Central PMCID: PMC4586847.
- 15. Stoddard ST, Forshey BM, Morrison AC, Paz-Soldan VA, Vazquez-Prokopec GM, Astete H, et al. House-to-house human movement drives dengue virus transmission. Proceedings of the National Academy of Sciences of the United States of America. 2013;110(3):994–9. Epub 2013/01/02. pmid:23277539; PubMed Central PMCID: PMC3549073.
- 16. Shaman J, Karspeck A, Yang W, Tamerius J, Lipsitch M. Real-time influenza forecasts during the 2012–2013 season. Nature communications. 2013;4:2837. Epub 2013/12/05. pmid:24302074; PubMed Central PMCID: PMC3873365.
- 17. Shaman J, Karspeck A. Forecasting seasonal outbreaks of influenza. Proceedings of the National Academy of Sciences of the United States of America. 2012;109(50):20425–30. Epub 2012/11/28. pmid:23184969; PubMed Central PMCID: PMC3528592.
- 18. Yang W, Lipsitch M, Shaman J. Inference of seasonal and pandemic influenza transmission dynamics. Proceedings of the National Academy of Sciences of the United States of America. 2015;112(9):2723–8. Epub 2015/03/03. pmid:25730851; PubMed Central PMCID: PMC4352784.
- 19. Yang W, Olson DR, Shaman J. Forecasting Influenza Outbreaks in Boroughs and Neighborhoods of New York City. PLoS computational biology. 2016;12(11):e1005201. Epub 2016/11/18. pmid:27855155; PubMed Central PMCID: PMC5113861 potential conflicts of interest.
- 20. Pei S, Shaman J. Counteracting structural errors in ensemble forecast of influenza outbreaks. Nature communications. 2017;8(1):925. Epub 2017/10/17. pmid:29030543; PubMed Central PMCID: PMC5640637 competing financial interests.
- 21. Bomfim R, Pei S, Shaman J, Yamana T, Makse HA, Andrade JS Jr., et al. Predicting dengue outbreaks at neighbourhood level using human mobility in urban areas. Journal of the Royal Society, Interface. 2020;17(171):20200691. Epub 2020/10/29. pmid:33109025; PubMed Central PMCID: PMC7653379.
- 22. Yoon IK, Rothman AL, Tannitisupawong D, Srikiatkhachorn A, Jarman RG, Aldstadt J, et al. Underrecognized mildly symptomatic viremic dengue virus infections in rural Thai schools and villages. The Journal of infectious diseases. 2012;206(3):389–98. Epub 2012/05/23. pmid:22615312; PubMed Central PMCID: PMC3490697.
- 23. Li R, Pei S, Chen B, Song Y, Zhang T, Yang W, et al. Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARS-CoV-2). Science (New York, NY). 2020;368(6490):489–93. Epub 2020/03/18. pmid:32179701; PubMed Central PMCID: PMC7164387.
- 24. Cheng J, Bambrick H, Yakob L, Devine G, Frentiu FD, Williams G, et al. Extreme weather conditions and dengue outbreak in Guangdong, China: Spatial heterogeneity based on climate variability. Environmental research. 2021;196:110900. Epub 2021/02/27. pmid:33636184.
- 25. Sun J, Lin J, Yan J, Fan W, Lu L, Lv H, et al. Dengue virus serotype 3 subtype III, Zhejiang Province, China. Emerging infectious diseases. 2011;17(2):321–3. Epub 2011/02/05. pmid:21291623; PubMed Central PMCID: PMC3204750.
- 26. Chen Y, Liu T, Yu X, Zeng Q, Cai Z, Wu H, et al. An ensemble forecast system for tracking dynamics of dengue outbreaks and its validation in China. PLoS computational biology. 2022;18(6):e1010218. Epub 2022/06/28. pmid:35759513; PubMed Central PMCID: PMC9269975.
- 27. Rozilawati H, Zairi J, Adanan CR. Seasonal abundance of Aedes albopictus in selected urban and suburban areas in Penang, Malaysia. Tropical biomedicine. 2007;24(1):83–94. Epub 2007/06/15. pmid:17568381.
- 28. Cheng Q, Jing Q, Spear RC, Marshall JM, Yang Z, Gong P. Climate and the Timing of Imported Cases as Determinants of the Dengue Outbreak in Guangzhou, 2014: Evidence from a Mathematical Model. PLoS neglected tropical diseases. 2016;10(2):e0004417. Epub 2016/02/11. pmid:26863623; PubMed Central PMCID: PMC4749339.
- 29. Goto K, Kumarendran B, Mettananda S, Gunasekara D, Fujii Y, Kaneko S. Analysis of effects of meteorological factors on dengue incidence in Sri Lanka using time series data. PloS one. 2013;8(5):e63717. Epub 2013/05/15. pmid:23671694; PubMed Central PMCID: PMC3650072.
- 30. Liu Z, Zhang Z, Lai Z, Zhou T, Jia Z, Gu J, et al. Temperature Increase Enhances Aedes albopictus Competence to Transmit Dengue Virus. Frontiers in microbiology. 2017;8:2337. Epub 2017/12/19. pmid:29250045; PubMed Central PMCID: PMC5717519.
- 31.
C. U. China United Network Communications Corporation Annual Report 2019. Unicom C., 2019.
- 32. Lauer SA, Sakrejda K, Ray EL, Keegan LT, Bi Q, Suangtho P, et al. Prospective forecasts of annual dengue hemorrhagic fever incidence in Thailand, 2010–2014. Proceedings of the National Academy of Sciences of the United States of America. 2018;115(10):E2175–e82. Epub 2018/02/22. pmid:29463757; PubMed Central PMCID: PMC5877997.
- 33. James Braselton IBJJoCS, Biology S. A Survey of Mathematical Models of Dengue Fever. 2015;08(05).
- 34. Anderson JL. An ensemble adjustment filter for data assimilation. monwearev. 2000.
- 35. Yamana TK, Kandula S, Shaman J. Superensemble forecasts of dengue outbreaks. Journal of the Royal Society, Interface. 2016;13(123). Epub 2016/10/14. pmid:27733698; PubMed Central PMCID: PMC5095208.
- 36. Pei S, Kandula S, Yang W, Shaman J. Forecasting the spatial transmission of influenza in the United States. Proceedings of the National Academy of Sciences of the United States of America. 2018;115(11):2752–7. Epub 2018/02/28. pmid:29483256; PubMed Central PMCID: PMC5856508.
- 37. Chang CW, Ushio M, Hsieh CHJER. Empirical dynamic modeling for beginners. 2017;(6).
- 38. Arthur RF, Gurley ES, Salje H, Bloomfield LS, Jones JH. Contact structure, mobility, environmental impact and behaviour: the importance of social forces to infectious disease dynamics and disease ecology. Philosophical transactions of the Royal Society of London Series B, Biological sciences. 2017;372(1719). Epub 2017/03/16. pmid:28289265; PubMed Central PMCID: PMC5352824.
- 39. Reiner RC Jr., Stoddard ST, Scott TW. Socially structured human movement shapes dengue transmission despite the diffusive effect of mosquito dispersal. Epidemics. 2014;6:30–6. Epub 2014/03/07. pmid:24593919; PubMed Central PMCID: PMC3971836.
- 40. Perchoux C, Chaix B, Cummins S, Kestens Y. Conceptualization and measurement of environmental exposure in epidemiology: accounting for activity space related to daily mobility. Health & place. 2013;21:86–93. Epub 2013/03/05. pmid:23454664.
- 41. Stoddard ST, Morrison AC, Vazquez-Prokopec GM, Paz Soldan V, Kochel TJ, Kitron U, et al. The role of human movement in the transmission of vector-borne pathogens. PLoS neglected tropical diseases. 2009;3(7):e481. Epub 2009/07/22. pmid:19621090; PubMed Central PMCID: PMC2710008.
- 42. Mammen MP, Pimgate C, Koenraadt CJ, Rothman AL, Aldstadt J, Nisalak A, et al. Spatial and temporal clustering of dengue virus transmission in Thai villages. PLoS medicine. 2008;5(11):e205. Epub 2008/11/07. pmid:18986209; PubMed Central PMCID: PMC2577695.
- 43. Bisanzio D, Dzul-Manzanilla F, Gomez-Dantés H, Pavia-Ruz N, Hladish TJ, Lenhart A, et al. Spatio-temporal coherence of dengue, chikungunya and Zika outbreaks in Merida, Mexico. PLoS neglected tropical diseases. 2018;12(3):e0006298. Epub 2018/03/16. pmid:29543910; PubMed Central PMCID: PMC5870998.
- 44. Gordon A, Kuan G, Mercado JC, Gresh L, Avilés W, Balmaseda A, et al. The Nicaraguan pediatric dengue cohort study: incidence of inapparent and symptomatic dengue virus infections, 2004–2010. PLoS neglected tropical diseases. 2013;7(9):e2462. Epub 2013/10/03. pmid:24086788; PubMed Central PMCID: PMC3784501.
- 45. Limkittikul K, Brett J, L’Azou M. Epidemiological trends of dengue disease in Thailand (2000–2011): a systematic literature review. PLoS neglected tropical diseases. 2014;8(11):e3241. Epub 2014/11/07. pmid:25375766; PubMed Central PMCID: PMC4222696 Pte Ltd and ML is employed by Sanofi Pasteur. This does not alter our adherence to all PLoS policies on sharing data and materials.
- 46. Morin CW, Comrie AC, Ernst K. Climate and dengue transmission: evidence and implications. Environmental health perspectives. 2013;121(11–12):1264–72. Epub 2013/09/24. pmid:24058050; PubMed Central PMCID: PMC3855512 interests.
- 47. Micieli MV, Campos RE. Oviposition activity and seasonal pattern of a population of Aedes (Stegomyia) aegypti (L.) (Diptera: Culicidae) in subtropical Argentina. Memorias do Instituto Oswaldo Cruz. 2003;98(5):659–63. Epub 2003/09/16. pmid:12973534.
- 48. Vezzani D, Velázquez SM, Schweigmann N. Seasonal pattern of abundance of Aedes aegypti (Diptera: Culicidae) in Buenos Aires City, Argentina. Memorias do Instituto Oswaldo Cruz. 2004;99(4):351–6. Epub 2004/08/24. pmid:15322622.