Skip to main content
Advertisement
  • Loading metrics

Heterogeneous suppressive effect of Wolbachia incompatible insect technique coupled with sterile insect technique across time and historical Ae. aegypti abundance - using distributional synthetic controls

  • Yichen Zhai ,

    Contributed equally to this work with: Yichen Zhai

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore

  • Chia-Chen Chang,

    Roles Writing – review & editing

    Affiliations Environmental Health Institute, National Environment Agency, Singapore, Singapore, Department of Biological Sciences, National University of Singapore, Singapore, Singapore

  • Zhiyong Xi,

    Roles Resources, Writing – review & editing

    Affiliation College of Natural Sciences, Michigan State University, East Lansing, Michigan, United States of America

  • Cheong Huat Tan,

    Roles Writing – review & editing

    Affiliation Environmental Health Institute, National Environment Agency, Singapore, Singapore

  • Lee Ching Ng,

    Roles Funding acquisition, Writing – review & editing

    Affiliations Environmental Health Institute, National Environment Agency, Singapore, Singapore, Department of Biological Sciences, National University of Singapore, Singapore, Singapore, School of Biological Sciences, Nanyang Technological University, Singapore, Singapore

  • Jue Tao Lim

    Roles Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Writing – original draft, Writing – review & editing

    juetao.lim@ntu.edu.sg

    Affiliation Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore

Abstract

Background

Biological control tools such as Wolbachia incompatible-insect technique, are a promising class of interventions to modify and suppress Aedes aegypti mosquitoes to reduce risk of Aedes-borne diseases. Due to the spatial nature of the intervention, intervention effects can be spatio-temporally heterogeneous. Yet, most evaluations of field-based technologies rely on average treatment effects, which preclude characterization and understanding of treatment effect heterogeneities and the factors influencing it.

Methods

Here, we developed a causal inference framework using distributional synthetic controls to explicitly account for spatio-temporal trap-level mosquito abundance data to ascertain the entomological efficacy of Wolbachia in suppressing Ae. aegypti abundance. This method is able to construct counterfactual distributions of intervened areas, provide detailed comparisons to actual distributions and quantify treatment effects of the intervention on mosquito abundance over different quantiles. By employing our framework to trap-level mosquito abundance data from 66,712 unique mosquito traps routinely maintained and measured twice a week, and a large-scale field trial of Wolbachia incompatible-insect technique coupled with sterile insect technique (IIT-SIT) in Singapore, we (1) quantified heterogeneous treatment effects for IIT-SIT across the time-since-intervention, over the traps’ historical mosquito abundance, over calendar time, (2) quantified whether elimination of wild-type Aedes aegypti was possible in intervention locations and (3) addressed if suppressive effects in spillover locations adjacent to directly intervened locations were heterogeneous.

Results

IIT-SIT interventions led to a strong suppressive effect on adult Aedes aegypti abundance. From the onset of intervention in directly treated locations, sector-specific intervention effectiveness (IE) ranged from 24.04% in the earliest treatment period, and reached 86.08% in the latest treatment period. Raw reductions in aegypti abundance were also found to increase over time as sectors were intervened over longer time periods. In spillover sectors, IE was lower in magnitude and more variable, but average IE reached a maximum of 78.08% in 2-years post-treatment. Wolbachia interventions also led to an increase in the percentage of traps recording no mosquitoes from 6.8% at the start of intervention to 33.01% 124-weeks post-intervention. We found that IE was higher in sectors with lower historical mosquito abundance. However, IE converged across sectors with different historical mosquito abundance as intervention time increased.

Conclusion

This study revealed spatial heterogeneities in suppressing wild-type female Ae. aegypti by IIT-SIT and provided strong evidence that IIT-SIT can drastically suppress wild-type Ae. aegypti populations despite heterogeneous treatment effects over time.

Author summary

Aedes-borne diseases transmit across tropical and sub-tropical regions of the world, with the most important being dengue threatening half the global population. Vector control plays a fundamental role in reducing transmission and infection by reducing vector populations. Previous studies have demonstrated that a promising biological control technique called IIT-SIT can efficiently suppress Ae. aegypti population and have examined its effects across different durations of suppression. However, less attention has been given on how this suppressive effect varies spatio-temporally. We therefore developed a framework which can characterize differences in these intervention effects on a fine-spatio-temporal scale. This framework can provide new insights on the spatio-temporal heterogeneity of the treatment on mosquito abundance. We identified a general suppression pattern across different levels of mosquito abundance and showed that elimination of wild-type mosquitoes was not possible in the intervened areas. We also demonstrated similar but weaker suppression effects in locations adjacent to intervention areas. These findings illustrate the spatio-temporal heterogeneity of vector control and can provide guidance for optimizing resource allocation in future intervention implementation.

Introduction

Dengue fever is one of the highest burden vector-borne diseases of major public health concern. The causative agent is the dengue virus and is transmitted primarily by the Aedes aegypti (Ae. aegypti) and Aedes albopictus (Ae. albopictus) vectors. Due to rapid urbanisation and climate change, the at-risk population and incidence of dengue have steadily increased in the past decades. Pharmaceutical options for prevention or treatment remain limited; the primary means to prevent Aedes-borne diseases, including chikungunya, dengue, yellow fever and Zika, is therefore vector-control. Incompatible Insect Technique coupled with the Sterile Insect Technique (IIT-SIT) is an emerging vector control method aimed at suppressing wild-type mosquito populations. IIT utilizes Wolbachia-infected male mosquitoes that, when released, produce inviable offspring upon mating with wild-type females. However, imperfect sex-sorting can lead to stable establishment of the released Wolbachia strain in the field due to unintentional release of fertile Wolbachia-infected female mosquitoes [1]. Therefore, SIT via low-dose irradiation to target female mosquito fertility is used to mitigate this risk. IIT-SIT offers several advantages over conventional vector control strategies such as insecticide-based approaches, and complements environmental management. Insecticide resistance can reduce the efficacy of chemical interventions. IIT-SIT complements traditional community-based source reduction efforts which may not reach cryptic breeding sites [2]. In addition, IIT-SIT provides a species-specific alternative with few off-target effects.

Globally, trials were able to replicate high levels of aggregate intervention effectiveness for IIT, SIT or a combination of both strategies [314]. However, intervention effectiveness has been found to be heterogeneous in the same study settings, across spatial locations, such as directly treated areas, those at the borders, or those adjacent to treatment areas, driven potentially by mosquito migration [4]. Intervention effectiveness can also vary across time due to seasonality [4] and the time required for IIT-SIT to induce suppressive effects on wild-type mosquito populations. Changes in climate across sites over time may alter environmental carrying capacity over treatment locations and also affect both wild-type and Wolbachia-infected mosquitoes life history traits [1517]. Lastly, across trials, the quality of evidence may be low, due to ad-hoc selection of a small number of control sites with potential differences in baseline characteristics from those of the intervention arm [6,9,10].

Evaluating the entomological effectiveness of IIT-SIT interventions primarily relies on measurements taken from mosquito traps (BG traps, ovitraps, Gravitraps), comparing the counts of eggs collected and/or the wild-type mosquito abundance on an aggregate basis in intervention versus control sites [4]. This can mask trap-level or location level heterogeneities in intervention effects and differences in intervention effects across time. Potentially, intervention effects could be driven by historical differences in trap-level mosquito abundance as well as anthropogenic and environmental factors [4]. In the post-intervention period, differences in suppression can be due to proximity to untreated areas; for example, (1) edge effects have been shown in a field trial of Singapore, where individual trap abundance was higher if it was closer to non-release locations versus if it was in the interior of the release site [4] (2) In a trial of the epidemiological effectiveness of mosquito-disseminated pyriproxyfen in Brazil, untreated zones close to intervention sites were conferred reductions in dengue incidence even though sites were not directly treated by intervention [18]. Understanding heterogeneities in treatment effects and the factors driving these heterogeneities can help advice optimization strategies for IIT-SIT release, and potentially confer performance gains in suppressive efficacy against target-species.

Therefore, the primary objectives of our study were 3-fold: We developed a causal-inference framework which explicitly accounts for spatio-temporal trap-level mosquito abundance data from 66,712 unique mosquito traps routinely maintained and measured to quantify (1) heterogeneous treatment effects for IIT-SIT across the time-since-intervention, over the traps’ historical mosquito abundance, over calendar time (2) whether elimination of wild-type Ae. aegypti was possible in intervention locations (3) if suppressive effects in locations adjacent to directly treated sites were heterogeneous, by exploiting the staggered adoption setting of the study setting.

Methods

Data

Entomological surveillance data was collected from Gravitraps which were designed to attract and catch gravid female Aedes mosquitoes. Each trap was measured twice a week, and can be individually geo-located to the postal code, representing a single apartment block. Surveillance data from Epidemiological Week (EW) 1 2019 to EW26 2022 was considered to evaluate the heterogeneous impact of Wolbachia IIT-SIT on wild-type Aedes aegypti and albopictus populations. Data after EW26 2022, was excluded due to the rollout of a large-scale randomised controlled trial in the study setting in most high-risk locations in Singapore, which made construction of the synthetic control donor pool challenging [19,20]. In this field study, four townships were selected to test two different intervention release strategies — an expanding release strategy and a targeted release strategy. The expanding release strategy is implemented by progressively expanding the size of release areas over time whereas the targeted release strategy is implemented in sites in interest. Yishun and Tampines were two large towns selected for the expanding release strategy, whereas Bukit Batok and Choa Chu Kang towns were selected for a targeted release approach4. The spatial resolution used for analyses was traps within sectors which comprise 10 – 20 public housing apartment blocks each and measure an average of approximately 0.088 km2. Sectors are used for the administration of surveillance and control for environmental infectious diseases in Singapore. To ensure that sufficient data was available to construct distributional synthetic controls, only sectors that had a pre-treatment period of 52 weeks or more were included, with 91 sectors included in the study as treated or intervened sectors. Similarly, the donor pool consisted of sectors that had never received the intervention before and during the study period, and were not adjacent to release sectors. To minimize the possibility of spillover contamination in control sectors comprising the donor pool, we only included control sectors which were non-adjacent to the intervention sectors for analysis. We included 662 sectors as potential control sectors in the donor pool. The average minimum distance of these control sectors to the nearest intervened sector was 4580.74 meters, which is far larger than the average flight distance (105.69 meters) of Ae. aegypti [21].

Releases of Wolbachia-infected male Ae. aegypti mosquitoes were conducted at fixed designated locations in the high-rise apartment blocks. There are 6–12 release locations which are equally distributed among ground level, middle floors (levels 5 – 6) and high floors (levels 10 – 11) of each apartment block. To maintain the density of intervention and reduce effect variation, Wolbachia-infected male mosquitoes were released twice a week in intervened sites. The density of release is uniform across sectors. Treatment for every sector started at different weeks and ended at the same week (EW26, 2022) in this study.

Distributional synthetic control (DSC) method

We were motivated by prior studies [4,22] which revealed spatio-temporal variations in IIT-SIT intervention effectiveness, which may be driven by edge effects, spatial proximity of site to untreated/treated locations and intervention time. Prior work also used average mosquito abundance over time as the outcome variable, and the canonical synthetic control method to obtain intervention effectiveness. This ignored finer-scale trap-level information, which can inform how treatment effects are different across different traps in intervention sites, and whether mosquito elimination is possible under IIT-SIT. For example, the percentage of mosquito traps that have no mosquitoes recorded in intervention versus comparator sites can be assessed to ascertain whether the intervention led to mosquito elimination.

We aimed to use the DSC method to understand heterogeneity in IIT-SIT treatment effects. Briefly, the DSC method aims to construct a counterfactual quantile function that characterises the quantile of mosquito abundances or the percentage of traps with no recorded mosquitoes in the intervention sector in the post-intervention period as though it did not receive treatment. The DSC for an intervention sector was obtained by optimizing weights which minimized the difference between a weighted average of quantile functions in the donor pool and the quantile function of the intervention sector in the pre-intervention period (Fig 1A). In the post-intervention period, the differences between the quantile function of the DSC and intervention sectors were taken to obtain the measure of intervention effectiveness across the observed quantiles of mosquito abundance between comparator groups (Fig 1B).

thumbnail
Fig 1. Illustration of distributional synthetic controls (A) optimizing weights to minimize the difference between a weighted average of quantile functions in the donor pool and the quantile function of the intervention sector in the pre-intervention period (B) taking differences between the quantile function of the DSC and intervention sectors to obtain the measure of intervention effectiveness.

GAI, Gravitrap Ae. aegypti index. Lines represent the quantile functions of the control sites (in pale light green), the intervention site (in solid light green) and the DSC (in black).

https://doi.org/10.1371/journal.pcbi.1014355.g001

To obtain a sufficient number of observations to construct smooth quantile functions, we binned trap-level observations of mosquito abundance to each quarter (13 weeks) for each eligible sector. After binning, binned time intervals shorter than 13 weeks in pre-treatment period were removed from analysis. These observations were then used to construct continuous, quarterly, sector-level empirical quantile distributions of the average trap-level number of trapped wild female Ae. aegypti mosquitoes for a specific postal code in that sector, which were subsequently smoothened using linear interpolation [23]. The default algorithm of estimating empirical quantile functions in the DSC framework was implemented for continuous variables. To obtain the optimal weights which minimized the differences between a weighted average of quantile functions in the donor pool and the quantile function of the intervention sector in the pre-intervention period, the 2-Wasserstein distance of quantile functions was computed as the objective function for optimization of continuous variables (e.g., mosquito abundance) and the 1-Wasserstein distance of cumulative density functions (CDF) was computed for optimization in discrete variables (e.g., mosquito elimination or not). The 2-Wasserstein distance described differences between two quantile distributions and was calculated discretely by equally dividing points from and then computing based on trapezoidal rule:

The 1-Wasserstein distance described the difference between two CDFs and is calculated by summing cumulative discrete differences among ordinal variables :

The Jensen-Shannon divergence (JSD) was also used as another possible divergence metric for the discrete CDF, and is computed as:

where is a mixture distribution of probability distribution  calculated by . Since there were 4–12 pre-treatment time intervals in the treated sectors, large variance on weights across pre-treatment periods would be expected if optimized weights were calculated separately from each pre-treatment interval. To alleviate this, we optimized the weights of control sectors only once by minimizing the sum of objective functions in all binned time intervals in the pre-treatment period.

As the donor pool contained a large number of control sectors, most sectors comprising the donor pool would assign a null weight value on the construction of DSCs. To reduce the computational load, we first empirically computed the similarity in distributions by computing the correlation in mosquito abundance between control and intervention sectors in the pre-intervention period. Correlation is defined based on the average 2-Wasserstein distance for analysing mosquito abundance and the average Jensen-Shannon divergence for analysing the percentage of traps recording zero mosquitoes (i.e., elimination) between two sectors over all time intervals in the pre-intervention period. Only the top 40 control sectors which were most correlated to a specific intervention sector were used for fitting the DSC for a specific intervention sector (Fig J in S1 File).

Accounting for discrete values in trap-level measurements

Gravitrap abundance index (GAI) represents the mosquito abundance at designated locations, calculated as the average number of wild female Ae. aegypti over the number of functional Gravitraps across the pre-specified spatio-temporal scale. At the trap-level, recorded abundances are at discrete 0.5 value intervals. We explored (1) building discrete quantile functions by trap for each sector, and (2) aggregating GAI values by postal code to convert GAI values from discrete to continuous ones. Plots were compared by visual inspection and the smoother representation of mosquito abundance was chosen.

We used the procedure of Li and Tolhurst by replacing uniform random sampling of quantile functions with beta distribution random sampling [24]. This was done to reduce the negative sampling effect of extreme values. As the data consisted more pre-intervention time periods and potentially extreme values in the upper tail of some quantile functions, the beta (3,3) distribution was used as the sampling method. Minimizing the sum of 2-Wasserstein distances between quantile functions of the treated sector d and control sectors j among pre-intervention time intervals was considered to obtain optimal DSC weights for the intervened sector d across the whole pre-intervention period and the objective function for determining the DSC weights was as follows:

where denotes the quantile function for mosquito abundance at intervened sector d at time interval t, the quantile function for mosquito abundance at control sector j at time interval t, the treatment start week, the weight for control sector j for the corresponding intervened sector d. The counterfactual quantile distribution of mosquito abundance at an intervened sector d in post-intervention time intervals was computed as follows:

Examining the possibility of wild-type mosquito elimination

To examine whether wild-type elimination of mosquitoes was possible under IIT-SIT, we rehashed our outcome to be the percentage of traps recording zero mosquitoes (instead of mosquito abundance). The cumulative density function was therefore taken as:

where x denotes two possible statuses in a trap: denotes no Aedes aegypti/albopictus recorded and otherwise. This representation always leaves for , which simplifies the estimation of counterfactual CDF from fitting two and to one parameter .

Given the CDF, we tested the use of the (1) 1-D Wasserstein distance and (2) Jensen-Shannon divergence to be applied as objective functions to find the optimal weight to construct the sector’s distributions during pre-treatment period. The 1-D Wasserstein distance between the actual distribution in the intervened sector d and the distributional synthetic control is:

where the second equality holds as there are only two possible values for the outcome y. Whereas JSD is computed as

where denotes the CDF for the intervened sector d at time t, denotes the counterfactual CDF by optimal weights and control sector CDFs at time t, denotes a mixture function of and at time t. here deviates from the prior JSD definition due to convexity and is only applied in the weight optimization step.

We used the entire pre-intervention period to compute objective functions and find optimal weights which comprised the distributional synthetic controls. As preliminary analyses comparing the differences of each fitted distribution and the original distribution by both 1-Wasserstein distance score and the JSD showed that most of the treated sectors were fitted better using the 1-Wasserstein distance method versus the JSD, the 1-Wasserstein distance method was applied as the objective function in weight selection (Fig T in S1 File). The optimal weights for each sector’s DSC were and was estimated by:

where . Counterfactual CDFs of mosquito elimination at an intervened sector d in post-intervention time intervals were computed as follows:

Estimating heterogeneous intervention effectiveness

Intervention effectiveness (IE) was computed for both directly treated intervention and adjacent spillover sectors. For directly treated sectors, we computed IEs by core or buffer sectors. Buffer sectors were directly treated sectors which shared borders with untreated sectors and core sectors were directly treated sectors which did not share borders with untreated sectors. Adjacent-spillover sectors were defined as never-treated or not-yet-treated sectors that shared geographical boundaries with treated sectors. Once an adjacent spillover sector adopted treatment, the data after treatment was not used to evaluate spillover IE. DSCs were computed for adjacent spillover sectors the same way as directly treated locations, and the donor pool consisted of only non-treated sectors never adjacent to a treated sector. We aggregated IEs by these sector categories by adoption period and geographical configurations over the post-intervention period. We aggregated IEs by calendar time, and by event-time, that is, the time since intervention was adopted in each location. Respectively, these aggregations helped quantify if there were temporal differences in the reductions of mosquito abundance or increased likelihood of wild-type elimination over the time of the study, or over the time since interventions were adopted. The same analytical procedures were used to examine the impact of IIT-SIT on Ae. albopictus abundance.

We also analysed the possibility of mosquito elimination under IIT-SIT, where IE was computed by substituting CDFs. Lastly, raw reductions (rather than relative reductions) in mosquito abundance were computed by taking the difference in quantiles between the observed GAI distribution and the counterfactual distribution estimated by the DSC.

Current DSC literature only proposed quantifying treatment effects via raw quantile value differences. This represented raw rather than relative treatment effects. We introduced a baseline scenario of no mosquitoes being detected, so that it can be scored against the mosquito abundance for a sector. This allowed us to calculate 2-Wasserstein distances between the GAI distributions at the sector and the baseline scenario. To compute IEs, we took the differences in scores of the intervened location’s mosquito abundance and the distributional synthetic control to the scenario of wild-type mosquito elimination (). In examining the effect of IIT-SIT on mosquito abundance, the quantity expresses the relative differences in distances between the treated/counterfactual location to the scenario of null wild-type mosquito abundance . For a specific sector d, the IE at time t was calculated as follow:

where is a degenerate distribution concentrated at zero with and characterizes the scenario with zero mosquitoes in the sector. The IE has a range (−∞,1]. When the actual mosquito abundance in treated sectors is near the scenario of mosquito elimination, IE ≈ 100%. When the observed mosquito distribution is further from the scenario of mosquito elimination versus the counterfactual distribution as estimated using the distributional synthetic control framework, IE is lower than 0. A protective treatment effect should have IE in the range of (0,1]. As the distributions of mosquito abundance were summarized by binning across consecutive 13-week periods (e.g., weeks 1 – 13, 14 – 26 in post-intervention period), kept constant within each 13-week interval, and the average 13-week IE was calculated as the mean of among sectors d which had surveillance data across the 13-week interval:

where is the number of sectors which had surveillance data across the 13-week interval. Whereas in examining the possibility of wild-type mosquito elimination in IIT-SIT treated sectors, we computed the increase in the percentage of traps which do not record mosquitoes as the difference in the percentage of traps which do not record mosquitoes in the intervention sector and its corresponding counterfactual sector. We aggregated this quantity by calendar time and time-since-intervention.

We also directly computed raw reductions in mosquito abundance in the post-intervention period by differencing the counterfactual and observed quantile functions of mosquito abundance for intervened sectors. For a specific post-intervention time interval , empirical quantile-based raw reduction function was calculated as follows:

where are discrete quantiles, is number of intervened sectors with mosquito abundance recorded at time t, is the actual quantile function for intervened sector d at time t, and is counterfactual quantile function for intervened sector d at time t. Quantile-based IE was also computed to quantify treatment effect heterogeneity, estimating the IEs in each post-intervention time interval across a specific area. This was computed as:

95% confidence intervals (CI) of average IE and raw reduction were calculated via bootstrap following Dijcke, Gunsilius and Wright [25]. The bootstrap procedure was employed because the statistics are non-linear or have unknown distributions. For each pre-treatment interval, trap-level measurements in control sectors were resampled with replacement, and new empirical quantile functions were estimated. New counterfactual quantile functions were constructed based on a new weighting scheme for the intervened sector. The resampling was repeated 500 times and the statistics in interest were repeatedly estimated. We obtained confidence intervals via the percentile method, where the 2.5th and 97.5th quantile were used as the lower and upper bound of the 95% CI.

Robustness checks

We conducted a large battery of robustness checks to confirm the internal validity of our analytical procedure. (1) We conducted in-time placebo checks, where we re-ran our analytical procedure and considered pseudo-intervention start points 26 and 52 weeks before actual treatment start dates, to see if there were any pre-trends in mosquito abundance which confounded our study (2) We conducted in-space placebo checks, where we re-ran our analytical procedure on control sectors which never received treatment, and assigned pseudo-interventions to these control sectors. This was done to see if spurious intervention effects were detected in control sectors. (3) We conducted visual inspection checks on all fitted DSCs to see if model fit to actual quantile functions in the intervention sectors were acceptable in the pre-intervention period (4) In addition to the bootstrap inference procedure, we conducted the placebo permutation test, where every control sector was reassigned to become pseudo-intervened sector to estimate its post-intervention effect, from which p-values could be obtained from the percentage of sectors that had an IE not smaller than the treated sector to assess statistical significance.

Results

We included a total of 7,819, 3,255 and 51,343 trap measurements in directly-treated, spillover and control sectors for analysis after exclusion. The total number of trap-measurements and sectors evaluated across the study period was provided in Table 1.

thumbnail
Table 1. Number of traps and study sectors (in brackets) used for analysis.

https://doi.org/10.1371/journal.pcbi.1014355.t001

Intervention effectiveness in release sectors increased with intervention time

By comparing the quantile functions between intervention sectors and the respective distributional synthetic controls, we found that the direct intervention effectiveness (IE) was greater in locations that were subject to longer intervention periods (Fig 2A). From 1 – 52 weeks post intervention, the average 13-week IE ranged from 24.04% (95% CI: 16.61% – 30.85%) to 71.51% (95% CI: 65.02% – 77.18%). In contrast, 53 – 124 weeks post intervention, the average 13-week IE ranged from 80.04% (95% CI: 76.26% – 83.46%) to 86.08% (95% CI: 82.89% – 88.78%). Raw reductions in abundance were also greater in locations that were subject to longer intervention periods (Fig 2C).

thumbnail
Fig 2. (A) IIT-SIT intervention effectiveness to reduce Ae. aegypti abundance by time-since-intervention in directly intervened sectors by GAI quantile.

(B) IIT-SIT intervention effectiveness to reduce Ae. aegypti abundance by time-since-intervention in spillover sectors by GAI quantile. (C) Raw reduction distribution in Ae. aegypti abundance by time-since-intervention in directly intervened sectors. (D) Raw reduction distribution in Ae. aegypti abundance by time-since-intervention in spillover intervened sectors. The coloured lines represent the average values across the sectors. The shaded regions represent the pointwise 95% confidence intervals. The shaded regions in grey represent quantiles where there is an insignificant reduction in Ae. aegypti populations due to intervention. The shaded regions in other colours represent quantiles where there is a significant reduction in Ae. aegypti populations due to intervention. Plots (A), (B) have been truncated as the intervention effectiveness estimates are negative and have 95% CIs which are not bounded by 0.

https://doi.org/10.1371/journal.pcbi.1014355.g002

By comparing the IEs over different quantiles, we found that in directly treated sectors, quantile IEs around the 25th quantile were higher than those at other quantiles. Quantile IEs around the 0th quantile were lower and gradually increased as quantiles increased. Comparing quantile IE between the 25th – 49.9th quantile and 75th – 100th quantile, the maximum quantile IE difference decreased from 61.33% in 1 – 13 weeks after intervention to 29.62% in week 105 – 117, and the minimum quantile IE difference decreased from 24.40% to −0.7%. This showed that IE reduced quickly at higher GAI quantiles at the beginning of treatment, and the treatment effect was lower in moderate mosquito abundance areas in the sector. Longer treatment times could, however, shrink the difference in treatment effectiveness between mosquito quantiles. Though the IE reduced with higher quantile of GAI, the raw reduction increases with higher quantiles (Fig 2A and 2C).

IE in later study periods (EW1 – 26, 2022) was also higher than that in earlier study periods (EW8 – 53, 2020). Mean relative reductions in Ae. aegypti abundance were heterogeneous in the initial study period (i.e., earlier e-weeks) (Fig A in S1 File), but gradually converged at around 1-year post intervention with more than 80% suppressive effectiveness on Ae. aegypti abundance (Fig 1A).

We also computed the average IE between core sectors and buffer sectors. We did not find significant IE differences across the two-year post-intervention period (Fig B in S1 File).

Intervention effectiveness in spillover sectors increased with intervention time

A similar pattern was found in spillover locations which shared geographical borders with direct intervention sectors. Spillover IE in Ae. aegypti abundance increased with increasing intervention duration (Fig 2C). From 1 – 52 weeks post intervention, the average spillover IE ranged from −1.29% (95% CI: −14.67% – 10.24%) to 37.98% (95% CI: 25.07% – 49.42%). In contrast, 53–117 weeks post intervention, the average spillover IE ranged from 52.65% (95% CI: 42.72% – 61.99%) to 78.08% (95% CI: 72.36% – 83.24%). We observed a decrease in IE in the 118 – 124 weeks, which may be due to the insufficient number of sectors in that period required for valid estimates of intervention effectiveness (n = 3). Raw reductions in abundance were also greater in spillover locations that were subject to longer intervention periods (Fig 2D). The result indicated a negative but insignificant intervention effectiveness estimate in sites defined to be spillover locations at the start of the trial. This potentially reflects sampling noise and migration of wild-type mosquitoes at earlier treatment times.

Comparing IE between directly intervened sectors and spillover sectors across intervention time, average IE in intervened sectors was higher versus adjacent, non-treated sectors in most quantiles (Fig 2A, 2B). We also found that raw GAI reductions in spillover sectors were consistently lower than those directly intervened versus across all quantiles over the intervention period (Fig 2C, 2D).

Spatial and temporal impact of intervention

Reductions in Ae. aegypti abundance were consistent and converged to a high-level, with the mean being around 65.06% near the end of the 26-week study period. This was consistent across sectors and townships, and aligned with previous study results (Fig 3).

thumbnail
Fig 3. Spatio-temporal configuration of intervention effectiveness of IIT-SIT on Ae. aegypti abundance in treated sectors.

Columns represent the respective time periods of EW27 – 53 2020, EW1 – 26 2021, EW27 – 52 2021 and EW1 – 26 2022. Rows represent each township. From top to bottom: Bukit Batok, Choa Chu Kang, Tampines and Yishun townships are represented. Base layer from the Master Plan 2019 Land Use Layer dataset, licensed under the Singapore Open Data Licence version 1.0. https://data.gov.sg/datasets?query=master+plan+2019+land+use+layer.

https://doi.org/10.1371/journal.pcbi.1014355.g003

Intervention impact by historical abundance and by township

was significantly higher in sectors with lower historical pre-treatment GAI. However, as the intervention time increased, IEs over different historical mosquito quantiles converged to a similar level (Fig 4A). Intervention effectiveness increased with more intervention time, with little heterogeneity across intervened townships (Fig 4B). Areas with historical high mosquito populations required 52 weeks to reach 75% suppression, while areas with low historical mosquito populations required 26 weeks.

thumbnail
Fig 4. (A) Sector intervention effectiveness of IIT-SIT to reduce Ae. aegypti abundance over previous sector relative Ae. aegypti abundance quantile in direct intervened sectors.

Coloured lines represent GAM models based on corresponding post-intervention IE. Each dot represents a unique sector evaluated at that specific event-time. (B) Mean intervention effectiveness of IIT-SIT to reduce in Ae. aegypti abundance in direct intervened sectors by township. Coloured lines represent average IE across the sectors in each township. The shaded areas represent pointwise 95% confidence intervals.

https://doi.org/10.1371/journal.pcbi.1014355.g004

Examining the potential for wild-type Ae. aegypti elimination

We further analysed if the intervention led to an increase in the percentages of traps recording no wild-type female Ae. aegypti mosquitoes. This was done to ascertain if the elimination of wild-type female Ae. aegypti mosquitoes was possible given sufficient intervention time. We found that the mean increase in the percentages of traps recording no wild-type female Ae. aegypti mosquitoes was around 6.77% (95% CI: 5.49% – 8.12%) – 33.01% (95% CI: 29.50% – 36.57%) in the 1 – 124 weeks after interventions began (Fig 5A). In later trial periods, this increase was consistently high at 23.05% (95% CI: 20.23% – 25.78%) – 23.35% (95% CI: 20.68% – 26.16%) from 2021 EW27–2022 EW26 (Fig 5B). In spillover locations, the effect was found to be weaker (Fig 5C5D), from 3.75% (95% CI: 0.84% – 7.08%) at 14 – 26 weeks post intervention to 18.81% (95% CI: 11.28% – 26.46%) at 105 – 117 weeks post-intervention.

thumbnail
Fig 5. (A) Increase in the percentage of traps recording no mosquitoes by time-since-intervention in directly intervened sectors.

(B) Increase in the percentage of traps recording no mosquitoes by study time in directly intervened sectors. (C) Increase in the percentage of traps recording no mosquitoes by time-since-intervention in sectors located adjacent to directly intervened sectors. (D) Increase in the percentage of traps recording no mosquitoes by study time in sectors located adjacent to directly intervened sectors. Lines in the boxes represent the middle 50% of the estimate, whereas the ends of the boxes represent the interquartile range, spanning from the 25th percentile to the 75th percentile. The lines represent the minimum and maximum respectively.

https://doi.org/10.1371/journal.pcbi.1014355.g005

Robustness checks

All robustness checks are reported in detail in the supplementary information section (S1 File).

Discussion

By using distributional synthetic controls, while we found that IIT-SIT interventions can lead to dramatic suppressive effects of up to 86.08% on adult Aedes aegypti abundance, we found that these interventions did not lead to mosquito elimination after 2–3 years of release. While the percentages of sectors with traps recording no mosquitoes increased (Fig 5A, 5C), after 52 weeks of intervention, this increase in the number of such traps only managed to stabilized at around 30% (Fig 5C). This may be due to the migration of wild-type vectors from non-release locations which interfere with the estimated suppressive effect of the intervention over a contiguous urban landscape. Cryptic populations of wild-type mosquitoes that cannot be reached by the intervention may also attenuate the possibility of elimination. However, these factors are likely to diminish given increasingly larger and longer rollouts of IIT-SIT across the city-state.

Furthermore, while IE was consistently high, it dipped in higher GAI quantiles, even though raw reductions increased consistently with higher GAI quantiles. We also found that IE was higher in sectors with lower historical GAI (Fig 4A), though IE converged across sectors with different historical GAI values as intervention time increased. Sectors with high historical abundance may reflect ecological conditions that are more favourable for wild-type mosquito populations, and may require a higher intensity of release or longer duration of releases to generate the same levels of suppressive effectiveness. As our study comprised evaluations of a short field trial period, intervention effectiveness may eventually converge for these historically high abundance locations once the suppressive effectiveness outpaces wild-type population growth. This also highlights the potential need to integrate Wolbachia-based suppression with other conventional control measures, such as environmental management and source reduction, to further reduce wild-type Ae. aegypti populations.

Raw reductions in Ae. aegypti abundance were also found to increase with more time spent in intervention sectors. In spillover sectors, IE was lower in magnitude (IE range: −1.29% – 78.08%), with raw reductions in Ae. aegypti abundance also found to increase with more time spent in spillover intervention sectors (Fig 2C). Estimates suggest that increasing immigration of Wolbachia mosquitoes into adjacent non-release sectors over the course of the intervention period can subsequently result in suppression of wild-type Ae. aegypti mosquitoes in adjacent non-release sectors. Significant intervention effectiveness in spillover sectors also highlights that not-yet-treated sectors may already be benefiting from spillover effects prior to direct release, which possibly contributed to higher direct IE during the later study periods (EW1 – 26, 2022) being higher than that of earlier study periods (EW8 – 53, 2020).

IE estimates yielded by DSC indicated treatment effect heterogeneity on both spatial and temporal scales. In contrast, the canonical SCM yielded pointwise IE estimates and showed temporal heterogeneity of treatment effects. In the canonical SCM, the intervention effectiveness of Wolbachia is evaluated via average mosquito abundance in sectors over time. However, this disregards the finer-scale trap-level information in sectors. Whereas DSC yields intervention effectiveness estimates using the entire quantile of observed mosquito abundance within sectors, which contains more information about the variation and spread of data in evaluated sectors. By obtaining counterfactual quantile functions as the comparator group to the observed quantile function in intervention sites, IE estimates can be expressed in other statistics, such as the IE over different mosquito abundance quantiles, and help tease out heterogeneous treatment effects over smaller spatial scales.

Our study has several strengths. Our analysis relied on a large, nationwide, routinely collected surveillance database on mosquito abundance. By using trap-level records, we could obtain and construct DSCs, which enabled us to understand the heterogeneous effects of Wolbachia-Aedes on wild-type Aedes abundance, and understand if the elimination of wild-type mosquitoes was possible. This analysis was supported by extensive internal validity checks – including in-space, in-time placebo checks, and additional inferential procedures such as permutation testing. These procedures enabled us to allay concerns that estimates of intervention effectiveness were spurious or due to poor model predictive performance. There are, however, certain limitations. Despite the extremely high resolution of our data, we tagged trap-level measurements into 13-week intervals at the sector level, which enabled us to understand heterogeneous intervention effectiveness across sites, but does not allow us to exactly identify the exact traps locations where wild-type mosquito populations do not have high IEs or elimination. Due to the short study period and initiation of a large-scale cluster randomised controlled trial in 2022 [19,20], further evaluation of entomological effectiveness in historically high-abundance locations, which have lower intervention effectiveness, cannot be done. In future studies, increasing the number of samples via more intensive surveillance can also enable analyses at a finer temporal resolution and potentially help DSC estimate finer-scale treatment effects. Lastly, the construction of DSCs assumed that non-intervened locations which were not adjacent to intervention sectors did not experience partial interference from intervention sectors. Yet, DSC relies on the stable unit treatment value assumption (SUTVA), requiring that the donor pool not be affected by treatment effects. This assumption is violated when the intervention generates spillover effects in the donor pool, which may lead to conservative intervention effectiveness estimates. While previous studies have shown limited dispersal for the Ae. aegypti vector in Singapore [26], interference of control sites may bias estimated intervention effectiveness downwards.

Conclusion

This study provides strong evidence that IIT-SIT can drastically suppress wild-type Aedes aegypti populations despite heterogeneous treatment effects over time and space. Future work should seek to triangulate the factors driving incomplete mosquito elimination in intervention locations.

Supporting information

S1 File. Supplementary information comprising additional study results and internal validity checks for the analytical framework.

A combination of texts, figures and tables describing (1) multiple robustness checks and sensitivity analyses and (2) additional study findings.

https://doi.org/10.1371/journal.pcbi.1014355.s001

(DOCX)

References

  1. 1. Lim JT, Bansal S, Chong CS, Dickens B, Ng Y, Deng L, et al. Efficacy of Wolbachia-mediated sterility to reduce the incidence of dengue: a synthetic control study in Singapore. Lancet Microbe. 2024;5(5):e422–32. pmid:38342109
  2. 2. Vanlerberghe V, et al. Community involvement in dengue vector control: cluster randomised trial. BMJ. 2009;338:b1959.
  3. 3. Zheng X, Zhang D, Li Y, Yang C, Wu Y, Liang X, et al. Incompatible and sterile insect techniques combined eliminate mosquitoes. Nature. 2019;572(7767):56–61. pmid:31316207
  4. 4. Bansal S, Lim JT, Chong C-S, Dickens B, Ng Y, Deng L, et al. Effectiveness of Wolbachia-mediated sterility coupled with sterile insect technique to suppress adult Aedes aegypti populations in Singapore: a synthetic control study. Lancet Planet Health. 2024;8(9):e617–28. pmid:39243778
  5. 5. Kittayapong P, Ninphanomchai S, Limohpasmanee W, Chansang C, Chansang U, Mongkalangoon P. Combined sterile insect technique and incompatible insect technique: the first proof-of-concept to suppress Aedes aegypti vector populations in semi-rural settings in Thailand. PLoS Negl Trop Dis. 2019;13(10):e0007771. pmid:31658265
  6. 6. Beebe NW, Pagendam D, Trewin BJ, Boomer A, Bradford M, Ford A, et al. Releasing incompatible males drives strong suppression across populations of wild and Wolbachia-carrying Aedes aegypti in Australia. Proc Natl Acad Sci U S A. 2021;118(41):e2106828118. pmid:34607949
  7. 7. Crawford JE, Clarke DW, Criswell V, Desnoyer M, Cornel D, Deegan B, et al. Efficient production of male Wolbachia-infected Aedes aegypti mosquitoes enables large-scale suppression of wild populations. Nat Biotechnol. 2020;38(4):482–92. pmid:32265562
  8. 8. Mains JW, Kelly PH, Dobson KL, Petrie WD, Dobson SL. Localized control of Aedes aegypti (Diptera: Culicidae) in Miami, FL, via inundative releases of Wolbachia-infected male mosquitoes. J Med Entomol. 2019;56(5):1296–303. pmid:31008514
  9. 9. Lozano S, Pritts K, Duguma D, Fredregill C, Connelly R. Independent evaluation of Wolbachia infected male mosquito releases for control of Aedes aegypti in Harris County, Texas, using a Bayesian abundance estimator. PLoS Negl Trop Dis. 2022;16(11):e0010907. pmid:36374939
  10. 10. Sánchez-González L, Crawford JE, Adams LE, Brown G, Ryff KR, Delorey M, et al. Incompatible Aedes aegypti male releases as an intervention to reduce mosquito population-a field trial in Puerto Rico. PLoS Negl Trop Dis. 2025;19(1):e0012839. pmid:39836703
  11. 11. Lim JT, Mailepessov D, Chong CS, Dickens B, Lai YL, Ng Y, et al. Adjacent spillover efficacy of Wolbachia for control of dengue: emulation of a cluster randomised target trial. BMC Med. 2025;23(1):184. pmid:40155909
  12. 12. Lim JT, Mailepessov D, Chong C-S, Dickens B, Lai YL, Ng Y, et al. Assessing Wolbachia-mediated sterility for dengue control: emulation of a cluster-randomized target trial in Singapore. J Travel Med. 2024;31(7):taae103. pmid:39105274
  13. 13. Lim JT, Lee VJ, Tan CH, Chong C-S, Vasquez K, Ng LC. Combating dengue using male Wolbachia-infected mosquitoes-lessons from Singapore’s experience. Lancet Reg Health West Pac. 2026;69:101841. pmid:41960412
  14. 14. Lim JT, Chong C-S, Chang C-C, Mailepessov D, Dickens B, Lai YL, et al. Dengue suppression by male Wolbachia-infected mosquitoes. N Engl J Med. 2026;394(12):1175–83. pmid:41671481
  15. 15. Sun H, Dickens BL, Richards D, Ong J, Rajarethinam J, Hassim MEE, et al. Spatio-temporal analysis of the main dengue vector populations in Singapore. Parasites & Vectors. 2021;14(1):null. https://doi.org/10.1186/s13071-020-04554-9
  16. 16. Tewari P, Pei S, Ma P, Gan G, Janhavi A, Choo ELW, et al. Non-linear associations between meteorological factors, ambient air pollutants and major mosquito-borne diseases in Thailand. PLOS Neglected Tropical Diseases. 2023;17(12):e0011763. https://doi.org/10.1371/journal.pntd.0011763
  17. 17. Tewari P, Guo P, Dickens B, Ma P, Bansal S, Lim JT. Associations between Dengue Incidence, Ecological Factors, and Anthropogenic Factors in Singapore. Viruses. 2023;15(9):1917. https://doi.org/10.3390/v15091917
  18. 18. Abad-Franch F, Carvajal-Cortés JJ, Rabelo ACL, Gusmão EVV, Soares SS de S, Luz SLB. Mosquito-disseminated pyriproxyfen for mosquito-borne disease control in Belo Horizonte, Brazil: a pragmatic, before-after control-intervention paired-series trial. Lancet Infect Dis. 2025;25(2):176–87. pmid:39307142
  19. 19. Ong J, Ho SH, Soh SXH, Wong Y, Ng Y, Vasquez K, et al. Assessing the efficacy of male Wolbachia-infected mosquito deployments to reduce dengue incidence in Singapore: study protocol for a cluster-randomized controlled trial. Trials. 2022;23(1):1023. pmid:36528590
  20. 20. Lim JT, Mailepessov D, Chong C-S, Chang C-C, Dickens B, Lai YL, et al. Update to: assessing the efficacy of male Wolbachia-infected mosquito deployments to reduce dengue incidence in Singapore. Trials. 2024;25(1):400. pmid:38902790
  21. 21. Moore TC, Brown HE. Estimating Aedes aegypti (Diptera: Culicidae) flight distance: meta-data analysis. J Med Entomol. 2022;59(4):1164–70. pmid:35640992
  22. 22. Wong WJ. et al. Suppression of Aedes aegypti may not affect sympatric Aedes albopictus populations: findings from two years of entomological surveillance in Singapore. Sci Rep. 2025;15;2253.
  23. 23. Gunsilius FF. Distributional synthetic controls. Econometrica. 2023;91:1105–17.
  24. 24. Li Y, Tolhurst TN. Adoption of Genetically Engineered Seeds in China: Predicting Treatment Effects on the Crop-Yield Distribution by Synthetic Control. 2024 Annu. Meet. July 28-30 New Orleans. 2024. https://ideas.repec.org//p/ags/aaea22/343921.html
  25. 25. Dijcke DV, Gunsilius F, Wright A. Return to office and the tenure distribution. 2024.
  26. 26. Filipović I, Hapuarachchi HC, Tien W-P, Razak MABA, Lee C, Tan CH, et al. Using spatial genetics to quantify mosquito dispersal for control programs. BMC Biol. 2020;18(1):104. pmid:32819378