Advertisement
  • Loading metrics

Comparative functional survival and equivalent annual cost of 3 long-lasting insecticidal net (LLIN) products in Tanzania: A randomised trial with 3-year follow up

  • Lena M. Lorenz,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    Affiliations Department of Disease Control, Faculty of Infectious and Tropical Diseases, London School of Hygiene &Tropical Medicine, London, United Kingdom, Queen’s Medical Research Institute, College of Medicine and Veterinary Medicine, University of Edinburgh, Edinburgh, United Kingdom

  • John Bradley,

    Roles Data curation, Formal analysis, Methodology, Visualization, Writing – original draft, Writing – review & editing

    Affiliation MRC Tropical Epidemiology Group, London School of Hygiene & Tropical Medicine, London, United Kingdom

  • Joshua Yukich,

    Roles Data curation, Formal analysis, Methodology, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Tropical Medicine, Tulane University School of Public Health and Tropical Medicine, New Orleans, Louisiana, United States of America

  • Dennis J. Massue,

    Roles Investigation, Methodology, Project administration, Writing – review & editing

    Affiliations National Institute for Medical Research, Amani Research Centre, Muheza, Tanzania, Vector Control Product Testing Unit, Ifakara Health Institute, Bagamoyo, Tanzania, Epidemiology and Public Health Department, Swiss Institute of Tropical and Public Health, Basel, Switzerland, University of Basel, Basel, Switzerland

  • Zawadi Mageni Mboma,

    Roles Investigation, Methodology, Project administration, Writing – review & editing

    Affiliations Department of Disease Control, Faculty of Infectious and Tropical Diseases, London School of Hygiene &Tropical Medicine, London, United Kingdom, Ifakara Health Institute, Dar es Salaam, Tanzania

  • Olivier Pigeon,

    Roles Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Plant Protection Products and Biocides Physico-chemistry and Residues Unit, Agriculture and Natural Environment Department, Walloon Agricultural Research Centre, Gembloux, Belgium

  • Jason Moore,

    Roles Investigation, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliations Vector Control Product Testing Unit, Ifakara Health Institute, Bagamoyo, Tanzania, Epidemiology and Public Health Department, Swiss Institute of Tropical and Public Health, Basel, Switzerland

  • Albert Kilian,

    Roles Methodology, Supervision, Writing – review & editing

    Affiliation Tropical Health, Montagut, Spain

  • Jo Lines,

    Roles Conceptualization, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Department of Disease Control, Faculty of Infectious and Tropical Diseases, London School of Hygiene &Tropical Medicine, London, United Kingdom

  • William Kisinza,

    Roles Methodology, Project administration, Supervision, Writing – review & editing

    Affiliation National Institute for Medical Research, Amani Research Centre, Muheza, Tanzania

  • Hans J. Overgaard ,

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    ‡ These authors are joint senior authors on this work.

    Affiliations Faculty of Science and Technology, Norwegian University of Life Sciences, Ås, Norway, Department of Microbiology, Faculty of Medicine, Khon Kaen University, Khon Kaen, Thailand

  • Sarah J. Moore

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – original draft, Writing – review & editing

    smoore@ihi.or.tz

    ‡ These authors are joint senior authors on this work.

    Affiliations Vector Control Product Testing Unit, Ifakara Health Institute, Bagamoyo, Tanzania, Epidemiology and Public Health Department, Swiss Institute of Tropical and Public Health, Basel, Switzerland, University of Basel, Basel, Switzerland

Comparative functional survival and equivalent annual cost of 3 long-lasting insecticidal net (LLIN) products in Tanzania: A randomised trial with 3-year follow up

  • Lena M. Lorenz, 
  • John Bradley, 
  • Joshua Yukich, 
  • Dennis J. Massue, 
  • Zawadi Mageni Mboma, 
  • Olivier Pigeon, 
  • Jason Moore, 
  • Albert Kilian, 
  • Jo Lines, 
  • William Kisinza
PLOS
x

Abstract

Background

Two billion long-lasting insecticidal nets (LLINs) have been procured for malaria control. A functional LLIN is one that is present, is in good physical condition, and remains insecticidal, thereby providing protection against vector-borne diseases through preventing bites and killing disease vectors. The World Health Organization (WHO) prequalifies LLINs that remain adequately insecticidal 3 years after deployment. Therefore, institutional buyers often assume that prequalified LLINs are functionally identical with a 3-year lifespan. We measured the lifespans of 3 LLIN products, and calculated their cost per year of functional life, to demonstrate the economic and public health importance of procuring the most cost-effective LLIN product based on its lifespan.

Methods and findings

A randomised double-blinded trial of 3 pyrethroid LLIN products (10,571 nets in total) was conducted at 3 follow-up points: 10 months (August–October 2014), 22 months (August–October 2015), and 36 months (October–December 2016) among 3,393 households in Tanzania using WHO-recommended methods. Primary outcome was LLIN functional survival (LLIN present and in serviceable condition). Secondary outcomes were (1) bioefficacy and chemical content (residual insecticidal activity) and (2) protective efficacy for volunteers sleeping under the LLINs (bite reduction and mosquitoes killed). Median LLIN functional survival was significantly different between the 3 net products (p = 0.001): 2.0 years (95% CI 1.7–2.3) for Olyset, 2.5 years (95% CI 2.2–2.8) for PermaNet 2.0 (hazard ratio [HR] 0.73 [95% CI 0.64–0.85], p = 0.001), and 2.6 years (95% CI 2.3–2.8) for NetProtect (HR = 0.70 [95% CI 0.62–0.77], p < 0.001). Functional survival was affected by accumulation of holes, leading to users discarding nets. Protective efficacy also significantly differed between products as they aged. Equivalent annual cost varied between US$1.2 (95% CI $1.1–$1.4) and US$1.5 (95% CI $1.3–$1.7), assuming that each net was priced identically at US$3. The 2 longer-lived nets (PermaNet and NetProtect) were 20% cheaper than the shorter-lived product (Olyset). The trial was limited to only the most widely sold LLINs in Tanzania. Functional survival varies by country, so the single country setting is a limitation.

Conclusions

These results suggest that LLIN functional survival is less than 3 years and differs substantially between products, and these differences strongly influence LLIN value for money. LLIN tendering processes should consider local expectations of cost per year of functional life and not unit price. As new LLIN products come on the market, especially those with new insecticides, it will be imperative to monitor their comparative durability to ensure that the most cost-effective products are procured for malaria control.

Author summary

Why was the study done?

  • Over 2 billion long-lasting insecticidal nets (LLINs) have been procured for malaria control. Modelling has shown that longer-lasting LLINs would save stakeholders between US$500 million and US$700 million over a period of 5 years, yet LLIN tendering processes currently assume that all LLINs have the same lifespan.
  • A functional LLIN must remain in the household, in good physical condition, and with adequate insecticidal activity to give good protection against malaria by preventing bites and killing mosquitoes.
  • Before this study, only a few small studies in distinct geographical areas had compared the functional life of alternative LLIN products, mostly retrospectively.
  • This 3-year randomised trial was designed to accurately compare the functional life of 3 leading LLIN brands, in order to help the Tanzanian government and other LLIN buyers to choose the most cost-effective LLINs.

What did the researchers do and find?

  • We randomised 3,393 households in Tanzania to 1 of 3 LLIN products (10,571 nets in total) and followed them for 3 years using methods recommended by the World Health Organization.
  • This study showed that the functional life of LLINs in domestic use is less than 3 years and differs substantially between products. The main reason for different lifespans between brands was differential accumulation of physical damage that results in users discarding nets that they think are no longer protective. However, tests showed that all LLIN products were still partially protective against pyrethroid-susceptible mosquitoes after 3 years.
  • In this trial, the most durable LLIN product was 20% more cost-effective (economic cost per year of effective life) than the least durable.

What do these findings mean?

  • Based on direct observation of a large number of nets in a range of study areas, our findings support previous studies suggesting that the functional life of LLINs may be less than 3 years.
  • Our findings reveal that the lifespans of competing products can differ to a substantial and economically important degree.
  • More durable LLINs would reduce the rate of loss of nets and the operational costs of malaria control, ultimately improving population access to this life-saving intervention.
  • This study provides justification that measurement of the functional survival of new LLINs coming to market is an essential component of product evaluation for decision making. Functional survival affects LLIN cost; therefore, tendering processes should include a net durability component not just unit price.

Introduction

The use of long-lasting insecticidal nets (LLINs) remains the most cost-effective way to control malaria and reduce mortality [1], notwithstanding insecticide resistance [2]. However, despite the procurement of 254 million LLINs in 2017 alone, global LLIN coverage remains inadequate, with only 56% of the population in endemic areas estimated to have access to a LLIN [3]. LLINs are mostly distributed through periodic mass distribution campaigns, and as a result, population access to LLINs fluctuates over time. Access is typically high directly after a mass campaign and then declines as nets wear out, often to 50% or less, until the next campaign. This fluctuating pattern of coverage, caused by nets wearing out, is seen across the African region [4], where gains in malaria control have stalled, and fewer than 50% of endemic countries remain on track to reach critical malaria reduction targets [3]. Investment in malaria control has stagnated and was US$2.3 billion (50%) below the resources required to meet the World Health Organization (WHO) targets of 40% reductions in malaria case incidence and mortality rates by 2020 [5]. These gaps in funding and coverage emphasise the need to deploy products that present the best value for money.

A report to the Malaria Policy Advisory Committee (MPAC) advised that increasing the functional life of LLINs by 1 or 2 years would reduce the cost of malaria control by between US$500 million and US$700 million over a period of 5 years [6]. A functional LLIN is one that is present, is in good physical condition, and remains insecticidal, thereby providing protection against vector-borne diseases through preventing bites and killing disease vectors [6]. Durability, or functional survival, of LLINs varies between geographical regions [7] and environments [8,9] and remains an undervalued but critical determinant of the success and efficiency of malaria control programmes [10,11]. How long LLINs remain protective under user conditions will dictate how frequently they should be replaced, which has both public health and economic implications [12]. In 2011, it was calculated that in Tanzania, for mean LLIN lifespans of 2, 3, and 4 years, 89, 63, and 51 million LLINs, respectively, would be needed over 10 years to achieve national access targets [10].

Currently, WHO prequalifies products that demonstrate adequate insecticidal activity 3 years after deployment, but does not appraise the physical deterioration of nets over time as part of the LLIN prequalification assessment [13]. Historically, pyrethroid-treated LLINs were assessed in multi-country studies for physical and chemical durability over an anticipated lifespan of 3 years and 20 washes. In the mid-2000s, when these procedures were designed, we did not yet know the relative importance of attrition—the disappearance of nets from study households—as one of the main factors limiting the duration of protection from LLINs. Unfortunately, even after the importance of attrition had become very clear, the evaluation criteria were never changed to take account of it. Thus, of the nets tested in the current study, PermaNet 2.0 received WHO recommendation (now prequalification) based on pooled prospective data from 6 countries, where 80% of remaining nets met bioefficacy and net fabric integrity criteria [14]; Olyset received recommendation based on pooled retrospective data from 7 countries, where 77% of nets passed bioefficacy criteria, although net loss and damage could not be accurately assessed [15]; and NetProtect did not receive full recommendation due to inconsistencies in data between WHO-sponsored studies [16,17], and was withdrawn from the market after the trial reported here had started.

The WHO prequalification website lists a number of newly prequalified products as long-lasting (LLINs) [18], including some with active ingredients other than pyrethroids. The listing of these products was based on experimental hut data from 2 or 3 sites. Fabric integrity, residual chemical content, and bioefficacy data for products after operational household use through longitudinal studies or post-marketing surveillance are requested, but are not a requirement for prequalification. This has resulted in a tendering process where donors assume LLINs are identical, and procurement is weighted by the unit price of the commodity without regard to actual product lifespan [19]. However, all the available data suggest that the assumption of a uniform 3-year lifespan for all LLIN products is unrealistic [4]. There is a clear need for a more integrative economic approach, with purchasing decisions based on value for money and cost per effective unit of LLIN coverage [6,19]. New product classes of LLINs with novel active ingredients for insecticide resistance management are becoming available [20], but they remain susceptible to the same forces of physical disintegration, being discarded, and losing insecticidal activity. Moreover, in most cases, they are more expensive. This emphasises the need to consider the price of LLINs in terms of cost per year of functional life [12].

Here we report results from a large randomised trial of 3 LLIN products (PermaNet 2.0, Olyset, and NetProtect), conducted in 8 epidemiologically and ecologically distinct districts in Tanzania. The proportion of LLINs remaining in use and still protective against malaria mosquitoes was measured over 3 years of follow-up after deployment. We calculated relative LLIN cost-effectiveness in terms of the equivalent annual cost (EAC), which is a conventional financial indicator used to compare products with different effective lifetimes. The median functional survival of each product and its EAC were calculated to inform optimal procurement of cost-effective LLINs.

Methods

The trial has been described in detail previously [21]. It took place in 8 districts in Tanzania, selected to be representative of national environmental, ecological, and epidemiological settings (Fig 1). Within each district, 10 villages were randomly selected (except for Kinondoni [Dar es Salaam], where only 6 areas were available), and within each village, 45 households were recruited to participate in the trial. All households were randomised to receive 1 of 3 LLIN brands on a 1:1:1 ratio, stratified by village. The 3 brands were Olyset (manufactured with an enhanced knitting pattern that was introduced in 2013; permethrin incorporated in 150 denier polyethylene; Sumitomo Chemicals, Japan), PermaNet 2.0 (deltamethrin coated on 100 denier polyester; Vestergaard Frandsen, Switzerland), and NetProtect (deltamethrin incorporated in 110 denier polyethylene; BestNet, Denmark). Distribution of trial nets took place between October and December 2013. All nets owned by the participating households were collected and replaced with enough nets to cover all sleeping spaces. Before distribution, a sample of 10 nets per product was quality tested. Nets were the same size and colour and labelled by a 5-digit serial number so that participants and investigators remained blinded to the LLIN product until data collection was complete. In total, 3,393 households were randomised (1,132 to Olyset, 1,127 to PermaNet 2.0, and 1,134 to NetProtect), to which 10,571 nets were distributed.

thumbnail
Fig 1. Map of trial districts with 2015 malaria prevalence data (percent of children aged 6–59 months diagnosed with malaria by rapid diagnostic test and microscopy) [22].

Open-access shapefiles from https://www.nbs.go.tz/index.php/en/census-surveys/gis.

https://doi.org/10.1371/journal.pmed.1003248.g001

Surveys were conducted among all consenting trial households when the LLINs were distributed and at 3 follow-up points: 10 months (August–October 2014), 22 months (August–October 2015), and 36 months (October–December 2016) (S1 Table). The serial numbers of the nets, linked to household-identifying codes in a master list, enabled follow-up of each net at each time point. At each follow-up visit, information on each LLIN was collected, including whether the net was present in the house, whether the net was in use, and, if the net was not present, reasons why it was not present. Physical integrity of LLINs was measured on a random sample of 3 nets per household by counting the number, location and size of holes [13,23]. Socioeconomic variables and a household member roster were also recorded. Electronic data capture was used for all surveys.

In addition to the data collected as part of the household surveys, at each time point 48 LLINs from each brand were randomly sampled from the master list and returned to a laboratory in Bagamoyo, Tanzania, for bioefficacy and chemical analysis using standard WHO methods [13,23] and, additionally, the Ifakara Ambient Chamber Test (IACT) [24]. Households received new nets to replace those removed for destructive sampling. Once a house had been sampled, it was eliminated from the master list to prevent confounding of results. Table 1 describes the different components of LLIN durability, the tests conducted to obtain the data, the outcome indicators for statistical analysis, and the corresponding WHO threshold criteria [6,13,23]. The numbers of LLINs tested for each of the components of LLIN durability are listed in S1 Table.

First, the protective efficacy of whole nets returned from the field was evaluated using IACT [24]. Each night, 10 male volunteers slept underneath 1 of the nets (or an untreated control net to monitor the quality of the bioassay) between 9 PM and 6 AM in a small chamber similar in size to a bedroom, within a screened compartment. At 9 PM, 30 laboratory-reared mosquitoes were released into the chamber. The next morning, all mosquitoes within the compartment were recaptured, and scored for 24-hour mortality and blood feeding inhibition. Each LLIN was tested twice on 2 consecutive nights. Subsequently, net pieces (25 × 25 cm2) were cut following the WHO sampling pattern and standard WHO cone bioassays were carried out [13]. If nets did not meet WHO optimal bioefficacy criteria for cone tests (Table 1), WHO tunnel tests were conducted [13]. All mosquito assays were conducted with fully pyrethroid-susceptible 2- to 8-day-old nulliparous female Anopheles gambiae sensu stricto (Ifakara strain). Insecticide content analyses were performed at Walloon Agricultural Research Centre (CRA-W) using standard Collaborative International Pesticides Analytical Council Limited (CIPAC) methods for determining LLIN insecticide content (Olyset, 331/LN/M/3; PermaNet 2.0, 333/LN/(M)/3; NetProtect, 333/LN/(M2)/3).

Statistical analysis

All statistical analyses were conducted using Stata release 13 (StataCorp, College Station, TX). Data from the surveys at 10, 22, and 36 months were used to calculate attrition and functional survival (Table 1) using Kaplan–Meier estimators. For both attrition and functional survival, nets reported as given away, sold, or stolen were treated as lost to follow-up. Hazard ratios (HRs) for the difference in attrition and functional survival were calculated using discrete time survival analysis using a complementary log-log model [25]. Robust standard errors were used to account for the highest level of clustering (district) [26]. Of nets that were present, net condition was defined, following WHO recommendations, as ‘good’ or ‘damaged’ (combined as ‘serviceable’) or ‘too torn/unserviceable’ (Table 1). Negative binomial regression was used to compare hole surface area between net products. Data on WHO bioassays and the IACT test came from the 48 nets sampled at each time point. For WHO bioassays and the IACT test, if control mortality for an assay of a section of net was over 10%, the data from that section were not included in the analysis. A chi-squared test assessed the proportion of nets of each product passing the WHO bioefficacy criteria based on combined cone and tunnel tests. Logistic regression was used to analyse mortality and blood feeding inhibition from the IACT test; results were adjusted for chamber and experimental night, and robust standard errors were used to take account of nets being tested multiple times. A further analysis was conducted to test for differences in mortality between net brands in the IACT test based on net condition, in which net condition (defined above) was adjusted for as a fixed effect.

Economic analysis

The EAC of an LLIN was calculated according to the standard formula [27]. To assess the value of longer functional survival, we used Eq 1, where b is the ratio of the lifespan of the more durable product to the lifespan of reference net n. The variable r is the discount rate. This relationship shows, for any change in net lifespan from n to bn, the relative increase in price, a, that would yield an identical EAC for the 2 products. Other factors being equal, a relative price increase less than a would favour the new, longer-lasting LLIN, while relative price increases greater than a would favour the reference net.

(1)

Simulation of EACs for products tested in the trial was conducted using Monte Carlo methods, assuming a 3% discount rate, as is standard in health economic analysis. The baseline survival function for LLINs was estimated by regressing the survival proportions of Olyset nets derived from Kaplan–Meier analysis against time. The survival function was converted into a baseline hazard, and net failure lifetimes were simulated for a cohort of 500 LLINs assuming a Weibull distribution of time to failure (in terms of functional survival). The results of the cohort were summarised by estimating the median lifetime, and this process was repeated 10,000 times for each net type, yielding an estimate of the expected median lifetime and quantiles of its expected distribution. Results were converted into EACs with 95% quantiles. Distributional assumptions for the baseline hazard and the parameters of the Weibull distribution were fitted to the results. The baseline hazard and proportional hazard were simulated with log normal distributions (S2 Table).

Ethics

Ethical approval was granted by ethical review committees at the London School of Hygiene & Tropical Medicine (6333/A443), Ifakara Health Institute (IHI/IRB/AMM/No: 07–2014), and the Tanzanian National Institute for Medical Research (NIMR/HQ/R.8c/Vol. I/285). Community sensitisation meetings were held prior to trial inception, and written informed consent was obtained from the head of the household or another adult household member of participating households before each survey. Volunteers for the IACT experiment were all Ifakara Health Institute staff members with appropriate training who gave written informed consent.

Results

A total of 3,393 households were randomised, to which 10,571 nets were distributed (3,520 Olyset [33%], 3,513 PermaNet 2.0 [33%], and 3,538 NetProtect [33%]). The 3 trial arms were similar in number of participants, number of nets allocated, household characteristics, house design, and socioeconomic characteristics (Table 2). The proportion of households lost to follow-up was 20% over the 3 years of the trial.

thumbnail
Table 2. Household and socioeconomic characteristics of participating households in each trial arm.

https://doi.org/10.1371/journal.pmed.1003248.t002

Functional survival

There were significant differences in functional survival (defined as presence of serviceable net) of the 3 products (Table 3). Estimated median functional survival was 2.0 years (95% CI 1.7–2.3) for Olyset, 2.5 years (95% CI 2.2–2.8) for PermaNet, and 2.6 years (95% CI 2.3–2.8) for NetProtect (p < 0.001). There was no significant difference in net use by net product (S3 Table).

thumbnail
Table 3. Percentage net functional survival (defined as presence of the net in the house and in serviceable condition) and simulated equivalent annual cost (assuming S$3.0 purchase price) by net product and time point.

https://doi.org/10.1371/journal.pmed.1003248.t003

Economic analysis

Simulation results show that the expected EAC in US dollars of the 3 LLINs in the trial varied between $1.2 (95% CI $1.1–$1.4) for PermaNet and NetProtect and $1.5 (95% CI $1.3–$1.7) for Olyset, assuming that each net was priced identically at $3.0 (Table 3). The longer-lived net products (PermaNet and NetProtect) were approximately 20% lower in EAC than the shorter-lived Olyset product.

Components of functional survival and secondary outcomes

Attrition.

There were significant differences in attrition between net products. Olyset nets were lost at a faster rate than PermaNet 2.0 and NetProtect nets (Table 4). After 3 years, 55% of Olyset nets were no longer present in households, compared to 42% of PermaNet 2.0 and 46% of NetProtect nets (p < 0.001; Table 4). Of the 10,571 nets distributed, 4,964 (46%) were lost over the whole trial period (S5 Table).

thumbnail
Table 4. Percentage attrition (defined as net loss due to discarding or alternative use of nets) and hazard ratios after 36 months by net product and time point.

https://doi.org/10.1371/journal.pmed.1003248.t004

Physical integrity.

The condition of nets that remained in households deteriorated over the course of the trial. At each time point, Olyset had the largest proportion and NetProtect had the smallest proportion of ‘too torn’ nets (Fig 2). The median hole surface area in Olyset nets increased from 38 cm2 at 10 months to 459 cm2 after 36 months, compared to 6 cm2 to 295 cm2 for PermaNet 2.0 and 8 cm2 and 152 cm2 for NetProtect (S6 Table). Questionnaire data showed that at 3 years, 70% of nets no longer in use had been discarded when they were perceived as too damaged to be useful. Others were given away (17%), stolen (3%), or repurposed (3%).

thumbnail
Fig 2. Physical condition of long-lasting insecticidal nets remaining in households at time of survey according to WHO categorisation using proportionate hole index (pHI) [5] for the 3 net products and time points.

Green shows percent of nets in good condition (pHI 0–64), orange shows percent nets in damaged condition (pHI 65–642), and red shows percent of nets defined as ‘too torn’ (pHI ≥ 643). The sample sizes at 10 months were as follows: Olyset, 3,520; PermaNet, 3,513; NetProtect, 3,538. The sample sizes at 22 months were as follows: Olyset, 2,592; PermaNet, 2,622; NetProtect, 2,617. The sample sizes at 36 months were as follows: Olyset, 1,687; PermaNet, 1,827; NetProtect, 1,746.

https://doi.org/10.1371/journal.pmed.1003248.g002

Bioefficacy.

At baseline, all products met optimal WHO bioefficacy criteria. After field use, there were significant differences in the bioefficacy of the net products measured using standard WHO cone and tunnel tests over time (Table 5). At 10 months, 100% of NetProtect and PermaNet 2.0 nets met WHO optimal bioefficacy criteria, compared to 73% of Olyset nets (p < 0.001). Nets decreased in bioefficacy through time, but even after 3 years, 96% of NetProtect, 85% of PermaNet 2.0, and 75% of Olyset nets met WHO criteria for bioefficacy (p = 0.017; Table 5).

thumbnail
Table 5. Percentages of net products meeting optimal WHO bioefficacy criteria by time point.

https://doi.org/10.1371/journal.pmed.1003248.t005

When whole nets were tested after 3 years using IACT, 88% of Olyset, 96% of PermaNet 2.0, and 92% of NetProtect nets passed WHO optimal criteria of ≥80% mortality and ≥90% blood feeding inhibition. There were differences between products in 24-hour mortality. Olyset showed lower mortality (p < 0.001), but all 3 products showed similar levels of feeding inhibition (Fig 3; S7 Table). Mosquito mortality was higher for nets defined as ‘too torn’ (odds ratio = 0.65 [95% CI 0.49–0.88], p = 0.005), and the differences in mosquito mortality between the net products remained significant after adjusting for physical condition. Similarly, protection from mosquito bites (feeding inhibition) was considerably lower among nets that were ‘too torn’ (OR = 0.12 [95% CI 0.08–0.18], p < 0.001), but the differences between the net products remained non-significant after adjusting for physical condition.

thumbnail
Fig 3. Ifakara Ambient Chamber Test (IACT) results for mosquito mortality and blood feeding inhibition by net product and time point.

Mosquito mortality (top panel) and blood feeding inhibition (bottom panel). Orange, Olyset; blue, PermaNet; maroon, NetProtect. Optimal WHO criteria (80% mortality; 90% blood feeding inhibition) are indicated by dashed lines. The number of mosquitoes used at 10 months was as follows: Olyset, 2,700; PermaNet, 2,730; NetProtect, 2,730. The number of mosquitoes used at 22 months was as follows: Olyset, 2,880; PermaNet, 2,880; NetProtect, 2,880. The number of mosquitoes used at 36 months was as follows: Olyset, 2,880; PermaNet, 2,880; NetProtect, 2,880.

https://doi.org/10.1371/journal.pmed.1003248.g003

Active ingredient content.

At baseline, 100% (10) of Olyset and PermaNet 2.0 and 50% (5) of NetProtect samples complied with their target doses of active ingredient (S8 Table).

At 10 months, 22 months, and 36 months, mean permethrin content in Olyset nets decreased to 16.2 g/kg, 14.8 g/kg, and 13.0 g/kg, corresponding to a loss of 20%, 27%, and 36% of the original dose, respectively. Mean deltamethrin content of PermaNet 2.0 nets decreased to 0.75 g/kg, 0.47 g/kg, and 0.40 g/kg, corresponding to a loss of 48%, 68%, and 72% of the original dose, respectively. Mean deltamethrin content of NetProtect nets decreased to 0.91 g/kg, 0.52 g/kg, and 0.40 g/kg, corresponding to a loss of 33%, 61%, and 70% of the original dose, respectively (S8 Table). While this loss of insecticide did not negatively impact the bioefficacy of the nets against a pyrethroid-susceptible strain of mosquito, it is plausible that it would impact the efficacy of the nets against more resistant mosquitoes.

Discussion

We conducted a randomised trial with 10,571 new LLINs of 3 brands (3,520 Olyset, 3,513PermaNet, and 3,538 NetProtect) distributed among 3,393 households in 76 villages in 8 districts in Tanzania and followed up annually for 3 years. This was done to measure the rate at which the 3 net brands became damaged, lost bioefficacy, and were discarded by households. The findings of this trial demonstrate that there is considerable variability in the lifespan of pyrethroid-treated LLIN products. Our data also confirm that the median functional life of the LLINs in our study was less than 3 years in Tanzania, as also suggested by a systematic review of LLIN retention data in 39 sub-Saharan African countries [4]. A WHO-sponsored evaluation of NetProtect and PermaNet 2.0 conducted in Kenya showed very similar results to those found here, with a median time to failure of 2.5 years for PermaNet 2.0 and 2.5 years for NetProtect [16]. A full literature review of durability data available for the products evaluated in this trial is included in S1 Text. Summary net durability data available from peer-reviewed publications and WHO reports agree with the data in our trial for estimates of bioefficacy and fabric integrity after 3 years of operational use. The proportions of nets passing WHO bioefficacy criteria were above 80% for NetProtect and PermaNet 2.0 and slightly below 80% for Olyset. NetProtect and PermaNet had similar fabric integrity after 3 years of domestic use, with a higher proportion of serviceable nets relative to Olyset.

While there have been substantial economic investments to find new active ingredients, insecticide combinations, and synergists to combat the negative effects of insecticide resistance [28], the importance of durability for LLIN effectiveness has been side-lined. Consideration of its importance in vector control by key stakeholders such as the WHO may re-awaken the LLIN market to reward more durable products. This should, in turn, create incentives for investments in technological advances, research, and development by LLIN manufacturers [19]. There are indications that LLINs can be made substantially more durable for a small increase in unit price [29], and rapid technological evolution may be possible if there are appropriate market incentives.

The WHO’s Guidelines for Procuring Public Health Pesticides [30] recommends that procurement decisions consider ‘operational cost’ rather than unit price, and an appropriate measure to compare value for money of LLINs would be ‘cost per median year of net life under local conditions’. We measured the relative durability of nets using functional survival estimates, in terms of the EAC, and demonstrated that this approach outlined by WHO would indeed be useful. The cost analysis showed approximately 20% lower EAC when a longer-lasting LLIN (PermaNet 2.0 or NetProtect) was chosen over a shorter-lasting LLIN (Olyset), assuming prices for the products were identical. The economic modelling showed that the relative increase in price that is acceptable for a new product coming to market is also much smaller when the lifetime of the standard product increases (S1 Fig). Thus, the extension of the life of an innovator product is much more valuable if the standard product is relatively short-lived, as was seen in this study.

WHO requests LLIN manufacturers to provide data from 3 longitudinal field evaluations in different ecologies (e.g., West Africa, East Africa, and Asia) to retain prequalification listing. While it is recognised that durability is context-specific, we argue that it is possible to routinely generate median functional survival estimates and EACs for at least 3 locations using the WHO methodology outlined [13,23], albeit with a more limited sample size than the present study. The EAC may be a useful metric to compare cost-effectiveness of products, rather than the current practice of assessing products based simply on a minimum threshold of insecticidal activity after 3 years.

The limitation of the EAC metric is that it only captures the relative weighting of price and effective lifetime, while full cost-effectiveness and cost (including non-commodity costs) will result from a complex interaction of net durability, distribution modality, cost, and effectiveness. A limitation of the simplified approach here is that it does not fully consider these interactions, but it presents a straightforward and easily applicable approach to judging the relative cost and lifetime of a product.

Attrition and fabric integrity, the 2 factors that define physical survival of LLINs [6,31], differed significantly between the 3 net products. Olyset demonstrated more rapid accumulation of damage and faster attrition. In the current study and in previous work, we demonstrated that most LLINs were discarded because they were perceived by users as too damaged to offer protection against mosquito bites or malaria [32]. Attrition and fabric integrity are highly variable between contexts, and information on these factors is simpler to collect than bioefficacy or chemical content data. Further consideration should be given to developing simple tools to allow countries to assess attrition and fabric integrity during routine surveys (e.g., Malaria Indicator Surveys or Demographic and Health Surveys) to inform planning of intervals between mass distribution campaigns.

Of those nets still present after 3 years, 25%–40% were categorised as no longer physically serviceable, depending on the brand. However, even after 3 years, nets remained highly insecticidal when tested by bioassays against insecticide-susceptible malaria vectors. Damage actually increased the mortality of mosquitoes that entered nets through holes and became trapped, as also observed in other studies [33]. Indeed, torn LLINs continue to provide a degree of individual and community protection from malaria [34,35]. Our IACT experiments demonstrated that the 3 brands were all highly protective, although Olyset killed significantly fewer mosquitoes than PermaNet 2.0 and NetProtect. It is of note that the most common location for damage to the nets is on the bottom section of the nets at the point where they are tucked under a mat or mattress (S2 Fig). The act of tucking makes these holes inaccessible to mosquitoes even though the net appears to be badly damaged to the user, which may motivate them to discard the net.

A limitation of the trial is that only susceptible mosquitoes were used for bioefficacy testing. Pyrethroid resistance is widespread and increases feeding success and reduces mortality of mosquitoes [33]. Another limitation is the fact that the trial was only conducted in Tanzania (albeit in a wide range of epidemiological settings). Functional survival varies by country (S1 Text), so the single country setting is a limitation. However, the setting is more likely to affect absolute net survival rates than the comparison between LLIN products. Furthermore, the trial only included 3 brands of LLINs, all of which are treated with pyrethroids. As new LLIN products come on the market treated with different insecticides, insecticide combinations, or synergists, such as piperonyl butoxide (PBO), it will be imperative to monitor their comparative durability to ensure that the most cost-effective products are procured for malaria control. Functional life will have important implications for the selection of new products for resistance management that have higher unit costs. New pyrethroid plus PBO nets may not be as durable as standard pyrethroid nets because PBO is lost rapidly from nets during washing, which reduces their efficacy [36]. However, in Tanzania, PBO nets continued to have superior public health benefits 2 years after distribution [20]. If the median functional survival of pyrethroid LLINs is 2 years, then PBO nets may remain cost-competitive.

Our findings confirm that even after 3 years, nets that are still in households, despite holes, still give partial protection against mosquito bites and continue to kill mosquitoes, providing some personal and community protection. However, if nets are discarded, or no longer used because they are perceived as too damaged, then they have no public health benefit at all. While it is possible to encourage users to retain their damaged, but still insecticidal, nets through behavioural change communication, a more effective and safer strategy would be to distribute more physically durable LLINs [29]. LLINs are the largest single cost item in the global malaria control budget. If LLIN effective lifespans became longer, net replacement needs would be substantially reduced, aiding in improving population access to this life-saving intervention despite the current stagnation in financial support for malaria control. It is technically feasible to manufacture more durable LLINs. However, this will happen only if institutional buyers consider cost-effectiveness for coverage [30] and give greater market share to longer-lasting and better value-for-money products.

Supporting information

S1 Fig. Relationship between increased net lifetimes in years and the acceptable increase in price.

https://doi.org/10.1371/journal.pmed.1003248.s001

(TIF)

S2 Fig. The location of damage on nets by year after distribution and net brand measured by proportionate hole index.

https://doi.org/10.1371/journal.pmed.1003248.s002

(PDF)

S1 Table. Study flow.

The number of interviews completed each year, loss to follow-up, and the number of study nets evaluated for each durability component is shown.

https://doi.org/10.1371/journal.pmed.1003248.s004

(PDF)

S2 Table. Parameters used in simulation of lifetimes for equivalent annual cost simulation analysis.

https://doi.org/10.1371/journal.pmed.1003248.s005

(PDF)

S3 Table. Reported net use the previous night by net product and time point.

Data represent numbers of respondents (percent) reporting use of nets.

https://doi.org/10.1371/journal.pmed.1003248.s006

(PDF)

S4 Table. Number at risk (functional survival).

https://doi.org/10.1371/journal.pmed.1003248.s007

(PDF)

S6 Table. Median hole surface area (in cm2) and interquartile range (IQR) by net product and time point.

https://doi.org/10.1371/journal.pmed.1003248.s009

(PDF)

S7 Table. Ifakara Ambient Chamber Test (IACT) results for mosquito mortality and blood feeding inhibition by net product and time point (in months).

https://doi.org/10.1371/journal.pmed.1003248.s010

(PDF)

S8 Table. Number of nets, mean active ingredient (AI) content (g/kg), range (g/kg), and between net variation (%RSD); percentage of active ingredient lost over time; mean R-alpha isomer content (g/kg); and percentage of deltamethrin (only for PermaNet 2.0 and NetProtect) in net samples at baseline and 3 follow-up time points.

https://doi.org/10.1371/journal.pmed.1003248.s011

(PDF)

S1 Text. Literature review on durability of PermaNet 2.0, Olyset, and NetProtect nets.

https://doi.org/10.1371/journal.pmed.1003248.s012

(PDF)

Acknowledgments

Our special thanks are addressed to all technical staff at the Vector Control Product Testing Unit at Ifakara Health Institute for conducting data collection in the laboratory and semi-field experiments. We thank the LLIN manufacturers Sumitomo Chemical (Olyset), Vestergaard Frandsen (PermaNet), and BestNet (NetProtect) for their donation of the LLINs free of charge. Special thanks to Dr. Karen Kramer and Renate Mandike for their thoughtful comments that helped shape the trial design, and support at inception. This paper is published with the permission of the National Institute for Medical Research in Tanzania (NIMR/HQ/P12 Vol. XXVIII/20).

References

  1. 1. Bhatt S, Weiss DJ, Cameron E, Bisanzio D, Mappin B, Dalrymple U, et al. The effect of malaria control on Plasmodium falciparum in Africa between 2000 and 2015. Nature. 2015;526(7572):207–11.
  2. 2. Kleinschmidt I, Bradley J, Knox TB, Mnzava AP, Kafy HT, Mbogo C, et al. Implications of insecticide resistance for malaria vector control with long-lasting insecticidal nets: a WHO-coordinated, prospective, international, observational cohort study. Lancet Infect Dis. 2018;18(6):640–9.
  3. 3. World Health Organization. World malaria report 2018. Geneva: World Health Organization; 2018.
  4. 4. Bhatt S, Weiss DJ, Mappin B, Dalrymple U, Cameron E, Bisanzio D, et al. Coverage and system efficiencies of insecticide-treated nets in Africa from 2000 to 2017. Elife. 2015;4:e09672.
  5. 5. World Health Organization. World malaria report 2019. Geneva: World Health Organization; 2019.
  6. 6. World Health Organization. Vector Control Technical Expert Group Report to MPAC September 2013. Estimating functional survival of long-lasting insecticidal nets from field data. Geneva: World Health Organization; 2013.
  7. 7. Kilian A, Koenker H, Obi E, Selby RA, Fotheringham M, Lynch M. Field durability of the same type of long-lasting insecticidal net varies between regions in Nigeria due to differences in household behaviour and living conditions. Malar J. 2015;14(1):123.
  8. 8. Hakizimana E, Cyubahiro B, Rukundo A, Kabayiza A, Mutabazi A, Beach R, et al. Monitoring long-lasting insecticidal net (LLIN) durability to validate net serviceable life assumptions, in Rwanda. Malar J. 2014;13:344.
  9. 9. Tami A, Mbati J, Nathan R, Mponda H, Lengeler C, Schellenberg JR. Use and misuse of a discount voucher scheme as a subsidy for insecticide-treated nets for malaria control in southern Tanzania. Health Policy Plan. 2006;21:1–9.
  10. 10. Koenker HM, Yukich JO, Mkindi A, Mandike R, Brown NJ, Kilian A, et al. Analysing and recommending options for maintaining universal coverage with long-lasting insecticidal nets: the case of Tanzania in 2011. Malar J. 2013;12:150.
  11. 11. Willey BA, Paintain LS, Mangham L, Car J, Schellenberg JA. Strategies for delivering insecticide-treated nets at scale for malaria control: a systematic review. Bull World Health Organ. 2012;90(9):672–84e.
  12. 12. Pulkki-Brännström A-M, Wolff C, Brännström N, Skordis-Worrall J. Cost and cost effectiveness of long-lasting insecticide-treated bed nets—a model-based analysis. Cost Eff Resour Alloc. 2012;10:5.
  13. 13. WHO Pesticide Evaluation Scheme. Guidelines for laboratory and field testing of long-lasting insecticidal nets. WHO/HTM/NTD/WHOPES/2013.3. Geneva: World Health Organization; 2013.
  14. 14. WHO Pesticide Evaluation Scheme. Report of the twelfth WHOPES Working Group Meeting. WHO/HQ, Geneva, 8–11 December 2008. Review of Bioflash GR, Permanet 2.0, Permenet 2.5, Permanet 3.0, Lambda-cyhalothrin LN. Geneva: World Health Organization; 2009.
  15. 15. WHO Pesticide Evaluation Scheme. Report of the thirteenth WHOPES Working Group Meeting. WHO/HQ, Geneva, 28–30 July 2009. Review of Olyset LN, Dawaplus 2.0 LN, Tianjin Yorkool LN. WHO/HTM/NTD/WHOPES/2009.5. Geneva: World Health Organization; 2009.
  16. 16. WHO Pesticide Evaluation Scheme. Report of the sixteenth WHOPES Working Group Meeting. WHO/HQ, Geneva, 22–30 July 2013. Review of: Pirimiphos-methyl 300 cs, Chlorfenapyr 240 sc, Deltamethrin 62.5 sc-pe, Duranet LN, Netprotect LN, Yahe LN, Spinosad 83.3 monolayer dt, Spinosad 25 extended release gr. Geneva: World Health Organization; 2013.
  17. 17. WHO Pesticide Evaluation Scheme. Report of the seventeenth WHOPES Working Group Meeting. WHO/HQ, Geneva, 15–19 September 2014. Review of: Alphacypermethrin 250 WG-SB, ICON MAXX, Netprotect LN, Chlorfenapyr 240 SC. Geneva: World Health Organization; 2014.
  18. 18. World Health Organization. List of WHO prequalified vector control products. Geneva: World Health Organization; 2020 [cited 2020 Apr 17]. https://www.who.int/pq-vector-control/prequalified-lists/PrequalifiedProducts27January2020.pdf?ua=1.
  19. 19. WHO Global Malaria Programme. A system to improve value for money in LLIN procurement through market competition based on cost per year of effective coverage. Geneva: World Health Organization; 2011.
  20. 20. Protopopoff N, Mosha JF, Lukole E, Charlwood JD, Wright A, Mwalimu CD, et al. Effectiveness of a long-lasting piperonyl butoxide-treated insecticidal net and indoor residual spray interventions, separately and together, against malaria transmitted by pyrethroid-resistant mosquitoes: a cluster, randomised controlled, two-by-two factorial design trial. Lancet. 2018;391(10130):1577–88.
  21. 21. Lorenz LM, Overgaard HJ, Massue DJ, Mageni ZD, Bradley J, Moore JD, et al. Investigating mosquito net durability for malaria control in Tanzania—attrition, bioefficacy, chemistry, degradation and insecticide resistance (ABCDR): study protocol. BMC Public Health. 2014;14(1):1266.
  22. 22. Ministry of Health, Community Development, Gender, Elderly and Children, Ministry of Health, National Bureau of Statistics, Office of Chief Government Statistician, ICF. Tanzania Demographic and Health Survey and Malaria Indicator Survey 2015–16. Rockville (MD): DHS Program; 2016.
  23. 23. World Health Organization. Guidelines for monitoring the durability of long-lasting insecticidal mosquito nets under operational conditions. Geneva: World Health Organization; 2011.
  24. 24. Massue DJ, Lorenz LM, Moore JD, Ntabaliba WS, Ackerman S, Mboma ZM, et al. Comparing the new Ifakara Ambient Chamber Test with WHO cone and tunnel tests for bioefficacy and non-inferiority testing of insecticide-treated nets. Malar J. 2019;18(1):153.
  25. 25. Prentice PL, Gloeckler LA. Regression analysis of grouped survival data with applications to breast cancer data. Biometrics. 1978;34:57–67.
  26. 26. Bottomley C, Kirby MJ, Lindsay SW, Alexander N. Can the buck always be passed to the highest level of clustering? BMC Med Res Methodol. 2016;16(1):29.
  27. 27. Drummond MF, Sculpher MJ, Torrance GW, O’Brien BJ, Stoddart GL. Methods for the economic evaluation of health care programmes. 4th edition. Oxford: Oxford University Press; 2015.
  28. 28. Hemingway J, Shretta R, Wells TNC, Bell D, DjimdÈ AA, Achee N, et al. Tools and strategies for malaria control and elimination: what do we need to achieve a grand convergence in malaria? PLoS Biol. 2016;14(3):e1002380.
  29. 29. Skovmand O, Bosselmann R. Strength of bed nets as function of denier, knitting pattern, texturizing and polymer. Malar J. 2011;10:87.
  30. 30. World Health Organization. Guidelines for procuring public health pesticides. WHO/HTM/NTD/WHOPES/2012.4. Geneva: World Health Organization; 2012.
  31. 31. Churcher TS, Lissenden N, Griffin JT, Worrall E, Ranson H. The impact of pyrethroid resistance on the efficacy and effectiveness of bednets for malaria control in Africa. Elife. 2016;5:e16090.
  32. 32. Massue DJ, Moore SJ, Mageni ZD, Moore JD, Bradley J, Pigeon O, et al. Durability of Olyset campaign nets distributed between 2009 and 2011 in eight districts of Tanzania. Malar J. 2016;15(1):176.
  33. 33. Randriamaherijaona S, Briët OJT, Boyer S, Bouraima A, N’Guessan R, Rogier C, et al. Do holes in long-lasting insecticidal nets compromise their efficacy against pyrethroid resistant Anopheles gambiae and Culex quinquefasciatus? Results from a release–recapture study in experimental huts. Malar J. 2015;14(1):332.
  34. 34. Maxwell CA, Msuya E, Sudi M, Njunwa KJ, Carneiro IA, Curtis CF. Effect of community-wide use of insecticide-treated nets for 3–4 years on malarial morbidity in Tanzania. Trop Med Int Health. 2002;7(12):1003–8.
  35. 35. Minta AA, Landman KZ, Mwandama DA, Shah MP, Eng JLV, Sutcliffe JF, et al. The effect of holes in long-lasting insecticidal nets on malaria in Malawi: results from a case-control study. Malar J. 2017;16(1):394.
  36. 36. Gleave K, Lissenden N, Richardson M, Choi L, Ranson H. Piperonyl butoxide (PBO) combined with pyrethroids in insecticide-treated nets to prevent malaria in Africa. Cochrane Database Syst Rev. 2018;11:CD012776.