A general framework to support cost-efficient survey design choices for the control of soil-transmitted helminths when deploying Kato-Katz thick smear

Adama Kazienga; Bruno Levecke; Gemechu Tadesse Leta; Sake J. de Vlas; Luc E. Coffeng

doi:10.1371/journal.pntd.0011160

Abstract

Background

To monitor and evaluate soil-transmitted helminth (STH) control programs, the World Health Organization (WHO) recommends screening stools from 250 children, deploying Kato-Katz thick smear (KK). However, it remains unclear whether these recommendations are sufficient to make adequate decisions about stopping preventive chemotherapy (PC) (prevalence of infection <2%) or declaring elimination of STHs as a public health problem (prevalence of moderate-to-heavy intensity (MHI) infections <2%).

Methodology

We developed a simulation framework to determine the effectiveness and cost of survey designs for decision-making in STH control programs, capturing the operational resources to perform surveys, the variation in egg counts across STH species, across schools, between and within individuals, and between repeated smears. Using this framework and a lot quality assurance sampling approach, we determined the most cost-efficient survey designs (number of schools, subjects, stool samples per subject, and smears per stool sample) for decision-making.

Principal findings

For all species, employing duplicate KK (sampling 4 to 6 schools and 64 to 70 subjects per school) was the most cost-efficient survey design to assess whether prevalence of any infection intensity was above or under 2%. For prevalence of MHI infections, single KK was the most cost-efficient (sampling 11 to 25 schools and 52 to 84 children per school).

Conclusions/Significance

KK is valuable for monitoring and evaluation of STH control programs, though we recommend deploying a duplicate KK on a single stool sample to stop PC, and a single KK to declare the elimination of STHs as a public health problem.

Author summary

Worldwide large-scale deworming programs are implemented to reduce the morbidity attributable to intestinal worms in school children. To monitor and evaluate the progress towards the programs’ goals, Word Health Organization (WHO) has developed both a survey design and a corresponding decision tree based on the prevalence and intensity of infections. However, these programs operate in resource-constrained countries, and hence it is crucial to minimize the operational costs to survey worm infections while ensuring the correctness of the program decision. To further support WHO in more evidence-based recommendations for cost-efficient decision-making, we developed a general framework that captures both the operational resources to perform surveys and the variation in test results when deploying the current diagnostic standard. Subsequently, we determined the most cost-efficient survey design to decide to stop the deworming programs and to verify whether the morbidity attributable to intestinal worms has been eliminated as a public health problem. Generally, we found that the current WHO-recommended survey design may not allow for optimal decision making. Based on our results, we proposed alternative survey designs for each of the worm species and program targets.

Citation: Kazienga A, Levecke B, Leta GT, de Vlas SJ, Coffeng LE (2023) A general framework to support cost-efficient survey design choices for the control of soil-transmitted helminths when deploying Kato-Katz thick smear. PLoS Negl Trop Dis 17(6): e0011160. https://doi.org/10.1371/journal.pntd.0011160

Editor: Qu Cheng, Huazhong University of Science and Technology Tongji Medical College, CHINA

Received: February 13, 2023; Accepted: May 28, 2023; Published: June 22, 2023

Copyright: © 2023 Kazienga et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All relevant data are within the manuscript and its Supporting Information files.

Funding: BL acknowledges funding from Ghent University starting grant (www.ugent.be) and LEC from the Dutch Research Council (NWO, grant 016.Veni.178.023). In addition, the financial support for the dataset used in this study was provided by Schistosomiasis Control Initiative, the Partnership for Child Development, the Children's Investment Fund Foundation, the End Neglected Tropical Diseases Fund, and UKAID-DFID. The funders has no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

Introduction

Recently, the World Health Organization (WHO) released its 2030 roadmap for the control of soil-transmitted helminths (STHs) [1,2]. In this new roadmap, the two crucial targets are (i) to eliminate STHs as a public health problem (EPHP), defined as prevalence of moderate-to-heavy intensity (MHI) infections less than 2%, and (ii) to reduce the number of tablets needed in preventive chemotherapy (PC). Regarding this second target, WHO recommends stopping PC if the prevalence of infection (any intensity) is less than 2%.

To assess whether prevalence of any intensity or MHI infections is under 2%, the WHO recommends screening stool samples from 250 children, deploying Kato-Katz thick smears (KK) [2–5]. However, little attention has been paid to whether this survey design is sufficient for reliable decision-making. There will always be a risk of making a wrong decision: stopping PC or declaring EPHP too early (referred to as “undertreatment” from here on) or too late (“overtreatment”). Amongst other things, these risks are driven by survey sample size and diagnostic accuracy, which means that a trade-off must be made between operational costs and feasibility of survey designs, and the maximum acceptable risks of under- and overtreatment.

Here, we assess the trade-off of survey design and associated operational costs versus the risk of under- and overtreatment for STHs when using KK as a diagnostic method because it was found more cost-effective than alternative diagnostic techniques based on egg counting [6]. We do this using a previously developed simulation framework for lot quality assurance sampling (LQAS) that only captured the prevalence of infection and not the variation in intensity of infection [7]. For this study, we expanded this framework to also capture variation in intensity of infection across STH species (Ascaris lumbricoides, Trichuris trichiura, hookworms), across schools, between and within individuals, and between repeated thick smears. These sources of variation are important as the sensitivity of KK for detecting infection in an individual depends on the intensity of infection [8–12]. Furthermore, using this expanded framework, we assess to what extent the accuracy of survey results can be improved (and at what cost) by increasing the number of thick smears per stool sample or the number of stool samples per person [8,13]. Finally, for different levels of acceptable risk of under- and overtreatment, we determine the most cost-efficient survey design and the associated decision cut-off (maximum number of egg-positive individuals) for decision-making.

Methods

Ethics statement

We used a dataset from a study in Ethiopia, which has already been published elsewhere [14], to quantify sources of variation in egg count. This study was designed for the national mapping of STH and schistosome infections in Ethiopia. The study protocol was reviewed and approved by the Ethiopian Public Health Institute Scientific and Ethical Review Office (reference number SERO-128-4-2005) and the Institutional Review Board of Imperial College London (reference number ICREC_8_2_2). Verbal consent was obtained from the parents or guardian, and the school head provided written consent on behalf them. In addition, students provided verbal consent to be included in the survey.

Overview

Based on a previously developed LQAS framework for monitoring and evaluation (M&E) of neglected tropical diseases (NTDs) [7], we developed a generic simulation framework for STH surveys and the associated operational costs at the level of a PC implementation unit. Using this framework, we assessed the cost-efficiency of different survey designs (number of schools, number of children per school, number of stool samples per child, and number of KK thick smears per stool sample) for each STH species and decision type (stop PC or declare EPHP) via the following steps: (1) simulate egg counts in thick smears of sampled children and determine the number of children that test positive; (2) for all possible decision cut-offs in terms of maximum number of positive children, calculate the probability of overtreatment and undertreatment across repeated Monte Carlo simulations and determine the decision cut-off for adequate decision-making (acceptable risk of under- and overtreatment); (3) estimate the total survey cost. To determine the most cost-efficient survey design and associated cut-off, we selected all designs that resulted in adequate decision-making and compared them in terms of cost and feasibility to implement.

Simulation of egg counts for different survey designs

We adopted the simulation framework for egg counts developed by Coffeng et al. [15] and expanded it with geographical variation in infection levels. The expanded framework simulates egg count data from a compound lognormal-gamma-gamma-gamma-Poisson distribution, capturing the following sources of variability in egg counts:

Variability in mean egg per gram stool (EPG) between schools (assumed to be lognormal distributed (see S1 Info);
Inter-individual variability in EPG due to variation in infection levels between individuals (considered to be gamma-distributed), where the level of aggregation (shape of the gamma distribution) is a linear function of the school-level mean EPG (see S1 Info);
Day-to-day variability in mean EPG within an individual due to heterogeneous egg shedding over time (assumed to be gamma-distributed);
Variability in mean EPG between repeated slides based on the same sample due to the aggregated distribution of eggs in feces (assumed to follow a poisson distribution);
Variability in count observation (expressed in raw egg count) due to random diagnostic variation (assumed to be Poisson distributed).

We presented the mathematical backbone of the simulation framework in S2 Info and quantified these aforementioned sources of variation based on published datasets [14]. Table 1 provides the full overview of the estimated parameter values for each STH species.

Download:

Table 1. Parametrization of the simulation framework for various sources of variability in Kato-Katz thick smear egg counts.

We parametrized the lognormal distribution using the mean and standard deviation on the logarithmic scale, and for the gamma distribution, the shape parameter k and scale (), where μ is the distribution’s mean. To quantify k, the coefficient of variation (cv) was used as standardized measure of variability [16].

https://doi.org/10.1371/journal.pntd.0011160.t001

Using this simulation framework, we considered 4 survey designs, denoted as KK_a×b, a is the number of stool samples per person, and b is the number of repeated smears per stool sample. These survey designs were KK_1×1 (considered as the reference [1,2]), KK_1×2, KK_2×1, and KK_2×2. We further set the number of schools (n_schools) ranging from 3 to 10 for any intensity of infection and from 10 to 25 for MHI infections (preliminary simulations already indicated that 3–10 schools did not result reliable decision making around MHI), while the number of children per school (n_children) ranged from 10 to 200 for both targets.

Calculating the probability of under- and overtreatment

To determine the probability of making right and wrong policy decisions for different survey designs, we used a 2-stage LQAS approach, a framework for NTD control program decision-making which we have previously described in detail [7]. The 2-stage aspect refers to the fact that we explicitly consider that survey results will be sampled from multiple clusters. In 2-stage LQAS, decision-making is based on the total number of positive test results (X₊; here, egg-positive individuals) in a sample of pre-defined size from a pre-defined number of clusters in an implementation unit and a decision cut-off c. The frequency of PC will be reduced (or PC is stopped altogether) in case X₊ is less than the decision cut-off c. Otherwise, the frequency of PC remains unchanged or may even be increased. This framework was used to assess two features of the decision: (1) the operational program decision threshold (e.g., 2% prevalence of infection); (2) the maximum acceptable risk of making a wrong decision when the true prevalence based on a single KK is at a pre-defined lower or higher value than the operational decision threshold (i.e., the “grey zone”, e.g., 1% and 3%).

Using LQAS, we assessed two operational decision thresholds for each STH species: one for a 2% prevalence of any intensity of infection (i.e., related to stopping PC) and another for a 2% prevalence of MHI infections (i.e., related to declare EPHP). Then, we considered adequate decision-making by setting the maximum allowed probability of unnecessarily continuing with the program (E_overtreat) when true prevalence is 3% (the upper limit of the grey zone, or UL) at 0.25. We further set the highest allowed probability of prematurely stopping interventions (E_undertreat) when true prevalence is 1% (the lower limit of the grey zone, or LL) at 0.05. For this, we determined the mean EPG at the implementation unit level that corresponds to these limits (LL and UL) as measured by single KK (Table 2), conditional on the estimated parameter values for sources of variability in egg counts (Table 1), assuming 100% specificity of KK [17,18].

Download:

Table 2. Parametrization of simulations for 2-stage lot quality assurance sampling in terms of the natural logarithm of the geometric mean infection intensity (eggs per gram feces or EPG) in the population as measured by single Kato-Katz.

https://doi.org/10.1371/journal.pntd.0011160.t002

Calculating the operational costs and determining the most cost-efficient survey design

We estimated the total survey costs for each simulated survey design and STH species. This cost was composed of the cost of consumables to collect and process samples, and the operational costs to both (ii) collect and process the samples and (iii) to inform the schools about the study [7].Technical details on how the total survey costs were estimated can be found in S3 Info

To determine the most cost-efficient survey design and associated decision cut-off, we selected all designs that allowed for adequate decision-making. Then, we chose the survey design that resulted in the lowest total survey cost (C_tot) and required a maximum of 100 children per school (a reasonable maximum size of individuals in a school).

Sensitivity analysis

We assessed the impact of several critical parameters on the estimated cost-efficiency of different survey designs. First, we explored the impact of assuming that variation between individuals within schools is governed by a fixed aggregation parameter k_k in contrast to letting it vary as a linear function of the mean EPG in a school. Second, we assessed the impact of considering higher inter-individual variability in egg counts (k_k) in (post-) control scenarios due to incomplete deworming coverage compared to this variability in the main analysis (assumed to be as observed in pre-control settings). Therefore, we set k_k to 2/3 of the value in the main analysis. Third, because diagnostic performance impacts survey design [7,19], we evaluated the impact of KK specificity, assuming 99.5% specificity instead of 100% in the main analysis. Finally, to assess the impact of stricter choices about the maximum allowed probability of making incorrect decisions, we set the risk of undertreating (E_undertreat) to 0.025 instead of 0.05 in the main analysis. As a second step, we also decreased the risk of overtreating (E_overtreat) from 0.25 to 0.1.

Results

Cost-efficient survey design for stopping PC

Fig 1 illustrates the required number of children per school (n_children) and the total survey cost (C_tot) as a function of the number of sampled schools (n_schools) to reliably stop PC for the different survey designs for each of the three STH species separately. The panels on n_children (Fig 1A, 1C and 1E) highlight three important aspects. First, fewer children per school are required when more schools are included in the survey. Second, preparing more smears per sample and collecting more stools per child further reduces the number of children per school. For example, when making program decisions for Ascaris infections and sampling 5 schools (Fig 1A), 88 children per school are required for a KK_1×1 survey design, while this number reduces to 64, 56, and 52 when deploying KK_1×2, KK_2×1 and KK_2×2 survey designs, respectively. Third, the minimum required size of the surveys varies across the three STH species. For instance, when sampling 5 schools and deploying a KK_1×1 survey design, 88 children per school are required for Ascaris infections (Fig 1A), while this is 126 for hookworm infections (Fig 1C) and 80 for Trichuris (Fig 1E).

Download:

Fig 1. The identification of the most cost-efficient survey design to reliably stop preventive chemotherapy.

This figure illustrates the required number of children per school (n_children; Panels A, C and E) and the corresponding total survey cost (C_tot; Panels B, D and F) as a function of the number of sampled schools (n_schools) for different survey designs and soil-transmitted helminths (Ascaris: Panels A and B; hookworm: Panels C and D; Trichuris: Panels E and F). The survey designs (KK_a×b) varied in the number of stool samples per child (= a) and the number of Kato-Katz thick smears per sample (= b). The black bullet point in Panels B, D and F indicates the most cost-efficient survey design. In other words, the number of schools that minimizes the costs while ensuring reliable decision-making. Note that we assumed that the maximum number of children per school could not exceed 100 (indicated by a horizontal dotted line).

https://doi.org/10.1371/journal.pntd.0011160.g001

When focusing on the panels representing the total cost C_tot (Fig 1B, 1D and 1F), two additional aspects become apparent. Survey designs involving a second stool sample (KK_2×1 and KK_2×2) are more financially demanding, even though fewer children are required to be sampled. Re-taking the aforementioned example (making program decisions for Ascaris infections and sampling 5 schools), the total survey costs for KK_1×1 survey design equals 2,653 US$ (n_children = 88), while survey costs are up to 3,781 US$ when deploying a KK_2×2 survey design (n_children = 52). Second, after an initial drop, the total survey costs further increase as a function of number of schools (for KK_1×1 and KK_1×2 survey designs across all STH species). In other words, there is an optimal number of schools that minimizes the costs while ensuring reliable decision-making.

Combining all these aspects and considering that some schools do not have more than 100 children, KK_1×2 is the most cost-efficient of all feasible survey designs for all three STH species, but the difference with KK_1×1 is modest. However, the required sample size (n_schools×n_children) and the total survey costs varies across the 3 STH species (Ascaris: 5 x 64, 2,465 US$ (Fig 1B); hookworm: 6 x 66, 2,983 US$ (Fig 1D); Trichuris: 4 x 70, 2,022 US$ (Fig 1F)).

In Table 3, we explored the impact of assumptions about inter-individual variation in EPG and the specificity of KK on what is the optimal survey design (n_schools x n_children) for the different STH species separately. This table indicates three important patterns when considering Ascaris. First, compared to an aggregation of infections within children (k_k), varying as a function of school mean EPG (5 x 64), fixing k_k (= 1.75) resulted in a smaller sample size (3 x 90) and a reduction of the total survey costs of 11.5% (= 2,181 US$/ 2,465 US$). Second, when assuming a post-control k_k (= 2/3 x varying k_k) resulted in slight increase in both sample size (5 x 68) and total survey costs (1.7% = 2,507 US$/ 2,465 US$). Finally, a reduced clinical specificity (= 99.5%) increased the sample size from 5 x 64 to 7 x 62, requiring 38.8% more funds. These patterns were very similar for the other species (Table 3).

Download:

Table 3. The impact of alternative model assumptions on both the required sample size and the total survey costs to reliably stop preventive chemotherapy.

This table presents the sample size (n_schools×n_children), the decision cut-off c and the associated total survey costs (C_tot) for different scenarios of parameterizing the aggregation of infections within children (k_k), the clinical specificity of Kato-Katz thick smear and the maximum allowed risk of incorrect decision-making for the different soil-transmitted helminths species separately. As a reference we assumed that k_k varies as a function of school mean eggs per gram of stool (EPG) and that Kato-Katz thick smears has a perfect specificity. We allowed for a risk of undertreatment (E_undertreat) equal to 0.05 and risk of overtreatment (E_overtreat) equal to 0.25. Also, the fixed aggregation parameter (Fixed k_k), which captures the variation between individuals within schools, was 0.326 for Ascaris, 0.257 for hookworm, and 0.532 for Trichuris [6]. A lower value of k_k (Lower k_k) means higher inter-individual variation in EPG values, assumed to be 2/3 of k_k in the main analysis.

https://doi.org/10.1371/journal.pntd.0011160.t003

We also verified the additional survey costs to further minimize the probability of over- and undertreatment (Table 3). Obviously, further minimizing the risk of undertreatment (E_undertreat) and overtreatment (E_overtreat) increases the sample size and hence the total survey cost, but not extremely. When we reduce the maximum allowed risk of undertreatment from 0.05 to 0.025, the total survey costs increase by 24% (3,058 US$ vs. 2,465 US$). When we also reduce the risk of undertreatment from 0.25 to 0.10, the sample size further increases to 78.5% (4,400 US$ vs. 2,465 US$). Again, we observed similar patterns for the other two species (Table 3).

Cost-efficient survey design to declare elimination of STH as a public health problem

After having assessed study designs and decision cut-offs for stopping PC, we now turn to study designs for declaring elimination of STH as a public health problem (Table 4; S1 Fig). Compared to the most cost-effective survey designs for stopping PC, two important differences can be noted. First, the KK_1×1 rather than KK_1×2 survey design is the most cost-efficient choice. Second, the required sample size (n_schools×n_children) is substantially larger (Ascaris: 11 x 84 vs. 5 x 64; hookworm: 25 x 52 vs. 6 x 66; Trichuris: 19 x 68 vs. 4 x 70). Compared to the total survey costs to reliably stop PC, the cost of surveys to reliably declare EPHP are 2.3 (Ascaris) to 4.6 (Trichuris) times higher.

Download:

Table 4. The cost-efficient survey design to declare elimination of soil-transmitted helminths as a public health problem.

This table represents the required sample size (n_schools×n_children), the decision cut-off c and the total survey costs (C_tot) for four different survey designs (KK_a×b) that vary in the number of stool samples per child (= a) and the number of Kato-Katz thick smears per sample (= b).

https://doi.org/10.1371/journal.pntd.0011160.t004

We also explored the impact of the assumptions made on the parameterization of the aggregation in infections between children (k_k), the clinical specificity and the allowed risk for both over- and undertreatment on the sample size (n_schools×n_children) and the total survey cost. Not unexpectedly, we observed similar trends as for reliably stopping PC, and hence we refer to S1 Table for more details.

Discussion

We have demonstrated that the current WHO guidelines to M&E STH control programs may not guarantee reliable decision-making for all program targets and STH species. Based on our results, we rather recommend deploying a duplicate KK on one stool when making decisions to stop PC, deploying a single KK on one stool sample when the aim is to verify whether STH has been eliminated as a public health problem. This difference in survey design is in line with other researchers’ findings [13] and can be explained by the fact that examining multiple KK smears increases the sensitivity [8,13,20,21] but generally does not affect estimates of the mean intensity of infection [8,13,20,22]. Also, collecting samples on two consecutive days (KK_2×1 and KK_2×2) was not cost-efficient, because it requires more funds. In addition, as the required sample size varies across STH species (due to differences in fecundity and aggregation of infections; see Table 1), it will be important to ensure sufficient number of schools and children per school to arrive at reliable decision-making for all STHs present in the surveyed implementation unit. In other words, the sample size is dictated by the STH species that requires the largest number of schools and children. This means that in an area where all three STH are present, the sample size to reliably stop PC is dictated by hookworms (6 schools and 66 children per school; see Table 3). Note that STH-specific decision cut-offs vary across sample size, and hence they will need to be adapted accordingly. In S2 and S3 Tables, we therefore provide the required sample size and the corresponding STH-specific decision cut-offs for areas where more than STH species are considered for decision-making.

We showed that the aggregation of infections within children (k_k) varies as a function of school mean EPG (see S1 Info), which is in agreement with a recent analysis of the TUMIKIA data. Indeed, this analysis showed that if not considered properly, it leads to poor decision-making due to smaller-than-required sample sizes [23]. Furthermore, the impact of reduced clinical specificity (resulting in increased sample size and total survey cost) was in line with previous work [7], highlighting the need for highly specific diagnostic methods when targeting low-intensity infections settings [24–26].

Minimizing the risk of making incorrect program decisions (risk of overtreatment and undertreatment) is more financially demanding when targeting stopping PC. However, by improving decision-making, one will also save substantial costs due to unnecessarily distributing tablets or re-establishing the PC program, this is in particular when a decision to stop PC is made. For decisions on elimination as a public health problem direct consequences are minimal. Future research is needed to further explore the optimal trade-off between the additional survey costs to have more reliable decision-making and the cost due to unnecessarily distributing tablets or re-establishing the PC program. Future research is also needed to assess the appropriateness of the WHO-recommended thresholds for STH policy using transmission models.

The LQAS approach in this simulation study has also been used for population-based decision-making in schistosomiasis [27] and trachoma [28] control programs. Conversely, another approach is the model-based geostatistical methods for M&E of STH, and other NTDs [29,30]. This model-based geostatistical approach allows estimating the prevalence for decision-making with sufficient spatial resolution. Yet, compared to the LQAS method, this alternative approach adoption required additional expertise in geostatistical analysis [7,30].

Conclusion

We confirm that KK is valuable for M&E of STH in low-endemicity infections settings, but the current WHO-recommended survey design may not guarantee reliable decision-making to stop PC, and especially not for declaring EPHP. We, therefore, provide cost-efficient alternative survey designs.

Supporting information

S1 Info. Quantification of between and within school variation in faecal egg counts.

https://doi.org/10.1371/journal.pntd.0011160.s001

(DOCX)

S2 Info. The mathematical backbone of the simulation framework.

https://doi.org/10.1371/journal.pntd.0011160.s002

(DOCX)

S3 Info. Estimation of total survey cost to monitor and evaluate STH when using Kato-Katz thick smear.

https://doi.org/10.1371/journal.pntd.0011160.s003

(DOCX)

S1 Fig. The identification of the most cost-efficient survey design to reliably declare elimination of soil-transmitted helminths as a public health problem.

This figure illustrates the required number of children per school (n_children; Panels A, C and E) and the corresponding total survey cost (C_tot; Panels B, D and F) as a function of the number of sampled schools (n_schools) for different survey designs and soil-transmitted helminths (Ascaris: Panels A and B; hookworm: Panels C and D; Trichuris: Panels E and F). The survey designs (KK_a×b) varied in the number of stool samples per child (= a) and the number of Kato-Katz thick smears per sample (= b). The black bullet point in Panels B, D and F indicates the most cost-efficient survey design. In other words, the number of schools that minimizes the costs while ensuring reliable decision-making. Note that we assumed that the maximum number of children per school could not exceed 100.

https://doi.org/10.1371/journal.pntd.0011160.s004

(TIF)

S1 Table. The impact of the model assumptions on both the required sample size and the total survey costs to reliably declare elimination of soil-transmitted helminths as a public health problem.

This table presents the sample size (n_schools x n_children), the decision cut-off c and the associated total survey costs (C_tot) for different scenarios of parameterizing the aggregation of infections within children (k_k), the clinical specificity of Kato-Katz thick smear and the maximum allowed risk of incorrect decision-making for the different soil-transmitted helminths species separately. As a reference we assumed that k_k varies as a function of school mean eggs per gram of stool (EPG) and that Kato-Katz thick smears has a perfect specificity. We allowed for a risk of undertreatment (E_undertreat) equal to 0.05 and risk of overtreatment (E_overtreat) equal to 0.25. In addition, the fixed aggregation parameter (Fixed k_k), indicating the variation between individuals within schools was 0.326 for Ascaris, 0.257 for hookworm, and 0.532 for Trichuris [6]. A lower value of k_k (Lower k_k) means higher inter-individual variation in EPG values, assumed to be 2/3 of k_k in the main analysis.

https://doi.org/10.1371/journal.pntd.0011160.s005

(DOCX)

S2 Table. The recommended sample size and corresponding soil-transmitted helminth specific decision cut-off for reliably stopping preventive chemotherapy based on predominant helminth species within an implementation unit.

This table summarizes the required sample size (n_schools x n_children) and the corresponding cut-off c (maximum number of positive individuals) across different scenarios of mono and mixed soil-transmitted helminths (STH) infections. This table only applies to surveys that perform a duplicate Kato-Katz thick smear on a single stool sample.

https://doi.org/10.1371/journal.pntd.0011160.s006

(DOCX)

S3 Table. The recommended sample size and corresponding soil-transmitted helminth specific decision cut-off for reliably declaring elimination as a public health problem based on predominant helminth species within an implementation unit.

This table summarizes the required sample size (n_schools x n_children) and the corresponding cut-off c (maximum number of positive individuals) across different scenarios of mono and mixed infections soil-transmitted helminth (STH) infections. This table only applies to surveys that perform a single Kato-Katz thick smear on a single stool sample.

https://doi.org/10.1371/journal.pntd.0011160.s007

(DOCX)

References

1. World Health Organization. Ending the neglect to attain the Sustainable Development Goals: A road map for neglected tropical diseases 2021–2030. In: World Health Organization [Internet]. 2021 [cited 10 Feb 2022]. Available: https://www.who.int/publications/i/item/9789240010352
2. World Health Organization. 2030 targets for soil-transmitted helminthiases control programmes. World Health Organization; 2020 [cited 15 Mar 2022]. Available: https://apps.who.int/iris/handle/10665/330611
3. World Health Organization. Helminth control in school-age children: a guide for managers of control programmes / A. Montresor… [et al.]. 2002 [cited 26 Apr 2023]. Available: https://apps.who.int/iris/handle/10665/42473
4. World Health Organization. Preventive chemotherapy in human helminthiasis: coordinated use of anthelminthic drugs in control interventions: a manual for health professionals and programme managers. 2006 [cited 26 Apr 2023]. Available: https://apps.who.int/iris/handle/10665/43545
5. World Health Organization. Helminth control in school-age children: a guide for managers of control programmes. 2011 [cited 26 Apr 2023]. Available: https://apps.who.int/iris/handle/10665/44671
6. Coffeng LE, Vlaminck J, Cools P, Denwood M, Albonico M, Ame SM, et al. A general framework to support cost-efficient fecal egg count method and study design choices for large-scale STH deworming programs–monitoring of therapeutic drug efficacy as a case study. PLoS Negl Trop Dis. 2023. Forthcoming
- View Article
- Google Scholar
7. Kazienga A, Coffeng LE, de Vlas SJ, Levecke B. Two-stage lot quality assurance sampling framework for monitoring and evaluation of neglected tropical diseases, allowing for imperfect diagnostics and spatial heterogeneity. PLoS Negl Trop Dis. 2022;16: e0010353. pmid:35394996
- View Article
- PubMed/NCBI
- Google Scholar
8. Cools P, Vlaminck J, Albonico M, Ame S, Ayana M, José Antonio BP, et al. Diagnostic performance of a single and duplicate Kato-Katz, Mini-FLOTAC, FECPAKG2 and qPCR for the detection and quantification of soil-transmitted helminths in three endemic countries. PLoS Negl Trop Dis. 2019;13: e0007446. pmid:31369558
- View Article
- PubMed/NCBI
- Google Scholar
9. Khurana S, Sethi S. Laboratory diagnosis of soil transmitted helminthiasis. Trop Parasitol. 2017;7: 86. pmid:29114485
- View Article
- PubMed/NCBI
- Google Scholar
10. Niguse AF, Hailu T, Alemu M, Nibret E, Amor A, Munshea A. Evaluating the Performance of Diagnostic methods for soil transmitted helminths in the Amhara National Regional State, Northwest Ethiopia. BMC Infect Dis. 2020.
- View Article
- Google Scholar
11. Dunn JC, Papaiakovou M, Han KT, Chooneea D, Bettis AA, Wyine NY, et al. The increased sensitivity of qPCR in comparison to Kato-Katz is required for the accurate assessment of the prevalence of soil-transmitted helminth infection in settings that have received multiple rounds of mass drug administration. Parasit Vectors. 2020;13: 1–11.
- View Article
- Google Scholar
12. De Vlas SJ, Gryseels B. Underestimation of Schistosoma mansoni prevalences. Parasitol Today. 1992;8: 274–277. pmid:15463638
- View Article
- PubMed/NCBI
- Google Scholar
13. Coffeng LE, Malizia V, Vegvari C, Cools P, Halliday KE, Levecke B, et al. Impact of different sampling schemes for decision making in soil-transmitted helminthiasis control programs. J Infect Dis. 2020;221: S531–S538. pmid:31829425
- View Article
- PubMed/NCBI
- Google Scholar
14. Leta GT, Mekete K, Wuletaw Y, Gebretsadik A, Sime H, Mekasha S, et al. National mapping of soil-transmitted helminth and schistosome infections in Ethiopia. Parasit Vectors. 2020;13: 1–13.
- View Article
- Google Scholar
15. Coffeng LE, Levecke B, Hattendorf J, Walker M, Denwood MJ. Survey design to monitor drug efficacy for the control of soil-transmitted helminthiasis and schistosomiasis. Clin Infect Dis. 2021;72: S195–S202. pmid:33906226
- View Article
- PubMed/NCBI
- Google Scholar
16. Denwood MJ, Love S, Innocent GT, Matthews L, McKendrick IJ, Hillary N, et al. Quantifying the sources of variability in equine faecal egg counts: implications for improving the utility of the method. Vet Parasitol. 2012;188: 120–126. pmid:22469484
- View Article
- PubMed/NCBI
- Google Scholar
17. Speich B, Ali SM, Ame SM, Albonico M, Utzinger J, Keiser J. Quality control in the diagnosis of Trichuris trichiura and Ascaris lumbricoides using the Kato-Katz technique: experience from three randomised controlled trials. Parasit Vectors. 2015;8: 1–8.
- View Article
- Google Scholar
18. Knopp S, Salim N, Schindler T, Voules DAK, Rothen J, Lweno O, et al. Diagnostic accuracy of Kato–Katz, FLOTAC, Baermann, and PCR methods for the detection of light-intensity hookworm and Strongyloides stercoralis infections in Tanzania. Am J Trop Med Hyg. 2014;90: 535. pmid:24445211
- View Article
- PubMed/NCBI
- Google Scholar
19. Levecke B, Coffeng LE, Hanna C, Pullan RL, Gass KM. Assessment of the required performance and the development of corresponding program decision rules for neglected tropical diseases diagnostic tests: Monitoring and evaluation of soil-transmitted helminthiasis control programs as a case study. PLoS Negl Trop Dis. 2021;15: e0009740. pmid:34520474
- View Article
- PubMed/NCBI
- Google Scholar
20. Moser W, Bärenbold O, Mirams GJ, Cools P, Vlaminck J, Ali SM, et al. Diagnostic comparison between FECPAKG2 and the Kato-Katz method for analyzing soil-transmitted helminth eggs in stool. PLoS Negl Trop Dis. 2018;12: e0006562. pmid:29864132
- View Article
- PubMed/NCBI
- Google Scholar
21. Nikolay B, Brooker SJ, Pullan RL. Sensitivity of diagnostic tests for human soil-transmitted helminth infections: a meta-analysis in the absence of a true gold standard. Int J Parasitol. 2014;44: 765–774. pmid:24992655
- View Article
- PubMed/NCBI
- Google Scholar
22. Levecke B, Brooker SJ, Knopp S, Steinmann P, Sousa-Figueiredo JC, Stothard JR, et al. Effect of sampling and diagnostic effort on the assessment of schistosomiasis and soil-transmitted helminthiasis and drug efficacy: a meta-analysis of six drug efficacy trials and one epidemiological survey. Parasitology. 2014;141: 1826–1840. pmid:24725546
- View Article
- PubMed/NCBI
- Google Scholar
23. Truscott JE, Ower AK, Werkman M, Halliday K, Oswald WE, Gichuki PM, et al. Heterogeneity in transmission parameters of hookworm infection within the baseline data from the TUMIKIA study in Kenya. Parasit Vectors. 2019;12: 1–13.
- View Article
- Google Scholar
24. Diagnostic target product profiles for monitoring, evaluation and surveillance of schistosomiasis control programmes. [cited 11 Oct 2021]. Available: https://www.who.int/publications/i/item/9789240031104
25. Stuyver LJ, Levecke B. The role of diagnostic technologies to measure progress toward WHO 2030 targets for soil-transmitted helminth control programs. PLoS Negl Trop Dis. 2021;15: e0009422. pmid:34081694
- View Article
- PubMed/NCBI
- Google Scholar
26. Lim MD, Brooker SJ, Belizario VY, Gay-Andrieu F, Gilleard J, Levecke B, et al. Diagnostic tools for soil-transmitted helminths control and elimination programs: A pathway for diagnostic product development. PLoS Negl Trop Dis. 2018;12. pmid:29494581
- View Article
- PubMed/NCBI
- Google Scholar
27. Olives C, Valadez JJ, Brooker SJ, Pagano M. Multiple category-lot quality assurance sampling: a new classification system with application to schistosomiasis control. PLoS Negl Trop Dis. 2012;6: e1806. pmid:22970333
- View Article
- PubMed/NCBI
- Google Scholar
28. Myatt M, Mai NP, Quynh NQ, Nga NH, Tai HH, Long NH, et al. Using lot quality-assurance sampling and area sampling to identify priority areas for trachoma control: Viet Nam. Bull World Health Organ. 2005;83: 756–763. pmid:16283052
- View Article
- PubMed/NCBI
- Google Scholar
29. Diggle PJ, Amoah B, Fronterre C, Giorgi E, Johnson O. Rethinking neglected tropical disease prevalence survey design and analysis: a geospatial paradigm. Trans R Soc Trop Med Hyg. 2021;115: 208–210. pmid:33587142
- View Article
- PubMed/NCBI
- Google Scholar
30. Johnson O, Fronterre C, Amoah B, Montresor A, Giorgi E, Midzi N, et al. Model-based geostatistical methods enable efficient design and analysis of prevalence surveys for soil-transmitted helminth infection and other neglected tropical diseases. Clin Infect Dis. 2021;72: S172–S179. pmid:33905476
- View Article
- PubMed/NCBI
- Google Scholar

[ref1] 1. World Health Organization. Ending the neglect to attain the Sustainable Development Goals: A road map for neglected tropical diseases 2021–2030. In: World Health Organization [Internet]. 2021 [cited 10 Feb 2022]. Available: https://www.who.int/publications/i/item/9789240010352

[ref2] 2. World Health Organization. 2030 targets for soil-transmitted helminthiases control programmes. World Health Organization; 2020 [cited 15 Mar 2022]. Available: https://apps.who.int/iris/handle/10665/330611

[ref3] 3. World Health Organization. Helminth control in school-age children: a guide for managers of control programmes / A. Montresor… [et al.]. 2002 [cited 26 Apr 2023]. Available: https://apps.who.int/iris/handle/10665/42473

[ref4] 4. World Health Organization. Preventive chemotherapy in human helminthiasis: coordinated use of anthelminthic drugs in control interventions: a manual for health professionals and programme managers. 2006 [cited 26 Apr 2023]. Available: https://apps.who.int/iris/handle/10665/43545

[ref5] 5. World Health Organization. Helminth control in school-age children: a guide for managers of control programmes. 2011 [cited 26 Apr 2023]. Available: https://apps.who.int/iris/handle/10665/44671

[ref6] 6. Coffeng LE, Vlaminck J, Cools P, Denwood M, Albonico M, Ame SM, et al. A general framework to support cost-efficient fecal egg count method and study design choices for large-scale STH deworming programs–monitoring of therapeutic drug efficacy as a case study. PLoS Negl Trop Dis. 2023. Forthcoming
View Article
Google Scholar

[7] View Article

[8] Google Scholar

[ref7] 7. Kazienga A, Coffeng LE, de Vlas SJ, Levecke B. Two-stage lot quality assurance sampling framework for monitoring and evaluation of neglected tropical diseases, allowing for imperfect diagnostics and spatial heterogeneity. PLoS Negl Trop Dis. 2022;16: e0010353. pmid:35394996
View Article
PubMed/NCBI
Google Scholar

[10] View Article

[11] PubMed/NCBI

[12] Google Scholar

[ref8] 8. Cools P, Vlaminck J, Albonico M, Ame S, Ayana M, José Antonio BP, et al. Diagnostic performance of a single and duplicate Kato-Katz, Mini-FLOTAC, FECPAKG2 and qPCR for the detection and quantification of soil-transmitted helminths in three endemic countries. PLoS Negl Trop Dis. 2019;13: e0007446. pmid:31369558
View Article
PubMed/NCBI
Google Scholar

[14] View Article

[15] PubMed/NCBI

[16] Google Scholar

[ref9] 9. Khurana S, Sethi S. Laboratory diagnosis of soil transmitted helminthiasis. Trop Parasitol. 2017;7: 86. pmid:29114485
View Article
PubMed/NCBI
Google Scholar

[18] View Article

[19] PubMed/NCBI

[20] Google Scholar

[ref10] 10. Niguse AF, Hailu T, Alemu M, Nibret E, Amor A, Munshea A. Evaluating the Performance of Diagnostic methods for soil transmitted helminths in the Amhara National Regional State, Northwest Ethiopia. BMC Infect Dis. 2020.
View Article
Google Scholar

[22] View Article

[23] Google Scholar

[ref11] 11. Dunn JC, Papaiakovou M, Han KT, Chooneea D, Bettis AA, Wyine NY, et al. The increased sensitivity of qPCR in comparison to Kato-Katz is required for the accurate assessment of the prevalence of soil-transmitted helminth infection in settings that have received multiple rounds of mass drug administration. Parasit Vectors. 2020;13: 1–11.
View Article
Google Scholar

[25] View Article

[26] Google Scholar

[ref12] 12. De Vlas SJ, Gryseels B. Underestimation of Schistosoma mansoni prevalences. Parasitol Today. 1992;8: 274–277. pmid:15463638
View Article
PubMed/NCBI
Google Scholar

[28] View Article

[29] PubMed/NCBI

[30] Google Scholar

[ref13] 13. Coffeng LE, Malizia V, Vegvari C, Cools P, Halliday KE, Levecke B, et al. Impact of different sampling schemes for decision making in soil-transmitted helminthiasis control programs. J Infect Dis. 2020;221: S531–S538. pmid:31829425
View Article
PubMed/NCBI
Google Scholar

[32] View Article

[33] PubMed/NCBI

[34] Google Scholar

[ref14] 14. Leta GT, Mekete K, Wuletaw Y, Gebretsadik A, Sime H, Mekasha S, et al. National mapping of soil-transmitted helminth and schistosome infections in Ethiopia. Parasit Vectors. 2020;13: 1–13.
View Article
Google Scholar

[36] View Article

[37] Google Scholar

[ref15] 15. Coffeng LE, Levecke B, Hattendorf J, Walker M, Denwood MJ. Survey design to monitor drug efficacy for the control of soil-transmitted helminthiasis and schistosomiasis. Clin Infect Dis. 2021;72: S195–S202. pmid:33906226
View Article
PubMed/NCBI
Google Scholar

[39] View Article

[40] PubMed/NCBI

[41] Google Scholar

[ref16] 16. Denwood MJ, Love S, Innocent GT, Matthews L, McKendrick IJ, Hillary N, et al. Quantifying the sources of variability in equine faecal egg counts: implications for improving the utility of the method. Vet Parasitol. 2012;188: 120–126. pmid:22469484
View Article
PubMed/NCBI
Google Scholar

[43] View Article

[44] PubMed/NCBI

[45] Google Scholar

[ref17] 17. Speich B, Ali SM, Ame SM, Albonico M, Utzinger J, Keiser J. Quality control in the diagnosis of Trichuris trichiura and Ascaris lumbricoides using the Kato-Katz technique: experience from three randomised controlled trials. Parasit Vectors. 2015;8: 1–8.
View Article
Google Scholar

[47] View Article

[48] Google Scholar

[ref18] 18. Knopp S, Salim N, Schindler T, Voules DAK, Rothen J, Lweno O, et al. Diagnostic accuracy of Kato–Katz, FLOTAC, Baermann, and PCR methods for the detection of light-intensity hookworm and Strongyloides stercoralis infections in Tanzania. Am J Trop Med Hyg. 2014;90: 535. pmid:24445211
View Article
PubMed/NCBI
Google Scholar

[50] View Article

[51] PubMed/NCBI

[52] Google Scholar

[ref19] 19. Levecke B, Coffeng LE, Hanna C, Pullan RL, Gass KM. Assessment of the required performance and the development of corresponding program decision rules for neglected tropical diseases diagnostic tests: Monitoring and evaluation of soil-transmitted helminthiasis control programs as a case study. PLoS Negl Trop Dis. 2021;15: e0009740. pmid:34520474
View Article
PubMed/NCBI
Google Scholar

[54] View Article

[55] PubMed/NCBI

[56] Google Scholar

[ref20] 20. Moser W, Bärenbold O, Mirams GJ, Cools P, Vlaminck J, Ali SM, et al. Diagnostic comparison between FECPAKG2 and the Kato-Katz method for analyzing soil-transmitted helminth eggs in stool. PLoS Negl Trop Dis. 2018;12: e0006562. pmid:29864132
View Article
PubMed/NCBI
Google Scholar

[58] View Article

[59] PubMed/NCBI

[60] Google Scholar

[ref21] 21. Nikolay B, Brooker SJ, Pullan RL. Sensitivity of diagnostic tests for human soil-transmitted helminth infections: a meta-analysis in the absence of a true gold standard. Int J Parasitol. 2014;44: 765–774. pmid:24992655
View Article
PubMed/NCBI
Google Scholar

[62] View Article

[63] PubMed/NCBI

[64] Google Scholar

[ref22] 22. Levecke B, Brooker SJ, Knopp S, Steinmann P, Sousa-Figueiredo JC, Stothard JR, et al. Effect of sampling and diagnostic effort on the assessment of schistosomiasis and soil-transmitted helminthiasis and drug efficacy: a meta-analysis of six drug efficacy trials and one epidemiological survey. Parasitology. 2014;141: 1826–1840. pmid:24725546
View Article
PubMed/NCBI
Google Scholar

[66] View Article

[67] PubMed/NCBI

[68] Google Scholar

[ref23] 23. Truscott JE, Ower AK, Werkman M, Halliday K, Oswald WE, Gichuki PM, et al. Heterogeneity in transmission parameters of hookworm infection within the baseline data from the TUMIKIA study in Kenya. Parasit Vectors. 2019;12: 1–13.
View Article
Google Scholar

[70] View Article

[71] Google Scholar

[ref24] 24. Diagnostic target product profiles for monitoring, evaluation and surveillance of schistosomiasis control programmes. [cited 11 Oct 2021]. Available: https://www.who.int/publications/i/item/9789240031104

[ref25] 25. Stuyver LJ, Levecke B. The role of diagnostic technologies to measure progress toward WHO 2030 targets for soil-transmitted helminth control programs. PLoS Negl Trop Dis. 2021;15: e0009422. pmid:34081694
View Article
PubMed/NCBI
Google Scholar

[74] View Article

[75] PubMed/NCBI

[76] Google Scholar

[ref26] 26. Lim MD, Brooker SJ, Belizario VY, Gay-Andrieu F, Gilleard J, Levecke B, et al. Diagnostic tools for soil-transmitted helminths control and elimination programs: A pathway for diagnostic product development. PLoS Negl Trop Dis. 2018;12. pmid:29494581
View Article
PubMed/NCBI
Google Scholar

[78] View Article

[79] PubMed/NCBI

[80] Google Scholar

[ref27] 27. Olives C, Valadez JJ, Brooker SJ, Pagano M. Multiple category-lot quality assurance sampling: a new classification system with application to schistosomiasis control. PLoS Negl Trop Dis. 2012;6: e1806. pmid:22970333
View Article
PubMed/NCBI
Google Scholar

[82] View Article

[83] PubMed/NCBI

[84] Google Scholar

[ref28] 28. Myatt M, Mai NP, Quynh NQ, Nga NH, Tai HH, Long NH, et al. Using lot quality-assurance sampling and area sampling to identify priority areas for trachoma control: Viet Nam. Bull World Health Organ. 2005;83: 756–763. pmid:16283052
View Article
PubMed/NCBI
Google Scholar

[86] View Article

[87] PubMed/NCBI

[88] Google Scholar

[ref29] 29. Diggle PJ, Amoah B, Fronterre C, Giorgi E, Johnson O. Rethinking neglected tropical disease prevalence survey design and analysis: a geospatial paradigm. Trans R Soc Trop Med Hyg. 2021;115: 208–210. pmid:33587142
View Article
PubMed/NCBI
Google Scholar

[90] View Article

[91] PubMed/NCBI

[92] Google Scholar

[ref30] 30. Johnson O, Fronterre C, Amoah B, Montresor A, Giorgi E, Midzi N, et al. Model-based geostatistical methods enable efficient design and analysis of prevalence surveys for soil-transmitted helminth infection and other neglected tropical diseases. Clin Infect Dis. 2021;72: S172–S179. pmid:33905476
View Article
PubMed/NCBI
Google Scholar

[94] View Article

[95] PubMed/NCBI

[96] Google Scholar

Figures

Abstract

Background

Methodology

Principal findings

Conclusions/Significance

Author summary

Introduction

Methods

Ethics statement

Overview

Simulation of egg counts for different survey designs

Calculating the probability of under- and overtreatment

Calculating the operational costs and determining the most cost-efficient survey design

Sensitivity analysis

Results

Cost-efficient survey design for stopping PC

Cost-efficient survey design to declare elimination of STH as a public health problem

Discussion

Conclusion

Supporting information

S1 Info. Quantification of between and within school variation in faecal egg counts.

S2 Info. The mathematical backbone of the simulation framework.

S3 Info. Estimation of total survey cost to monitor and evaluate STH when using Kato-Katz thick smear.

S1 Fig. The identification of the most cost-efficient survey design to reliably declare elimination of soil-transmitted helminths as a public health problem.

S1 Table. The impact of the model assumptions on both the required sample size and the total survey costs to reliably declare elimination of soil-transmitted helminths as a public health problem.

S2 Table. The recommended sample size and corresponding soil-transmitted helminth specific decision cut-off for reliably stopping preventive chemotherapy based on predominant helminth species within an implementation unit.

S3 Table. The recommended sample size and corresponding soil-transmitted helminth specific decision cut-off for reliably declaring elimination as a public health problem based on predominant helminth species within an implementation unit.

References