Advertisement
  • Loading metrics

Trade-offs between cost and accuracy in active case finding for tuberculosis: A dynamic modelling analysis

Trade-offs between cost and accuracy in active case finding for tuberculosis: A dynamic modelling analysis

  • Lucia Cilloni, 
  • Katharina Kranzer, 
  • Helen R. Stagg, 
  • Nimalan Arinaminpathy
PLOS
x

Abstract

Background

Active case finding (ACF) may be valuable in tuberculosis (TB) control, but questions remain about its optimum implementation in different settings. For example, smear microscopy misses up to half of TB cases, yet is cheap and detects the most infectious TB cases. What, then, is the incremental value of using more sensitive and specific, yet more costly, tests such as Xpert MTB/RIF in ACF in a high-burden setting?

Methods and findings

We constructed a dynamic transmission model of TB, calibrated to be consistent with an urban slum population in India. We applied this model to compare the potential cost and impact of 2 hypothetical approaches following initial symptom screening: (i) ‘moderate accuracy’ testing employing a microscopy-like test (i.e., lower cost but also lower accuracy) for bacteriological confirmation and (ii) ‘high accuracy’ testing employing an Xpert-like test (higher cost but also higher accuracy, while also detecting rifampicin resistance). Results suggest that ACF using a moderate-accuracy test could in fact cost more overall than using a high-accuracy test. Under an illustrative budget of US$20 million in a slum population of 2 million, high-accuracy testing would avert 1.14 (95% credible interval 0.75–1.99, with p = 0.28) cases relative to each case averted by moderate-accuracy testing. Test specificity is a key driver: High-accuracy testing would be significantly more impactful at the 5% significance level, as long as the high-accuracy test has specificity at least 3 percentage points greater than the moderate-accuracy test. Additional factors promoting the impact of high-accuracy testing are that (i) its ability to detect rifampicin resistance can lead to long-term cost savings in second-line treatment and (ii) its higher sensitivity contributes to the overall cases averted by ACF. Amongst the limitations of this study, our cost model has a narrow focus on the commodity costs of testing and treatment; our estimates should not be taken as indicative of the overall cost of ACF. There remains uncertainty about the true specificity of tests such as smear and Xpert-like tests in ACF, relating to the accuracy of the reference standard under such conditions.

Conclusions

Our results suggest that cheaper diagnostics do not necessarily translate to less costly ACF, as any savings from the test cost can be strongly outweighed by factors including false-positive TB treatment, reduced sensitivity, and foregone savings in second-line treatment. In resource-limited settings, it is therefore important to take all of these factors into account when designing cost-effective strategies for ACF.

Author summary

Why was this study done?

  • Active case finding (ACF) is a strategy for reducing the burden of tuberculosis (TB) that aims to identify and treat TB cases in the community, as rapidly as possible.
  • However, because ACF can be very resource-intensive, it is important to understand how best to conduct it, in the most cost-efficient way.
  • Concentrating on the tests used to diagnose TB, we hypothesised that cheaper tests, although less accurate than more costly tests, would be important in bringing down the overall cost of ACF.

What did the researchers do and find?

  • Using a mathematical model of TB in urban slums in India, we simulated the cost and impact of an ACF intervention over the next 15 years.
  • Contrary to our initial hypothesis, we found that the use of cheaper diagnostic tests with lower accuracy can in fact increase, not decrease, the overall cost of ACF.
  • The reason is that the cost of a test can be outweighed by the costs of treatment, specifically false-positive (unnecessary) TB treatment, and second-line treatment for drug-resistant TB; cheaper tests would also have lower impact overall, as a result of their lower sensitivity.

What do these findings mean?

  • Our findings show how cheaper diagnostic tests may represent a false economy in ACF, i.e., leading to larger intervention costs overall, if they are also associated with reduced performance in ruling out TB.
  • Those implementing ACF in resource-limited, high-burden settings should consider all of these factors in their planning, and not just the cost of the test.

Introduction

Tuberculosis (TB) remains a major concern for global health, with 10.4 million incident cases globally in 2017 and approximately 1.3 million deaths [1]. The End TB Strategy calls for a reduction in incidence of 90% by 2035 [2]; to reach this target, it will be necessary to accelerate the rate at which TB cases are diagnosed and initiated on treatment [2]. Active case finding (ACF) is one way of doing so: Modelling suggests that ACF could be cost-effective under certain cost thresholds, particularly over longer (>10 years) time horizons [3] However, direct evidence for the potential impact of such measures in practice is limited [4], including in settings like India, the country with the world’s largest TB burden, which alone has an estimated 26% of the 3.6 million estimated ‘missing cases’ [1].

In response to these challenges, a key component in India’s 2017 National Strategic Plan for TB Elimination is the need to perform intensive, sustained ACF in specific populations such as urban slums, which are known to have a greater TB burden than the general population [5]. In general, ACF in these and other settings employs screening for symptoms suggestive of TB, followed by bacteriological testing. The latter is often performed using molecular tools such as Xpert MTB/RIF (hereafter referred to as ‘Xpert’), a cartridge-based nucleic acid amplification test. More recently developed, the ‘Ultra’ diagnostic platform offers higher sensitivity than Xpert, but at the expense of lower specificity [6]. In the present work, we concentrate on the deployment of Xpert. Key advantages of Xpert are that (i) it is more sensitive than the conventionally used smear microscopy, which can miss up to half of pulmonary TB cases [7] and (ii) it offers detection of rifampicin resistance at the point of TB diagnosis [1,8], thus allowing the timely initiation of second-line treatment. However, those cases detectable through smear microscopy tend to be the most infectious [9], and smear microscopy is considerably cheaper than Xpert. Therefore, the use of smear microscopy may achieve substantial epidemiological impact, at a lower cost.

Could smear-based ACF be more cost-effective than Xpert-based ACF, in settings such as India? What are the benefits of using Xpert in comparison to smear microscopy, and vice versa? Our scope is not simply yield (defined as the proportion of positive cases identified), a major focus of operational research, but also potential epidemiological impact, taking into account the potential transmission implications of ACF. In line with India’s National Strategic Plan, we model case-finding efforts in conditions typical of urban slums using a transmission model combined with a simple costing approach. Building on previous modelling analyses of ACF [10,11], in this work we focus on both the specificity and sensitivity of the diagnostic strategy employed in ACF.

Methods

Transmission model

We developed a dynamic transmission model of TB, illustrated in Fig 1 and described in further technical detail in S1 Text. The model captures key features in the natural history of TB, including asymptomatic but infectious disease, smear status, TB mortality, and spontaneous cure. The model focuses on pulmonary TB and disregards extrapulmonary TB, assuming ACF to focus on the former. Amongst those with TB (indicated by the orange box in Fig 1), we assumed that smear-negative pulmonary TB cases are, on average, 20% as infectious as smear-positive ones [9] (see Table 1 for model parameters). We incorporated ‘passive’ TB service delivery, including the split between public and private sectors that is a major feature of the health system in India [12]. Additionally, the model also distinguishes drug-susceptible TB (DS-TB) and drug-resistant TB (DR-TB), the latter including both rifampicin-resistant and multi-drug-resistant forms of TB. Although DR-TB only accounts for approximately 5% of the TB burden in India, it also consumes a disproportionate amount of the TB budget due to the high cost of second-line treatment [1]. In the model, we account for the delay in recognition of DR-TB as a result of missed opportunities for drug sensitivity testing, as well as the potential impact of Xpert-based ACF in reducing this delay.

thumbnail
Fig 1. Schematic illustration of the model.

The tuberculosis (TB) transmission model distinguishes TB by smear status and by symptom status. Upon developing symptoms, symptomatic individuals seek care through either the private or public sectors (‘passive’ TB services) after a certain delay, estimated to match data in Table 2. Although not shown here for clarity, the model captures these sectors separately, including the lower standard of TB care in the private sector (see S1 Text for full model details). Those successfully diagnosed initiate TB treatment; we assume that 15% of diagnoses in the public sector are conducted with Xpert, the remainder by microscopy. All those lost from the TB care cascade, whether because of missed diagnosis, pre-treatment loss to follow-up, or failed treatment, temporarily disengage from care-seeking, before once again seeking care after a given delay. Compartments shown in orange denote the effect of an active case finding (ACF) intervention on this ‘passive’ system; we assume that ACF consists of initial symptom screening, followed by microbiological confirmation. Meanwhile, the separate compartments on the right represent a subset of the general population that may be detected by the ACF intervention (represented by the orange compartments) because they have TB-like symptoms, but without TB: These may include, for example, individuals with chronic obstructive pulmonary disease, bronchitis, and other lung conditions. They incur a cost to the health system for diagnosis and—if they are mistakenly diagnosed with TB—a cost in false-positive treatment. The number incorrectly identified as having TB is dependent on the specificity of both the screening and confirmatory stages. Finally, at any stage individuals may die of natural causes or of TB (in the diseased compartments) or recover spontaneously. For simplicity, these transitions are not shown in the figure (see S1 Text for full model details).

https://doi.org/10.1371/journal.pmed.1003456.g001

We separately simulated the dynamics of a non-TB symptomatic (NTS) population, i.e., individuals who would be eligible for a TB diagnosis based on the presence of TB-like symptoms, but who do not have TB. This population is necessary for tracking the overall number of diagnostic tests being conducted during the case-finding intervention, as well as the unnecessary treatment of false-positive TB [13].

Model calibration

The model described above was calibrated to annual risk of Mycobacterium tuberculosis infection and prevalence estimates representative of urban slums in India (Table 2). To inform model parameters for symptom onset from asymptomatic stages, and for progression of smear status with developing disease, we drew from a prevalence survey in Chennai [5]. In particular, we calibrated the model to the proportion of prevalent TB cases that are symptomatic and the proportion smear-positive amongst those who had not yet presented for care, stratified by symptom status (Table 2).

Uncertainty was estimated using Latin hypercube sampling to sample model parameters from their respective ranges (10,000 samples) and simulating the model to 2018, as described in S1 Text. Parameter sets were accepted in the sampling if they provided model projections that fell within the calibration target ranges, while the rest were rejected.

Intervention

Using the calibrated model, we simulated an ACF algorithm using symptom screening followed by a confirmatory microbiological test. We assumed that all TB diagnoses through ACF would be microbiologically confirmed, i.e., we assumed that there is no role for presumptive clinical diagnosis in ACF. For the screening stage, we modelled the use of symptom screening, with individuals reporting any symptom suggestive of TB deemed eligible for microbiological confirmation. For the sensitivity and specificity of this approach for TB, we drew from a recent meta-analysis of screening approaches [14]. We also performed sensitivity analyses (described below) under an alternative screening approach: identifying those with prolonged cough, rather than any TB symptom (with prolonged cough screening having higher specificity but lower sensitivity than ‘any TB symptom’).

For the confirmatory test, we distinguished 2 types of strategy: a ‘moderate accuracy’ strategy, using a confirmatory test with performance and cost consistent with smear microscopy, and a ‘high accuracy’ strategy, using a confirmatory test with performance and cost consistent with Xpert (see Table 1 for parameters). The reason for these designations is that—although there exists data from clinical trials on the performance of smear microscopy and Xpert—there is currently little evidence for characteristics such as the specificity of either test in real-world conditions. In particular, test specificity is often assessed against culture as a reference standard and thus does not address how to interpret smear-positive, culture-negative cases that nonetheless show clear signs of having TB [15,16]. We do not address the important question of how reference standards might be improved to meet these challenges. Instead, our analysis casts light on which types of uncertainty are most critical for future studies to address in strategic planning for ACF activities. Consistent with the capabilities of smear microscopy and molecular tests such as Xpert, we assumed that the high-accuracy test can detect rifampicin resistance at the same time as detecting TB, while the moderate-accuracy test cannot. We assumed that all individuals recognised as having rifampicin resistance are immediately initiated on second-line therapy, while those with unrecognised rifampicin resistance are only switched to second-line therapy after failing first-line treatment.

We considered ‘sensitivity’ as the proportion of TB cases that yield a positive microbiological result under a given test, and likewise ‘specificity’ as the proportion of individuals without TB who yield a negative microbiological result. Moreover, we assumed that all smear-positive cases test positive through a smear-like test, and that no smear-negative cases do (i.e., sensitivities of 1 and 0, respectively). This is a simplification for model purposes: We also performed a sensitivity analysis under alternative assumptions, where smear status is associated with a given probability of diagnosis.

We simulated the intervention at different levels of coverage to run from 2020 to 2035, scaled up linearly over the first 4 years (2020–2023), ultimately to screen a given proportion of the population per year. We assumed for simplicity that this proportion is selected at random from the slum population each year. The impact of ACF was measured as the percentage reduction in cumulative incidence between 2020 and 2035. Finally, we calculated the incremental costs of the intervention relative to a baseline of status quo, i.e., current standards of TB care continued indefinitely, without ACF.

Economic evaluation

We focus on the programmatic perspective, i.e., considering only costs borne by the TB programme, and ignoring broader societal costs. The model accounts for ‘passive’ TB services, i.e., those routine services (diagnosis and treatment, both first- and second-line) independent of ACF, and contingent on patients presenting for care. Since these services could be lowered by the rollout of ACF, this will impact the overall incremental costs. Concentrating on programmatic costs, we counted only the costs of diagnosis and treatment in the public sector, and not the private sector. Moreover, new second-line regimens introduced in 2017 present a range of possible costs for DR-TB treatment. However, as the focus of the current study is on ACF, for simplicity we assumed costs and outcomes consistent with currently used regimens (Tables 1 and 3), while performing sensitivity analyses with respect to this assumption. For all unit costs, for simplicity we assumed uncertainty intervals of ±20%.

For the ACF costs, we assumed that all patients identified through ACF are linked to treatment in the public sector. We focused for simplicity on service costs related to the numbers of confirmatory tests and patient-months of first- and second-line treatment incurred by the intervention. In doing so, we are neglecting the ‘intervention costs’ needed to facilitate the delivery of these interventions (e.g., human resources). As discussed below, these are important cost components in any exercise aiming to estimate the full costs of ACF [17]. For the purpose of the present study, however, if these intervention costs are similar for moderate- and high-accuracy testing, they may not substantially impact a comparison in cost between the two.

Finally, we tracked the costs of treating false-positive TB diagnoses, as driven by the imperfect specificity of the screening and diagnostic tools involved, and the low prevalence of TB (<5% amongst those with symptoms, even in urban slums). Unnecessary TB treatment carries heavy societal costs, including avoidable stigma [13], as well as the monetary costs to patients and households (e.g., travel costs) involved in completing a regimen of TB treatment [18]. Such factors are outside the scope of our current study: Here we focus on unnecessary programmatic spending on the treatment of false-positive TB, recognising (as discussed below) that this approach represents only one narrow part of the overall adverse effects of false-positive treatment [13]. All unit costs are provided in Table 3. Overall, we caution that our estimates should not be interpreted as representing the overall cost of any ACF intervention, given that they miss these cost components, as well as the implementation costs described above.

Sensitivity analysis

To test model sensitivity to alternative screening strategies, we first simulated the impact on incidence and incremental costs of using prolonged cough for symptom screening, which has higher specificity and lower sensitivity than the symptom screening strategy used in the main analysis, any symptom suggestive of TB. For additional sensitivity analyses, as a focal model output, we calculated the cumulative cases averted between 2020 and 2035 under an assumed budget of US$20 million, calculating the ratio of cases averted between the high-accuracy and moderate accuracy scenarios. This ratio offers an estimate of the relative cost efficiency of the 2 approaches. We examined model sensitivity to individual parameters by conducting a partial rank correlation between this model output and each of the model inputs listed in Table 1. We additionally evaluated the focal model output under different scenarios: (i) assuming that smear microscopy can detect 25% and 75% of smear-negative and -positive cases, respectively (as opposed to 0% and 100% in the main analysis) and (ii) using alternative scenarios for the burden and management of DR-TB, which can consume a disproportionate share of programmatic spending. We modelled a scenario consistent with Mumbai, which has a substantially higher DR-TB burden than the national average. We also modelled a scenario with the adoption of new, more effective, and less costly second-line regimens.

Planning and execution of methods

At the outset of this analysis, the modelling plan focused on the confirmatory test, assuming the use of ‘any symptom suggestive of TB’ as a screening strategy. Subsequently, our main adjustment to this initial plan was in response to constructive reviewer comments, on the need to better understand the influence of the screening algorithm. In response, we incorporated the additional analysis as described above, on the alternative use of prolonged cough as a screening strategy. Also in response to reviewer comments, we incorporated the additional sensitivity analyses described above, for the alternative scenarios for the burden and management of DR-TB. Our initial modelling plan otherwise underwent no data-driven changes.

Results

Results of model calibration are shown in Fig A in S1 Text. Simulating the ACF interventions, Fig 2 shows model projections for how epidemiological impact varies with coverage (proportion of the slum population screened per year). The higher the proportion of the slum population being screened each year, the greater the reduction in the prevalent pool of infectious TB; the impact shown in Fig 2 is the result of reducing opportunities for transmission in this way, measuring impact as the percentage reduction in cumulative incidence between 2020 and 2035. The figure illustrates that high-accuracy testing would have a greater impact than a moderate-accuracy strategy, at a given level of coverage, as a result of its higher sensitivity. Even with the latter diagnosing the most infectious cases, this difference in impact is robust to parameter uncertainty. Taking the example of 50% coverage, the relative impact of the high- versus moderate-accuracy strategies is 1.16 (95% credible interval 1.11–1.22).

thumbnail
Fig 2. Active case finding (ACF) impact as a function of coverage.

Here we measure impact as the percentage reduction in cumulative incidence between 2020 and 2035, and coverage as the proportion of the slum population being screened per year. We assume for simplicity that a randomly selected proportion of the slum population is selected for screening each year, independent of screening in previous years. An ACF intervention with symptom screening is followed by bacteriological confirmation, using either a smear-like test (red curve) or an Xpert-like test (blue curve). The shaded areas represent the 95% credible intervals. Each of the curves is generated by taking a range of annual screening proportion from 0 (no ACF) to 1 (whole slum population screened for symptoms once a year): The upper endpoints of each curve occur at the upper limit of this range. Overlap between these areas does not imply a lack of significant difference between the interventions, as points in the red and blue areas are correlated. Indeed, the relative impact of the 2 strategies is robust to this parameter uncertainty (see main text).

https://doi.org/10.1371/journal.pmed.1003456.g002

Fig 3 illustrates how impact varies with incremental spending between 2020 and 2035 under the 2 ACF strategies. Here we assume an illustrative slum population of 2 million people, based on the mean population of major cities in India of approximately 10 million, of whom roughly a third live in slums [19] (for smaller or larger cities, incremental spending will be proportional to population size). The vertical dashed line shows the percent of cases that could be averted under an illustrative spend of US$20 million. As noted above, this spend relates only to service costs of ACF, and does not reflect the full implementation costs of ACF. Under this budget, the impact of high-accuracy testing, relative to that of moderate-accuracy testing, is 1.14 (95% credible interval from simulation 0.75–1.99). Overall, therefore, results suggest that high-accuracy testing would not only be more impactful at a given level of coverage (Fig 2), it could—under certain circumstances—also be more cost-efficient.

thumbnail
Fig 3. Active case finding (ACF) impact as a function of incremental programmatic spending, in an assumed slum population of 2 million people.

As in Fig 2, we measure impact as the percent cases averted by ACF. Incremental spending (in millions of US dollars [USD]) is the overall service cost of diagnostics and treatment, relative to a baseline scenario of no ACF, and assuming current conditions continue indefinitely. The vertical dashed line shows an illustrative budget of US$20 million; in spite of using a lower-cost test, a moderate-accuracy strategy is overall less cost-efficient than a high-accuracy one. The shaded areas represent the 95% credible intervals.

https://doi.org/10.1371/journal.pmed.1003456.g003

Fig 4 shows analysis to better resolve these circumstances. Fig 4A shows the most influential model parameters in the relative impact of a high- versus moderate-accuracy test at a budget of US$20 million, highlighting the respective specificities of the 2 tests as the most influential parameters. In particular, the difference in specificity between the 2 tests is an important driver: Fig 4B shows the absolute difference, plotted against relative impact, highlighting that a high-accuracy test would be robustly more cost-efficient than a moderate-accuracy one, as long as it has specificity that is at least 3 percentage points greater.

thumbnail
Fig 4. Sensitivity analysis to identify key model parameters in the relative impact of high- versus moderate-accuracy strategies, under a given budget of US$20 million between 2020 and 2035.

Here, we define relative impact as the ratio of the number of cases averted over this period by a high-accuracy testing strategy relative to a moderate-accuracy one. In Fig 3, this focal model output is estimated to be 1.14 (95% credible interval from simulation 0.75–1.99). (A) Partial rank correlation coefficients of model parameters against relative impact, showing only the 10 highest correlations, and highlighting the test specificities as being the 2 most influential parameters. (B) Association between relative impact and test specificity, showing that rather than individual specificities, it is their absolute difference that matters most for relative impact. All points to the right of the vertical dashed line correspond to a high-accuracy test being more impactful than a moderate-accuracy one; these results suggest that an absolute specificity difference of at least 3 percentage points is sufficient to ensure that a high-accuracy test is more impactful than a moderate-accuracy one. DR-TB, drug-resistant tuberculosis; DS-TB, drug-susceptible tuberculosis; USD, US dollars.

https://doi.org/10.1371/journal.pmed.1003456.g004

Fig 5 illustrates why specificity is a driving factor, as well as identifying additional drivers in the impact of a high-accuracy test. Taking the example of 50% coverage, the figure shows the separate components of incremental cost through time for both diagnostic tests. Fig 5A illustrates that false-positive treatment is by far the largest cost driver of a moderate-accuracy ACF intervention, followed by the cost of second-line treatment. For a high-accuracy test (Fig 5B), major cost drivers are the cost of the test itself, the cost of treating false-positive diagnoses, and the cost of second-line treatment. Two comparisons bear mention. First, the rate of false-positive TB diagnosis is strongly affected by the specificity of the confirmatory test, with a moderate-accuracy test being associated with 350,000 false-positive treatment initiations (95% credible interval 100,000–710,000), compared to 180,000 for high-accuracy testing (95% credible interval 30,000–560,000). Second, the effects of each test on DR-TB incidence plays an important role in cost dynamics: By identifying DR-TB cases early, high-accuracy testing tends to have a stronger impact on reducing DR-TB incidence, thus leading to cost savings in second-line treatment costs, over 15 years.

thumbnail
Fig 5. Breakdown of the incremental ACF service cost, shown here at 50% screening coverage for the 2 ACF algorithms.

(A) Moderate-accuracy testing. The major driver of the incremental cost of moderate-accuracy testing is the treatment of false-positive TB in the non-TB symptomatic population (orange line). (B) High-accuracy testing. Notably, the cost of treatment of false-positive individuals is nearly halved when using an Xpert-like test for diagnosis (orange line). False-positive TB treatment costs and diagnosis costs (red line) are the 2 components that are the main cost drivers for high-accuracy testing. The shaded areas represent the 95% credible intervals. ACF, active case finding; TB, tuberculosis; Tx, treatment; USD, US dollars.

https://doi.org/10.1371/journal.pmed.1003456.g005

Cost drivers are further explored in Fig 6. The role of false-positive TB treatment is illustrated in Fig 6A, which shows how the positive predictive value of the whole diagnostic algorithm (including symptom screening) changes over time under both algorithms. For both scenarios, this value substantially decreases over time as a result of decreasing TB prevalence in the community but remains considerably lower for smear microscopy than for Xpert. Likewise, the role of DR-TB is further illustrated in Fig 6B, which shows the strong DR-TB incidence reductions that would be brought about by a high-accuracy testing strategy over time.

thumbnail
Fig 6. Additional comparisons between testing strategies.

(A) Comparison of the positive predictive value (PPV) of active case finding (ACF) strategies. The panel shows the PPV of the entire diagnostic algorithm (including symptom screening), and not just that of the confirmatory test. Percentages on the right-hand side of the figure (20%, 50%, etc.) show ACF coverage scenarios, i.e., the proportion of the slum population being screened per year. The shaded areas represent the 95% credible intervals. Overall, as tuberculosis (TB) prevalence is reduced over time by ACF, the PPV also decreases. Improved diagnostic algorithms, with improved specificity, may be needed in these advanced stages. (B) Comparison of both testing strategies shown in Fig 3, by their impact on the incidence of drug-resistant TB (DR-TB) over time, at fixed 50% coverage. Because a high-accuracy test is able to diagnose rifampicin resistance at the point of TB diagnosis, it can contribute strongly to long-term reductions in DR-TB incidence, thus also averting future costs of second-line treatment (Fig 5B). A moderate-accuracy strategy also leads to a decline in DR-TB incidence, although to a lesser extent, as individuals with DR-TB are only switched to second-line therapy after failing first-line therapy.

https://doi.org/10.1371/journal.pmed.1003456.g006

The cost efficiency of the overall ACF algorithm can be shaped as much by the choice of screening algorithm as by the choice of confirmatory test. Fig B in S1 Text shows results for incidence and impact under an alternative screening algorithm, using prolonged cough as the eligibility criterion for confirmatory testing, an approach having lower sensitivity and higher specificity (25% and 96%, respectively [14]). At a given level of coverage, such a screening approach would reduce the overall impact of both high- and moderate-accuracy strategies, owing to its lowered sensitivity. As a result of its higher specificity, such an approach also substantially reduces the number of false-positive treatments overall, narrowing this specific advantage of a high-accuracy test. However, under a given budget of US$20 million (as used in Fig 4), a prolonged cough screening algorithm could allow many more people to be screened over time, potentially leading to a greater impact overall (Table A and Fig B in S1 Text) than that shown in Fig 3. In turn, this enhanced impact promotes the long-term effect of the high-accuracy test in averting second-line costs. The overall effect is for the relative impact of the 2 testing strategies at a budget of US$20 million, to remain qualitatively similar to that estimated from Fig 3 above, and indeed shifted in favour of the high-accuracy test.

Finally, we conducted sensitivity analyses. Focusing on the relative impact of the high- versus moderate-accuracy strategies shown in Fig 3, Fig D in S1 Text shows how this focal model output varies under a range of scenarios. The figure illustrates that the essential qualitative results remain under alternative scenarios for the sensitivity of smear microscopy, the burden and management of DR-TB, and the size of the NTS population.

Discussion

ACF is potentially highly impactful, but also highly resource-intensive: Our analysis therefore addresses the critical need to optimise its cost-effectiveness. We used mathematical modelling to examine strategies for microbiological testing in ACF for TB, aiming to identify the type of confirmatory test that would yield the greatest epidemiological impact at the lowest cost.

Findings

We hypothesised that a moderate-accuracy testing strategy, using a relatively cheap test that can nonetheless detect the most infectious cases, may be more cost-efficient (achieving incidence reductions at lower cost) than a high-accuracy strategy. However, our results suggest that the converse is true (Fig 3) wherever lower test cost is associated with reduced specificity. The reasons are 3-fold: (i) small improvements in test specificity can translate to large reductions in unnecessary (false-positive) TB treatments, which outweigh the cost of the test; (ii) a high-accuracy test that can also identify rifampicin resistance can offer long-term savings by reducing the burden of rifampicin-resistant TB (and thus the need for costly second-line treatment); and (iii) a high-accuracy test has a greater impact than a moderate-accuracy test as a result of its higher sensitivity (Figs 24).

We have conservatively designated the confirmatory tests as ‘smear-like’ and ‘Xpert-like’, in recognition that performance data drawn from meta-analyses of clinical trials (Table 1) do not necessarily reflect the numbers of appropriate or erroneous TB treatments that would arise in real-world ACF implementation. In light of this uncertainty, the key conclusion of our analysis is not that one test should be preferred over another, but rather that specificity in field ACF conditions—for any diagnostic test—is a critical data gap to address for future ACF planning. In recent years the availability of molecular diagnostics has rapidly expanded for routine TB services in India [2022]; our findings support the use of similar tests, with equal or higher specificity and the ability to detect rifampicin resistance, in ACF.

Quantifying specificity

We note that quantifying ‘true’ specificity is a complex challenge, partly as the culture reference standard (against which specificity is judged) also has imperfect sensitivity, raising the question of how to interpret smear-positive, culture-negative results, particularly amongst those with strong clinical signs of TB. As initial steps in this direction, future ACF implementation research could aim, for example, to supplement microbiological reference standards with ‘composite’ reference standards that additionally incorporate clinical diagnosis and patient assessment on follow-up, including response to anti-TB treatment. Our results also have implications beyond the particular diagnostic tests being examined here. For example, a new generation of molecular diagnostic test, Xpert Ultra, has higher sensitivity than Xpert, but also lower specificity [6]. Its use in ACF would lead to similarly unacceptable numbers of false-positive TB treatments, as those illustrated in Fig 5A.

Role of screening

Our sensitivity analysis shows that the performance of the screening stage can also play an influential role, although whether this widens or narrows the gap between the 2 diagnostic tests (at a given budget) depends on the relative magnitudes of (i) the reduction in false-positive TB treatments arising from a higher-specificity screening algorithm and (ii) the long-term second-line TB treatment costs that can be averted by a high-accuracy test (Fig C and Table A in S1 Text). In our current work, the overall effect is for our qualitative findings to remain unchanged. Strategies such as X-ray screening (not modelled in the current study) can show greater sensitivity and specificity than symptom screening alone [23], while allowing TB detection amongst those not reporting symptoms. Implementation of X-ray screening is more resource-intensive than symptom screening, but could be facilitated by the use of mobile radiography units [24,25], along with newly emerging technology for automated X-ray reads [26,27]. While the present analysis has focused on confirmatory tests, a more systematic exploration of these and other screening strategies will be an important area for future work.

The patient perspective

Focusing on programmatic costs, our analysis does not address the important issue of patient costs associated with TB [2830]. In the context of routine TB services, the costs of care-seeking and TB treatment can have a substantial impact on productivity and household income, and are an important cause of catastrophic health expenditure [29]. Previous work in India has shown that ACF can bring about substantial reductions in these patient costs [18], essentially by bringing TB services to those in need in a timely way. By neglecting patient costs, our analysis therefore does not capture the societal cost savings that would result from higher-sensitivity testing strategies. Our analysis also does not address the societal costs of false-positive TB diagnosis, including the potentially life-changing impact of stigma [13] and the potential side effects of TB treatment. Our analysis thus does not capture the societal cost savings that would result from higher-specificity ACF approaches. Overall, therefore, we expect that inclusion of societal costs would act to widen the gap between the strategies shown in Fig 3. The extension of our analysis to incorporate these important costs to the patient is an important area for future work.

Key considerations in intervention costs

Our study has focused on the performance of confirmatory tests in ACF but has not addressed the implementation of these tests. For example, the overall cost of an Xpert test will depend on whether Xpert units are readily accessible for use in ACF, or whether they are only available in central laboratories, requiring the additional expense of sample transport and relaying test results to the patient. Previous work has addressed these considerations in the context of routine TB services [31]. Although such considerations are outside the scope of our current analysis, we note that access to Xpert facilities is likely to be a more pressing concern in peripheral health facilities in rural India than in urban slums. India’s current National Strategic Plan includes measures to improve the capacity for Xpert testing nationwide [32]. Moreover, recent developments offer prospects for reduced reliance on laboratory infrastructure, for example with the development of new, more mobile molecular diagnostics such as Xpert Omni [33] and Truenat [34], as well as the deployment of Xpert MTB/RIF through mobile diagnostic vans [35]. All of these developments would tend to reduce the per-test cost of high-accuracy diagnostic tools, by allowing closer proximity of testing to the ACF intervention. For any study aiming systematically to estimate the full cost of ACF, these and other implementation factors will be important to take into account (e.g., as demonstrated in [17,31]). Nonetheless, our findings illustrate an important consideration in any such study: In addition to these important cost components, the specificity of the confirmatory test, along with that of the whole ACF cascade, is likely to be a key driver of the cost/impact ratio of any ACF intervention.

Our analysis has ignored intervention costs directly associated with the rollout of the intervention, such as human resource costs and costs associated with the purchase of equipment. We also take a simple approach of assuming unit costs that are unaffected by the scale of the intervention, thus ignoring the potential for economies of scale, especially at high levels of population coverage. If human resource costs are similar under the 2 strategies, they would have little effect on the relative costs of these strategies. Overall, however, we emphasise that our estimates should not be interpreted as estimates of the actual cost of ACF. An important area for future work would be to incorporate these important elements [17,36], for more comprehensive estimates of the full cost of ACF.

Model limitations

For simplicity, we ignored pre-treatment loss to follow-up. Although commonly observed in practical implementations of ACF [37], we do not expect this simplification to alter our essential findings, as long as it affects the 2 testing strategies roughly equally. Again, for simplicity, we assume that all false-positive TB diagnoses have the same rates of treatment completion as true-positive diagnoses; if their completion rates are substantially lower, this would tend to reduce the treatment cost associated with false-positive TB diagnosis. Finally, we note that there is considerable uncertainty about the potential transmission impact of ACF interventions, owing partly to a lack of direct evidence, particularly in South-Asian settings [4]. In the present analysis, our impact projections are based on a series of assumptions, including perfect implementation of symptom screening and diagnosis, high-quality engagement with and participation by the community, effective linkage to treatment, immediate rapid bacteriological suppression upon treatment (thus interrupting transmission), and assumptions about the degree to which ACF is able to identify TB cases while they still have substantial potential for passing on infection [4]. Lessons from current and future ACF initiatives will be invaluable in identifying which of these assumptions needs most attention.

Conclusion

As ACF efforts are scaled up in India and other high-burden settings, implementation planning could benefit from a population perspective of potential costs and benefits. Such a perspective, complementing other approaches such as operational research, takes into account both the epidemiological impact and unintended consequences (such as false-positive diagnosis) of large-scale deployment. Addressing important questions about the optimum implementation of ACF could open the way for considerable impact on TB burden, in India and elsewhere.

Supporting information

S1 Text. Supporting information.

Table A: Comparison of different screening algorithms and testing strategies. Table B: Proportion contribution of each cost component to the total incremental service cost. Fig A: Results of the model calibration. Fig B: Simulated impact and cost-effectiveness under alternative symptom screening strategies. Fig C: Breakdown of the ACF incremental service cost under the prolonged cough screening strategy. Fig D: Sensitivity analysis to different scenarios.

https://doi.org/10.1371/journal.pmed.1003456.s002

(DOCX)

References

  1. 1. World Health Organization. Global tuberculosis report 2019. Geneva: World Health Organization; 2019 [cited 2019 Mar 29]. Available from: https://www.who.int/tb/publications/factsheet_global.pdf?ua = 1.
  2. 2. World Health Organization. The end TB strategy. Geneva: World Health Organization; 2014 [cited 2017 May 15]. Available from: http://www.who.int/tb/strategy/End_TB_Strategy.pdf.
  3. 3. Azman AS, Golub JE, Dowdy DW. How much is tuberculosis screening worth? Estimating the value of active case finding for tuberculosis in South Africa, China, and India. BMC Med. 2014;12(1):216.
  4. 4. Kranzer K, Afnan-Holmes H, Tomlin K, Golub JE, Shapiro AE, Schaap A, et al. The benefits to communities and individuals of screening for active tuberculosis disease: a systematic review. Int J Tuberc Lung Dis. 2013;17(4):432–46. pmid:23485377
  5. 5. Dhanaraj B, Papanna MK, Adinarayanan S, Vedachalam C, Sundaram V, Shanmugam S, et al. Prevalence and risk factors for adult pulmonary tuberculosis in a metropolitan city of south India. PLoS ONE. 2015;10(4):e0124260. pmid:25905900
  6. 6. Dorman SE, Schumacher SG, Alland D, Nabeta P, Armstrong DT, King B, et al. Xpert MTB/RIF Ultra for detection of Mycobacterium tuberculosis and rifampicin resistance: a prospective multicentre diagnostic accuracy study. Lancet Infect Dis. 2018;18(1):76–84. pmid:29198911
  7. 7. Desikan P. Sputum smear microscopy in tuberculosis: is it still relevant? Indian J Med Res. 2013;137(3):442–4. pmid:23640550
  8. 8. Steingart KR, Schiller I, Horne DJ, Pai M, Boehme CC, Dendukuri N. Xpert MTB/RIF assay for pulmonary tuberculosis and rifampicin resistance in adults. Cochrane Database Syst Rev. 2014;(1):CD009593. pmid:24448973
  9. 9. Tostmann A, Kik SV, Kalisvaart NA, Sebek MM, Verver S, Boeree MJ, et al. Tuberculosis transmission by patients with smear-negative pulmonary tuberculosis in a large cohort in the Netherlands. Clin Infect Dis. 2008;47(9):1135–42. pmid:18823268
  10. 10. Houben RMGJ Menzies NA, Sumner T Huynh GH, Arinaminpathy N, Goldhaber-Fiebert JD, et al. Feasibility of achieving the 2025 WHO global tuberculosis targets in South Africa, China, and India: a combined analysis of 11 mathematical models. Lancet Glob Health. 2016;4(11):e806–15. pmid:27720688
  11. 11. Dowdy DW, Lotia I, Azman AS, Creswell J, Sahu S, Khan AJ, et al. Population-level impact of active tuberculosis case finding in an Asian megacity. PLoS ONE. 2013;8(10):e77517. pmid:24147015
  12. 12. Arinaminpathy N, Batra D, Khaparde S, Vualnam T, Maheshwari N, Sharma L, et al. The number of privately treated tuberculosis cases in India: an estimation from drug sales data. Lancet Infect Dis. 2016;16(11):1255–60. pmid:27568356
  13. 13. Houben RMGJ, Lalli M, Kranzer K, Menzies N, Schumacher S, Dowdy DW. What if they don’t have tuberculosis? The consequences and trade-offs involved in false-positive diagnoses of tuberculosis. Clin Infect Dis. 2019;68(1):150–6. pmid:29982375
  14. 14. van’t Hoog AH, Langendam MW, Mitchell E, Cobelens FG, Sinclair D, Leeflang MMG, et al. A systematic review of the sensitivity and specificity of symptom- and chest-radiography screening for active pulmonary tuberculosis in HIV-negative persons and persons with unknown HIV status. Geneva: World Health Organization; 2013 [cited 2019 Jun 25]. Available from: https://www.who.int/tb/Review2Accuracyofscreeningtests.pdf.
  15. 15. Nguyen MVH, Levy NS, Ahuja SD, Trieu L, Proops DC, Achkar JM. Factors associated with sputum culture-negative vs culture-positive diagnosis of pulmonary tuberculosis. JAMA Netw Open. 2019;2(2):e187617. pmid:30735231
  16. 16. Dutt AK, Stead WW. Smear-negative pulmonary tuberculosis. Semin Respir Infect. 1994;9(2):113–9. pmid:7973170
  17. 17. Sohn H, Vyas A, Puri L, Gupta S, Qin ZZ, Codlin A, et al. Costs and operation management of community outreach program for tuberculosis in tribal populations in India. Public Health Action. 2019;9(2):58–62. pmid:31417854
  18. 18. Muniyandi M, Thomas BE, Karikalan N, Kannan T, Rajendran K, Dolla CK, et al. Catastrophic costs due to tuberculosis in South India: comparison between active and passive case finding. Trans R Soc Trop Med Hyg. 2020;114(3):185–92. pmid:31820812
  19. 19. Office of the Registrar General and Census Commissioner. 2011 census data. New Delhi: Ministry of Home Affairs; 2019 [cited 2019 Apr 10]. Available from: http://www.censusindia.gov.in/2011-Common/CensusData2011.html.
  20. 20. Raizada N, Sachdeva KS, Sreenivas A, Vadera B, Gupta RS, Parmar M, et al. Feasibility of decentralised deployment of Xpert MTB/RIF test at lower level of health system in India. PLoS ONE. 2014;9(2):e89301. pmid:24586675
  21. 21. Lee DJ, Kumarasamy N, Resch SC, Sivaramakrishnan GN, Mayer KH, Tripathy S, et al. Rapid, point-of-care diagnosis of tuberculosis with novel Truenat assay: cost-effectiveness analysis for India’s public sector. PLoS ONE. 2019;14(7):e0218890. pmid:31265470
  22. 22. Sachdeva KS, Raizada N, Sreenivas A, Van’t Hoog AH, Van Den Hof S, Dewan PK, et al. Use of Xpert MTB/RIF in decentralized public health settings and its effect on pulmonary TB and DR-TB case finding in India. PLoS ONE. 2015;10(5):e0126065. pmid:25996389
  23. 23. van’t Hoog AH, Meme HK, Laserson KF, Agaya JA, Muchiri BG, Githui WA, et al. Screening strategies for tuberculosis prevalence surveys: the value of chest radiography and symptoms. PLoS ONE. 2012;7(7):e38691. pmid:22792158
  24. 24. Datta B, Prakash AK, Ford D, Tanwar PK, Goyal P, Chatterjee P, et al. Comparison of clinical and cost-effectiveness of two strategies using mobile digital x-ray to detect pulmonary tuberculosis in rural India. BMC Public Health. 2019 Jan 22;19(1):99. pmid:30669990
  25. 25. Morishita F, Garfin AMCG, Lew W, Oh KH, Yadav RP, Reston JC, et al. Bringing state-of-the-art diagnostics to vulnerable populations: the use of a mobile screening unit in active case finding for tuberculosis in Palawan, the Philippines. PLoS ONE. 2017;12(2):e0171310. pmid:28152082
  26. 26. Maduskar P, Muyoyeta M, Ayles H, Hogeweg L, Peters-Bax L, Van Ginneken B. Detection of tuberculosis using digital chest radiography: automated reading vs. interpretation by clinical officers. Int J Tuberc Lung Dis. 2013;17(12):1613–20. pmid:24200278
  27. 27. Abubakar I, Story A, Lipman M, Bothamley G, van Hest R, Andrews N, et al. Diagnostic accuracy of digital chest radiography for pulmonary tuberculosis in a UK urban population. Eur Respir J. 2010;35(3):689–92. pmid:20190334
  28. 28. Laurence YV, Griffiths UK, Vassall A. Costs to health services and the patient of treating tuberculosis: a systematic literature review. Pharmacoeconomics. 2015;33:939–55. pmid:25939501
  29. 29. Tanimura T, Jaramillo E, Weil D, Raviglione M, Lönnroth K. Financial burden for tuberculosis patients in low- and middle-income countries: a systematic review. Eur Respir J. 2014;43:1763–75. pmid:24525439
  30. 30. Prasanna T, Jeyashree K, Chinnakali P, Bahurupi Y, Vasudevan K, Das M. Catastrophic costs of tuberculosis care: a mixed methods study from Puducherry, India. Glob Health Action. 2018;11(1):1477493. pmid:29902134
  31. 31. Sohn H, Kasaie P, Kendall E, Gomez GB, Vassall A, Pai M, et al. Informing decision-making for universal access to quality tuberculosis diagnosis in India: an economic-epidemiological model. BMC Med. 2019;17(1):155. pmid:31382959
  32. 32. Revised National Tuberculosis Control Programme. National strategic plan for tuberculosis elimination 2017–2025. New Delhi: Ministry of Health and Family Welfare; 2017 [cited 2019 Jun 20]. Available from: https://tbcindia.gov.in/WriteReadData/NSP Draft 20.02.2017 1.pdf.
  33. 33. Médecins Sans Frontières. MSF access campaign Xpert OMNI factsheet: what to consider before Xpert Omni implementation. Paris: Médecins Sans Frontières; 2018.
  34. 34. Nikam C, Jagannath M, Narayanan MM, Ramanabhiraman V, Kazi M, Shetty A, et al. Rapid diagnosis of Mycobacterium tuberculosis with Truenat MTB: a near-care approach. PLoS ONE. 2013;8(1):e51121. pmid:23349670
  35. 35. Codlin AJ, Monyrath C, Ky M, Gerstel L, Creswell J, Eang MT. Results from a roving, active case finding initiative to improve tuberculosis detection among older people in rural Cambodia using the Xpert MTB/RIF assay and chest X-ray. J Clin Tuberc Other Mycobact Dis. 2018;13:22–7. pmid:31720408
  36. 36. Sarin S, Huddart S, Raizada N, Parija D, Kalra A, Rao R, et al. Cost and operational impact of promoting upfront GeneXpert MTB/RIF test referrals for presumptive pediatric tuberculosis patients in India. PLoS ONE. 2019;14(4):e0214675. pmid:30933997
  37. 37. MacPherson P, Houben RM, Glynn JR, Corbett EL, Kranzer K. Pre-treatment loss to follow-up in tuberculosis patients in low- and lower-middle-income countries and high-burden countries: a systematic review and meta-analysis. Bull World Health Organ. 2014;92(2):126–38. pmid:24623906
  38. 38. Tiemersma EW, van der Werf MJ, Borgdorff MW, Williams BG, Nagelkerke NJD. Natural history of tuberculosis: duration and fatality of untreated pulmonary tuberculosis in HIV negative patients: a systematic review. PLoS ONE. 2011;6(4):e17601. pmid:21483732
  39. 39. den Boon S, Verver S, Lombard CJ, Bateman ED, Irusen EM, Enarson DA, et al. Comparison of symptoms and treatment outcomes between actively and passively detected tuberculosis cases: the additional value of active case finding. Epidemiol Infect. 2008;136(10):1342–9. pmid:18177518
  40. 40. Andrews JR, Noubary F, Walensky RP, Cerda R, Losina E, Horsburgh CR. Risk of progression to active tuberculosis following reinfection with Mycobacterium tuberculosis. Clin Infect Dis. 2012;54(6):784–91. pmid:22267721
  41. 41. World Health Organization. The Global Health Observatory. Geneva: World Health Organization; 2020 [cited 2020 May 13]. Available from: https://www.who.int/data/gho.
  42. 42. Subbaraman R, Nathavitharana RR, Satyanarayana S, Pai M, Thomas BE, Chadha VK, et al. The tuberculosis cascade of care in India’s public sector: a systematic review and meta-analysis. PLoS Med. 2016;13(10):e1002149. pmid:27780217
  43. 43. Boehme CC, Nabeta P, Hillemann D, Nicol MP, Shenai S, Krapp F, et al. Rapid molecular detection of tuberculosis and rifampin resistance. N Engl J Med. 2010;363(11):1005–15. pmid:20825313
  44. 44. World Health Organization. Systematic screening for active tuberculosis: principles and recommendations. Geneva: World Health Organization; 2013 [cited 2016 Oct 6]. Available from: http://www.who.int/tb/publications/Final_TB_Screening_guidelines.pdf.
  45. 45. van’t Hoog AH, Onozaki I, Lonnroth K. Choosing algorithms for TB screening: a modelling study to compare yield, predictive value and diagnostic burden. BMC Infect Dis. 2014;14(1):532. pmid:25326816
  46. 46. Gopi PG, Prasad VV, Vasantha M, Subramani R, Tholkappian AS, Sargunan D, et al. Annual risk of tuberculosis infection in Chennai city. Indian J Tuberc. 2008;55(3):157–61. pmid:18807749
  47. 47. Revised National Tuberculosis Control Programme. TB India report 2018. New Delhi: Ministry of Health and Family Welfare; 2018.
  48. 48. Chadha Id VK, Anjinappa SM, Dave P, Rade K, Baskaran D, Narang P, et al. Sub-national TB prevalence surveys in India, 2006–2012: results of uniformly conducted data analysis. PLoS ONE. 2019;14(2):e0212264. pmid:30794595
  49. 49. Menzies NANA, Gomez GB, Bozzani F, Chatterjee S, Foster N, Baena IGIG, et al. Cost-effectiveness and resource implications of aggressive action on tuberculosis in China, India, and South Africa: a combined analysis of nine models. Lancet Glob Health. 2016;4(11):e816–26. pmid:27720689
  50. 50. Vassall A, van Kampen S, Sohn H, Michael JS, John KR, den Boon S, et al. Rapid diagnosis of tuberculosis with the Xpert MTB/RIF assay in high burden countries: a cost-effectiveness analysis. PLoS Med. 2011;8(11):e1001120. pmid:22087078
  51. 51. Stop TB Partnership Global Drug Facility. Medicines and diagnostics catalog. Geneva: Stop TP Partnership; 2020 [cited 2020 Nov 5]. Available from: http://stoptb.org/assets/documents/gdf/drugsupply/GDFProductCatalog.pdf.