Automated digital microscopy has the potential to improve the diagnosis of tuberculosis (TB), particularly in settings where molecular testing is too expensive to perform routinely. The cost-effectiveness of TB diagnostic algorithms using automated digital microscopy remains uncertain.
Using data from a demonstration study of an automated digital microscopy system (TBDx, Applied Visual Systems, Inc.), we performed an economic evaluation of TB diagnosis in South Africa from the health system perspective. The primary outcome was the incremental cost per new TB diagnosis made. We considered costs and effectiveness of different algorithms for automated digital microscopy, including as a stand-alone test and with confirmation of positive results with Xpert MTB/RIF (‘Xpert’, Cepheid, Inc.). Results were compared against both manual microscopy and universal Xpert testing.
In settings willing to pay $2000 per incremental TB diagnosis, universal Xpert was the preferred strategy. However, where resources were not sufficient to support universal Xpert, and a testing volume of at least 30 specimens per day could be ensured, automated digital microscopy with Xpert confirmation of low-positive results could facilitate the diagnosis of 79–84% of all Xpert-positive TB cases, at 50–60% of the total cost. The cost-effectiveness of this strategy was $1280 per incremental TB diagnosis (95% uncertainty range, UR: $340-$3440) in the base case, but improved under conditions likely reflective of many settings in sub-Saharan Africa: $677 per diagnosis (95% UR: $450-$935) when sensitivity of manual smear microscopy was lowered to 0.5, and $956 per diagnosis (95% UR: $40-$2910) when the prevalence of multidrug-resistant TB was lowered to 1%.
Although universal Xpert testing is the preferred algorithm for TB diagnosis when resources are sufficient, automated digital microscopy can identify the majority of cases and halve the cost of diagnosis and treatment when resources are more scarce and multidrug-resistant TB is not common.
Citation: Jha S, Ismail N, Clark D, Lewis JJ, Omar S, Dreyer A, et al. (2016) Cost-Effectiveness of Automated Digital Microscopy for Diagnosis of Active Tuberculosis. PLoS ONE 11(6): e0157554. https://doi.org/10.1371/journal.pone.0157554
Editor: Selvakumar Subbian, Public Health Research Institute at RBHS, UNITED STATES
Received: January 21, 2016; Accepted: May 31, 2016; Published: June 20, 2016
Copyright: © 2016 Jha et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Our study used anonymized, aggregate data from a database owned by the National Tuberculosis Reference Laboratory in South Africa. The aggregate data required to replicate the analysis are included in Table 2 of the manuscript. For further inquiries related to these data, please contact Dr. Nazir Ismail at email@example.com.
Funding: This work was funded in part by the B. Frank and Kathleen Polk Assistant Professorship in Epidemiology (to DWD). Applied Visual Systems, Inc., provided input as to parameter values and support for open-access publication fees but otherwise had no input into the design of the study or the decision to publish.
Competing interests: The authors have read the journal's policy and have the following competing interests: Dr. Ismail reports grants from NHLS Research Trust during the conduct of the study. All other authors have declared that no competing interests exist.
Every year, an estimated 3.6 million individuals develop active tuberculosis (TB) yet are not notified to public health authorities. Improved diagnostic testing for TB is likely to be critical for reaching this “missing 3 million”[2, 3]. Current testing algorithms largely depend either on sputum smear microscopy—a test with variable sensitivity that depends on operator skill and such variables as microscopist time constraints–or Xpert MTB/RIF (Cepheid, Inc.; Sunnyvale, CA, USA), a molecular test with higher sensitivity and the ability to detect rifampin resistance[5, 6], but that can cost over ten times more per test than sputum smear[3, 7]. For settings in which high-quality sputum smear microscopy cannot be performed, but performing Xpert MTB/RIF on all patients with symptoms of TB may be very expensive (including settings of systematic screening for TB), automated digital microscopy offers an attractive alternative. Automated visualization algorithms can facilitate high-quality sputum smear microscopy that is not user-dependent in interpretation; an example of an automated microscopy system that was recently validated is the TBDx system (Applied Visual Sciences, Leesburg, VA, USA). This system uses patented software and a high-specification camera to identify acid fast bacilli, thereby reducing subjectivity in results and potentially improving performance. In a prospective single-center study at the National Tuberculosis Reference Laboratory in Johannesburg, South Africa, TBDx was shown to have 0.78 sensitivity for culture-proven TB, and when positive results were confirmed by Xpert MTB/RIF, the specificity of the algorithm was estimated at 0.998. However, whether TBDx or a similar automated microscopy system could be cost-effective in high-burden settings remains uncertain. Thus, we used data from this study to perform an economic evaluation of automated digital microscopy for active TB in a representative African reference lab setting.
Like most automated microscopy systems, TBDx provides results at different levels of certainty; in the case of TBDx, as reported in the published demonstration study , there are four relevant result levels: negative (no acid-fast bacilli [AFB] detected), “scanty 1” (<1 AFB per 300 high-power fields), “low positive” (2–9 AFB per 300 high-power fields), and “high positive” (≥10 AFB per 300 high-power fields). We used data on these TBDx results, alone and in combination with Xpert MTB/RIF, as performed in 1009 South African adults with clinical suspicion of TB, to construct a model of the effectiveness of such testing in a hypothetical population of 10,000 people having characteristics of the source population. In addition to diagnostic consequences, we estimated the costs of TB testing and treatment from a health system perspective. The original study was approved by the Faculty of Health Sciences Research Ethics Committee at the University of Pretoria; no additional ethical approval was required for this non-human subjects analysis.
We evaluated the costs and effectiveness of a series of alternative algorithms: (1) sputum smear microscopy alone; (2) TBDx automated microscopy alone; (3) TBDx automated microscopy, with confirmation of low positive results by Xpert MTB/RIF; (4) TBDx automated microscopy, with confirmation of all positive results by Xpert MTB/RIF; and (5) Xpert MTB/RIF performed on all specimens. For each algorithm including automated microscopy, we considered scenarios in which “scanty 1” results were treated as either negative or low positive. Under each scenario, we projected the total number of patients with culture-confirmed TB who would be treated, the number of false-positive diagnoses that would be made, and the total costs from a health system perspective. For purposes of appropriate comparison (to scenarios in which treatment of drug-resistant TB would otherwise not be considered), we also considered options in which drug susceptibility testing was performed for all individuals before initiation of TB treatment. We also considered three alternative scenarios of treatment volume: a “high-volume” scenario in which 100 individuals were evaluated per day, a “moderate-volume” scenario in which 30 individuals were evaluated per day and a “low-volume” scenario in which 10 individuals were evaluated per day. Our primary outcome was the incremental cost per incremental true-positive diagnosis made, relative to sputum smear microscopy alone as the reference scenario.
All costs were valued in 2015 US dollars, with conversion from South African rand into US dollars using the historical exchange rate and inflation to year 2015 using the South African gross domestic product (GDP) deflator. Unit costs were developed for sputum smear, TBDx automated microscopy, and Xpert MTB/RIF using estimates from the literature in an “ingredients” approach as shown in Table 1. Overheads (including building space) and utilities were estimated from other published evaluations of sputum smear microscopy and Xpert MTB/RIF in South Africa, conservatively assuming that allocations for TBDx-enhanced microscopy would be similar to Xpert MTB/RIF (and thus higher than for microscopy) and also including an annual cost for quality assurance and training, the allocation of which to each type of diagnostic modality was assumed to be $400[11–13].
Costs of capital equipment (e.g., microscopes and Xpert systems) were also taken from the literature and annualized using a 3% annual discount rate and an expected useful life of five years (Xpert) or ten years (microscope and camera)[14, 15]. Costs of required hardware and software licensing for TBDx were valued in consultation with experts from Applied Visual Systems, Inc.–who provided estimates of cost without any input as to the use of those estimates in the economic model. These estimates included: (a) a licensing fee of $2 per slide in a high-volume setting or $15,000 per year in low and moderate-volume setting; (b) combined equipment costs of slide loader-fitted microscope and camera of $27,000 for a low and moderate-throughput loader and $47,000 for a high-throughput loader; (c) $3,600 in installation and shipping costs; (d) $1,000 for a computer and printer (also applied to the Xpert MTB/RIF); and (e) annual maintenance and warranty at 10% of total equipment costs (also applied to Xpert and fluorescence microscopes).
Personnel costs were estimated assuming an hourly wage of $5.13 for a general laboratory technician and $6.83 for a skilled microscopist[11, 12, 16]. We assumed that all procedures related to Xpert specimen preparation, loading, and results reporting would take 15 minutes per test (run on-demand), versus five minutes per slide for sputum smear (where individual smears can be batched), plus an additional seven minutes per slide for manual reading. Consumables were estimated at $0.10 for sputum smear (including TBDx) and $9.98 for Xpert MTB/RIF (the current cost of an Xpert cartridge)[13, 15, 17, 18], with procurement and shipping costs estimated at 10% of the unit price.
We estimated the cost of TB treatment according to the cost of first-line and second-line drugs as well as necessary outpatient follow-up. We did not attempt to estimate downstream consequences after initiation of treatment; thus, all people diagnosed with TB were assigned a treatment cost equivalent to drugs and outpatient visits for six months (if drug-susceptible) or twenty months (if multidrug-resistant, MDR), and all people not diagnosed with TB were treated as false-negative or true-negative, without attempting to capture future attempts at diagnosis or empiric treatment. We assumed that culture-based drug susceptibility testing would be performed prior to any initiation of MDR-TB therapy, and we included the costs thereof. We assumed a high proportion of MDR-TB (5% of all cases), as might be reflective of testing performed at a national referral center. Costs of diagnosis with standard sputum smear microscopy and Xpert MTB/RIF, as well as other component costs of automated microscopy (e.g., staff costs, overhead costs, DST) were estimated from the literature[12, 13, 16, 19, 20]. A full listing of model parameters is given in Table 2.
We performed one-way sensitivity analysis on all model parameters across reasonable ranges as shown in Table 2. In addition, we also performed scenario analyses for high- and low-volume settings (as above) and at different assumed levels of MDR-TB prevalence. In addition, we performed a probabilistic uncertainty analysis in which all parameters were simultaneously varied over the ranges shown in Table 2 (and by +/-25% of base value for each cost component not shown in Table 2). Each parameter range was defined as a beta distribution with an alpha (shape) parameter of 4. The results of this analysis are reported as 95% uncertainty ranges (95% UR’s), bounded by the 2.5th and 97.5th percentiles of the resulting simulations.
Impact of volume on cost of automated microscopy
In a low-volume setting processing 10 specimens per day, the unit cost of automated digital microscopy was nearly that of Xpert MTB/RIF (Table 1), due to the relatively high costs of both equipment and annual software licensing for TBDx. By contrast, in both moderate (30 specimens/day) and high-volume (100 specimens/day) settings, the per-test cost of automated microscopy was about one-third that of Xpert MTB/RIF. Given the relatively low likelihood that automated microscopy would be performed instead of Xpert MTB/RIF if the unit costs of testing were similar, we focused subsequent analyses on the high-volume setting.
Costs and consequences of automated digital microscopy
Table 3 shows the costs and consequences of various testing algorithms for active TB that incorporate automated digital microscopy. Using automated microscopy as a standalone test (i.e., no confirmation of positive results by Xpert MTB/RIF) resulted in more false-positive diagnoses than incremental true-positive diagnoses. However, if automated microscopy were used as a triage test, with low-positive results confirmed by Xpert MTB/RIF and high-positive results proceeding to treatment, 79–84% of all individuals with Xpert-positive TB could be diagnosed (true TB diagnoses made), at 50–60% of the cost (total diagnostic cost plus total treatment cost). This strategy had a favorable incremental cost-effectiveness ratio of $1,280 per TB diagnosis made (95% uncertainty range, UR: $340-$3440), relative to manual sputum smear microscopy with sensitivity of 0.68 (versus 0.73 for TBDx). If manual sputum smear had a sensitivity of 0.5 rather than 0.68 (as observed in the TBDx demonstration study), this automated microscopy strategy would cost $677 per incremental TB diagnosis (95% UR: $450-$935), relative to manual smear. If the prevalence of MDR-TB was lowered to 1% of all samples, the cost of this algorithm fell to $956 per diagnosis (95% UR: $40-$2910). The corresponding cost-effectiveness frontier (Fig 1) demonstrates that this strategy would be preferred where resources are insufficient for universal Xpert MTB/RIF, or the willingness to pay for an incremental TB diagnosis falls between $1,280 ($677 if sensitivity of manual smear is 0.5) and $1,927.
The number of true-positive microbiological diagnoses for each algorithm is shown on the x-axis and the corresponding costs on the y-axis, such that the slope of any line is the incremental cost-effectiveness ratio between two algorithms. Algorithms appearing further to the right are more effective, and those appearing higher on the y-axis are more expensive. The frontier of cost-effective options is shown as a solid dark line, with incremental cost-effectiveness ratios (in units of cost per true-positive TB treatment) shown for each comparison along this frontier. In a setting of constrained resources, automated digital microscopy with low-positive results confirmed by Xpert MTB/RIF would be the first selected strategy beyond sputum smear microscopy alone, followed by Xpert MTB/RIF for all specimens, where resources are sufficient. If one incremental microbiological diagnosis could avert as few as 0.2 disability-adjusted life years, all strategies along the cost-effectiveness frontier would be cost-effective, at a willingness-to-pay threshold equal to South Africa’s per-capita annual gross national income (GNI). Sc1 = “scanty 1” result; pos = positive; neg = negative; sens. = sensitivity.
Sensitivity and scenario analyses
Assuming that both the specificity of manual sputum smear microscopy and the volume of testing is high, three additional parameters were strong drivers of the incremental cost-effectiveness of automated digital microscopy (Fig 2): the prevalence of TB, the prevalence of MDR-TB, and the sensitivity of manual microscopy. In settings where the sensitivity of manual microscopy is poor, the incremental cost-effectiveness of TBDx with Xpert confirmation of all positive results began to approach that of universal Xpert (Table 3). This strategy allows for 78–83% of all Xpert-positive TB to be diagnosed, with all drug-resistant TB also treated. Under most situations tested in sensitivity analysis, the algorithm that provided the most TB diagnoses per dollar spent (incremental to manual microscopy) was TBDx, with Xpert confirmation of low-positive results, and counting “Scanty 1” results as negative.
Primary drivers of cost-effectiveness in one-way sensitivity analysis. All parameters in Tables 1 and 2 were varied; only those parameters that resulted in a change of +/-$200 in the incremental cost-effectiveness ratio are shown. Blue bars correspond to the incremental cost-effectiveness of automated microscopy by TBDx relative to manual smear microscopy, at the low value of the specified parameter range. Red bars correspond to the incremental cost-effectiveness at the high value of that range, holding all other parameter values constant.
This economic evaluation provides insight as to the potential role of automated digital microscopy in the diagnosis of adult pulmonary tuberculosis. Specifically, in settings where universal Xpert MTB/RIF is affordable, and health systems are willing to pay at least $1927 per incremental TB diagnosis made, universal Xpert is generally preferred. If an incremental microbiologically-confirmed TB diagnosis can lead to one year of additional life (or disability-adjusted life year averted), this willingness-to-pay threshold would be considered highly cost-effective by traditional criteria in most high-burden countries[21, 22]. This finding is consistent with prior economic evaluations suggesting that Xpert is likely to be highly cost-effective relative to sputum smear microscopy where the level of empiric TB diagnosis is low[7, 20]. However, in many settings, universal Xpert MTB/RIF is not an affordable option, in part owing to recurring maintenance and calibration costs. In these cases, and when specimens can be processed at moderate-to-high volume, automated digital microscopy (with confirmation of positive results by Xpert) can improve the yield of manual microscopy, and at an incremental cost-effectiveness ratio that is favorable relative to universal Xpert. The strategy that appears to optimize cost-effectiveness in most settings is Xpert confirmation of low-positive results only, taking high-positive results as a direct indication for treatment.
Prior analyses have evaluated the potential cost-effectiveness of hypothetical “triage” tests for active TB, suggesting that such tests could be cost-effective under certain conditions. This analysis is among the first to evaluate a novel diagnostic test for TB that could be used for purposes of triage. Such tests are designed to provide the majority of the benefit of using a more sensitive confirmatory test (e.g., Xpert MTB/RIF), but at a reduced cost—and ideally a more favorable cost-effectiveness ratio, such that it is preferable to perform the triage test on the full population rather than the confirmatory test on part of it. This economic evaluation demonstrates precisely this result, specifically that automated digital microscopy can reduce the overall costs of diagnostic testing substantially, and be performed at a cost-effectiveness ratio that is generally favorable to that of universal Xpert.
As shown in our sensitivity analysis, automated microscopy is particularly attractive in settings where manual microscopy cannot be performed with consistent quality. For TBDx as a specific example of automated microscopy, the preferred algorithm is one in which high-positive results lead directly to treatment, low-positive results are confirmed with Xpert (or other more accurate confirmatory test), and inconclusive results (i.e., 1 AFB per 300 fields) are treated as negative. Unless the cost of licensing and equipment can be brought down in the future, TBDx is likely to be too expensive on a per-test basis to scale up in low-volume settings that do not perform substantially more than 10 sputum evaluations for TB each day.
Two elements of automated digital microscopy performance bear mention in this analysis. Automated digital microscopy was performed on concentrated sputum specimens, which may increase the sensitivity of both manual and automated microscopy, though perhaps less so in those infected with HIV. Customized slides and marking of the inoculation area for camera guidance were also critical to test performance; though not major contributors to cost, these required elements may limit the ability to perform automated digital microscopy in some settings. Furthermore, while slides are still manually prepared, the automated algorithm does not assess sputum quality.
As with any modeling analysis, this evaluation has certain limitations. Parameter values were drawn from the literature and, in some cases, required assumptions based on expert opinion. Nevertheless, our results were robust to most sensitivity analyses, and particularly surrounding those parameter values that were most uncertain. We did not attempt to incorporate downstream effectiveness measures, including the health benefits of making TB diagnoses nor the costs and effectiveness of HIV therapy, which is a major driver of the economics of TB diagnosis in HIV-endemic settings. Our ability to compare automated microscopy to health interventions other than TB diagnostic assays is therefore limited. Nevertheless, we are able to demonstrate that the cost-effectiveness of automated microscopy is likely similar (if not superior) to that of Xpert MTB/RIF, which has been modeled in such fashion. We limited this analysis to the costs and consequences of microbiological diagnosis; in reality, ancillary diagnostic testing (e.g., with chest X-ray) and empiric treatment may have major impact on patient outcomes[27, 28]. Our results should therefore not be interpreted as reflective of the entire process of TB diagnosis and treatment, but rather only of the costs and consequences of diagnosis and treatment based on microbiological confirmation.
In summary, this economic evaluation suggests that automated digital microscopy can serve as a cost-effective alternative to Xpert MTB/RIF when specimens can be processed at high volume and universal Xpert is unaffordable. The algorithm most likely to be cost-effective is one in which high-positive results on automated microscopy result in referral for treatment, low-positive results are confirmed with Xpert, and inconclusive results are treated as negative. Further studies should evaluate the effectiveness (ideally with linkage to empiric costs) of automated digital microscopy in a variety of real-world settings. As the armamentarium of diagnostic options for TB continues to expand, it is important to optimize the use of each test in such a way that constrained resources are put to their best use. By reducing the costs of Xpert MTB/RIF testing while still providing the majority of the benefits (in terms of TB diagnoses), automated digital microscopy has the potential to fill an important niche in the TB diagnostic landscape.
This work was funded in part by the B. Frank and Kathleen Polk Assistant Professorship in Epidemiology (to DWD). Applied Visual Systems, Inc., provided input as to parameter values and support for open-access publication fees but otherwise had no input into the design of the study or the decision to publish.
Conceived and designed the experiments: DWD GC. Performed the experiments: SJ DWD. Analyzed the data: SJ DWD. Contributed reagents/materials/analysis tools: NI. Wrote the paper: SJ DWD. revised manuscript and approved final version: SJ NI DC JJL SO AD VC GC DWD.
- 1. Organization WH. Global tuberculosis report 2015. 2015.
- 2. Glaziou P, Sismanidis C, Floyd K, Raviglione M. Global epidemiology of tuberculosis. Cold Spring Harb Perspect Med. 2015;5(2):a017798. pmid:25359550.
- 3. Keeler E, Perkins MD, Small P, Hanson C, Reed S, Cunningham J, et al. Reducing the global burden of tuberculosis: the contribution of improved diagnostics. Nature. 2006;444 Suppl 1:49–57. pmid:17159894.
- 4. Van Deun A, Portaels F. Limitations and requirements for quality control of sputum smear microscopy for acid-fast bacilli. Int J Tuberc Lung Dis. 1998;2(9):756–65. pmid:9755931.
- 5. Boehme CC, Nicol MP, Nabeta P, Michael JS, Gotuzzo E, Tahirli R, et al. Feasibility, diagnostic accuracy, and effectiveness of decentralised use of the Xpert MTB/RIF test for diagnosis of tuberculosis and multidrug resistance: a multicentre implementation study. Lancet. 2011;377(9776):1495–505. pmid:21507477; PubMed Central PMCID: PMC3085933.
- 6. Boehme CC, Nabeta P, Hillemann D, Nicol MP, Shenai S, Krapp F, et al. Rapid molecular detection of tuberculosis and rifampin resistance. N Engl J Med. 2010;363(11):1005–15. pmid:20825313; PubMed Central PMCID: PMC2947799.
- 7. Vassall A, van Kampen S, Sohn H, Michael JS, John KR, den Boon S, et al. Rapid diagnosis of tuberculosis with the Xpert MTB/RIF assay in high burden countries: a cost-effectiveness analysis. PLoS Med. 2011;8(11):e1001120. pmid:22087078; PubMed Central PMCID: PMC3210757.
- 8. Caminero JA, Migliori GB. Automated Digital Microscopy in New Tuberculosis Diagnostic Algorithms. Can It Boost Case Finding? Am J Respir Crit Care Med. 2015;191(12):1352–3. pmid:26075421.
- 9. Ismail NA, Omar SV, Lewis JJ, Dowdy DW, Dreyer AW, van der Meulen H, et al. Performance of a Novel Algorithm Using Automated Digital Microscopy for Diagnosing Tuberculosis. Am J Respir Crit Care Med. 2015. pmid:25826383.
- 10. Bank W. Available from: http://data.worldbank.org/indicator/NY.GDP.DEFL.KD.ZG.
- 11. Lu C, Liu Q, Sarma A, Fitzpatrick C, Falzon D, Mitnick CD. A systematic review of reported cost for smear and culture tests during multidrug-resistant tuberculosis treatment. PLoS One. 2013;8(2):e56074. pmid:23457502; PubMed Central PMCID: PMC3574085.
- 12. Pooran A, Pieterson E, Davids M, Theron G, Dheda K. What is the cost of diagnosis and management of drug resistant tuberculosis in South Africa? PLoS One. 2013;8(1):e54587. pmid:23349933; PubMed Central PMCID: PMC3548831.
- 13. Pantoja A, Fitzpatrick C, Vassall A, Weyer K, Floyd K. Xpert MTB/RIF for diagnosis of tuberculosis and drug-resistant tuberculosis: a cost and affordability analysis. Eur Respir J. 2013;42(3):708–20. pmid:23258774.
- 14. 2011. Available from: http://www.nhls.ac.za/.
- 15. Diagnostics F. Available from: http://www.finddiagnostics.org/about/what_we_do/successes/find-negotiated-prices/xpert_mtb_rif.html.
- 16. Meyer-Rath G, Schnippel K, Long L, MacLeod W, Sanne I, Stevens W, et al. The impact and cost of scaling up GeneXpert MTB/RIF in South Africa. PLoS One. 2012;7(5):e36966. pmid:22693561; PubMed Central PMCID: PMC3365041.
- 17. Organization WH. Xpert MTB/RIF Implementation Manual: Technical and Operational 'How-To'; Practical Considerations. Xpert MTB/RIF Implementation Manual: Technical and Operational 'How-To'; Practical Considerations. WHO Guidelines Approved by the Guidelines Review Committee. Geneva 2014.
- 18. Van Rie A, Page-Shipp L, Scott L, Sanne I, Stevens W. Xpert((R)) MTB/RIF for point-of-care diagnosis of TB in high-HIV burden, resource-limited countries: hype or hope? Expert Rev Mol Diagn. 2010;10(7):937–46. pmid:20964612.
- 19. Department of Health RoSA. National Tuberculosis Management Guidelines. In: Health, editor. South Africa 2014.
- 20. Graham SM, Ahmed T, Amanullah F, Browning R, Cardenas V, Casenghi M, et al. Evaluation of tuberculosis diagnostics in children: 1. Proposed clinical case definitions for classification of intrathoracic tuberculosis disease. Consensus from an expert panel. The Journal of infectious diseases. 2012;205 Suppl 2:S199–208. pmid:22448023; PubMed Central PMCID: PMC3334506.
- 21. Marseille E, Larson B, Kazi DS, Kahn JG, Rosen S. Thresholds for the cost-effectiveness of interventions: alternative approaches. Bull World Health Organ. 2015;93(2):118–24. pmid:25883405; PubMed Central PMCID: PMC4339959.
- 22. World Health Organization G. Choosing interventions that are cost-effective 2014. Available from: http://www.who.int/choice/en/.
- 23. van't Hoog AH, Cobelens F, Vassall A, van Kampen S, Dorman SE, Alland D, et al. Optimal triage test characteristics to improve the cost-effectiveness of the Xpert MTB/RIF assay for TB diagnosis: a decision analysis. PLoS One. 2013;8(12):e82786. pmid:24367555; PubMed Central PMCID: PMC3867409.
- 24. Steingart KR, Henry M, Ng V, Hopewell PC, Ramsay A, Cunningham J, et al. Fluorescence versus conventional sputum smear microscopy for tuberculosis: a systematic review. Lancet Infect Dis. 2006;6(9):570–81. pmid:16931408.
- 25. Cattamanchi A, Dowdy DW, Davis JL, Worodria W, Yoo S, Joloba M, et al. Sensitivity of direct versus concentrated sputum smear microscopy in HIV-infected patients suspected of having pulmonary tuberculosis. BMC Infect Dis. 2009;9:53. pmid:19419537; PubMed Central PMCID: PMC2690598.
- 26. Andrews JR, Lawn SD, Dowdy DW, Walensky RP. Challenges in evaluating the cost-effectiveness of new diagnostic tests for HIV-associated tuberculosis. Clin Infect Dis. 2013;57(7):1021–6. pmid:23788239; PubMed Central PMCID: PMC3765010.
- 27. Theron G, Peter J, Dowdy D, Langley I, Squire SB, Dheda K. Do high rates of empirical treatment undermine the potential effect of new diagnostic tests for tuberculosis in high-burden settings? Lancet Infect Dis. 2014;14(6):527–32. pmid:24438820.
- 28. Theron G, Zijenah L, Chanda D, Clowes P, Rachow A, Lesosky M, et al. Feasibility, accuracy, and clinical effect of point-of-care Xpert MTB/RIF testing for tuberculosis in primary-care settings in Africa: a multicentre, randomised, controlled trial. Lancet. 2014;383(9915):424–35. pmid:24176144.
- 29. Foster N, Vassall A, Cleary S, Cunnama L, Churchyard G, Sinanovic E. The economic burden of TB diagnosis and treatment in South Africa. Soc Sci Med. 2015;130:42–50. pmid:25681713.