Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Selection bias in multidrug-resistant tuberculosis cohort studies assessing sputum culture conversion

  • Carly A. Rodriguez ,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Visualization, Writing – original draft

    Car08@bu.edu

    Affiliations Department of Epidemiology, Boston University School of Public Health, Boston, Massachusetts, United States of America, Department of Global Health and Social Medicine, Harvard Medical School, Boston, Massachusetts, United States of America

  • Sara Lodi,

    Roles Methodology, Writing – review & editing

    Affiliation Department of Biostatistics, Boston University School of Public Health, Boston, Massachusetts, United States of America

  • C. Robert Horsburgh,

    Roles Supervision, Writing – review & editing

    Affiliation Department of Epidemiology, Boston University School of Public Health, Boston, Massachusetts, United States of America

  • Mathieu Bastard,

    Roles Writing – review & editing

    Affiliation Epicentre, Paris, France

  • Cathy Hewison,

    Roles Investigation, Writing – review & editing

    Affiliation Médecins Sans Frontières, Paris, France

  • Helena Huerga,

    Roles Investigation, Writing – review & editing

    Affiliation Epicentre, Paris, France

  • Munira Khan,

    Roles Investigation, Writing – review & editing

    Affiliation THINK TB & HIV Investigative Network, Durban, South Africa

  • Palwasha Y. Khan,

    Roles Investigation, Writing – review & editing

    Affiliations Interactive Research and Development Global, Singapore, Singapore, Department of Clinical Research, London School of Hygiene and Tropical Medicine, London, United Kingdom

  • Uzma Khan,

    Roles Investigation, Writing – review & editing

    Affiliation Interactive Research and Development Global, Singapore, Singapore

  • Lawrence Oyewusi,

    Roles Investigation, Writing – review & editing

    Affiliation Partners In Health, Maseru, Lesotho

  • Shrivani Padayachee,

    Roles Investigation, Writing – review & editing

    Affiliation THINK TB & HIV Investigative Network, Durban, South Africa

  • Carole D. Mitnick,

    Roles Conceptualization, Formal analysis, Investigation, Supervision, Writing – review & editing

    Affiliation Department of Global Health and Social Medicine, Harvard Medical School, Boston, Massachusetts, United States of America

  • Molly F. Franke

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Supervision, Writing – review & editing

    Affiliation Department of Global Health and Social Medicine, Harvard Medical School, Boston, Massachusetts, United States of America

Abstract

Background

Conversion of sputum culture from positive to negative for M. tuberculosis is a key indicator of treatment response. An initial positive culture is a pre-requisite to observe conversion. Consequently, patients with a missing or negative initial culture are excluded from analyses of conversion outcomes. To identify the initial, or “baseline” culture, researchers must define a sample collection interval. An interval extending past treatment initiation can increase sample size but may introduce selection bias because patients without a positive pre-treatment culture must survive and remain in care to have a culture in the post-treatment interval.

Methods

We used simulated data and data from the endTB observational cohort to investigate the potential for bias when extending baseline culture intervals past treatment initiation. We evaluated bias in the proportion with six-month conversion.

Results

In simulation studies, the potential for bias depended on the proportion of patients missing a pre-treatment culture, proportion with conversion, proportion culture positive at treatment initiation, and proportion of patients missing a pre-treatment culture who would have been observed to be culture positive, had they had a culture. In observational data, the maximum potential for bias when reporting the proportion with conversion reached five percentage points in some sites.

Conclusion

Extending the allowable baseline interval past treatment initiation may introduce selection bias. If investigators choose to extend the baseline collection interval past treatment initiation, the proportion missing a pre-treatment culture and the number of deaths and losses to follow up during the post-treatment allowable interval should be clearly enumerated.

Background

During tuberculosis (TB) treatment, particularly drug-resistant TB (DR-TB), sputum cultures are routinely monitored for growth of Mycobacterium tuberculosis (M.tb). Conversion of culture from positive to negative for M.tb is an important sign of treatment response and is often used as an early indicator of treatment outcome [14]. Although the World Health Organization (WHO) recommends monthly culture monitoring [5], in observational TB cohorts treated under programmatic conditions, patient encounters and sample collection may occur less frequently, and limited laboratory services or reagent stock-outs can result in inconsistent data.

An initial, “baseline” positive culture is a pre-requisite to observe conversion to negative culture. Only patients with positive cultures at a pre-defined baseline time point (generally before treatment initiation) are included in conversion analyses; patients with a negative baseline culture or a missing baseline culture are excluded. Under programmatic conditions, patients may not have a culture result immediately before treatment initiation or may not have a culture result before treatment initiation at all. Therefore, investigators will define an interval before treatment initiation constituting the baseline culture. In some cases, investigators may extend this interval past treatment initiation to include patients who lacked a pre-treatment culture but had a culture after treatment initiation [6]. While the latter may improve precision by increasing sample size, it could also introduce selection bias. This is because the analysis cohort will include those without a positive pre-treatment culture who survived or were retained long enough to have a recorded positive culture in the post-treatment interval, but exclude those without a positive pre-treatment culture who die or are lost to follow up (LTFU) during this interval, events often defined as non-conversions. Inclusion in the study requires a subset of patients (i.e. patients missing a pre-treatment culture) to survive or be retained in the study long enough to make it past a selection process (i.e. having a culture in the post-treatment initiation interval) [7, 8]. The ramifications of selection bias have been assessed at length in the epidemiologic literature [915].

Using simulations and observational data from a cohort of DR-TB patients, we investigate the potential for bias when reporting the proportion of a cohort with culture conversion when the baseline culture collection interval is extended past treatment initiation.

Methods

Quantifying bias using simulated data

We first simulated a hypothetical cohort with complete pre-treatment culture data and then introduced missing data under different scenarios to explore its impact on conversion. Conducting bias analyses in real-world data is limited by the range of values observed in the dataset. By simulating data, we can generate the full range of potential values for parameters relevant to conversion, in order to better understand the scenarios where bias can occur [16, 17]. To simulate a cohort, we used a tree graph to define the subsets of patients in a given hypothetical TB cohort, which is detailed in Supporting Information. Using the tree graph as a guide, we inferred an equation to quantify the difference in the true and observed proportions with culture conversion, resulting in the parameters specified below. The values applied to each of the following parameters are listed in Table 1.

thumbnail
Table 1. Parameters and values, simulation study of bias due to early death and loss-to-follow up events occurring during a hypothetical post-treatment initiation sputum collection interval among participants missing a pre-treatment sputum culture.

https://doi.org/10.1371/journal.pone.0276457.t001

Culture positivetruth (abbreviated Pt), represents the proportion who would have been observed to be culture positive at the time of treatment initiation, had they had a culture.

Culture missingobserved (abbreviated m), represents the proportion missing a pre-treatment culture.

Culture positivetruth│Culture missingobserved (abbreviated Pt│m), represents the proportion with a missing pre-treatment culture, who would have been observed to have a positive culture at treatment initiation, had they had a culture.

Converted│Culture positivetruth (abbreviated C│Pt), represents the proportion with conversion among patients who would have been observed to have a positive culture at the time of treatment initiation, had they had a culture.

The proportion with conversion is calculated by dividing the number of patients observed to have converted by the number of patients observed with a positive baseline culture. We calculate the observed proportion with conversion (Converted│Culture positiveobserved (abbreviated C│PO)) as follows: (Supporting Information). This formula includes all conversion events in the numerator and subtracts from the denominator patients missing a culture who would have been positive, had they had a culture in the interval. We hypothesized early deaths and LTFU occurring during the post-treatment interval would drive differences between true and observed conversion frequencies, and therefore that conversion in patients missing a pre-treatment culture occurred at an equal or lower frequency than among patients observed to have a pre-treatment culture. This assumption limits C│PO to values greater than or equal to C│Pt, We report the difference between C│Pt and C│PO and the minimum and maximum proportion of the cohort observed to have converted and percentage point discrepancy between the two figures, where the maximum proportion observed to have converted assumes all patients with Pt│m = 1 do not convert. Values presented in Table 1 were simulated irrespective of whether, in combination, they produced results that exceeded the 0.00 to 1.00 bounds of a proportion (e.g., 0.70 * 0.80 / [0.70 - (1.0*0.5)] = 2.80). We excluded such results, as they would not be possible in a real patient cohort.

Quantifying maximum bias in an observational cohort

In order to determine the extent bias might have impacted a real cohort of DR-TB patients, we used data from the endTB observational cohort (ClinicalTrials.gov record NCT02754765). The endTB observational cohort is a prospective cohort of patients treated with bedaquiline and/or delamanid in 17 countries. Patients were eligible if they initiated an endTB regimen between 04/01/2015-11/16/2018 [18, 19]. The endTB Observational Study protocol was approved by central ethics review committees for each consortium partner, and local ethical approval was obtained in all endTB countries. All study activities were carried out following the principles of the Declaration of Helsinki. Participants provided written informed consent for inclusion in the observational cohort.

Baseline culture definitions.

In primary analyses, we compared a baseline culture definition with an allowable interval of 90 days before (-90) and 0 days after (+0) treatment initiation to definitions extending the interval to 30, 60, and 90 days after treatment initiation. For the latter definitions, patients with any positive culture(s) in the allowable interval were considered to have a positive baseline culture. Patients without any cultures in the allowable interval were classified as missing a baseline culture.

Culture conversion definitions.

We used an interim endpoint of six-month culture conversion, defined as two consecutive negative cultures collected at least 15 days apart, the first occurring up to 180 days after treatment initiation and the second up to 210 days after treatment initiation. Negative cultures were counted only if they were performed on samples collected after the baseline positive culture had been established. Participants who died or were LTFU before conversion were considered not to have converted because they had not experienced conversion and these events are considered unfavorable final treatment outcomes [20]. Death was due to any cause and LTFU was defined as treatment interruption for ≥2 consecutive months.

Calculating maximum bias in the frequency of culture conversion.

We quantified the reported proportion with conversion (abbreviated C│P) as follows: . For conversion definitions including an interval extending past treatment initiation, we report the number of participants added and the number of participants missing a baseline culture who died or were LTFU during the post-treatment initiation interval. In order to investigate the upper bound of bias, we calculated the proportion converted, assuming a scenario of maximum bias (Converted│Culture positivemaximum bias, abbreviated C│Pmb) as follows: .

This equation reflects maximum bias in that it presumes 100% of patients with a missing pre-treatment culture who died or were LTFU during the allowable post-treatment initiation culture interval would have been observed to be culture-positive, had they had a culture. As this percentage decreases from 100% the expected magnitude of bias decreases.

Results

Quantifying bias using simulated data

Combinations of the values listed in Table 1 resulted in 420 scenarios; 66 exceeded the 0.00 to 1.00 bounds for a proportion and were excluded, leaving 354 results. Fig 1 provides a guided interpretation of simulation results presented in Figs 24 and annotates two of the most influential drivers of bias. The horizontal line represents C│Pt. The shaded region indicates the potential minimum and maximum bias as a function of the proportion of patients who did not convert among those missing a pre-treatment culture at the value of m on the x-axis. Thus, the upper bound of the shaded region represents the proportion observed if no patients missing a pre-treatment culture converted. The lower bound of the shaded region reflects the point conversion frequencies in patients missing a pre-treatment culture and patients observed to have a pre-treatment culture were the same. The two most influential drivers of bias, as shown by the width of the shaded region, are the proportion of patients missing a pre-treatment culture (x-axis) and the proportion of these patients who did not convert among those missing a pre-treatment culture (vertical point within shaded region), the latter of which we hypothesize to be due with death and LTFU during the post-treatment initiation interval.

thumbnail
Fig 1. Culture conversion among participants missing a pre-treatment culture, simulation study of cohort where Pt = 70%, Pt│m = 50%, and C│Pt = 70%.

Fig 1 represents a simulated cohort of patients in which: 1) 70% are truly culture positive, 2) Of patients missing a culture 50% are truly culture positive and 50% are truly culture negative patients, and 3) among truly culture-positive patients, 70% achieved culture conversion. If 20% (x-axis = 0.20) of patients were missing their pre-treatment culture and 100% of these patients did not convert (e.g., due to early death or LTFU during the post-treatment interval), the observed proportion with culture conversion would be 82% (■), a 12 percentage point discrepancy. If 65% (i.e. the halfway point of the shaded region) did not convert, the observed proportion would be 76% (▲), a 6 percentage point discrepancy. If 30% did not convert (i.e. the point at which conversion frequencies in patients missing a baseline culture and patients observed to have a baseline culture are equal), the observed proportion would be 70% (●), no discrepancy. The shaded region can be interpreted similarly in Figs 24. Abbreviations: Culture positivetruth (Pt); Culture positivetruth│Culture missingobserved (Pt│m); Converted│Culture positivetruth (C│Pt).

https://doi.org/10.1371/journal.pone.0276457.g001

thumbnail
Fig 2. Culture conversion among participants missing a pre-treatment culture, simulation study of cohort where Pt = 70%, Pt│m = 50%, and C│Pt = 50%, 70%, or 90%.

In cohorts with high culture conversion frequencies (e.g. 90% conversion in blue), there are a finite number of patients who can be missing a pre-treatment culture (e.g. 15% at 90% conversion), assuming missing a pre-treatment culture is perfectly correlated with non-conversion due to early death or LTFU during the post-treatment interval (upper bound of shaded region).

https://doi.org/10.1371/journal.pone.0276457.g002

thumbnail
Fig 3. Culture conversion among participants missing a pre-treatment culture, simulation study of cohort where Pt varies from 60% to 90%, Pt│m = 50%, and C│Pt = 50%, 70%, or 90%.

As the proportion of patients culture positive at treatment initiation increases (each panel), the potential magnitude of bias decreases (shaded regions become smaller). This is because, assuming the proportion missing a culture who are culture positive is held constant (here, 50%), the exclusion of the same number of patients from a smaller cohort (i.e. smaller proportion of culture positive patients = smaller denominator) is more influential on the observed proportion with culture conversion than in a larger cohort (i.e. larger proportion of culture positive patients = larger denominator).

https://doi.org/10.1371/journal.pone.0276457.g003

thumbnail
Fig 4. Culture conversion among participants missing a pre-treatment culture, simulation study of cohort where Pt = 70%, Pt│m is varied from 0–100% and C│Pt = 50%, 70%, or 90%.

The maximum magnitude of bias (top of each shaded region) is dependent on the proportion of patients who are culture positive among those missing a pre-treatment culture (each panel). If no (0%) patients missing a pre-treatment culture are culture positive, then these patients would be excluded from the analysis and no bias will be introduced (top left). Conversely, if all (100%) patients missing a pre-treatment culture are culture positive, then these patients should be included and the most potential for bias introduced (bottom right).

https://doi.org/10.1371/journal.pone.0276457.g004

Four patterns emerged from the simulation. First, the potential for bias increases as m increases, as shown by the larger width of shaded regions at higher values of the x-axis in Figs 24. Second, the potential for bias is limited in cohorts with high frequencies of conversion, as shown by the leveling off of the shaded region’s upper bound at 100% where C│Pt = 90% and m = ~15% in Fig 2. This is because the upper bound reflects a scenario in which all patients missing a pre-treatment culture do not convert and, in cohorts with high frequencies of conversion, there are a smaller number of patients who do not convert. Third, holding other parameters fixed, as Pt increases from 60% to 90%, the potential maximum bias decreases, as shown by the decreasing shaded regions’ widths across panels in Fig 3. This is because the sample size for a cohort in which 90% of patients are eligible (e.g. a denominator of 900 in a cohort of 1000 patients) will be larger than that in which 60% are eligible (e.g. a denominator of 600 in a cohort of 1000 patients). In addition, excluding the same number of patients from a cohort with a smaller denominator is more influential on the observed proportion than in a cohort with a larger denominator. Lastly, the magnitude of bias is dependent on Pt│m (Fig 4). If all patients missing a pre-treatment culture would be culture negative had they had a culture, these patients would be excluded from analyses of conversion endpoints and no bias will be introduced. Conversely, if all patients missing a pre-treatment culture would be culture positive had they had a culture, these patients should be included. The magnitude of bias will then depend on the amount of missingness and non-conversion frequencies in this subset of the cohort, and to a lesser extent, the proportion of patients culture positive at treatment initiation, had they had a culture (Fig 3).

Quantifying maximum bias in the endTB observational cohort data

In the endTB observational study, 2789 participants initiated a regimen and consented to participate. Of these, 1769 participants had a positive pre-treatment culture within 90 days before treatment initiation (-90/+0) and a 6-month conversion outcome (Table 2). Approximately 86% (N = 1518/1769) achieved conversion by 6 months. Applying a baseline culture definition extending 30 days past treatment initiation included 114 additional patients and yielded a similar conversion frequency (1614/1883, 86%).

thumbnail
Table 2. Sputum culture conversion and early death and loss-to-follow up events among participants missing a sputum culture in the specified interval before (-) and after (+) treatment initiation, endTB observational cohort.

https://doi.org/10.1371/journal.pone.0276457.t002

Seventeen participants without a pre-treatment culture, nearly half of whom were treated in a single high HIV burden country, died or were LTFU in the 30-day period after treatment initiation. Assuming these participants would have been culture positive if they had had a culture, the proportion with conversion would be one percentage-point lower (85%, N = 1614/1900) than the observed proportion (Table 2, Fig 5, -90/+30 days). The potential maximum bias differed by site. A 1–5 percentage point discrepancy between the observed proportion with conversion and proportion with conversion assuming maximum bias (Fig 5, -90/+30 days) was observed in the 6 sites with at least one death or LTFU event within 30 days of treatment initiation among participants missing a pre-treatment culture (Table 2). Similar findings were observed when extending the interval 60 and 90 days past treatment initiation (Supporting Information), with the exception of one site with a small sample size (N = 4 at -90/+90 days), which had a 10 percentage point discrepancy.

thumbnail
Fig 5. Absolute proportion of sputum culture conversion in the endTB observational cohort, by site assuming a baseline sputum culture collection interval 90 days before and after 30 days after treatment initiation.

* Proportion of the cohort with sputum culture conversion, assuming maximum bias was calculated as follows: . Sites on the green line indicate no deaths or loss-to-follow up events among participants with a missing culture occurred in the specified interval before (-) and after (+) treatment initiation.

https://doi.org/10.1371/journal.pone.0276457.g005

Discussion

Using simulated data and observational cohort data, we investigated the potential for selection bias when extending baseline culture definitions to include a period after treatment initiation. Our findings have important implications for investigators reporting on descriptive outcomes of DR-TB treatment cohorts. In the present analyses, we identified the most influential factors increasing bias were the proportion of the cohort with a missing pre-treatment culture and the occurrence of death and LTFU in this group.

Simulation studies are a tool for exploring biases in epidemiology. However, simulations are only useful to the extent they are encoded with realistic values [16]. In simulations, we present the entire spectrum of bias in the reported proportion with conversion. In reality, the magnitude of bias is likely below the upper bound of these estimates because it is improbable that everyone missing a pre-treatment culture and who would have been culture positive had they had a culture does not convert (e.g., due to death or LTFU). Smaller amounts of potential bias suggests missing pre-treatment culture is less associated with non-conversion. Simulations with 20–30 percentage point overestimates of conversion proportions required a high frequency of culture-positive patients missing a pre-treatment culture (20–30%) and a high incidence of non-conversion (e.g., due to early death or LTFU in the post-treatment allowable interval) in this group. Early death rates of that magnitude are less common in today’s cohorts given advances in treatment have reduced mortality [21, 22], but not in historical cohorts. High early death rates were common among patients with advanced drug-resistance and HIV co-infection, such as in South Africa [23]. In fact, among DR-TB patients in South Africa between 2012–2014, 10% died within 12 weeks of treatment initiation and a missing or contaminated baseline culture was the strongest predictor of mortality [24]. While this study did not assess conversion, it is an example for which extending the allowable baseline interval past treatment initiation could introduce sizable bias. Theoretically, LTFU rates may have been higher in historical cohorts as well, given the toxicity of older regimens. Other context-dependent factors, such as the distance to treatment sites or war, could result in greater rates of early LTFU. Contamination may be an additional reason for missingness. Guidelines accept contamination frequencies ≤5% for fresh specimens and ≤10% for specimens requiring transport [25]. While contamination may increase the proportion of patients for whom a pre-treatment culture is missing, it is unlikely to be associated with either conversion or nonconversion, limiting the magnitude of bias.

We identified notable heterogeneity in bias across endTB sites. Site-specific differences provide insight into how this mechanism of selection bias can play out across settings with vastly different qualities of laboratory services, treatment programs, and comorbidities—features that our simulations did not explore. For example, high frequencies of early death and LTFU occurred in Lesotho, potentially due to more HIV and advanced drug resistance. And, in Kenya, a small number of early losses drastically biased conversion frequencies due to the site’s small size. Results from the simulation reinforce that low conversion frequencies and small proportions of patients with a positive pre-treatment culture increase bias, two common factors in high HIV burden cohorts. Investigators reporting on patients with comorbidities or other disease characteristics known to predict early death or LTFU should report whether these early events manifest in their cohort and the pre-treatment culture status of such patients. Several steps can be taken to prevent and assess the potential for this bias. During analysis, investigators could implement baseline culture definitions that do not extend the collection interval after treatment initiation. While this definition may exclude patients who had a culture shortly after treatment initiation, it also eliminates the potential for this source of bias. When investigators do extend the culture collection interval past treatment initiation, the investigator can simply check for death or LTFU events occurring in the post-treatment initiation interval among those without a pre-treatment culture. If these events occurred, the investigator should report them, as excluding these patients could introduce selection bias into the final estimate. Further, investigators could perform analyses to calculate the potential upper and lower bounds of the reported outcome to account for uncertainty due to possible selection bias or further explore the potential impact of selection bias by using inverse probability weighting [26, 27].

It is important to note that restricting the study sample to patients with a pre-treatment culture would exclude patients without a pre-treatment culture and could still impose selection bias. This source of selection bias is primarily an issue stemming from missing data and may be particularly problematic when using the interim endpoint of culture conversion if having a pre-treatment culture is associated with another variable. This source of bias is an inherent limitation of using culture conversion as an interim endpoint in the real-world setting where the likelihood of missing pre-treatment culture data is high and elucidates that an endpoint primarily developed for clinical trials may not transfer well to settings with less controlled clinical monitoring and data collection.

During data collection, investigators can avoid bias altogether by making dedicated efforts to collect sputum specimens before or on the day of treatment initiation. However, securing complete pre-treatment culture data is undoubtedly difficult in the context of observational DR-TB cohorts. Contamination occurs, patients may have difficulty producing sputum, and operational challenges to obtaining, processing, and transporting a specimen all impose barriers to complete data. Additionally, priority has been placed on decentralized capacity for rapid molecular diagnostics (e.g. Xpert® MTB/RIF (Cepheid, Sunnyvale, USA)) [28]. This may reduce availability of (pre-treatment) cultures.

We present potential bias estimates disaggregated by each of the 17 enrollment sites of endTB to highlight heterogeneity that may arise from settings of different patient comorbidities and early treatment outcomes. In countries with small sample sizes, even a few patients with a missing pre-treatment culture who die or are LTFU can impose substantial bias in the proportion with conversion. Small sample sizes are not necessarily a study limitation, rather they reflect cohort sizes routinely reported on in the literature: 8% of MDR-TB cohort studies included less than 25 patients and 31% included less than 100 [6]. Second, in the endTB absolute proportion analysis, we calculate the proportion with conversion assuming maximum bias by adding to the denominator 17 patients who were missing a pre-treatment culture and died or were LTFU during the 30-day interval after treatment initiation. An additional 153 patients missing a pre-treatment culture were retained during this same period. We did not pursue analyses to assess how the exclusion of retained patients affected the observed proportion because doing so would require assumptions on the proportion who would have been culture positive had they had a culture and the conversion outcomes in this group, of which both assumptions lack previous evidence to inform their values. Thus, our endTB analysis effectively assumes retained patients with a missing culture would have converted at rates similar to patients with a culture.

Conclusion

The implications of our study findings underscore the need to scrutinize whether bias is introduced when determining who is included and excluded from analyses with culture-based endpoints. Avoiding extension of the baseline culture interval past treatment initiation will eliminate the potential for bias. When this definition is extended past treatment initiation, the decision to do so should be reported and early death and LTFU events among excluded patients should be enumerated. Taking these steps will improve transparency and comparability of study findings across cohorts.

Acknowledgments

We acknowledge and thank Unitaid for financing the endTB project, including the observational study. We are indebted to the patients who participated in the endTB observational study and to the clinicians and program staff of participating national tuberculosis programs. We thank endTB staff at Partners In Health, Médecins Sans Frontières, Epicentre, and Interactive Research and Development. We also thank Leo Martinez for his comments on this work.

Ethics statement

This study was approved by the Partners Healthcare Human Research Committee (Boston, MA, USA), the MSF Ethics Review Board (Geneva, Switzerland), IRD Institutional Review Board (Karachi, Pakistan) and in all 17 implementing countries by appropriate government authorities or local ethics committees (Armenia: Ethics Committee of Yerevan State Medical University after Mkhitar Heratsi; Bangladesh: Ethical Committee, National Institute of Diseases of the Chest and Hospital; Belarus: Ethics Committees of the Republican Scientific and Practical Centre of Pulmonology and Tuberculosis; DPRK: Ministry of Public Health; Ethiopia: National Research Ethics Review Committee of Ministry of Scient and Technology; Georgia: Ethics Committee of National Center for Tuberculosis and Lung Diseases; Haiti: Comité Des Droits Humains Des Centres GHESKIO, Zanmi Lasante Research Committee; Indonesia: Ethics Committee, Faculty of Medicine, Universitas Indonesia; Kazakhstan: National Scientific Center of Phthisiopulmonology of the Ministry of Health; Kenya: The Scientific and Ethics Review Unit, Kenya Medical Research Institute; Kyrgyzstan: Committee on Bioethics under the MoH of the Kyrgyz Republic; Lesotho: Ministry of Health Research and Ethics Committee; Myanmar: Ethics Review Committee, Department of Medical Research, Ministry of Health and Sports; Pakistan: IRD Institutional Review Board; Peru: Institutional Research Ethics Committee at the Peruvian University of Cayetano Heredia; South Africa: Bio Medical Research Ethics Committee, University of KwaZulu-Natal; Vietnam: Sciences and Ethical Committee of the National Lung Hospital and Independent Ethics Committee, Ministry of Health).

References

  1. 1. World Health Organization. WHO treatment guidelines for multidrug- and rifampicin-resistant tuberculosis, 2018 update. WHO/CDS/TB/2018.15.
  2. 2. Mitnick CD, White RA, Lu C, Rodriguez CA, Bayona J, Becerra MC, et al. Multidrug-resistant tuberculosis treatment failure detection depends on monitoring interval and microbiological method. European Respiratory Journal. 2016;48(4). pmid:27587552
  3. 3. Kurbatova E V, Cegielski JP, Lienhardt C, Akksilp R, Bayona J, Becerra MC, et al. Sputum culture conversion as a prognostic marker for end-of-treatment outcome in patients with multidrug-resistant tuberculosis: a secondary analysis of data from two observational cohort studies. Lancet Respir Med. 2015 Mar;3(3):201–9. pmid:25726085
  4. 4. Meyvisch P, Kambili C, Andries K, Lounis N, Theeuwes M, Dannemann B, et al. Evaluation of six months sputum culture conversion as a surrogate endpoint in a multidrug resistant-tuberculosis trial. PLoS One. 2018 Jul 19;13(7):e0200539–e0200539. pmid:30024924
  5. 5. WHO consolidated guidelines on drug-resistant tuberculosis treatment. Geneva: World Health Organization; 2019. Licence: CC BY-NC-SA 3.0 IGO.
  6. 6. Rodriguez CA, Brooks MB, Aibana O, Mitnick CD, Franke MF. Sputum culture conversion definitions and analytic practices for multidrug-resistant TB. Int J Tuberc Lung Dis. 2021 Jul;25(7):596–8. pmid:34183109
  7. 7. Smith LH. Selection Mechanisms and Their Consequences: Understanding and Addressing Selection Bias. Curr Epidemiol Rep. 2020.
  8. 8. Ray WA. Evaluating Medication Effects Outside of Clinical Trials: New-User Designs. Am J Epidemiol [Internet]. 2003 Nov 1;158(9):915–20. Available from: pmid:14585769
  9. 9. Greenland S. Quantifying Biases in Causal Models: Classical Confounding vs Collider-Stratification Bias. Epidemiology. 2003;14(3). pmid:12859030
  10. 10. Cole SR, Platt RW, Schisterman EF, Chu H, Westreich D, Richardson D, et al. Illustrating bias due to conditioning on a collider. Int J Epidemiol. 2010 Apr 1;39(2):417–20. pmid:19926667
  11. 11. Whitcomb BW, Schisterman EF, Perkins NJ, Platt RW. Quantification of collider-stratification bias and the birthweight paradox. Paediatr Perinat Epidemiol. 2009 Sep;23(5):394–402. pmid:19689488
  12. 12. Heinke D, Rich-Edwards JW, Williams PL, Hernandez-Diaz S, Anderka M, Fisher SC, et al. Quantification of selection bias in studies of risk factors for birth defects among livebirths. Paediatr Perinat Epidemiol. 2020 Nov 1;34(6):655–64. pmid:32249969
  13. 13. Del Junco DJ, Bulger EM, Fox EE, Holcomb JB, Brasel KJ, Hoyt DB, et al. Collider bias in trauma comparative effectiveness research: the stratification blues for systematic reviews. Injury. 2015 May;46(5):775–80. pmid:25766096
  14. 14. Mayeda ER, Glymour MM. The Obesity Paradox in Survival after Cancer Diagnosis: Tools for Evaluation of Potential Bias. Cancer Epidemiology Biomarkers & Prevention. 2017 Jan 1;26(1):17 LP– 20. pmid:28069728
  15. 15. Howe CJ, Cole SR, Lau B, Napravnik S, Eron JJ Jr. Selection Bias Due to Loss to Follow Up in Cohort Studies. Epidemiology. 2016 Jan;27(1):91–7. pmid:26484424
  16. 16. Rudolph JE, Fox MP, Naimi AI. Simulation as a Tool for Teaching and Learning Epidemiologic Methods. Am J Epidemiol. 2020 Oct 21.
  17. 17. Lash TL, Fox MP, Fink AK. Applying Quantitative Bias Analysis to Epidemiologic Data. 2009.
  18. 18. Khan U, Huerga H, Khan AJ, Mitnick CD, Hewison C, Varaine F, et al. The endTB observational study protocol: treatment of MDR-TB with bedaquiline or delamanid containing regimens. BMC Infect Dis. 2019 Aug;19(1):733. pmid:31429722
  19. 19. Franke MF, Khan P, Hewison C, Khan U, Huerga H, Seung KJ, et al. Culture Conversion in Patients Treated with Bedaquiline and/or Delamanid: A Prospective Multi-country Study. Am J Respir Crit Care Med. 2020 Jul 24.
  20. 20. World Health Organisation. Definitions and reporting framework for tuberculosis– 2013 revision. World Health Organisation. 2014.
  21. 21. Ndjeka N, Schnippel K, Master I, Meintjes G, Maartens G, Romero R, et al. High treatment success rate for multidrug-resistant and extensively drug-resistant tuberculosis using a bedaquiline-containing treatment regimen. European Respiratory Journal. 2018 Dec 1;52(6):1801528. pmid:30361246
  22. 22. Conradie F, Diacon AH, Ngubane N, Howell P, Everitt D, Crook AM, et al. Treatment of Highly Drug-Resistant Pulmonary Tuberculosis. New England Journal of Medicine. 2020 Mar 4;382(10):893–902. pmid:32130813
  23. 23. Gandhi NR, Shah NS, Andrews JR, Vella V, Moll AP, Scott M, et al. HIV Coinfection in Multidrug- and Extensively Drug-Resistant Tuberculosis Results in High Early Mortality. Am J Respir Crit Care Med. 2010 Jan 1;181(1):80–6. pmid:19833824
  24. 24. Schnippel K, Firnhaber C, Ndjeka N, Conradie F, Page-Shipp L, Berhanu R, et al. Persistently high early mortality despite rapid diagnostics for drug-resistant tuberculosis cases in South Africa. International Journal of Tuberculosis and Lung Disease. 2017 Oct 1;21(10):1106–11. pmid:28911353
  25. 25. Narvaiz de Kantor I, Frieden TR, Laszlo A, Fabio L, Pierre-Yves N, Hans LR, et al. 1998. Laboratory services in tuberculosis control. WHO, Geneva, Switzerland.
  26. 26. Cole SR, Hudgens MG, Edwards JK, Brookhart MA, Richardson DB, Westreich D, et al. Nonparametric Bounds for the Risk Function. Am J Epidemiol [Internet]. 2019 Apr 1;188(4):632–6. Available from: https://pubmed.ncbi.nlm.nih.gov/30698633 pmid:30698633
  27. 27. Mansournia MA, Altman DG. Inverse probability weighting. BMJ [Internet]. 2016;352. Available from: https://www.bmj.com/content/352/bmj.i189 pmid:26773001
  28. 28. Molecular assays intended as initial tests for the diagnosis of pulmonary and extrapulmonary TB and rifampicin resistance in adults and children: rapid communication. Policy update. Geneva: World Health Organization; 2020. Licence: CC BY-NC-SA 3.0 IGO.