Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Diagnostic accuracy of nanopore sequencing for the rapid diagnosis of pulmonary tuberculosis: A protocol for a systematic review and meta-analysis

  • Guocan Yu,

    Roles Data curation, Formal analysis, Investigation, Methodology, Resources, Software, Writing – original draft, Writing – review & editing

    Affiliation Department of Thoracic Surgery, Hangzhou Red Cross Hospital, Hangzhou, Zhejiang, China

  • Xudong Xu,

    Roles Investigation, Methodology, Resources, Validation, Visualization, Writing – original draft

    Affiliation Department of Thoracic Surgery, Hangzhou Red Cross Hospital, Hangzhou, Zhejiang, China

  • Yanqin Shen,

    Roles Data curation, Formal analysis, Resources, Supervision

    Affiliation Department of Nursing, Hangzhou Red Cross Hospital, Hangzhou, Zhejiang, China

  • Bifei Fang

    Roles Conceptualization, Project administration, Software, Supervision, Writing – review & editing

    fangbifeimz@163.com

    Affiliation Department of Nursing, Hangzhou Red Cross Hospital, Hangzhou, Zhejiang, China

Abstract

Background

Pulmonary tuberculosis (PTB) is the most common type of tuberculosis (TB). Rapid diagnosis of PTB can help in TB control. Although the use of molecular tests (such as the GeneXpert MTB/RIF) has improved the ability to rapidly diagnose PTB, there is still room for improvement. Nanopore sequencing is a novel means of rapid TB detection. The purpose of this study was to establish a systematic review and meta-analysis protocol for evaluating the accuracy of nanopore sequencing for the rapid diagnosis of PTB.

Methods

We completed this protocol according to the Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) statement and registered on the PROSPERO platform. We will screen studies related to nanopore sequencing for diagnosis of PTB by searching through PubMed, EMBASE, the Cochrane Library using English, and Wanfang database, CNKI (China National Knowledge Infrastructure) using Chinese. Eligible studies will be screened according to the inclusion and exclusion criteria established in the study protocol. We will evaluate the methodological quality of the individual included studies using Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2). We will use Stata (version 15.0) with the midas command and RevMan (version 5.3) for meta-analysis and forest plots and SROC curves generation. A p < 0.05 was treated as a statistically significant difference. When significant heterogeneity exists between studies, we will explore sources of heterogeneity through meta-regression analysis and subgroup analysis.

Conclusion

To the best of our knowledge, this will be the first systematic review and meta-analysis of nanopore sequencing for the diagnosis of PTB. We hope that this study will find a new and effective tool for the early diagnosis of PTB.

PROSPERO Registration number

CRD42023495593.

Introduction

Tuberculosis (TB), a chronic infectious disease caused by Mycobacterium tuberculosis complex (MTB) infection of the body, continues to pose a major threat to human health [1]. TB causes millions of human deaths each year, the most deaths caused by a single infectious disease [2]. Pulmonary TB (PTB) is the most predominant type of TB, accounting for about 80% of all TB [3]. Because of the open nature of the respiratory tract, MTB can be discharged to the outside world via the respiratory tract and thus infect other people; therefore, PTB is the main source of infection for TB transmission [4]. The control of PTB is the key to ending TB epidemic [5]. The control of PTB relies on early and rapid diagnosis of the disease so that standardized and effective treatment can be given to minimize the number and duration of MTB emissions in patients with PTB [3].

The traditional classical TB detection means have some limitations. The acid-fast bacilli (AFB) smear is a very widely used routine test for TB, although it is simple to operate and inexpensive, it has low sensitivity, cannot effectively detect PTB [3]. AFB smear cannot distinguish between MTB and non-tuberculosis mycobacteria (NTM) [6], and there is a possibility of miss-diagnosis and misdiagnosis [6]. MTB culture is another test that is essential for the diagnosis of PTB, and while it is effective in diagnosing PTB and differentiating NTM, the time it takes to obtain results is lengthy, often taking weeks [7], and this time may also lead to significant MTB dissemination [8]. GeneXpert MTB/RIF is a commonly used molecular diagnostic tool in clinical practice [9], but the test remains limited in its ability to diagnose smear-negative PTB [2], and it only detects rifampicin resistance [10]. The development of other effective early rapid tests for PTB diagnosis is urgently needed.

Gene sequencing is the gold standard for the diagnosis of infection pathogens, by which the species of the pathogen can be clarified [11]. GeneXpert MTB/RIF has played a very important role in the rapid diagnosis of PTB, but its diagnostic accuracy still needs to be further improved. Several studies have shown that GeneXpert MTB/RIF is less accurate than gene sequencing methods (such as nanopore sequencing) for the diagnosis of PTB [1214]. Nanopore sequencing is a new generation of gene sequencing technology, which is characterized by fast sequencing speed, long sequencing reads, real-time monitoring of sequencing data, and portable equipment [15]. So far, nanopore sequencing is relatively expensive compared to other tests and requires good laboratory conditions, but these are not worth mentioning compared to its benefits [16]. Nanopore sequencing is now showing its advantages in the field of infectious disease diagnosis, which can effectively improve the detection efficiency of pathogenic bacteria [17, 18]. Nanopore sequencing has also been applied in the early and rapid diagnosis of TB, showing satisfactory diagnostic accuracy and is a new star in the field of TB diagnosis [12]. In PTB, even in smear-negative PTB diagnosis, nanopore sequencing likewise demonstrated very good diagnostic accuracy [13, 19]. The results of previous research suggested that the area under the curve (AUC) value obtained via nanopore sequencing were significantly higher than the AUC value obtained via AFB smear microscopy (0.88 vs. 0.55; P < 0.001), MTB culture (0.88 vs. 0.68; P < 0.001), and GeneXpert MTB/RIF (0.88 vs. 0.71; P < 0.001) [20]. Studies on nanopore sequencing for PTB are basically single-center studies [13, 21], and although the performance is satisfactory, there is no evidence-based medical evidence to evaluate the overall diagnostic accuracy of nanopore sequencing for PTB. The objective of this study is to determine the accuracy of nanopore sequencing on the diagnosis of PTB and whether that effect could improve the diagnosis of PTB as a whole using a systematic review and meta-analysis approach, enabling clinicians to better recognize the role of nanopore sequencing in the rapid diagnosis of PTB.

Methods

Design and registration

We completed this protocol for systematic review and meta-analysis according to the Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) statement [22] and registered on the PROSPERO platform with registration number CRD42023495593. We will report the full study results according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis for Diagnostic Test Accuracy (PRISMA-DTA) statement [23]. Ethical approval is not required for systematic reviews and meta-analyses; therefore, this study was exempt from ethical approval.

Information sources

We will screen studies related to nanopore sequencing for diagnosis of PTB by searching through PubMed, EMBASE, the Cochrane Library using English, and Wanfang database, CNKI (China National Knowledge Infrastructure) using Chinese. References to published meta-analysis or reviews on similar topics will be carefully evaluated to further identify suitably qualified studies.

Search strategy

Two independent researchers (Guocan Yu and Xudong Xu) will design a search strategy for each database that meets the needs of the topic and finalize the search strategy after discussing with each other. The two researchers will develop an effective search strategy through consultation. We will search English databases in English and Chinese databases in Chinese, and there will be no time restriction on the search process. We will conduct an update search prior to the completion of the research to minimize the omssion of studies that might meet the inclusion criteria. The search strategy for PubMed is reported as follows:

  1. #1 "Tuberculosis, Pulmonary"[Mesh] OR “Tuberculoses, Pulmonary” OR “Pulmonary Tuberculoses” OR “Pulmonary Tuberculosis” OR “Pulmonary Consumption” OR “Consumption, Pulmonary” OR “Consumptions, Pulmonary” OR “Pulmonary Consumptions” OR “Pulmonary Phthisis” OR “Phthises, Pulmonary” OR “Phthisis, Pulmonary” OR “Pulmonary Phthises” OR PTB OR “Pulmonary TB” OR PTB
  2. #2 "Nanopore Sequencing"[Mesh] OR “Nanopore Sequencings” OR “Sequencing, Nanopore” OR “third generation sequencing” OR “Oxford Nanopore Technology” OR “Oxford Nanopore Technologies” OR ONT
  3. #3 #1 AND #2

Eligibility criteria

Type of studies.

Any study that reported results on the diagnostic accuracy of nanopore sequencing for the diagnosis of PTB will be included in this study.

Participants.

Patients with PTB, there will be no restrictions on age, race, or gender.

Index tests.

Nanopore sequencing will be treated as index test.

Comparator test.

Comparator tests will be optional as this study only evaluated the diagnostic accuracy of nanopore sequencing for PTB.

Outcomes.

Diagnostic accuracy metrics such as sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and AUC will be treated as outcome metrics.

Reference standard.

Clinical diagnosis and MTB culture will be treated as reference standards. Clinical diagnosis is the result of a comprehensive assessment of multiple evaluation indicators (such as clinical symptoms, pulmonary imaging changes, TB immunologic testing, MTB smear, culture, molecular diagnostic test results of respiratory specimens and anti-TB efficacy).

Target conditions.

Original studies evaluating nanopore sequencing for the diagnosis of PTB and reporting clear reference standards will be included in this systematic review and meta-analysis. Articles for which true positive (TP), false positive (FP), false negative (FN), and true negative (TN) values can be obtained from the original study or calculated from information provided in the article will meet the inclusion criteria. If insufficient information was provided in the study, we will contact the corresponding author of the article to seek additional information. Studies for which TP, FP, FN, and TN values are not available, case reports, reviews, conference abstracts without full-text reporting, and studies published in languages other than English and Chinese will be excluded.

Literature screening and selection.

We will use Endnote (version 9.2) to unify the management of literature obtained from searches of various databases. We will strictly follow the inclusion and exclusion criteria set by this protocol to screen the literature. Two independent researchers (Guocan Yu and Xudong Xu) will individually screen relevant literature, first by title, then abstract, and finally full text to determine if it fits the research topic. They will check the screening results with each other, and articles with inconsistent conclusions will be further analyzed and discussed with a third independent researcher (Bifei Fang) to make a final decision.

Data extraction.

The final included studies obtained through screening will be extracted with relevant data such as basic information about the study, nanopore sequencing for diagnosis of PTB. Basic information includes the year the study was published, the country in which the study was conducted, the name of the first author, the type of study, the method of patient selection, the type of patient (adult or children, AIDS or not), the sample size, the type of PTB (smear-positive or not), and reference standards (clinical diagnosis or MTB culture). Information related to nanopore sequencing for diagnosis of PTB, such as TP, FP, FN, TN values, type of samples (sputum or bronchoalveolar lavage fluid), and type of nanopore sequencing (targeted amplification or not). As in the literature screening stage, the same two independent researchers will each extract relevant information and check it with each other, and where there is disagreement discuss it with the third independent researcher for a final decision.

Methodological quality assessment.

We will evaluate the methodological quality of the individual included studies using Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) [24]. This is a widely used evaluation tool that incorporates 4 domains (patient selection, index test, reference standard, and flow and timing). The same two independent researchers will assess the methodological quality of the individual included studies separately, and inconsistencies will be decided through discussion with a third independent researcher. We will use funnel plots to examine data to identify the potential for studies to be missing.

Data synthesis and statistical analysis.

We will calculate the pooled sensitivity, specificity, PPV, NPV, AUC and their 95% confidence intervals (CIs) using the four values TP, FP, FN, and TN. We will calculate and evaluate the relevant outcome metrics separately according to different reference standards. For the evaluation of heterogeneity between studies we will use the I statistic, where I2 = 0 suggests that there is no heterogeneity between studies, I2<50% suggests that there is insignificant heterogeneity between studies, and I2>50% suggests that there is significant heterogeneity between studies. When significant heterogeneity existed between studies, we will explore the source of heterogeneity, which will be further explored through subgroup analysis and meta-regression analysis if the number of included studies are sufficient. We will perform subgroup analysis and meta-regression analysis based on different study types, different methods of patient screening, different types of specimens, different types of patients, different types of PTBs, and different types of nanopore sequencing. The robustness of the correlation analysis will be evaluated through sensitivity analysis. We will use Stata (version 15.0, Stata Corp., College Station, TX, USA) with the midas command and RevMan (version 5.3, Cochrane Collaboration, Oxford, United Kingdom) for meta-analysis and forest plots and SROC curves generation [25]. A p-value of less than 0.05 was treated as a statistically significant difference.

Evidence evaluation.

We will evaluate the quality of evidence by following the Grading of Recommendations Assessment, Development and Evaluation (GRADE)-guidelines [26]. Based on the results of the assessment, the quality of evidence will be categorized into four levels: high, moderate, low, and very low.

Discussion

With a large patient population, PTB is a major stumbling block on the road to ending TB and requires focused attention [27]. Early and rapid diagnosis is a prerequisite for PTB eradication, and nanopore sequencing may be an effective tool to significantly improve early diagnosis. To the best of our knowledge, this will be the first systematic review and meta-analysis of nanopore sequencing for the diagnosis of PTB. Our study will include only relevant studies in English and Chinese, which may lead to biased results. We will seek to publish our meta-analysis in peer-reviewed journals, and will upgrade the manuscript if there are corrections that need to be made. We hope that this study will find a new and effective tool for the early diagnosis of PTB.

Supporting information

S1 File. Preferred Reporting Items for Systematic review and Meta-Analysis Protocols (PRISMA-P) checklist.

https://doi.org/10.1371/journal.pone.0304162.s001

(DOC)

S2 File. Search strategies for English and Chinese databases.

https://doi.org/10.1371/journal.pone.0304162.s002

(DOCX)

References

  1. 1. Hazra D, Lam C, Chawla K, Sintchenko V, Dhyani VS, Venkatesh BT. Impact of Whole-Genome Sequencing of Mycobacterium tuberculosis on Treatment Outcomes for MDR-TB/XDR-TB: A Systematic Review. Pharmaceutics. 2023;15(12). pmid:38140122
  2. 2. Zheng H, Zhong F, Yu G, Shen Y. Comparison of the diagnostic efficacy of the CapitalBio Mycobacterium real-time polymerase chain reaction detection test and Xpert MTB/RIF in smear-negative pulmonary tuberculosis. Eur J Clin Microbiol Infect Dis. 2021;40(5):969–77. pmid:33242168
  3. 3. Qiu X, Zheng S, Yang J, Yu G, Ye Y. Comparing Mycobacterium tuberculosis RNA Accuracy in Various Respiratory Specimens for the Rapid Diagnosis of Pulmonary Tuberculosis. Infect Drug Resist. 2022;15:4195–202. pmid:35946035
  4. 4. Malede A, Taye B, Legesse M, Debie A, Shibabaw A. Pulmonary tuberculosis preventive practices among Anibessa Bus users at Addis Ababa, Ethiopia: a cross-sectional study. BMC Res Notes. 2019;12(1):104. pmid:30808404
  5. 5. Wu Q, Liu Y, Ma YB, Liu K, Chen SH. Incidence and prevalence of pulmonary tuberculosis among patients with type 2 diabetes mellitus: a systematic review and meta-analysis. Ann Med. 2022;54(1):1657–66. pmid:35703920
  6. 6. Shen Y, Fang L, Xu X, Ye B, Yu G. CapitalBio Mycobacterium real-time polymerase chain reaction detection test: Rapid diagnosis of Mycobacterium tuberculosis and nontuberculous mycobacterial infection. Int J Infect Dis. 2020;98:1–5. pmid:32553719
  7. 7. Yu G, Zhong F, Zhao W, Ye B, Xu K, Chen G. Head-to-head comparison of the diagnostic value of five tests for constrictive tuberculous pericarditis: Five tests for constrictive TBP. Int J Infect Dis. 2022;120:25–32. pmid:35429643
  8. 8. Yu G, Shen Y, Ye B, Shi Y. Diagnostic accuracy of Mycobacterium tuberculosis cell-free DNA for tuberculosis: A systematic review and meta-analysis. PLoS One. 2021;16(6):e0253658. pmid:34161399
  9. 9. Zhang H, Dai X, Hu P, Tian L, Li C, Ding B, et al. Comparison of targeted next-generation sequencing and the Xpert MTB/RIF assay for detection of Mycobacterium tuberculosis in clinical isolates and sputum specimens. Microbiology spectrum. 2024:e0409823. pmid:38602399
  10. 10. Amin W, Gadallah M, Salah A, Rady M. Prevalence of Rifampicin resistance tuberculosis among presumptive tuberculosis patients in Egypt-2021: a national health facility-based survey. BMC infectious diseases. 2024;24(1):210. pmid:38360617
  11. 11. Muigg V, Seth-Smith HMB, Adam KM, Weisser M, Hinić V, Blaich A, et al. Novel Organism Verification and Analysis (NOVA) study: identification of 35 clinical isolates representing potentially novel bacterial taxa using a pipeline based on whole genome sequencing. BMC Microbiol. 2024;24(1):14. pmid:38178003
  12. 12. Yang J, Ye W, Zhang C, Lin W, Mei L, Liu S, et al. Accuracy of Nanopore Sequencing as a Diagnostic Assay for Pulmonary Tuberculosis versus Smear, Culture and Xpert MTB/RIF: A Head-to-Head Comparison. Trop Med Infect Dis. 2023;8(9). pmid:37755902
  13. 13. Yu G, Shen Y, Zhong F, Zhou L, Chen G, Fang L, et al. Diagnostic accuracy of nanopore sequencing using respiratory specimens in the diagnosis of pulmonary tuberculosis. Int J Infect Dis. 2022;122:237–43. pmid:35671950
  14. 14. Zou X, Zhu Y, Qin Y, Fei F, Chen Y, Wang P, et al. Value analysis of next-generation sequencing combined with Xpert in early precise diagnosis of pulmonary tuberculosis. Diagnostic microbiology and infectious disease. 2023;107(1):115921. pmid:37478548
  15. 15. Lobiuc A, Pavăl NE, Dimian M, Covașă M. Nanopore Sequencing Assessment of Bacterial Pathogens and Associated Antibiotic Resistance Genes in Environmental Samples. Microorganisms. 2023;11(12). pmid:38137978
  16. 16. Dorey A, Howorka S. Nanopore DNA sequencing technologies and their applications towards single-molecule proteomics. Nature chemistry. 2024;16(3):314–34. pmid:38448507
  17. 17. Guo Y, Li Z, Li L, Li S, Sun L, Yang X, et al. A dual-process of targeted and unbiased Nanopore sequencing enables accurate and rapid diagnosis of lower respiratory infections. EBioMedicine. 2023;98:104858. pmid:37925777
  18. 18. Chen J, Xu F. Application of Nanopore Sequencing in the Diagnosis and Treatment of Pulmonary Infections. Mol Diagn Ther. 2023;27(6):685–701. pmid:37563539
  19. 19. Yu G, Shen Y, Yao L, Xu X. Evaluation of Nanopore Sequencing for Diagnosing Pulmonary Tuberculosis Using Negative Smear Clinical Specimens. Infect Drug Resist. 2024;17:673–82. pmid:38405053
  20. 20. Zhou L, Zou X, Hu Q, Hua H, Qi Q. Determination of the diagnostic accuracy of nanopore sequencing using bronchoalveolar lavage fluid samples from patients with sputum-scarce pulmonary tuberculosis. Journal of infection and chemotherapy: official journal of the Japan Society of Chemotherapy. 2024;30(2):98–103. pmid:37714266
  21. 21. Liu Z, Yang Y, Wang Q, Wang L, Nie W, Chu N. Diagnostic value of a nanopore sequencing assay of bronchoalveolar lavage fluid in pulmonary tuberculosis. BMC Pulm Med. 2023;23(1):77. pmid:36890507
  22. 22. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1. pmid:25554246
  23. 23. McInnes MDF, Moher D, Thombs BD, McGrath TA, Bossuyt PM, Clifford T, et al. Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement. Jama. 2018;319(4):388–96. pmid:29362800
  24. 24. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–36. pmid:22007046
  25. 25. Shen Y, Fang L, Ye B, Yu G. Meta-analysis of diagnostic accuracy of nucleic acid amplification tests for abdominal tuberculosis. PLoS One. 2023;18(11):e0289336. pmid:38011098
  26. 26. Mendoza C, Kraemer P, Herrera P, Burdiles P, Sepúlveda D, Núñez E, et al. [Clinical guidelines using the GRADE system (Grading of Recommendations Assessment, Development and Evaluation)]. Rev Med Chil. 2017;145(11):1463–70. pmid:29664529
  27. 27. Khan MK, Islam MN, Ferdous J, Alam MM. An Overview on Epidemiology of Tuberculosis. Mymensingh Med J. 2019;28(1):259–66. pmid:30755580