Figures
Abstract
Background
The LightCycler® Mycobacterium Detection Kit based on real-time PCR technology for the detection of Mycobacterium tuberculosis, Mycobacterium avium and Mycobacterium kansasii was recently developed. This study evaluated its analytical sensitivity, specificity and reproducibility.
Methodology/Principal Findings
Plasmid standards were prepared and used to determine the limit of detection. The assay was also performed against organisms other than mycobacteria, other mycobacterial strains and interfering substances to exclude cross-reactivity and interference. Reference standards were prepared and tested to assess the assay's reproducibility. All PCR assays were performed using the LightCycler® 2.0 Instrument. The detection limit for M. tuberculosis was 28 copies per microlitre. Neither cross-reactivity nor interference occurred with non-mycobacterial organisms and substances tested. Overall reproducibility for consecutive measurements, run-to-run, lot-to-lot, day-to-day and laboratory-to-laboratory achieved a coefficient of variance of less than two percent.
Citation: Omar SV, Roth A, Ismail NA, Erasmus L, Ehlers M, Kock M, et al. (2011) Analytical Performance of the Roche LightCycler® Mycobacterium Detection Kit for the Diagnosis of Clinically Important Mycobacterial Species. PLoS ONE 6(9): e24789. https://doi.org/10.1371/journal.pone.0024789
Editor: Ben J. Marais, University of Stellenbosch, South Africa
Received: April 19, 2011; Accepted: August 18, 2011; Published: September 22, 2011
Copyright: © 2011 Omar et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Introduction
In 2009, 5.8 million cases of tuberculosis were reported to the national tuberculosis control programmes globally where only 57% of the globally notified pulmonary cases were smear positive. Furthermore, the World Health Organization estimates that close to 1.3 million people die as a consequence of the disease. Therefore serious efforts are needed to strengthen the control of tuberculosis [1].
The occurrence of nontuberculous mycobacteria (NTM) from pulmonary samples is occurring with greater frequency driven mainly by the high rates of people living with HIV [2]. The commonest NTM's associated with pulmonary infection are M. avium complex, M. kansasii, M. abscessus and M. fortuitum [2]–[4].
Since tuberculosis is a disease for which the vaccine has failed to provide complete protective immunity [5], its control has relied on early diagnosis and treatment. However, smear microscopy which is the primary tool has a low sensitivity and culture has a very lengthy turnaround time despite its sensitivity [6]. Several nucleic acid amplification tests are available and all aimed at improving the diagnosis of tuberculosis [6]–[9]. However, none of these assays have performed adequately to become the new standard for diagnosis. Recently the Xpert® MTB/Rif (Cepheid, USA) test, based on real-time polymerase chain reaction (PCR), has received WHO endorsement [10].
Real-time PCR provides great hope as it is a highly sensitive, specific, and rapid molecular method. In addition, an assessment of the dissociation-characteristics of double-stranded DNA during heating known as melting curve analysis can provide species identification [11]–[13]. The LightCycler® System (Roche Diagnostics, Germany) has been widely used as a platform for real-time PCR. This platform has the advantage of a high-throughput capacity which is important in a high-burden setting.
A new commercial molecular diagnostic assay the LightCycler® Mycobacterium Detection Kit (Roche Products (Pty) Ltd, Randburg, South Africa), was developed for use on respiratory samples. It is based on the real-time PCR technology for the detection of M. tuberculosis, M. avium and M. kansasii within 90 minutes and amplifies the 16s ribosomal RNA (rRNA) gene which includes the hypervariable region A. The products are detected using the fluorogenic hybridization probes and species identification by melting curve analysis on the LightCycler® 2.0 (Roche Diagnostics, Germany). A synthetic internal control has been integrated into the reaction. This study evaluated the assay's analytical sensitivity, specificity and reproducibility.
Methods
This study was performed at 4 centres viz. the HELIOS Klinikum E. v. Behring (Germany), Institute of Medical Microbiology Hygiene - University of Regensburg (Germany), Department of Medical Microbiology - University of Pretoria (South Africa) and the National Health Laboratory Service - Kimberley laboratory (South Africa).
These centres were involved in analytically evaluating the LightCycler® Mycobacterium Detection Kit by preparation of plasmid standards to determine the limit of detection, a challenge panel consisting of other mycobacterial species, non-mycobacterial organisms and interfering substances to assess specificity and mycobacterial standards to measure reproducibility. The assay's reproducibility in terms of consecutive measurements (intra-run), run-to-run, day-to-day, lot-to-lot and laboratory-to-laboratory was performed at the two South African centres only.
DNA extraction
Mycobacterial reference standards and simulated respiratory samples were decontaminated using N-acetyl-L-cysteine-Sodium hydroxide (NaLc-NaOH) [14] and resuspended in 1.5 ml of phosphate buffer containing 0.5% Tween 80 which allowed better homogenization and even distribution of the bacilli within the suspension prior to extraction.
The COBAS® Amplicor Respiratory Sample Preparation Kit (Roche Diagnostics, Germany) was used according to the manufacturer's instructions. Briefly, a 100 µl aliquot of the NALC-NaOH decontaminated sample was mixed with the kit's wash solution and centrifuged (14,000× g for 10 min). After centrifugation, the supernatant was removed and the lysis reagent was added to the pellet. After brief vortexing, the suspension was incubated at 60°C for 45 min to complete lysis of the mycobacteria. Thereafter the neutralizing reagent was added making a total volume of 200 µl neutralized DNA sample. Four microlitres (4 µl) of the neutralized sample was used as template DNA for subsequent PCR testing.
PCR assay
All PCR assays were performed using the LightCycler® 2.0 (Roche, Germany) real-time instrument. For amplification and detection, the LightCycler® Mycobacterium Detection Kit (Roche Diagnostics) was used according to the manufacturer's instructions. Samples were amplified as follows: initial denaturation step at 95°C for 10 min to activate the FastStart Taq DNA polymerase and 45 cycles of denaturation at 95°C for 10 sec, annealing at 50°C for 10 sec, and an extension at 72°C for 20 sec.
Following the amplification phase, a melting curve analysis at 40°C to 65°C was performed with a temperature transition rate of 0.1°C/sec to determine the melting temperature (Tm) values for the sequences targeted by the hybridization probes. Tm values were either automatically or manually assigned from a plot generated by the instrument. A Tm of 53.5–56.5°C indicated M. tuberculosis, 48–51°C M. avium and 57–60°C M. kansasii.
The generation of target amplicons for each sample was monitored between the annealing and the elongation steps at 640 nm. Samples positive for the specific amplicon (an approximate 200 bp fragment of the mycobacterial 16S rDNA) were identified by the instrument at the cycle number where the fluorescence attributable to the target sequences exceeded that measured for background. Samples scored as positive by the instrument were confirmed by visual inspection of the amplification curve (cycle number versus fluorescence value) generated by the instrument.
Analysis was performed after activation of the colour compensation using the following steps: a positive control showing an exponential amplification curve with a defined crossing point (CP) value of ∼26.5 with a signal intensity of >0.1; a positive control showing a melting curve Tm value of ∼57–60°C for M. kansasii with a signal intensity of >0.1, a negative control showing an exponential amplification curve for the internal control only (detection channel 705/back 530 nm only) with a defined CP value of ∼30–34 with a signal intensity of >0.1. Samples were regarded positive for mycobacteria if they had exponential amplification with a CP value of less than 35 with a signal intensity of >0.02 and negative with no amplification on the 640/back 530 nm channel and exponential amplification for the internal control in the 705/back 530 nm channel having a signal intensity of >0.02.
Preparation of Mycobacterial Reference Standards
M. tuberculosis, M. avium and M. kansasii clinical isolates were cultured on 7H11 agar (Becton Dickinson, USA) for 2 weeks. Homogenization of harvested bacteria was achieved by vortexing with glass beads (2 mm) for 30 seconds followed by subsequent sub-cultivation in 7H9 broth (Becton Dickinson, USA). Once culture broths reached the logarithmic growth phase corresponding to a McFarland 0.5 turbidity the broth was removed and dilution standards prepared. The dilutions were further homogenized by vortexing with glass beads. These bacterial suspensions contained approximately 106 colony forming units per millilitre (CFU/ml).
Preparation of simulated respiratory samples
Samples of bronchoalveolar lavage (BAL) originating from patients without any clinical signs or symptoms of tuberculosis or other mycobacterial infections were used as template material for preparation of the simulated respiratory samples for the reproducibility study. The BAL samples were spiked with the prepared mycobacterial reference standards. Culture of the spiked samples yielded 13 000 CFU/µl for M. tuberculosis, 39 000 CFU/µl for M. avium and 30 000 CFU/µl for M. kansasii. These stock solutions were used to prepare the dilution series.
Analytical Sensitivity (Limit of Detection)
Plasmid standards using a single gene copy were used to determine the Limit of Detection (LOD) of the assay. Plasmid standards for M. tuberculosis were tested in a 6 fold dilution series: 130, 65, 33, 16, 7 and 2 copies per microlitre. All measurements were performed in 20-fold replicates (5 replicates in 4 independent runs on the same LightCycler® Instrument and the same day). For verification of the measurements the reference standards were run in parallel on the FDA approved Cobas® Amplicor Mycobacterium Tuberculosis Test. The effect of interfering substances (table 1) on PCR inhibition was also assessed.
Analytical specificity
In order to check for cross reactivity, a challenge panel was prepared which consisted of other mycobacterial species and non-mycobacterial organisms (table 1); this was tested in duplicate using the LightCycler® Mycobacterium Detection Kit. The concentrations of the template nucleic acids were determined by photometric measurement and quantitative in-house PCR assays [15]. The species identities of all bacterial and fungal strains were verified by complete 16S rDNA sequencing.
Reproducibility Study
The reproducibility study was designed to measure the variability of the Tm and CP measurements of the assay. For this reproducibility study the following standards were used M. tuberculosis at concentrations of 1625 cp/µl, 325 cp/µl, 65 cp/µl and 13 cp/µl, M. avium at 4875 cp/µl, 487.5 cp/µl and 48.75 cp/µl, and M. kansasii concentrations of 3750 cp/µl, 375 cp/µl and 37.5 cp/µl. In each run, these standards were tested in triplicate for M. tuberculosis and duplicate for both M. avium and M. kansasii. The study was performed at two laboratories; each using a single technician, with a total of 60 runs completed over a 10 day period. The reproducibility of consecutive measurements (intra-run), run-to-run, day-to day, lot-to-lot and laboratory-to-laboratory was measured. A coefficient of variance (CV) of less than ten percent was expected.
Statistical analysis
The limit of detection (LOD) was determined by using the Probit method, where, the number of positive responses were converted to a ratio for each of the test concentrations and fitted to a regression model of binary response variables. The LOD was read off the generated graph at the 95% probability for response. For the determination of the measurement precision, the run-to-run, day-to-day, lot-to-lot and laboratory-to-laboratory variation, a variance component analysis for the crossing points (CP) and melting temperatures (Tm) of M. tuberculosis, M. avium and M. kansasii at different concentrations was carried out. The variance component analysis was performed. All statistical analyses were carried out using the statistical software package JMP 7.0 (SAS/STAT® Software).
Results
Analytical Sensitivity (LOD)
Plasmid standards with the target gene were used to determine the limit of detection of the assay. Based on Probit analysis the LOD at the 0.95 (95%) probability for response was calculated at 28 copies per µl [95%CI: 19, 54] or 112 copies per reaction [95%CI: 76, 216] (Figure 1). Furthermore, interfering substances had no effect on PCR performance.
Analytical Specificity
For all non mycobacterial organism tested the specific primer and probe set of the LightCycler® Mycobacterium Detection Kit showed no cross-reactivity with non-mycobacterial organisms. However, two other mycobacterial species were detected M. flavescens with a Tm around 50°C (expected for M. avium) and M. scrofulaceum appeared with a melting point around 58°C (expected for M. kansasii) and no cross-reactivity in the melting temperature range for M. tuberculosis.
Reproducibility
The coefficient of variance for the CP and Tm values of M. tuberculosis, M. avium and M. kansasii at different concentrations were calculated. The Tm values for the run-to-run, day-to-day and lot-to-lot had a coefficient of variance (CV) of less than 2%. The majority of samples demonstrated CV's below 0.4% (Table 2) with a standard deviation of between 0.1–0.2°C. The highest variance for the Tm of M. tuberculosis and M. avium occurred in the laboratory-to-laboratory component due to three outliers at the Pretoria site from a total of 760 measurements.
There was a variance in the mean Tm of approximately 0.3°C–0.4°C across all the mycobacterial concentrations between the Pretoria and Kimberley sites (Table 3). The standard deviation for the Tm ranged between 0.1–0.2°C and these were independent of sample concentrations. However, in a single measurement from the 900 tested a Tm for M. tuberculosis occurred in the specified melting temperature range of M. kansasii (57–60°C) (Figure 2).
The mean and standard deviation (SD) for the CP values were dependent on the concentration of organisms within the samples (table 3). At the higher concentrations the variance ranged from 0.22–1.02% with a SD range of 0.247–0.480 and at the lower concentrations the variance ranged from 0.0–1.03% with a SD range of 0.357–1.087 (table 2 & 3).
Discussion
Improved diagnostic tests for tuberculosis are urgently needed and this has been demonstrated in several studies [8], [16]. Diagnostics with better sensitivity and the ability to differentiate between M. tuberculosis and non-tuberculous mycobacteria are required. The application of nucleic acid amplification techniques for tuberculosis diagnosis is promising as it can be done directly on patient specimens with corresponding high sensitivity/specificity and a rapid turnaround time. Real-time PCR provides an advanced methodology due to its unique ability to monitor the complete DNA amplification process and identify specific products within the same reaction using fluorescence techniques. The initial high cost of this technology has decreased considerably with the continual improvement in their capability and accuracy [17].
This study showed the LightCycler® Mycobacterium Detection kit to be a robust and accurate assay. The limit of detection as low as 28 copies per microlitre (112 copies/reaction) is promising when compared with other TB molecular assays although not as sensitive as the Xpert® MTB/Rif assay (Cepheid, USA) [18]–[20]. The assay has the potential of being used as a rapid TB diagnostic in place of smear microscopy where resources are available. The lack of sensitivity in comparison to the Xpert® MTB/Rif assay may be due to the initial specimen volume of a 100 µl in comparison to the 1.5 ml used by the Cepheid system [20]. Studies to evaluate changes in the input volume to improve test performance are required.
This study was reproducible as it showed good performance at two independent sites an academic laboratory and a routine diagnostic laboratory in South Africa. The overall accuracy and precision for the run to run, laboratory to laboratory, lot to lot, day to day and intra-assay variance exceeded expected outcomes with variability as low as 1% in the medium to high concentration samples. The higher mean melting temperature range (∼0.3–0.4°C) observed in the Kimberley Laboratory when compared to Pretoria could be attributed to the instruments or other environmental parameters. It was also noted that in a single sample from the 900 tested the Tm value for M. tuberculosis in the Kimberley Laboratory overlapped the lower specified Tm value for M. kansasii range. Adjustment of the M. kansasii Tm range to accommodate this finding is recommended.
The assay did not cross react with any of the non-mycobacterial organisms tested nor was the assay inhibited by the tested interfering substances. All but two of the tested mycobacterial species cross-reacted within the Tm range of M. avium and M. kansasii, however, no cross-reactivity occurred within the Tm range for M. tuberculosis. The two mycobacterial species detected by the challenge panel were M. scrofulaceum which is usually isolated from lymph nodes and M. flavescens which has been rarely isolated in humans [21]. The LightCycler® Mycobacterium Detection Kit proved to be specific for M. tuberculosis, M. avium and M. kansasii which are clinically important for respiratory infections especially in TB/HIV co-infection settings. The test can further be improved to detect other mycobacterial species based on their unique melting temperatures. This would have a direct impact on the early and correct management of the affected patients.
The LightCycler® Mycobacterium Detection kit showed minimal variance when applied using different operators and environments highlighting its robustness. The overall, analytical performance make this kit a candidate tool in the raoid diagnosis of tuberculosis. Clinical evaluations in routine settings are required to validate its performance.
Acknowledgments
We would like to thank Roche Products (Pty) Ltd, Randburg, South Africa for providing the prototype LightCycler® Mycobacterium Detection Kits and COBAS® Amplicor Respiratory Sample Preparation Kit. We further thank the National Health Laboratory Service, Pretoria and Braamfontein, for providing the culture strains.
Author Contributions
Conceived and designed the experiments: UR. Performed the experiments: SVO HMS NP AR. Analyzed the data: SVO AR NAI LE ME MK AAH UR. Contributed reagents/materials/analysis tools: SVO AR NAI ME MK AAH UR. Wrote the paper: SVO AR NAI LE ME MK AAH UR.
References
- 1.
World Health Organization (2010) Global tuberculosis control 2010. Available: http://www.who.int/tb/publications/global_report/2010/en/index.html. 2011 June 23.
- 2. Johnson MM, Waller EA, Leventhal JP (2008) Nontuberculous mycobacterial pulmonary disease. Curr Opin Pulm Med 14(3): 203–210.
- 3. McGrath EE, McCabe J, Anderson PB, American Thoracic SocietyInfectious Diseases Society of America (2008) Guidelines on the diagnosis and treatment of pulmonary non-tuberculous mycobacteria infection. Int J Clin Pract 62(12): 1947–1955.
- 4. Corbett EL, Blumberg L, Churchyard GJ, Moloi N, Mallory K, et al. (1999) Nontuberculous mycobacteria: Defining disease in a prospective cohort of south african miners. Am J Respir Crit Care Med 160(1): 15–21.
- 5. Andersen P, Doherty TM (2005) The success and failure of BCG - implications for a novel tuberculosis vaccine. Nat Rev Microbiol 3(8): 656–662.
- 6. Nahid P, Pai M, Hopewell PC (2006) Advances in the diagnosis and treatment of tuberculosis. Proc Am Thorac Soc 3: 101–110.
- 7. Steingart KR, Henry M, Laal S, Hopewell PC, Ramsay A, et al. (2007) Commercial serological antibody detection tests for the diagnosis of pulmonary tuberculosis: A systematic review. PLoS Med 4(6): e202.
- 8. Green C, Huggett JF, Talbot E, Mwaba P, Reither K, et al. (2009) Rapid diagnosis of tuberculosis through the detection of mycobacterial DNA in urine by nucleic acid amplification methods. Lancet Infect Dis 9(8): 505–511.
- 9. Grandjean L, Moore DA (2008) Tuberculosis in the developing world: Recent advances in diagnosis with special consideration of extensively drug-resistant tuberculosis. Curr Opin Infect Dis 21(5): 454–461.
- 10. World Health Organization (2010) WHO endorses new rapid tuberculosis test. 2010(December/10): 1.
- 11. Ririe KM, Rasmussen RP, Wittwer CT (1997) Product differentiation by analysis of DNA melting curves during the polymerase chain reaction. Anal Biochem 245(2): 154–160.
- 12. Lay MJ, Wittwer CT (1997) Real-time fluorescence genotyping of factor V leiden during rapid-cycle PCR. Clin Chem 43(12): 2262–2267.
- 13. Shrestha NK, Tuohy MJ, Hall GS, Reischl U, Gordon SM, et al. (2003) Detection and differentiation of mycobacterium tuberculosis and nontuberculous mycobacterial isolates by real-time PCR. J Clin Microbiol 41(11): 5121–5126.
- 14. Kubica GP, Dye WE, Cohn ML, Middlebrook G (1963) Sputum digestion and decontamination with N-acetyl-L-cysteine-sodium hydroxide for culture of mycobacteria. Am Rev Respir Dis 87: 775–779.
- 15. Vollmer T, Stormer M, Kleesiek K, Dreier J (2008) Evaluation of novel broad-range real-time PCR assay for rapid detection of human pathogenic fungi in various clinical specimens. J Clin Microbiol 46(6): 1919–1926.
- 16. Dowdy DW, Chaisson RE, Moulton LH, Dorman SE (2006) The potential impact of enhanced diagnostic techniques for tuberculosis driven by HIV: A mathematical model. AIDS 20(5): 751–762.
- 17.
Logan J, Edwards K, Saunders N (2009) Real-time PCR : Current technology and applications. Norfolk: Caister Academic Press. 284 p.
- 18. Flores E, Rodriguez JC, Garcia-Pachon E, Soto JL, Ruiz M, et al. (2009) Real-time PCR with internal amplification control for detecting tuberculosis: Method design and validation. APMIS 117(8): 592–597.
- 19. Helb D, Jones M, Story E, Boehme C, Wallace E, et al. (2010) Rapid detection of mycobacterium tuberculosis and rifampin resistance by use of on-demand, near-patient technology. J Clin Microbiol 48(1): 229–237.
- 20. Boehme CC, Nabeta P, Hillemann D, Nicol MP, Shenai S, et al. (2010) Rapid molecular detection of tuberculosis and rifampin resistance. N Engl J Med 363(11): 1005–1015.
- 21.
Schaaf HS, Zumla A, Grange JM (2009) Tuberculosis : A comprehensive clinical reference. Edinburgh: Saunders/Elsevier. 1014 p.