The Leishmania OligoC-TesT and NASBA-Oligochromatography (OC) were recently developed for simplified and standardised molecular detection of Leishmania parasites in clinical specimens. We here present the phase II evaluation of both tests for diagnosis of visceral leishmaniasis (VL), cutaneous leishmaniasis (CL) and post kala-azar dermal leishmaniasis (PKDL) in Sudan.
The diagnostic accuracy of the tests was evaluated on 90 confirmed and 90 suspected VL cases, 7 confirmed and 8 suspected CL cases, 2 confirmed PKDL cases and 50 healthy endemic controls from Gedarif state and Khartoum state in Sudan.
The OligoC-TesT as well as the NASBA-OC showed a sensitivity of 96.8% (95% CI: 83.8%–99.4%) on lymph node aspirates and of 96.2% (95% CI: 89.4%–98.7%) on blood from the confirmed VL cases. The sensitivity on bone marrow was 96.9% (95% CI: 89.3%–99.1%) and 95.3% (95% CI: 87.1%–98.4%) for the OligoC-TesT and NASBA-OC, respectively. All confirmed CL and PKDL cases were positive with both tests. On the suspected VL cases, we observed a positive OligoC-TesT and NASBA-OC result in 37.1% (95% CI: 23.2%–53.7%) and 34.3% (95% CI: 20.8%–50.9%) on lymph, in 72.7% (95% CI: 55.8%–84.9%) and 63.6% (95% CI: 46.6%–77.8%) on bone marrow and in 76.9% (95% CI: 49.7%–91.8%) and 69.2% (95% CI: 42.4%–87.3%) on blood. Seven out of 8 CL suspected cases were positive with both tests. The specificity on the healthy endemic controls was 90% (95% CI: 78.6%–95.7%) for the OligoC-TesT and 100% (95% CI: 92.9%–100.0%) for the NASBA-OC test.
The leishmaniases are a group of vector-borne diseases caused by protozoan parasites of the genus Leishmania. The parasites are transmitted by phlebotomine sand flies and can cause, depending on the infecting species, three clinical manifestations of leishmaniasis: visceral leishmaniasis (VL), post kala-azar dermal leishmaniasis (PKDL) and cutaneous leishmaniasis (CL) including the mucocutaneous form. VL, PKDL as well as CL are endemic in several parts of Sudan, and VL especially represents a major health problem in this country. Molecular tests such as the polymerase chain reaction (PCR) or nucleic acid sequence based assay (NASBA) are powerful techniques for accurate detection of the parasite in clinical specimens, but broad use is hampered by their complexity and lack of standardisation. Recently, the Leishmania OligoC-TesT and NASBA-Oligochromatography were developed as simplified and standardised PCR and NASBA formats. In this study, both tests were phase II evaluated for diagnosis of VL, PKDL and CL in Sudan.
Citation: Saad AA, Ahmed NG, Osman OS, Al-Basheer AA, Hamad A, Deborggraeve S, et al. (2010) Diagnostic Accuracy of the Leishmania OligoC-TesT and NASBA-Oligochromatography for Diagnosis of Leishmaniasis in Sudan. PLoS Negl Trop Dis 4(8): e776. https://doi.org/10.1371/journal.pntd.0000776
Editor: Paul Andrew Bates, Lancaster University, United Kingdom
Received: March 23, 2010; Accepted: June 28, 2010; Published: August 3, 2010
Copyright: © 2010 Saad et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study received financial support from the Commission of the European Communities' Sixth Framework Programme, priority INCO-DEV, project TRYLEIDIAG, contract 015379. S. Deborggraeve is a postdoctoral fellow of the Research Foundation Flanders (FWO). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: T. Laurent is an employee of Coris BioConcept, the company involved in the development and provisioning of the OligoC-TesTs. All other authors report no potential conflicts.
The leishmaniases are a group of vector-borne diseases caused by parasites of the genus Leishmania. The parasites are transmitted by phlebotomine sand flies and can cause, depending on the infecting species, three main clinical manifestations of leishmaniasis: visceral leishmaniasis (VL), post kala-azar dermal leishmaniasis (PKDL) and cutaneous leishmaniasis (CL) including the mucocutaneous form . VL is the most severe form in which the internal organs are invaded and tends to be 100% fatal if not appropriately treated. While CL and MCL are clinical manifestations as a result from replication of the parasite in the dermis and naso-oropharyngeal mucosa respectively, PKDL is a skin disorder seen in a number of treated VL patients. VL, PKDL and CL are endemic in several parts of Sudan and especially VL represents a major health problem in this country .
Although serological tests such as the direct agglutination test (DAT) ,  and the rK39 dipstick test – have become the mainstay in VL diagnosis , parasite detection by microscopic analysis of aspirates from the lymph nodes, bone marrow or spleen is still used in some endemic regions. The diagnostic standard for CL and PKDL is microscopic analysis of tissue biopsies or scrapings. However, microscopy is hampered by its low and variable sensitivity and the need for rather invasive sampling in the case of VL. Sensitivity may be increased by prior in vitro cultivation of the parasite, but this technique is cumbersome and time consuming. Serological tests are of high value to support clinical diagnosis of VL but they are less useful in patients co-infected with HIV  and antibodies remain detectable for years after successful treatment , . Antibody detection with the rapid rK39 dipstick test is not yet implemented in Sudan due to the reported low diagnostic performance of the test in this region –.
Molecular diagnostics such as the polymerase chain reaction (PCR) and nucleic acid sequence based assay (NASBA) offer attractive alternatives to conventional parasite detection as they are generally highly sensitive and specific. PCR detects the parasite's DNA through in vitro thermocyclic conditions , while NASBA amplifies the RNA by an isothermal reaction . However, broad application of these powerful techniques in diagnosis and control of leishmaniasis is hindered by their complexity and lack of standardised test formats. Recently, the Leishmania OligoC-TesT and NASBA-Oligochromatography (OC) were introduced as promising PCR and NASBA formats for simplified and standardised molecular detection of Leishmania parasites , . The tests are based on amplification of a short sequence within the Leishmania 18S ribosomal DNA (PCR) or RNA (NASBA), followed by simple and rapid detection of amplified products in dipstick format. Both tests are available as self-containing kits including all components needed except for the Taq polymerase enzyme in the OligoC-TesT and the Nuclisense Basic Kit in the NASBA-OC due to licensing issues. The tests showed high sensitivity and specificity on experimentally prepared specimens and on clinical specimens from a limited number of confirmed cases and healthy controls (phase I) ,  and satisfactory repeatability and reproducibility in a multicenter evaluation study . In this phase II study, we evaluated the two tests in Sudan on confirmed and suspected VL, CL and PKDL patients and on healthy endemic controls.
VL and PKDL suspects and endemic healthy controls were recruited in Gedarif State and CL suspects in Khartoum State between October 2008 and January 2009. VL and PKDL suspects were recruited in the health centers of villages within the endemic areas while the endemic healthy controls were volunteers from the same villages but not visiting the health centers. CL suspects were recruited at the Dermatology Hospital in Khartoum. Confirmed leishmaniasis cases were given appropriate treatment in the same health center or hospital as they were diagnosed. A participant was included in the study if 2 years or older and written consent was obtained from the individual or his/her guardian. Specimen collection was performed by the Faculty of Medicine of Khartoum University. Ethical clearance for the study was obtained from the ethical committees of the Federal Ministry of Health Committee in Sudan and the University of Antwerp in Belgium.
Participant classification and reference tests
A participant was classified as (i) confirmed VL case if there was clinical suspicion for VL, DAT on serum was positive (titer ≥1∶3200) and parasites were observed in lymph or bone marrow aspirates by microscopic analysis; (ii) suspected VL case with positive DAT if there was clinical suspicion for VL, DAT on serum was positive, no parasites were observed in lymph or bone marrow aspirates and no previous history of VL was reported; (iii) suspected VL case with negative DAT if there was clinical suspicion for VL, DAT on serum was negative, no parasites were observed in lymph or bone marrow aspirates and no previous history of VL was reported; (iv) endemic healthy control if there was no clinical suspicion for VL, no previous history of VL and DAT on serum was negative; (v) confirmed CL or PDKL case if there was clinical suspicion for CL or PKDL and parasites were observed in lesion or skin scrapings by microscopic analysis; and (vi) suspected CL case if there was clinical suspicion for CL and no parasites were observed in lesion or skin scrapings. Clinical suspicion for VL was defined as a history of fever for two weeks or more and splenomegaly or lymphadenopathy and for CL and PKDL the presence of skin lesions or nodules. The reference tests were performed by experienced laboratory technicians immediately after specimen taking at the collection sites as described in the WHO manual on visceral leishmaniasis .
Two hundred µl anti-coagulated blood (confirmed and suspected VL cases and healthy endemic controls), and/or inguinal lymph node aspirate, and/or bone marrow aspirate (confirmed and suspected VL cases) or lesion or skin scrapings (confirmed and suspected CL and PKDL cases) was mixed with 200 µl of AngeroNA buffer (Mallinckrodt Baker, USA). This buffer allows specimen storage without loss of DNA and RNA quality. The same specimens were used for the reference tests and for the index tests. Specimens were shipped at 4°C from the collection site to Soba University hospital laboratory of Khartoum University and stored at 4°C for a maximum of two weeks. Nucleic acids of the specimens were extracted according to the method described by Boom et al. . Elution was done in 50 µl of Tris-EDTA (TE) buffer and stored at −20°C until analysis. The extracts were tested with the Leishmania OligoC-TesT and NASBA-OC between October 2008 and February 2009 as described by Deborggraeve et al.  and Mugasa et al. . In brief, with the OligoC-TesT DNA of the parasite is amplified by PCR and subsequently 40 µl of denatured PCR product is mixed with 40 µl of migration buffer preheated at 55°C for at least 20 minutes followed by dipping the Oligo-strip into the solution. The NASBA-OC amplifies an RNA sequence of the parasite by NASBA reaction after which 4 µl of the amplified product is mixed with 76 µl of migration buffer preheated at 55°C and the Oligo-strip is dipped into the solution. Test results are read after 10 minutes for both tests. Executors of the index tests were trained during a one-week workshop held in June 2007 at Makerere University, Kampala, Uganda. No external quality control confirming the reference test or index test results could be performed during the study. Executors of the index tests were not blinded to the results of the reference tests.
The sensitivity and specificity of the Leishmania OligoC-TesT and NASBA-OC were calculated from data entered into contingency tables. Differences in sensitivity and specificity between the two tests and differences in test results of specimen types were estimated by the Mc Nemar test. Concordances between the two tests were determined using the kappa index. All calculations were estimated at a 95% confidence interval (95% CI).
In the study the following participants were recruited: 90 confirmed and 67 suspected VL cases with positive DAT, 23 suspected VL cases with negative DAT, 7 confirmed and 8 suspected CL cases, 2 confirmed PKDL cases and 50 healthy endemic controls.
Sensitivity and specificity of the Leishmania OligoC-TesT and NASBA-OC
Confirmed VL, CL and PKDL patients.
The Leishmania OligoC-TesT and the NASBA-OC showed both a sensitivity of 96.8% on lymph node aspirates from confirmed VL cases and of 96.2% on blood (Table 1). The sensitivity on bone marrow was 96.9% and 95.3% for the OligoC-TesT and NASBA-OC, respectively. All confirmed CL (n = 7) and PKDL (n = 2) cases were positive with the OligoC-TesT and NASBA-OC. There was no significant difference in sensitivity between the two index tests (P>0.05). When analysing different specimen types from the same VL patient we observed no significant difference in test outcome (P>0.05).
Suspected VL and CL patients.
On the suspected VL cases with positive DAT, the OligoC-TesT showed a positive test result in 37.1%, 76.9% and 72.7% on lymph, blood and bone marrow, respectively; while for NASBA-OC this was 34.3%, 69.2% and 63.6% (Table 1). On the suspected VL cases with negative DAT, the OligoC-TesT was positive in 30%, 28.6% and 42.9% on lymph, blood and bone marrow and the NASBA-OC in 30%, 42.9% and 50%. On the 8 CL suspected cases 7 were positive with the OligoC-TesT and the NASBA-OC. The Mc Nemar test indicated no significant difference in results of the two tests on the specimens from suspected cases (P>0.05). We observed no significant difference in test outcome when different specimen types from the same suspected VL patient were analysed (P>0.05).
Healthy endemic controls.
Five of the 50 healthy endemic controls showed a positive OligoC-TesT result, while the NASBA-OC remained negative on all endemic controls (Table 1). Hence, the specificity of the OligoC-TesT for disease was 90.0% and of the NASBA-OC 100.0%, which is significantly higher (P<0.05).
On all specimens analysed (n = 321) the two tests showed a kappa value of 0.85 (95% CI: 0.75–0.96) indicating almost perfect agreement . An overview of the agreement analysis on the different specimen types is presented in table 2.
Molecular diagnostics are attractive alternatives to conventional parasite detection as they combine sensitivity with specificity. Recently, the Leishmania OligoC-TesT and NASBA-OC were developed as standardised formats for molecular detection of Leishmania parasites , . Here we present the phase II evaluation of the two tests on confirmed and suspected VL, CL and PKDL cases and on health endemic controls from Sudan. Although the study was set out as a phase II diagnostic evaluation, it has some limitations. A weak point is the lack of external quality control on a subset of specimens carried out by another reference laboratory. Furthermore, the executors of the index tests were not blinded to the participant classification and thus the results of the reference tests. Although we are convinced that these limitations did not influence the study results, these shortcomings should be avoided in future phase II and III evaluation trials. In addition, response to treatment was not included in the standard references as we were not able to follow up the patients after treatment. Lastly, the number of participants in some subgroups is too low to make major conclusions.
The Leishmania OligoC-TesT as well as the NASBA-OC showed a high sensitivity (>95%) on lymph, blood and bone marrow from the confirmed VL patients. The observation that analysing lymph or blood yielded similar sensitivity as bone marrow is very promising towards less invasive diagnosis. Indeed this means that the OligoC-TesT and NASBA-OC on lymph or blood could indicate the infection status of VL suspected cases. Similar findings were reported in a study on the phase III evaluation of conventional PCR for VL diagnosis in Nepal . Although the number of confirmed CL and PKDL cases in our study was limited, all were positive with both tests indicating their potential for accurate detection of the parasites in skin tissues. In addition, the high sensitivity is confirmed by the observation that the tests were able to detect Leishmania RNA or DNA in the blood or lesion scrapings of to the majority of the suspected VL and CL cases. Several cases in the suspected patient with positive DAT group might be true leishmaniasis cases given the suboptimal sensitivity of the conventional parasite detection tests. In 2008, Deborggraeve et al. reported a sensitivity of conventional PCR on probable VL cases (defined as clinical suspicion of VL and positive DAT test but negative in conventional parasite detection) of 67.6% on blood and 71.8% on bone marrow . The sensitivities of the index tests on the lymph node aspirates of the suspected VL cases is surprisingly low (34–37%). This might indicate that the parasite load in blood is higher than in lymph. The fact that this is not observed in the confirmed VL cases is probably due to the general higher parasite load in this patient group because of the low sensitivity of the reference test. PCR positivity in the suspected VL group with negative DAT was not significantly lower than with positive DAT. This confirms the low correlation in DAT and PCR status in these groups as observed earlier . While antibody levels in the blood are a marker for the host response, the PCR/NASBA status of the blood is a marker for the presence of parasites and might therefore be complementary. PCR and NASBA can offer an added value compared to immunodiagnosis in HIV co-infected VL patients.
On the 50 healthy endemic controls, the OligoC-TesT showed a specificity of 90% while this was 100% for the NASBA-OC. The positive OligoC-TesT results might be due to asymptomatic infections, which are known to be common in VL endemic regions. The inclusion of these asymptomatic carriers in the control group could be explained by the low concordance between negative DAT status and PCR outcome on blood from endemic control persons as described by Deborggraeve et al.  and Bhattarai et al. . However, while NASBA-OC showed equal sensitivity on the confirmed and suspected VL cases, the test did not detect these assumed asymptomatic infections in the endemic control group. This discrepancy can be explained in two ways. Firstly, although not indicated by the negative controls taken along in specimen analysis, contamination of the PCR can never be fully excluded. Secondly, the OligoC-TesT might be slightly more sensitive than the NASBA-OC and thus pick up asymptomatic infections which might have very low parasite loads in the blood. The observed equal sensitivity for both tests on the confirmed and suspected VL cases might be biased by the fact that these cases are individuals presenting syndromes and thus probably have higher parasite loads than healthy parasite carriers. Hence, NASBA-OC might provide a better marker for active disease than the OligoC-TesT, as NASBA-OC does not detect asymptomatic infections while more than 95% of the active VL cases are still positive with the test. Furthermore, both tests might be useful as a test of cure after treatment of VL. As cure does not always equals parasite clearance, NASBA-OC might be more suitable than the OligoC-TesT. However, specific evaluation studies are needed to confirm this hypothesis.
One should keep in mind that the PCR-OC and NASBA-OC are not yet an option for routine diagnosis at the primary care level as they require basic molecular biology lab facilities. VL typically affects populations in rural areas where health centers most often suffer from infrastructural limitations and thus only apply less sophisticated diagnostic methods. Yet, they can be valuable tools in leishmaniasis diagnosis at reference hospitals with basic molecular biology lab facilities. In addition, the evaluated tools can offer an added value in disease surveillance and epidemiological studies in which specimens are analysed at central reference laboratories.
In conclusion, the Leishmania OligoC-TesT and NASBA-OC showed high sensitivity on lymph and blood of VL patients and on scrapings from CL and PKDL patients from Sudan. A significant higher specificity for active VL with the NASBA-OC than with the OligoC-TesT was observed. Both tests are not yet an option for routine diagnosis of leishmaniasis at the primary care level due to their infrastructural requirements but they might be powerful diagnostic tests in disease surveillance programmes and in monitoring intervention studies.
We are most grateful to the patients and control persons participating in this study and to Dr. Suliman Hussein Suliman and the entire staff of Soba University Hospital.
Conceived and designed the experiments: O. S. Osman, A. A. Al-Basheer, S. Deborggraeve, P. Büscher, G. J. Schoone, H. D. Schallig, T. Laurent, O. F. Osman, A. M. Eltom, M. I. Elbashir, S. El-Safi. Performed the experiments: A. A. Saad, N. G. Ahmed, A. Hamad, A. Haleem. Analyzed the data: A. A. Saad, S. Deborggraeve, S. El-Safi. Contributed reagents/materials/analysis tools: G. J. Schoone, T. Laurent, S. El-Safi. Wrote the paper: A. A. Saad, N. G. Ahmed, O. S. Osman, A. A. Al-Bashir, A. Hamad, S. Deborggraeve, P. Büscher, G. J. Schoone, H. D. Schallig, T. Laurent, A. Haleem, O. F. Osman, A. M. Eltom, M. I. Elbashir, S. El-Safi.
- 1. Murray HW, Berman JD, Davies CR, Saravia NG (2005) Advances in leishmaniasis. Lancet 366: 1561–1577.
- 2. Zijlstra EE, El-Hassan AM (2001) Leishmaniasis in Sudan. Trans R Soc Trop Med Hyg 95: 1–76.
- 3. Harith AE, Kolk AH, Leeuwenburg J, Muigai R, Huigen E, et al. (1988) Improvement of a direct agglutination test for field studies of visceral leishmaniasis. J Clin Microbiol 26: 1321–1325.
- 4. Boelaert M, El Safi S, Jacquet D, De Muynck A, Van der Stuyft P, et al. (1999) Operational validation of the direct agglutination test for diagnosis of visceral leishmaniasis. Am J Trop Med Hyg 60: 129–134.
- 5. Ritmeijer K, Melaku Y, Mueller M, Kipngetich S, O'Keeffe C, Davidson RN (2006) Evaluation of a new recombinant K38 rapid diagnostic test for Sudanese visceral leishmaniasis. Am J Trop Med Hyg 74: 76–80.
- 6. Chappuis F, Mueller Y, Nguimfack A, Rwakimari JB, Couffignal S, et al. (2005) Diagnostic accuracy of two rK39 antigen-based dipsticks and the formol gel test for rapid diagnosis of visceral leishmaniasis in northeastern Uganda. J Clin Microbiol 43: 5973–5977.
- 7. ter Horst R, Tefera T, Assefa G, Ebrahim AZ, Davidson RN, et al. (2009) Field evaluation of rK39 test and direct agglutination test for diagnosis of visceral leishmaniasis in a population with high prevalence of human immunodeficiency virus in Ethiopia. Am J Trop Med Hyg 80: 929–934.
- 8. Chappuis F, Sundar S, Hailu A, Ghalib H, Rijal S, et al. (2007) Visceral leishmaniasis: what are the needs for diagnosis, treatment and control? Nat Rev Microbiol 5: S7–S16.
- 9. Gari-Toussaint M, Leliévre A, Marty P, Le Fichoux Y (1994) Contribution of serological tests to the diagnosis of visceral leishmaniasis in patients infected with the human immunodeficiency virus. Trans R Soc Trop Med Hyg 88: 301–302.
- 10. De Almeida Silva L, Dardo Romero H, Prata A, Costa RT, Nascimento E, et al. (2006) Immunologic tests in patients after clinical cure of visceral leishmaniasis. Am J Trop Med Hyg 75: 739–743.
- 11. Hailu A (1990) Pre- and post-treatment antibody levels in visceral leishmaniasis. Trans R Soc Trop Med Hyg 84: 673–675.
- 12. Zijlstra EE, Nur Y, Desieux P, Khalil EA, El-Hassan AM, et al. (2001) Diagnosing visceral leishmaniasis with the recombinant K39 strip test: experience from the Sudan. Trop Med Int Health 6: 108–113.
- 13. Ritmeijer K, Melaku Y, Mueller M, Kipngetich S, O'Keeffe C, et al. (2006) Evaluation of a new recombinant K39 rapid diagnostic test for Sudanese visceral leishmaniasis. Am J Trop Med Hyg 74: 76–80.
- 14. Veeken H, Ritmeijer K, Seaman J, Davidson R (2003) Comparison of an rK39 dipstick rapid test with direct agglutination test and splenic aspiration for the diagnosis of kala-azar in Sudan. Trop Med Int Health 8: 164–167.
- 15. Mullis K, Faloona F, Scharf S, Saiki R, Horn G, et al. (1986) Specific enzymatic amplification of DNA in vitro: the polymerase chain reaction. Cold Spring Harb Symp Quant Biol 51: 263–273.
- 16. Van der Meide WF, Schoone GJ, Faber WR, Zeegelaar JE, de Vries HJC, et al. (2005) Quantitative Nucleic Acid Sequence-Based assay as a new molecular tool for the detection and quantification of Leishmania parasites in skin biopsies. J Clin Microbiol 43: 5560–5566.
- 17. Deborggraeve S, Laurent T, Espinosa D, Van der Auwera G, Mbuchi M, et al. (2008) A simplified and standardized polymerase chain reaction format for the diagnosis of leishmaniasis. J Infect Dis198: 1565–1572.
- 18. Mugasa CM, Laurent T, Saad AA, Basiye FL, Schoone GJ, et al. Simplified molecular detection of Leishmania parasites in various clinical samples from patients with leishmaniasis. Parasit Vectors. In press.
- 19. Mugasa CM, Deborggraeve S, Schoone GJ, Laurent T, Leeflang MM, et al. Accordance and concordance of PCR and NASBA followed by oligochromatography for the molecular diagnosis of Trypanosoma brucei and Leishmania. Trop Med Int Health. in press.
- 20. WHO (1996) Manual on visceral leishmaniasis. World Health Organization, Geneva, Switzerland, WHO/LEISH/96.40.
- 21. Boom R, Sol CJA, Salimans MMM, Jansen CL, Wertheim-van Dillen PME, et al. (1990) Rapid and simple method for purification of nucleic acids. J Clin Microbiol 28: 495–503.
- 22. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33: 159–174.
- 23. Deborggraeve S, Boelaert M, Rijal S, De Doncker S, Dujardin JC, et al. (2008) Diagnostic accuracy of a new Leishmania PCR for clinical visceral leishmaniasis in Nepal and its role in diagnosis of disease. Trop Med Int Health 13: 1378–1383.
- 24. Bhattarai NR, Van der Auwera G, Khanal B, De Doncker S, Rijal S, et al. (2009) PCR and direct agglutination as Leishmania infection markers among healthy Nepalese subjects living in areas endemic for Kala-Azar. Trop Med Int Health 14: 404–411.