Advertisement
  • Loading metrics

Sensitivity and Specificity of a Prototype Rapid Diagnostic Test for the Detection of Trypanosoma brucei gambiense Infection: A Multi-centric Prospective Study

  • Sylvie Bisser ,

    sbisser@hotmail.com

    Current address: Institut Pasteur, Cayenne, French Guiana

    Affiliation INSERM UMR1094, Institute of Neuroepidemiology and Tropical Neurology, Limoges, France

  • Crispin Lumbala,

    Affiliation Programme National de Lutte contre la Trypanosomiase Humaine Africaine (PNLTHA), Kinshasa, Democratic Republic of the Congo

  • Etienne Nguertoum,

    Affiliation Institut Centrafricain de la Recherche Agronomique (ICRA), Bangui, Central African Republic

  • Victor Kande,

    Affiliation Programme National de Lutte contre la Trypanosomiase Humaine Africaine (PNLTHA), Kinshasa, Democratic Republic of the Congo

  • Laurence Flevaud,

    Affiliation Médecins Sans Frontières (MSF) Operational Centre Barcelona-Athens (OCBA), Barcelona, Spain

  • Gedeao Vatunga,

    Affiliation Instituto de Combate e Controlo das Tripanossomiases, Luanda, Angola

  • Marleen Boelaert,

    Affiliation Institute of Tropical Medicine Antwerp, Antwerpen, Belgium

  • Philippe Büscher,

    Affiliation Institute of Tropical Medicine Antwerp, Antwerpen, Belgium

  • Theophile Josenando,

    Affiliation Instituto de Combate e Controlo das Tripanossomiases, Luanda, Angola

  • Paul R. Bessell,

    Affiliation Epi Interventions Ltd., Edinburgh, United Kingdom

  • Sylvain Biéler,

    Affiliation Foundation for Innovative New Diagnostics, Campus Biotech, Geneva, Switzerland

  • Joseph M. Ndung’u

    Affiliation Foundation for Innovative New Diagnostics, Campus Biotech, Geneva, Switzerland

Sensitivity and Specificity of a Prototype Rapid Diagnostic Test for the Detection of Trypanosoma brucei gambiense Infection: A Multi-centric Prospective Study

  • Sylvie Bisser, 
  • Crispin Lumbala, 
  • Etienne Nguertoum, 
  • Victor Kande, 
  • Laurence Flevaud, 
  • Gedeao Vatunga, 
  • Marleen Boelaert, 
  • Philippe Büscher, 
  • Theophile Josenando, 
  • Paul R. Bessell
PLOS
x

Abstract

Background

A major challenge in the control of human African trypanosomiasis (HAT) is lack of reliable diagnostic tests that are rapid and easy to use in remote areas where the disease occurs. In Trypanosoma brucei gambiense HAT, the Card Agglutination Test for Trypanosomiasis (CATT) has been the reference screening test since 1978, usually on whole blood, but also in a 1/8 dilution (CATT 1/8) to enhance specificity. However, the CATT is not available in a single format, requires a cold chain for storage, and uses equipment that requires electricity. A solution to these challenges has been provided by rapid diagnostic tests (RDT), which have recently become available. A prototype immunochromatographic test, the SD BIOLINE HAT, based on two native trypanosomal antigens (VSG LiTat 1.3 and VSG LiTat 1.5) has been developed. We carried out a non-inferiority study comparing this prototype to the CATT 1/8 in field settings.

Methodology/Principal Findings

The prototype SD BIOLINE HAT, the CATT Whole Blood and CATT 1/8 were systematically applied on fresh blood samples obtained from 14,818 subjects, who were prospectively enrolled through active and passive screening in clinical studies in three endemic countries of central Africa: Angola, the Democratic Republic of the Congo and the Central African Republic. One hundred and forty nine HAT cases were confirmed by parasitology. The sensitivity and specificity of the prototype SD BIOLINE HAT was 89.26% (95% confidence interval (CI) = 83.27–93.28) and 94.58% (95% CI = 94.20–94.94) respectively. The sensitivity and specificity of the CATT on whole blood were 93.96% (95% CI = 88.92–96.79) and 95.91% (95% CI = 95.58–96.22), and of the CATT 1/8 were 89.26% (95% CI = 83.27–93.28) and 98.88% (95% CI = 98.70–99.04) respectively.

Conclusion/Significance

After further optimization, the prototype SD BIOLINE HAT could become an alternative to current screening methods in primary healthcare settings in remote, resource-limited regions where HAT typically occurs.

Author Summary

Early diagnosis and treatment of human African trypanosomiasis is essential for safe and effective treatment. The tests used to screen suspected patients and populations at risk are difficult to implement in remote rural settings where the disease occurs. Availability of simple, easy to use, instrument-free rapid diagnostic tests would improve screening and coverage of the population at risk and contribute to elimination of the disease. It would enable technicians with limited training and clinicians in emergency or medical wards to make rapid differential diagnosis for neurological syndromes or malaria-like illnesses. Introduction of such tests in all healthcare facilities in endemic regions would enable early detection of cases, hence reducing the time lost by patients before they get adequate and safe treatment. Treatment delay occurs when such patients attend non-specialized health centres that are unable to perform diagnosis of the disease. We evaluated a prototype rapid diagnostic test for HAT, the SD BIOLINE HAT in Angola, the Democratic Republic of the Congo and the Central African Republic. We show here that the test is as sensitive as the CATT in a 1/8 dilution and less sensitive than CATT on whole blood, although this latter difference was not statistically significant. The prototype RDT is a promising alternative for serodiagnosis of HAT.

Introduction

Human African trypanosomiasis (HAT) or sleeping sickness is a neglected tropical disease that is endemic in remote, resource-limited regions of sub-Saharan African countries [1]. The disease is transmitted by infected Glossina species (tsetse fly) and presents in two different forms caused by two different trypanosome subspecies, Trypanosoma brucei (T. b.) gambiense and T. b. rhodesiense respectively. The two disease forms differ in their geographic location, transmission pattern, clinical manifestation and response to treatment [2, 3]. More than 95% of reported cases of HAT are caused by T. b. gambiense which is the focus of this study. Both forms of HAT evolve in two disease phases: an early or haemo-lymphatic phase or stage one, and a late meningo-encephalitic phase or stage two. During stage one, clinical signs are non-specific and can easily be confounded with a malaria-like illness, whereas neurological signs (sleep disorders, abnormal movements, gait disturbances and/or psychiatric disturbances) insidiously develop and characterize the stage two disease [4]. Control of T. b. gambiense HAT is dependent on diagnosis and treatment of infected individuals. Due to the chronic nature of the disease and a lack of specific symptoms during stage one, identification of cases relies on passive and active screening of patients and populations in endemic areas. Suspects identified using a screening test have to be confirmed as cases by demonstration of parasites in either blood, lymph node aspirates or the cerebrospinal fluid (CSF) by microscopy [4].

Thanks to international and national efforts, the number of cases of HAT reported to the World Health Organization (WHO) have been declining, from 37,991 in 1998 to 3,796 in 2014 [5,6,7]. Although the drop in cases is encouraging, there is concern that interest and funding of activities related to surveillance and control of the disease could go down, increasing the risk of resurgence [8]. In this context, and considering WHO’s goal of eliminating HAT by 2020 that was endorsed by the London Declaration of 2012 [9], it is of particular importance to implement novel control strategies. Elimination of the disease and sustaining elimination will require improved surveillance and coverage of the population at risk, using tools that have a higher accuracy, and easier to deploy in the settings where the disease occurs. This can be hampered by challenges in diagnosis of the disease, as current screening algorithms are neither sensitive enough, nor easy to use in peripheral health centres where patients first seek care, or in general hospital wards. Indeed, infected people can spend a long time seeking appropriate care without a correct diagnosis being made, ending up in stage two [10]. Management of the disease when it has advanced into the second stage is complicated, expensive (due to the requirement for in-patient treatment), and associated with risks of sequelae and relapses. There is therefore a great need for accurate, easy to use and affordable diagnostic tests for HAT that can be used to screen individuals presenting with symptoms with a differential diagnosis that includes HAT [11]. Such tests would enable integration of HAT diagnosis in the general primary health care system, thus improving coverage of the population at risk.

Alere/Standard Diagnostics, Inc., South Korea, in collaboration with among others the Foundation for Innovative New Diagnostics (FIND), Switzerland and the Institute of Tropical Medicine (ITM) in Belgium, has developed a number of prototype rapid diagnostic tests (RDTs) for HAT using different trypanosome antigen combinations. Comparison of the prototype RDTs with the reference antibody detection screening test in current use, the card agglutination test for trypanosomiasis (CATT/T.b.gambiense) [12] using stored plasma samples showed that the SD BIOLINE HAT performed as well as CATT (S1 File). A limitation of that comparison however, was that the plasma samples had been pre-selected using CATT, as it was the only screening test for HAT that was in use at the time. The aim of this study was to evaluate the diagnostic accuracy of the prototype SD BIOLINE HAT using fresh blood samples under field conditions in a cross-sectional study; to compare its performance with that of CATT, on subjects who are not pre-selected using another serological method. CATT on 1/8 diluted plasma, which is more specific than CATT on whole blood and may be more suited for the target diagnostic settings, was considered for the main comparison. The study was carried out in three countries, in order to assess whether regional differences associated with parasite strains, level of endemicity or population genetic polymorphisms would interfere with test results. Angola, the Democratic Republic of the Congo (DRC) and the Central African Republic (CAR) were selected as countries with low (0.1–0.5%), intermediate (0.5–1.5%) and high (1.5–3.0%) prevalence, respectively. Subjects were enrolled through passive screening in fixed healthcare facilities and through active screening by mobile teams.

Methods

Participants

The settings, prevalence, names and locations of the study sites are summarized in Table 1. Study participants were enrolled in HAT endemic regions during both active and passive screening activities by teams of the national sleeping sickness control programs in Angola, the DRC and CAR. Cases of HAT were defined as subjects in whom trypanosomes were demonstrated by microscopy in either blood, lymph node aspirate or CSF. Cases were classified as stage one when no trypanosomes were observed in CSF and when the CSF white cell count was lower than or equal to 5 cells/μL, while those with trypanosomes in CSF and/or a CSF cell count above 5 cells/μL were classified as stage two. Controls were subjects living in the same areas as cases, with no previous history of HAT treatment and who were either seronegative (negative with all serological tests), or who were seropositive (positive with one or more serological tests) but with no detectable parasites in body fluids.

thumbnail
Table 1. Sites in Angola, CAR and the DRC where participants were enrolled by both passive and active screening.

Prevalence was calculated on the basis of combined active and passive screening results from this study.

http://dx.doi.org/10.1371/journal.pntd.0004608.t001

Test procedures

The prototype SD BIOLINE HAT is an immunochromatographic test for qualitative detection of antibodies of all isotypes (IgG, IgA and IgM). The test has a nitrocellulose membrane strip with two regions (T1 and T2) that are pre-coated with two native variant surface glycoprotein (VSG) antigens from T.b. gambiense (VSG LiTat1.3 and VSG LiTat 1.5 respectively). It also has a procedural control line (C) (Fig 1). The test is stable for at least 24 months at 40°C, or at least 5 weeks at 55°C. To perform the test, 20 μl of whole blood is taken from a finger prick and transferred into a sample well using a plastic pipette, and 4 drops (approximately 120 μl) of chase buffer are added. The sample flows along the membrane by capillarity, passing through the two test regions. Results are read after 15 to 20 minutes by comparing the intensity of the test lines against a colour chart provided by the manufacturer (Fig 1a and 1b). A result is considered positive when the control line C and either one or both test lines T1 and T2 are visible, negative when only the C line is observed and invalid if the C line is not observed. All participants found positive with the RDT or CATT test were tested for malaria using an SD BIOLINE malaria Ag P.f RDT. Those who were positive for malaria were examined, and if necessary, treated in line with national guidelines.

thumbnail
Fig 1. Example of an SD BIOLINE HAT positive test and the colour chart provided for interpretation of test intensity (the color chart is for research purposes only, the final test would be as positive or negative result only).

1a: from right to left: S: sample well, 1: band 1(LiTat 1.3), band 2 (LiTat 1.5). 1b: from top to bottom: possible results 4+, 3+, 2+, 1+, 0, and the range of color intensity corresponding to each result.

http://dx.doi.org/10.1371/journal.pntd.0004608.g001

Both CATT and SD BIOLINE HAT were performed on finger-prick blood from each subject who presented to mobile teams and any subject who presented to a health centre with symptoms indicative of HAT. Any subject who was positive by the RDT and/or CATT or who showed symptoms highly suggestive of HAT (i.e. a combination of at least 2 neurological signs) was eligible for enrolment in the parasitological work-up. Written informed consent was sought from these subjects prior to enrolment. Any individual who declined to participate was followed up according to the standard procedures of the national control programme. Individuals who were negative in both CATT and RDT were considered as not infected and were not investigated further. A lymph node aspirate was collected from any subject who presented with swollen lymph nodes and examined for trypanosomes by microscopy. Ten ml venous blood with heparin as anticoagulant, were collected from each RDT and/or CATT positive subject, as well as those with palpable lymph nodes. Six hundred μl of blood was used to perform the capillary tube centrifugation (CTC) test (4 capillary tubes of 75 μl) and the miniature anion exchange centrifugation technique (mAECT) (300 μl) [13], except in CAR where mAECT was not performed as it was not in routine use. For subjects who were positive by CATT on whole blood, 1 ml plasma was used to perform CATT dilutions [14]. Parasitologically confirmed cases and/or subjects found positive by CATT at a dilution of 1/16 who were negative by all other parasitological methods that were performed underwent a lumbar puncture in accordance with national guidelines for stage determination and/or parasitological confirmation in CSF when there were suggestive neurological signs. Parasitological examination of CSF was done using the modified single centrifugation technique [13]. The technicians who performed the tests were part of the teams of the national sleeping sickness control programmes, with experience in performing routine parasitological tests for detection of trypanosomes. They were trained on how to perform, read and interpret results of the RDTs.

There were two levels of blinding. During the initial screening of participants using blood from a finger prick, one health worker was responsible for performing the CATT test, while another health worker tested them with the RDT. The two health workers operated independently (but used blood from the same finger prick), without exchanging results (first level of blinding). A supervisor was responsible for collecting results of the two tests and deciding whether or not to collect venous blood for the parasitological tests. Samples of venous blood were labelled with blinding codes by the supervisor (second level of blinding). The same codes were used to identify all other samples collected from the participants (e.g. the buffy coat, plasma, CSF and/or blood on filter paper) and constituted the anonymisation process kept all along the study.

All plasma, buffy coat and CSF samples that remained after the diagnostic procedures were aliquoted and stored in liquid nitrogen. Due to logistical constraints in CAR that limited access to liquid nitrogen for sample storage, blood was dried on Whatman filter paper, while plasma was stored at 4°C in the field for not more than 2 weeks before being transferred to Bangui, where it was stored at -20°C. The samples were later shipped to either Limoges University (France) or Makerere University (Uganda) for storage. Samples from a subset of subjects who were positive by any screening method but not by parasitology were later tested with two molecular methods, including the loop-mediated isothermal amplification (LAMP) developed by Eiken Chemical Co. [15] and polymerase chain reaction (PCR) using primers specific for the T. brucei group [16].

Sample size calculation

We aimed to enrol sufficient study participants to give a robust estimate of test performance parameters whilst ensuring that the target sample size would be logistically feasible for such a prospective study. In order to achieve this, we calculated a sample size to demonstrate non-inferiority of the sensitivity and specificity of the RDT compared to the CATT 1/8 with a confidence interval (1-alpha) of 95% and a power (1-beta) of 80%, a non-inferiority margin of 5%, and using an expected sensitivity and specificity of 95% for both tests. The minimum number of study participants required to achieve this was 235 true HAT cases and 235 controls [17]. Based on the expected prevalence of HAT in the study areas, the minimum number of subjects estimated to be enrolled in order to get at least 235 HAT cases were 6,320 in Angola and 4,200 in each of the DRC and CAR, for a total of 14,720 subjects.

Statistical analysis

Sensitivity and specificity were calculated for the prototype RDT, CATT on whole blood and CATT on 1/4 and 1/8 diluted plasma, by country, by disease stage and by screening method. In the field, CATT dilutions are sometimes performed on subjects who are negative by CATT on whole blood if the subject has symptoms indicative of HAT. However, since CATT dilutions are usually not performed on subjects who are negative by CATT on whole blood, we considered any subject who was negative by CATT on whole blood to also be negative by CATT on diluted plasma for purposes of the analysis.

The results of the serological tests CATT and RDT were each compared to a composite reference standard (CRS). This CRS classified participants based on demonstration of trypanosomes by any of the parasitological methods. A participant was classified as CRS positive, and hence considered as a HAT case, when parasites were demonstrated by any of the parasitological tests. A participant was classified as CRS negative if parasites were not identified in any body fluid, provided that at least CTC and mAECT had been performed (except in CAR where mAECT was not used).

The results on diagnostic accuracy of the tests are reported in a descriptive manner, without claiming non-inferiority for two reasons: the required sample size could not be reached as the prevalence of HAT was lower than expected and the actual sensitivity and specificity of the CATT 1/8 and the RDT were also lower than anticipated. Therefore, 95% confidence intervals (CI) were calculated around the sensitivity and specificity estimates using the Wilson method implemented in the Hmisc package for the R statistical environment [18, 19]. Statistical significance was analysed by checking for an overlap in confidence intervals and more formally using Pearson’s Chi-squared test.

In an additional analysis, we compared the results of molecular analyses to those of parasitology to identify participants who were potentially parasitological false negatives.

Ethical approval

The study received ethical clearance from the different committees of the three participating countries respectively for DRC, CAR and Angola: “Ecole de santé publique de l’Université de Kinshasa”; “Comité scientifique de la faculté des sciences de la santé” and “direccao nacional da saude publica, Ministerio da saude”. Participants provided written informed consent before being enrolled in the study. For children below 18 years, consent was provided by a parent or guardian. All individuals who presented at study sites during the period of enrollment and consented to being screened were eligible. All participants’ samples were blinded and further analysed anonymously.

Results

Overview of participants and test results

Enrollment of participants was carried out from July to October 2011 in Angola, September 2012 to March 2013 in the DRC, and from April to June 2012 in CAR. The global and country-specific overview of the results of the study is shown as a flow chart in Fig 2. In total, 14,818 participants were screened using both serological tests (9.5% in passive screening), and out of these 149 HAT cases were confirmed by parasitology. Hence, the prevalence of HAT was found to be lower than originally estimated, and as such it was not possible to reach the target number of cases. Among the remaining 14,669 participants, 112 could not be included as controls because 98 had previous history of HAT, and 14 who were positive by serology were excluded during analysis because their parasitology results were incomplete (CTC had not been performed).

thumbnail
Fig 2. Overview of the results of the CATT and RDT tests in Angola, CAR and the DRC.

RDT: SD BIOLINE HAT rapid diagnostic test. CATT: card agglutination test for trypanosomiasis. * 1 case that was negative on CATT whole blood and the RDT was detected by CATT 1/8 dilution. ** a = Angola; b = Central African Republic; c = Democratic Republic of the Congo. / = and/or

http://dx.doi.org/10.1371/journal.pntd.0004608.g002

Among the 149 confirmed cases, 148 were positive by either CATT on whole blood and/or RDT, while one case was negative by both CATT whole blood and RDT, and was detected by CATT dilutions. CATT dilutions were performed on this case because of the presence of symptoms suggestive of HAT. Twenty one cases were identified in Angola (detection rate of 0.30%), 77 in CAR (detection rate of 2.13%) and 51 in the DRC (detection rate of 1.20%). The median age of cases was 24 years (range 1–78) with a sex ratio of 0.84 (68 males/81 females). One hundred and nine cases (73.2%) were enrolled during active screening and 40 (26.8%) during passive screening. Forty six (31%) cases were in stage one disease and 103 (69%) were in stage two. Forty percent of cases identified by active screening were in stage one disease, compared to only 5% among cases identified by passive screening.

Among the 14,557 controls, 1,106 (7.6%) were positive with either one or both screening tests, and 13,437 were negative with both. Of these controls, 6,892 (47.4%) were enrolled in Angola (5,877 by active screening and 1,013 by passive screening), 3,514 (24.2%) in CAR (all by active screening) and 4,151 (28.5%) in the DRC (3,816 by active screening and 335 by passive screening). Among the 1,106 positive tests, 278 were positive with both serological tests, 317 were positive by CATT and negative by RDT and 511 were negative by CATT and positive by RDT. No invalid RDT result was reported from any country.

Eight hundred and twenty seven subjects (548 seropositive with at least one test and 279 positive by both tests) were tested using LAMP and PCR. Both molecular tests were negative in 664 (80.29%) samples, 65 (7.86%) were positive with LAMP only and 72 (8.71%) with PCR only. Both molecular tests were positive in 26 (3.14%) samples, 25 of which were from CAR where mAECT had not been used for parasitological confirmation of cases.

Results on sensitivity and specificity for each test and each CATT dilution by country, screening method and disease stage are shown in Tables 2, 3 and 4 respectively. The overall sensitivity of the RDT and CATT at 1/8 dilution was identical, at 89.26% (95% CI = 83.27–93.28), while that for CATT on whole blood was higher, at 93.96% (95% CI = 88.92–96.79%). Sensitivity of CATT on whole blood was highest in Angola and lowest in CAR. However, in CAR CATT retained its sensitivity when serial dilutions were considered, whilst in Angola and DRC the sensitivity declined, such that a dilution of 1/16 had the highest sensitivity in CAR (Table 2). The sensitivity of the RDT was highest in Angola and lowest in CAR. It is noticeable that the sensitivity of band 1 on the RDT, which has the same antigen as the one in the CATT test, was very similar in the three countries (85.71; 85.71 and 86.27% respectively for Angola, CAR and DRC), whilst the sensitivity of band 2 varied from 95.24% in Angola (95% CI = 77.33–99.76) to 83.12% (95% CI = 73.23–89.86) in CAR.

thumbnail
Table 2. Performance of CATT and prototype SD BIOLINE HAT RDT on fresh blood by country.

http://dx.doi.org/10.1371/journal.pntd.0004608.t002

thumbnail
Table 3. Performance of CATT and prototype SD BIOLINE HAT RDT on fresh blood by method of screening.

http://dx.doi.org/10.1371/journal.pntd.0004608.t003

thumbnail
Table 4. Sensitivity of CATT and prototype SD BIOLINE HAT RDT on fresh blood by stage of disease.

http://dx.doi.org/10.1371/journal.pntd.0004608.t004

The overall specificity was 94.58% (95% CI = 94.20–94.94%) for the RDT, 95.91% (95% CI = 95.58–96.22%) for CATT on whole blood, and 98.88% (95% CI = 98.70–99.04%) for CATT at 1/8 dilution. There were significant differences (p<0.001) between the three countries in the specificity of all tests except for CATT 1/16 (99.36% overall specificity (95% CI = 99.22–99.48%) (Table 2). As was seen with sensitivity, all tests were most specific in Angola and least specific in CAR.

Both the RDT and CATT on whole blood were more sensitive in stage two than in stage one patients (Table 4). Similarly, both the RDT and CATT on whole blood were more sensitive in passive than in active screening (Table 3). However, when CATT at 1/8 dilution was considered, sensitivity was higher in active than in passive screening (Table 3). The specificity of all tests was higher in passive than active screening (Table 3).

If a hypothetical cohort of 1,000 subjects with a HAT prevalence of 1% is considered, then the RDT would result in 53 false positives proceeding for confirmatory testing, while CATT WB and CATT 1/8 would results in 40 and 11 false positives respectively (Table 5).

thumbnail
Table 5. Test outcomes based on a hypothetical cohort of 1,000 subjects with a HAT prevalence of 1%.

http://dx.doi.org/10.1371/journal.pntd.0004608.t005

Agreement between CATT on whole blood and RDT was 93.91%, with both positive for 426 (2.87%) participants (Table 6). Both tests were negative in 13,489 (91%), 361 (2.4%) were CATT positive and RDT negative, while 542 (3.6%) were CATT negative and RDT positive. Agreement increased slightly when band 1 of the RDT was considered on its own (94.53%) but was similar for RDT band 2 (93.99%).

thumbnail
Table 6. Agreement between CATT on whole blood and SD BIOLINE HAT RDT, RDT band 1 and RDT band 2.

This table includes all enrolled participants.

http://dx.doi.org/10.1371/journal.pntd.0004608.t006

Discussion

This study is the first report of a multi-centric evaluation of an RDT for screening HAT in settings where the disease occurs in central African countries. It is the first study conducted without pre-selection of participants on the basis of their CATT status, the only screening test that was in routine used at that time. The overall sensitivity of the SD BIOLINE HAT RDT and CATT at 1/8 dilution were identical (89.26%, 95% CI 83.27, 93.28%). The RDT was less sensitive than CATT on whole blood, although this difference was not statistically significant. However, the specificity of the RDT was 4.3% lower than that of CATT at 1/8 dilution, at 94.58% (95% CI 94.20, 94.94%). Comparison of the prototype RDT to CATT at 1/8 dilution was in line with the knowledge that the specificity of CATT is improved when this dilution is considered.

The sensitivity of the prototype RDT (89.26%) was lower than that reported in a recent study in the DRC on another RDT (98.5% for the HAT Sero-K-SeT) [20]. This may be explained by methodological differences, as our study included both active and passive screening, none of the study participants had been pre-selected with CATT, and the level of blinding was higher. During passive screening, a patient is subjected to a screening test after being suspected of having HAT, while in active screening, all people who present themselves are screened. As a result of the clinical suspicion before being tested, a passive screening setting may therefore bias the results towards higher sensitivity. The two studies are however in agreement that a combination of at least two antigens (VSG LiTat 1.3 and VSG LiTat 1.5) on the same test is necessary to provide sufficient sensitivity. In our study, using a single antigen would have resulted in a drop of 3.3% in sensitivity, whilst the specificity would have increased by less than 1%. In another study that compared the diagnostic accuracy of the commercialized versions of both RDTs on stored serum samples from West Africa, the sensitivity of both tests was reported to be very good while the specificity was low [21]. This might be explained by geographic differences in the specificity of responses to VSG antigens but it may also suggest that results obtained using stored samples could differ from those obtained on fresh whole blood samples or alternatively, some changes in the buffer to optimize sensitivity could also modify specificity. In the present study, 16 cases would have been missed if only the prototype RDT had been used, and 9 if only CATT on whole blood had been used, reflecting the imperfect nature of both tests. Based on these observations, further optimization of the prototype RDT to improve both its sensitivity and specificity, which is critical when a test has to be used in situations of low prevalence, is recommended. The one case that was missed by CATT and RDT but found positive by CATT on diluted plasma could indicate the existence of a prozone effect, as has been reported with other serological tests [22].

Both of the antigens used in the prototype RDT are produced from pathogenic trypanosomes harvested from artificially infected rodents. Difficulties in their production could pose a challenge in scaling up production of the test. Altogether, both tests are imperfect, and reflect the difficulty of their use in settings of low prevalence and/or insufficient knowledge on parasite strain variation and/or the elicited immune reactions, highlighting the need for more investments in development of optimal tests. Recently, promising results were reported when prototype RDTs made using recombinant antigens were compared with the commercialized version of the SD BIOLINE HAT [23].

This study had a number of limitations. Firstly, the study lacked the level of statistical power that we had aimed for, and secondly, the results of the present study were not systematically validated with reference tests for antibody detection such as immune trypanolysis [24]. Thirdly, the mAECT test, which is the most sensitive parasitological method for T. b. gambiense HAT [25], was not routinely used in the CAR and was therefore not included in that part of the study, potentially leading to the misclassification of some infected individuals as controls. It is possible that participants who were reported as false positives with either serological test were in fact true positives, compromising in particular the reported specificity of the screening tests. Indeed both tests were least specific in the CAR. This is supported by the observation that when LAMP and PCR were performed on 70% of the seropositive but parasitologically negative samples, 3.14% were positive on both tests (S2 File). Most of the positive samples were from CAR where mAECT, was not performed. Approximately 8% of seropositive samples were positive by either LAMP or PCR, pointing to the possibility that these could have been true infections that were missed by the methods that are currently in clinical use. Indeed recent retrospective studies using samples from HAT patient have shown that both methods, which detect parasite DNA, have a sensitivity of up to 90% [25, 26, 28]. However, when human-infective parasite DNA is detected, it is unclear whether this should be taken as a marker of infection or disease; both spontaneous resolution and persistent latent infection can occur [21, 26]. Introduction of such molecular tests into clinical use may be a challenge and strategies on how they could be used to contribute to elimination of the disease have still to be fully explored [21, 26, 27, 28].

RDTs have a number of advantages, especially in settings of low prevalence and where the target is to eliminate the disease. They are simple, instrument-free, easy to use, and do not require a cold chain for storage. This study has demonstrated that performance of the SD BIOLINE HAT RDT is comparable to that of CATT 1/8. The recommendations arising from the study have since been used to optimize the prototype RDT, and performance and implementation studies using the optimized product are going on in several countries.

Introduction of HAT RDTs in routine use as an alternative to CATT could have significant cost implications on the healthcare system, which should be determined and the information used to guide policy decisions. While the benefits of using RDTs for passive screening in health facilities are evident, the cost-effectiveness of algorithms that use RDTs in active screening in place of CATT should be evaluated. During active screening using CATT for example, blood samples from 10 individuals are tested in parallel, which is advantageous because a large number of people can be tested in one day. When RDTs are used instead, one person is tested at a time, and the results are read after 15 minutes, meaning that fewer people are likely to be screened in one day, with a negative impact on population coverage. Similarly, the reagents used to perform the CATT test are packed in multiple doses while RDTs are single devices, which occupy a larger space during transportation, thus posing a challenge and additional costs to the mobile team. A detailed analysis of these aspects is currently being prepared as a follow on publication.

Supporting Information

S1 File. Comparison of the performance of antigens in a prototype HAT rapid diagnostic test (RDT) with CATT using stored samples.

doi:10.1371/journal.pntd.0004608.s001

(DOCX)

S2 File. Proportion of positive and negative test results using molecular analysis (LAMP and PCR).

doi:10.1371/journal.pntd.0004608.s002

(DOCX)

S3 File. STARD checklist.

doi:10.1371/journal.pntd.0004608.s003

(DOC)

Acknowledgments

The authors acknowledge the teams of the sleeping sickness control programme in Angola, CAR and DRC for their commitment and efforts in enrolling study participants and performing the tests under difficult field conditions. The Institut Pasteur in Bangui and in particular its director, Kazanji M, is thanked for storing the samples from CAR and organizing their shipment to France and Uganda. We are grateful to Prof. Enock Matovu of Makerere University for testing a sub-set of the samples by LAMP and PCR.

Author Contributions

Conceived and designed the experiments: SBis SBie JMN CL. Performed the experiments: SBis GV TJ CL VK EN LF. Analyzed the data: PRB. Contributed reagents/materials/analysis tools: PB. Wrote the paper: SBis PRB SBie JMN MB PB.

References

  1. 1. WHO (2013). The 17 neglected tropical diseases. World Health Organization. http://www.who.int/neglected_diseases/diseases/en/ Accessed 5 September 2014.
  2. 2. Simarro PP, Franco JR, Diarra A, Ruiz Postigo JA, Jannin JG (2013) Diversity of human African trypanosomiasis epidemiological settings requires fine-tuning control strategies to facilitate disease elimination. Research and Reports in Tropical Medicine 4: 1–6.
  3. 3. Simarro PP, Jannin JG, Cattand P (2008) Eliminating human African trypanosomiasis: where do we stand and what comes next? Plos Med 5:e55. doi: 10.1371/journal.pmed.0050055. pmid:18303943
  4. 4. Kennedy PG (2013) Clinical features, diagnosis, and treatment of human African trypanosomiasis (sleeping sickness). Lancet Neurol 12(2):186–94 doi: 10.1016/S1474-4422(12)70296-X. pmid:23260189
  5. 5. Simarro PP, Diarra A, Ruiz Postigo JA, Franco JR, Jannin JG (2011) The human African trypanosomiasis control and surveillance programme of the World Health Organization 2000–2009: The way forward. PLoS Negl Trop Dis 5(2): e1007. doi: 10.1371/journal.pntd.0001007. pmid:21364972
  6. 6. Franco JR, Simarro PP, Diarra A, Ruiz-Postigo JA, Jannin JG (2014) The journey towards elimination of gambiense human African trypanosomiasis: not far, nor easy. Parasitology 141(6):748–60. doi: 10.1017/S0031182013002102. pmid:24709291
  7. 7. World Health Organization (2015). Human African Trypanosomiasis: Cases of sleeping sickness drop to lowest level in 75 years. URL: http://www.who.int/trypanosomiasis_african/cases_drop_to_lowest_since_75_years/en/
  8. 8. Chappuis F, Lima MA, Flevaud L, Ritmeijer K (2010) Human African trypanosomiasis in areas without surveillance. Emerging Infectious Diseases 16(2):354–355. doi: 10.3201/eid1602.090967. pmid:20113585
  9. 9. World Health Organization (WHO) (2012) Accelerating work to overcome the global impact of neglected tropical diseases: A road-map for implementation: 1–22. http://whqlibdoc.who.int/hq/2012/WHO_HTM_NTD_2012.1_eng.pdf.
  10. 10. Hasker E, Lumbala C, Mbo F, Mpanya A, Kande V, Lutumba P, et al. (2011). Health care-seeking behaviour and diagnostic delays for human African trypanosomiasis in the Democratic Republic of the Congo. Trop Med Int Health 16(7):869–74. doi: 10.1111/j.1365-3156.2011.02772.x. pmid:21447063
  11. 11. Deborggraeve S, Büscher P (2010) Molecular diagnostics for sleeping sickness: what is the benefit for the patient? Lancet Infect Dis. 10(6):433–9. doi: 10.1016/S1473-3099(10)70077-3. pmid:20510283
  12. 12. Magnus E, Vervoort T, Van Meirvenne N (1978) A card agglutination test with stained trypanosomes (CATT) for the serological diagnosis of T. b. gambiense trypanosomiasis. Ann Soc Belg Med Trop 58: 169–176. pmid:747425
  13. 13. Buscher P, Mumba Ngoyi D, Kabore´ J, Lejon V, Robays J, Jamonneau V, et al. (2009) Improved models of mini anion exchange centrifugation technique (mAECT) and modified single centrifugation (MSC) for sleeping sickness diagnosis and staging. PLoS Negl Trop Dis (3): e471.
  14. 14. Mitashi P, Hasker E, Lejon V, Kande V, Muyembe JJ, Lutumba P et al. (2012). Human African trypanosomiasis diagnosis in first-line health services of endemic countries, a systematic review. PLoS Negl Trop Dis 6(11):e1919. doi: 10.1371/journal.pntd.0001919. pmid:23209860
  15. 15. Ndung’u JM, Bieler S., Roscigno G. (2010) “Piggy-backing” on diagnostic platforms brings hope to neglected diseases: the case of sleeping sickness. PLoS Negl Trop Dis 4(5): e715. doi: 10.1371/journal.pntd.0000715. pmid:20520801
  16. 16. Masiga DK, Smyth AJ, Hayes P, Bromidge TJ, Gibson WC (1992). Sensitive detection of trypanosomes in tsetse flies by DNA amplification. Int J Parasitol. 22(7):909–18. pmid:1459784
  17. 17. Blackwelder W.C (1982). Proving the null hypothesis in clinical trials. Controlled Clinical Trials 3:345–353. pmid:7160191
  18. 18. Frank E Harrell Jr, with contributions from Charles Dupont and many others (2014) Hmisc: Harrell Miscellaneous. R package version 3.14–6. http://CRAN.R-project.org/package=Hmisc
  19. 19. R Core Team (2014). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL http://www.R-project.org/.
  20. 20. Büscher P, Mertens P, Leclipteux T, Gilleman Q, Jacquet D, Büscher P (2014) Sensitivity and specificity of HAT Sero-K-SeT, a rapid diagnostic test for serodiagnosis of sleeping sickness caused by Trypanosoma brucei gambiense: a case-control study. Lancet Glob Health 2 (6):e359–63. doi: 10.1016/S2214-109X(14)70203-7. pmid:25103304
  21. 21. Jamonneau V, Camara O, Ilboudo H, Peylhard M, Koffi M, Sakande H, et al. (2015) Accuracy of individual rapid tests for serodiagnosis of gambiense sleeping sickness in west Africa. PLoS Negl Trop Dis 9(2):e0003480. doi: 10.1371/journal.pntd.0003480. pmid:25642701
  22. 22. Jacobs JF, van der Molen RG, Bossuyt X, Damoiseaux J (2015). Antigen excess in modern immunoassays: to anticipate on the unexpected. Autoimmun Rev 14(2):160–7. doi: 10.1016/j.autrev.2014.10.018. pmid:25461469
  23. 23. Sternberg JM, Gierliński M, Biéler S, Ferguson MAJ, Ndung’u JM (2014) Evaluation of the diagnostic accuracy of prototype rapid tests for human African trypanosomiasis. PLoS Negl Trop Dis 8(12):e3373. doi: 10.1371/journal.pntd.0003373. pmid:25521120
  24. 24. Van Meirvenne N, Magnus E, Büscher P (1995) Evaluation of variant specific trypanolysis tests for serodiagnosis of human infections with Trypanosoma brucei gambiense. Acta tropica 60: 189–199. pmid:8907397
  25. 25. Mumba Ngoyi D, Ali Ekangu R, Mumvemba Kodi MF, Pyana PP, Balharbi F, et al. (2014) Performance of parasitological and molecular techniques for the diagnosis and surveillance of Gambiense sleeping sickness. PLoS Negl Trop Dis 8(6):e2954. doi: 10.1371/journal.pntd.0002954. pmid:24921941
  26. 26. Mugasa CM, Adams ER, Boer KR, Dyserinck HC, Büscher P, Schallig HD et al. (2012) Diagnostic accuracy of molecular amplification tests for human African trypanosomiasis—systematic review. PLoS Negl Trop Dis;6(1):e1438. doi: 10.1371/journal.pntd.0001438. pmid:22253934
  27. 27. Ilboudo H, Bras-Gonçalves R, Camara M, Flori L, Camara O, Sakande H et al (2014). Unravelling human trypanotolerance: IL8 is associated with infection control whereas IL10 and TNFα are associated with subsequent disease development. PLoS Pathog 10(11):e1004469. doi: 10.1371/journal.ppat.1004469. pmid:25375156
  28. 28. Mitashi P, Hasker E, Ngoyi DM, Pyana PP, Lejon V,Van der Veken W et al. (2013) Diagnostic accuracy of Loopamp Trypanosoma brucei detection kit for diagnosis of human African trypanosomiasis in clinical samples. PLoS Negl Trop Dis 7(10).