Figures
Abstract
Background
Infections with soil-transmitted helminths (STH) and schistosomiasis (SCH) result in a significant global health burden, particularly in rural communities in low and middle-income countries. While microscopy remains the primary diagnostic method for STH and SCH in resource-limited settings, nucleic acid amplification tests (NAATs) are gaining prominence as tools for evaluation of public health control programs in endemic countries, and individual diagnosis in high-income countries. Despite the high sensitivity and specificity of NAATs, previous research has highlighted inter-laboratory variations, both in technical and clinical performance, justifying the need for continuous proficiency testing.
Methodology
Results from 5 rounds over a 5-year period of the so far only longitudinal international Helminth External Molecular Quality Assessment Scheme (HEMQAS), coordinated by the Dutch Foundation for Quality Assessment in Medical Laboratories (SKML), were examined in order to (i) assess the diagnostic proficiency of laboratories in detecting helminths in stool and (ii) identify potential factors contributing to variations in performance.
Outcome and conclusions
Thirty-six laboratories, from 18 countries and 5 continents, participated in HEMQAS. The overall diagnostic performances were satisfying, with remarkably low numbers (<2%) of false-positive results. False-negative results were more often reported for stool (15%) than for DNA (5%) samples. False-negative results varied largely between targets (the highest number (29%) for Trichuris trichiura). Twenty-five laboratories provided a sufficient number of results for a robust comparison between participating laboratories, which confirmed substantial inter-laboratory variability in quantitative NAAT results (Cq-values). This variability likely arises from differences in pre-treatment, DNA isolation and DNA-target amplification procedures. This study emphasizes the complexity of molecular diagnosis for STH and SCH, highlighting the critical role of proper stool preparation and DNA isolation methods. The results underscore the necessity for laboratory professionals and public health decision-makers to recognize these complexities and continuously undertake external quality assessment schemes to ensure accurate and reliable performance in molecular diagnosis.
Author summary
Parasitic worms cause significant global health challenges, particularly in rural communities in low and middle-income countries. Laboratory tests that detect parasite DNA in human stool are increasingly being used for the diagnosis of parasitic worm infections. While parasite DNA detection can be an excellent diagnostic tool, its performance in clinical practice varies considerably, as demonstrated by previous research. To ensure the quality in diagnostic testing of these parasitic worms, it is important that laboratories evaluate the diagnostic performance of their DNA-based tests by participating in a so-called external quality assessment scheme (EQAS). This study, focusing on the first five-yearly rounds of the so far only longitudinal international EQAS to date, reveals that quantitative DNA detection results are not directly comparable across laboratories due to substantial inter-laboratory variability. This variability mainly stems from differences in pre-treatment and DNA isolation protocols, and to a lesser extent from differences in DNA target amplification procedures. Furthermore, the study underscores the complexity of molecular diagnosis for parasitic worms in clinical practice and the necessity for laboratories to engage in EQAs to guarantee the proper functioning of these diagnostic tests.
Citation: Schutte AHJ, Koelewijn R, Ajjampur SSR, Levecke B, McCarthy JS, Mejia R, et al. (2024) Detection of soil-transmitted helminths and Schistosoma spp. by nucleic acid amplification test: Results of the first 5 years of the only international external quality assessment scheme. PLoS Negl Trop Dis 18(8): e0012404. https://doi.org/10.1371/journal.pntd.0012404
Editor: Jong-Yil Chai, Seoul National University College of Medicine, REPUBLIC OF KOREA
Received: March 18, 2024; Accepted: July 25, 2024; Published: August 8, 2024
This is an open access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Data Availability: All the raw data used to prepare the figures are supplied in the supporting information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Infections with soil-transmitted helminths (STH) and schistosomiasis (SCH) lead to a major global health burden due to their high prevalence and intensity of infection in rural communities. STH are caused by hookworms (Necator americanus, Ancylostoma duodenale and Ancylostoma ceylanicum), whipworms (Trichuris trichiura), the roundworm (Ascaris lumbricoides) and Strongyloides stercoralis. Globally, over 1 billion people are estimated to be affected by one or multiple STH, and circa 140 million people by SCH [1–3]. In many high-prevalence countries, public health programs entail large-scale deworming programs aiming to control and eventually eliminate STH and SCH.
In 2020 the World Health Organization (WHO) released the 2030 targets for global advancements in STH control and among the listed requirements is the need for improved and less time-consuming diagnostics [4,5]. In resource-poor settings microscopy-based techniques are the primary method for diagnosing both STH and SCH. However, nucleic acid amplification tests (NAATs) are increasingly available and used for research purposes in public health programs in endemic countries as well as in individual testing in high-income countries [6–8]. Compared to microscopy, NAATs have a very high diagnostic accuracy, both in specificity and sensitivity, and can therefore be used to accurately assess changes in infection prevalence following mass drug administration [9–13]. Furthermore, NAATs may be less labor-intensive, especially if large numbers of samples need to be examined in a high-throughput setting [14]. Lastly, NAATs may play a role in the early detection of emerging anthelmintic resistance [15].
Although the detection of STH and SCH by NAATs can be both sensitive and specific, technical difficulties are recognized as possible impediments to diagnostic performance [8,16,17]. First, DNA amplification can only be achieved if target DNA is released from eggs or larvae; the former are surrounded by a firm eggshell or cuticle that varies in structure and thickness between helminth species [17]. Second, the quantity of DNA within the egg and larvae can be dependent on the development of the embryonic stage [17]. Further, stool is known to contain factors that inhibit DNA amplification, which poses difficulties for the proper amplification of DNA extracted from stool [18]. In a world that is increasingly dependent and trusting towards NAATs, it is crucial that the NAAT performance in actual practice is secured. External quality assessment schemes (EQAS) provide a blinded process in which well-validated specimens can be examined and results can be compared with other diagnostic laboratories. Thereby EQAS are essential for the detection of weaknesses in routine diagnostics that can be improved [19,20].
In 2018, the Helminth External Molecular Quality Assessment Scheme (HEMQAS) was launched as the first international EQAS for the detection of STH and SCH in stool by NAATs. It demonstrated proof of principle for the feasibility of a worldwide EQAS for NAATs for detection of helminths in stool [21]. It also demonstrated the added value of the simultaneous distribution of both stool and DNA samples in HEMQAS, as this combination allows the assessment of accuracy of the entire laboratory procedure as well as the efficiency of target DNA amplification. Thereby each HEMQAS participant can determine their areas for improvement, such as DNA isolation or amplification of the target DNA.
In this study all results of the HEMQAS of the first 5-years are examined with the following aims: (i) to evaluate the diagnostic performance of laboratories for the detection of different helminths, and (ii) to identify potential causes for the differences in performance between the laboratories.
Methods
HEMQAS design HEMQAS is organized by the Dutch Foundation for Quality Assessment in Medical Laboratories (SKML) [22]. From 2018 to 2022, a set of 8 to 12 homogenized ethanol-preserved stool samples and 6 to 10 purified DNA samples in stabilization buffer, were sent from the SKML-EQAS coordinating center (Department of Medical Microbiology and Infectious Diseases, Erasmus Medical Center, Rotterdam, the Netherlands) to the participating laboratories. Between the different distributions the DNA and parasite loads intentionally varied with emphasis on loads challenging to detect. The participating laboratories were asked to report the detected helminths species with a corresponding Cq-value. Concurrently, all participating laboratories received an online questionnaire in which they were asked to specify the DNA extraction and NAAT protocol that was used for their NAAT.
Sample preparation and validation
The applied methods for sample preparation, selection of expert laboratories and sample validation, were in detail described before [21]. In short, the distributed stool samples were prepared from clinical specimens that contained a high number of eggs and/or larvae as demonstrated by microscopy or PCR. The coordinating center of HEMQAS prepared homogeneous and stable suspensions of these clinical specimens by dilution in 70% (v/v) ethanol. The samples were sent only once per year for logistical and economic reasons.
Prior to each distribution the following seven expert laboratories examined selected stool and DNA samples to certify the presence or absence the 6 target helminths and to validate the homogeneity of the samples: Baylor College of Medicine, Houston, TX, U.S.A.; Christian Medical College, Vellore, Tamil Nadu, India; Elisabeth-Tweesteden Hospital, Tilburg, the Netherlands; Erasmus MC University Medical Center, Rotterdam, The Netherlands; Leiden University Medical Center, Leiden, The Netherlands; Peter Doherty Institute for Infection and Immunity, Melbourne, Australia; Smith College, Northampton, MA, U.S.A.. A sample was classified as positive for a particular helminth target if the following three criteria were fulfilled: (i) all quintuplicates analyzed by one of the expert laboratories were positive for that target, (ii) the standard deviation of the quantification cycle (Cq)-values of the quintuplicates was less than two cycles, and (iii) all other expert laboratories confirmed the presence of that target. These criteria guarantee that positive certified helminth targets should be detectable by state-of-the-art NAAT methods. A sample was classified as negative for a particular target if the two following criteria were fulfilled: (i) all quintuplicates analyzed by the expert laboratory were negative for that target and (ii) all other expert laboratories confirmed the negative result for that particular target. Samples that were not classified as positive or negative for a specific target, were considered as ‘educational’ for that target, meaning that the target was not consistently detected by all expert laboratories. In this case, the sample probably contained a too-low parasite load to homogeneously be dispersed and/or to be detected. Hence, a positive NAAT result cannot be demanded from the participating laboratories, and therefore, these targets are validated as ‘educational’. The criteria used for validation of targets as positive, negative or educational, are commonly applied for validation of samples by EQAS organizations, including but not limited to the SKML.
Inclusion of HEMQAS participants and data analysis
HEMQAS participation was open to all laboratories from all over the world. All participating laboratories reported their results using the online QBase submission software of the SKML. Anonymized data was extracted from Qbase, after which data were analyzed in Excel 2016 and figures were prepared using Graphpad Prism 9.1.4.
Since only 3 stool samples were distributed to the participating laboratories that contained Ancylostoma spp. (Table 1), too few results were obtained for a reliable performance analysis for this target. Therefore, this helminth target was excluded from further analysis in this study. In addition to analysis of the qualitative performance (absence / presence of target), this study also aimed to evaluate to accuracy of qualitative test results in relation to the semi-quantitative results and the used methodology. For this part of the study only the results of laboratories were included that reported a minimum 4 quantitative results for both DNA- as well as stool samples for at least one helminth target, to avoid bias because of too little data points.
Results
Analysis of qualitative results
Over the studied 5-year period from 2018 to 2023, 36 laboratories participated in the HEMQAS from the following countries: Australia (n = 2), Belgium (n = 1), Denmark (n = 1), Germany (n = 1), France (n = 1), India (n = 1), Italy (n = 1), Kenya (n = 1), Luxembourg (n = 1), Malaysia (n = 1), Mozambique (n = 1) Netherlands (n = 10), Norway (n = 2), Spain (n = 1), Uganda (n = 2), USA (n = 5), Sweden (n = 1) and Switzerland (n = 3). Laboratories that participated in HEMQAS during the entire 5-year period, received a total of 50 stool samples and 36 DNA samples. However, most participating laboratories (n = 30) participated for fewer than 5 years, and thus examined a smaller number of samples. The distributed samples could comprise none, a single or multiple helminth species and Table 1 shows the number distributed stool and DNA samples classified as positive, negative or educational for the different helminth species investigated in this study: Ascaris lumbricoides, Necator americanus, Schistosoma spp., S. stercoralis and T. trichiura. This table also shows both the number of reported results and the total number of false-negative and false-positive results reported by all participating laboratories.
The accuracy of the qualitative results of NAAT for the detection of helminth parasites in stool was overall on average ca. 85%, with a sensitivity of 86% for A. lumbricoides, 86% for N. americanus, 89% for Schistosoma spp., 86% for S. stercoralis and only 71% for T. trichiura. As expected, the overall sensitivity for the detection of the helminth targets was higher in the DNA samples compared to stool samples (95% vs. 85%) with a sensitivity in DNA samples of 92% for A. lumbricoides, 92% for N. americanus, 96% for Schistosoma spp., 96% for S. stercoralis, and 99% for T. trichiura (Table 1). Participating laboratories reported overall more often false-negative outcomes (15%) than false-positive outcomes (1%) for stool samples (Table 1). In stool samples, most false-negative results were reported for T. trichiura (22 out of 77 stool samples, 29%) and in DNA samples for Ascaris ssp. (17 out of 210, 8%). The reported false results were not evenly distributed over the participating laboratories, because three participating laboratories (J, R and S) reported approximately half of all errors and were clearly poor performers in comparison the other participating laboratories (Fig 1).
Each point represents the reported Cq-value of the individual participant subtracted by the median of reported Cq-value of all participants and each horizontal line represents the median difference in reported Cq-value. Points and lines were only shown if the participants reported four or more Cq-values for either stool or DNA (educationals excluded). The table below represents the number of false negatives, false positives and false negative educationals (*) are displayed. Some numbers were placed in italics, this means the participant included ’positive’ results without reporting a Cq-value. Each letter on the the X-axis represents a different participant, these participants are similarly ordered throughout Fig 1–5. For the target Trichuris (Fig 5), most samples were assigned as educationals.
Analysis of quantitative results
In case of a positive test result the participating laboratories also reported the cycle at which the NAAT became positive (Cq-value). This Cq-value is a semi-qualitative measure for the amount of the target DNA and a low Cq-value means that relatively few DNA-amplification cycles were required to exceed the detection threshold and thus corresponds to relatively high concentrations of target DNA. However, the Cq -value is not only determined by the abundance of target DNA in the sample, as it is also affected by the efficiency of the NAAT. Since the distributed HEMQAS samples were validated to comprise equal amounts of helminths with only minor variations, the reported Cq-values could be used to examine the variation in detection efficiency among participating laboratories for distinct targets and sample types. To obtain robust data, only the results of laboratories were included that reported quantitative results for at least 4 DNA- and 4 stool samples for at least one helminth target. Using this inclusion criterion, the results of 11 participating laboratories had to be excluded, after which the results of 25 participating laboratories remained. The included laboratories were based in the following countries: Australia (n = 1), Belgium (n = 1), Denmark (n = 1), Germany (n = 1), India (n = 1), Italy (n = 1), Kenia (n = 1), Mozambique (n = 1) Netherlands (n = 9), Norway (n = 2), Sweden (n = 1), Switzerland (n = 1), Uganda (n = 1) and USA (n = 3)
According to the study of Cools et al. [21], for each positive target in each sample the median Cq-value of all participants was calculated. Subsequently, for each positive target in each sample for each included participant, their difference to the median of all participants could be calculated. These differences (the delta Cq to the median of all participants) was summed per participant per target per sample type, after which the delta median Cq-value per target could be compared among participants. In Figs 1–5, these delta Cq-values per target per participant are shown. In all panels of Figs 1–5, the participants are sorted identically on the X-axis, based on their overall median Cq-value for all helminth targets (from low to high Cq-value). The delta-Cq is plotted on the Y-axis and data points below the X-axis (negative values) correspond to participants that reported on average lower Cq-values than the median of all participants and thus represent participants with a relatively efficient NAAT. To show only robust delta median Cq-value data-points, only results were plotted of participants that reported ≥4 Cq-values for the depicted target. In addition, in each panel of Figs 1–5, the number of false-negative and false-positive outcomes are listed for each participant. Since the results for educational samples could not be assigned as false-positive nor false-negative, only the number and proportion of positive results for each target and sample type per participant are shown.
For detailed explanation of the figure, see legend of Fig 1.
For detailed explanation of the figure, see legend of Fig 1.
For detailed explanation of the figure, see legend of Fig 1.
For detailed explanation of the figure, see legend of Fig 1.
This analysis demonstrated a large variation in reported Cq-values for all helminth targets (Figs 1–5). For positive targets in most stool samples the difference between the lowest and highest reported Cq-value was >15 amplification cycles and for DNA samples this difference was as expected lower, but still often >10 amplification cycles. This observed variation was not randomly distributed, as some participants reported consistently relatively low Cq-values whereas others reported relatively high Cq-values. This observation is true for all helminth targets in both stool and DNA samples (Figs 1–5). Therefore, these results showed that large differences exist between participants in the detection efficiency of their NAAT. Participants that reported relatively low Cq-values for a specific helminth target in stool samples, tend to do so for all other helminth targets as well, because the participants are sorted identically in all panels of Figs 1–5 and throughout all these the average reported Cq-value ascents from left to right. Thus, independent from the target, participants tended to report either a consistently low or high Cq-values for stool samples. This correlation is much less pronounced for DNA samples, which shows that sample pre-treatment before DNA isolation and the DNA isolation method itself are important factors affecting the efficiency of NAAT to detect helminths in stool.
For most helminth targets, at most a very weak correlation was observed between the incidence of reported false-negative outcomes and relatively high Cq-values (only slightly more false-negative results reported by participants on the right half of the panels of Figs 1–5). This suggests that the differences in efficiency between participants did not substantially affect the qualitative outcome for stool samples with a substantial parasite load. On the other hand, participating laboratories that reported relatively low Cq-values (sorted on the left of part of the X-axis in de panels of Figs 1–5) seemed to report a higher proportion of educational samples as positive, an observation most apparent for T. trichiura. This result suggests that lower parasite loads are more often detected by efficient NAAT protocols.
Analysis of variations in methodology
In addition to the test results, most participants also answered the additional questions on the NAAT methodology used for the detection of helminths in stool in their laboratory. The variation between laboratories in methodology was very large, encompassing differences at all stages of the NAAT procedure, including sample pre-treatment before DNA extraction, DNA extraction method and equipment, volume of stool used for DNA extraction and subsequent NAAT, DNA target for amplification, sequences of primers and probes, type of DNA probes, PCR protocol (e.g. annealing temperature and number of cycles), concentration and source of DNA polymerase and other PCR components [8, 17]. Basically each participating laboratory used a unique protocol that deviated in one or more aspects from all other participants. Therefore, no conclusions can be drawn on the correlation between variations in the various steps of the NAAT and the resulting test efficiency.
As participating laboratories reported the volume of stool used for DNA extraction, their elution volume as well as the volume of isolated DNA in their NAAT, it could be calculated what proportion of the distributed 200 μL stool was examined in their NAAT. Again, a large variation was found among participants, as some used only 1 μL of the stool sample whereas others used up to 36 μL. As this difference was large, it was examined whether a correlation could be found between this ‘sample input volume for NAAT‘ (shown underneath all panels of Figs 1–5) with the median reported delta-Cq to the median Cq of all participants for each helminth target. However, no clear trend was observed (no increase or decrease in sample volume input from left to right in Figs 1–5). This result suggests that the ‘sample input volume for NAAT‘ is not the critical factor that on its own can explain the observed variation in reported Cq-values. When a similar analysis was performed to examine the correlation between quantitative results for DNA samples and the NAAT methodology used, again no correlation was found (not shown). These findings demonstrate that the diversity in the methodology for DNA amplification only, was already too high to detect trends between the applied methodology and test performance. Altogether the analyses of the quantitative results show that the NAAT for detection of helminths in stool differ substantially between laboratories, and that the cause for observed variation is multi-factorial.
Discussion
This is the first reported longitudinal inter-laboratory comparison study on the performance of NAAT for the detection of STH and SCH in stool. It demonstrated that although NAATs can be highly sensitive and specific, their performance in routine practice for clinical or epidemiological purposes can be poor in some laboratories, as false-negative results (ca. 15%) and false-positive (ca. 1%) occur. However, a small proportion of the participating labortories had a consistent diagnostic accuracy of >98%; confirming that PCR–if well performed–is a very powerful diagnostic approach. These results confirm the necessity of EQAS to ensure proper performance of NAATs for the detection of STH and SCH in stool.
In stool samples most false-negative results were reported for the detection of T. trichiura (29%). The median reported Cq-value for all positive T. trichiura stool samples was higher than those of stool samples positive for the other helminth targets (Table 1). Although it cannot be excluded that this difference is simply caused by inclusion of stool samples containing relatively low loads of T. trichiura, this difference could (in part) also be caused by the previously reported difficulties in extracting DNA from T. trichiura eggs, which have a relatively late embryonic development (and therefore not as many cells and genome copies per egg) and a relatively thick and lysis-resistant eggshell [8, 23]. Participating laboratories that performed best in detection of T. trichiura in stool (C, G and K) used relatively rigorous lysis methods (combining beat beating and protease K treatment), which suggests that harsh lysis methods are required for sensitive detection of T. trichiura eggs in stool.
For DNA samples most false-negative results were reported for Ascaris spp. (8%), and most of these false-negative results were reported for the DNA samples distributed in 2019 (n = 6) and 2020 (n = 4). Interestingly, most of these participating laboratories detected Ascaris spp. in the simultaneously distributed stool samples. The cause for this striking observation was the source from which the DNA sample for Ascaris spp. was prepared; adult worm muscle tissue for the 2019 and 2020 samples and from eggs for the samples from 2021 onwards. This source was important as the DNA target for Ascaris used by some participating laboratories was the high copy-number repeat sequence specific for germline cells that are only abundantly present in eggs and larvae [24]. Therefore, most of the false-negative results for A. lumbricoides in DNA samples appeared to be an artefact of the source of DNA for sample preparation.
As this study showed that the variation in the reported semi-quantitative results (the Cq-values) between laboratories is extremely variable and can be as large as 15 DNA amplification cycles, quantitative PCR results are not comparable between laboratories. This hampers epidemiological surveys and thus potential application for evaluation of efficacy of large scale deworming programs if examined by distinct laboratories that do not use an identical protocol [10, 12, 15]. Hence, harmonization is needed, but given the in this study shown multi-factorial cause of the variation this will be difficult to achieve unless identical protocols and equipment will be used.
Finally, the following limitations of this study should be noted. This study was a retrospective study that analyzed the results of HEMQAS, which was not designed to investigate which NAAT method is most efficient. In addition, given the noted large extent in variations in NAAT methodology compared to the number of participating laboratories, almost every participant used a unique protocol, which prohibits firm conclusions on what methodology is efficient or not. Distributed samples were selected from a limited number of geographical sites (India, East Africa, Dutch travelers, and immigrants to the Netherlands), which might not be representative for all helminth genome variants around the world. Furthermore, the clinically important helminths Ancylostoma spp. and Schistosoma haematobium could not be included in this study, as until now no stool (Ancylostoma spp) or urine (S. haematobium) samples were distributed that contained these helminths. Given the clinical importance of female and male genital schistosomiasis caused by S. haematobium [25, 26], future inclusion of this helminth in EQA schemes is necessary. The selection criteria for inclusion of participant results for analysis of correlations between qualitative and quantitative results, resulted in a selection bias for laboratories based in high income countries as those participated for longer periods to HEMQAS and were able to report HEMQAS reports during the COVID-19 outbreak. In contrast to laboratories in high-income countries, laboratories from endemic countries were unable to participate as consistently in EQA schemes. Since a detailed overview of the performance of NAAT in laboratories based in endemic areas in low- and middle-income countries is lacking, this needs further investigation and requires further low-cost EQA implementation in these countries.
Acknowledgments
The authors express their gratitude to the participating laboratories of HEMQAS and to Nicolette van der Ham (Erasmus MC, Rotterdam), Malathi Manuel (CMC, Vellore), Francesca Azzato (Peter Doherty Institute for Infection and Immunity, Melbourne), and Eric Brienen (Leiden University Medical Center) for expert technical assistance.
References
- 1. Pullan RL, Smith JL, Jasrasaria R, Brooker SJ. Global numbers of infection and disease burden of soil transmitted helminth infections in 2010. Parasit Vectors. 2014;7:37. pmid:24447578
- 2. Disease GBD, Injury I, Prevalence C. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet. 2018;392(10159):1789–858. pmid:30496104
- 3. IHME. Schistosomiasis Level 3 cause 2023 [updated 2019; cited 2023 21-11-2023]. Available from: https://www.healthdata.org/results/gbd_summaries/2019/schistosomiasis-level-3-cause.
- 4. WHO. 2030 targets for soil-transmitted helminthiases control programmes 2020 [updated 2020; cited 2023 21-11-2023]. Available from: https://iris.who.int/bitstream/handle/10665/330611/9789240000315-eng.pdf?sequence=1.
- 5. Montresor A, Mupfasoni D, Mikhailov A, Mwinzi P, Lucianez A, Jamsheed M, et al. The global progress of soil-transmitted helminthiases control in 2020 and World Health Organization targets for 2030. PLoS Negl Trop Dis. 2020;14(8):e0008505.] pmid:32776942
- 6. ten Hove RJ, van Esbroeck M, Vervoort T, van den Ende J, van Lieshout L, Verweij JJ. Molecular diagnostics of intestinal parasites in returning travellers. Eur J Clin Microbiol Infect Dis. 2009;28:1045–53. pmid:19415354
- 7. O’Connell EM, Nutman TB. Molecular Diagnostics for Soil-Transmitted Helminths. Am J Trop Med Hyg. 2016;95:508–13. pmid:27481053
- 8. Verweij JJ, Stensvold CR. Molecular testing for clinical diagnosis and epidemiological investigations of intestinal parasitic infections. Clin Microbiol Rev. 2014;27:371–418. pmid:24696439
- 9. Werkman M, Wright JE, Truscott JE, Easton AV, Oliveira RG, Toor J, et al. Testing for soil-transmitted helminth transmission elimination: Analysing the impact of the sensitivity of different diagnostic tools. PLoS Negl Trop Dis. 2018;12(1):e0006114. pmid:29346366
- 10. Dunn JC, Papaiakovou M, Han KT, Chooneea D, Bettis AA, Wyine NY, et al. The increased sensitivity of qPCR in comparison to Kato-Katz is required for the accurate assessment of the prevalence of soil-transmitted helminth infection in settings that have received multiple rounds of mass drug administration. Parasit Vectors. 2020;13(1):324. pmid:32580759
- 11. Cools P, Vlaminck J, Albonico M, Ame S, Ayana M, Jose Antonio BP, et al. Diagnostic performance of a single and duplicate Kato-Katz, Mini-FLOTAC, FECPAKG2 and qPCR for the detection and quantification of soil-transmitted helminths in three endemic countries. PLoS Negl Trop Dis. 2019;13(8):e0007446. pmid:31369558
- 12. Easton AV, Oliveira RG, O’Connell EM, Kepha S, Mwandawiro CS, Njenga SM, et al. Multi-parallel qPCR provides increased sensitivity and diagnostic breadth for gastrointestinal parasites of humans: field-based inferences on the impact of mass deworming. Parasit Vectors. 2016;9:38. pmid:26813411
- 13. Llewellyn S, Inpankaew T, Nery SV, Gray DJ, Verweij JJ, Clements AC, et al. Application of a Multiplex Quantitative PCR to Assess Prevalence and Intensity Of Intestinal Parasite Infections in a Controlled Clinical Trial. PLoS Negl Trop Dis. 2016;10(1):e0004380. pmid:26820626
- 14. Papaiakovou M, Wright J, Pilotte N, Chooneea D, Schar F, Truscott JE, et al. Pooling as a strategy for the timely diagnosis of soil-transmitted helminths in stool: value and reproducibility. Parasit Vectors. 2019;12(1):443. pmid:31522691
- 15. Papaiakovou M, Littlewood DTJ, Gasser RB, Anderson RM. How qPCR complements the WHO roadmap (2021–2030) for soil-transmitted helminths. Trends Parasitol. 2021;37(8):698–708. pmid:33931342
- 16. Cools P, Vlaminck J, Verweij JJ, Levecke B. Quantitative PCR in soil-transmitted helminth epidemiology and control programs: Toward a universal standard. PLoS Negl Trop Dis. 2021;15:e0009134. pmid:33661910
- 17. Papaiakovou M, Gasser RB, Littlewood DTJ. Quantitative PCR-Based Diagnosis of Soil-Transmitted Helminth Infections: Faecal or Fickle? Trends Parasitol. 2019;35:491–500. pmid:31126720
- 18. Monteiro L, Bonnemaison D, Vekris A, Petry KG, Bonnet J, Vidal R, et al. Complex polysaccharides as PCR inhibitors in feces: Helicobacter pylori model. J Clin Microbiol. 1997;35(4):995–8. pmid:9157172
- 19. Carter JY. External quality assessment in resource-limited countries. Biochem Med (Zagreb). 2017;27:97–109. pmid:28392732
- 20. Schuurs TA, Koelewijn R, Brienen EAT, Kortbeek T, Mank TG, Mulder B, et al. Harmonization of PCR-based detection of intestinal pathogens: experiences from the Dutch external quality assessment scheme on molecular diagnosis of protozoa in stool samples. Clin Chem Lab Med. 2018;56:1722–7. pmid:29451859
- 21. Cools P, van Lieshout L, Koelewijn R, Addiss D, Ajjampur SSR, Ayana M, et al. First international external quality assessment scheme of nucleic acid amplification tests for the detection of Schistosoma and soil-transmitted helminths, including Strongyloides: A pilot study. PLoS Negl Trop Dis. 2020;14:e0008231.
- 22. SKML. Stichting Kwaliteitsbewaking Medische Laboratoriumdiagnostiek 2023 [updated 2023; cited 2023 21-11-2023]. Available from: https://www.skml.nl/.
- 23. Kaisar MMM, Brienen EAT, Djuardi Y, Sartono E, Yazdanbakhsh M, Verweij JJ, et al. Improved diagnosis of Trichuris trichiura by using a bead-beating procedure on ethanol preserved stool samples prior to DNA isolation and the performance of multiplex real-time PCR for intestinal parasites. Parasitology. 2017;144:965–74.
- 24. Pilotte N, Maasch J, Easton AV, Dahlstrom E, Nutman TB, Williams SA. Targeting a highly repeated germline DNA sequence for improved real-time PCR-based detection of Ascaris infection in human stool. PLoS Negl Trop Dis. 2019;13:e0007593.
- 25. Sturt AS, Webb EL, Phiri CR, Mweene T, Chola N, van Dam GJ, et al. Genital self-sampling compared with cervicovaginal lavage for the diagnosis of female genital schistosomiasis in Zambian women: The BILHIV study. PLoS Negl Trop Dis. 2020;14:e0008337.
- 26. Kayuni SA, Alharbi MH, Shaw A, Fawcett J, Makaula P, Lampiao F, et al. Detection of male genital schistosomiasis (MGS) by real-time TaqMan(R) PCR analysis of semen from fishermen along the southern shoreline of Lake Malawi. Heliyon. 2023;9:e17338.