Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Phase 3 evaluation of an innovative simple molecular test for the diagnosis of malaria in different endemic and health settings in sub-Saharan Africa (DIAGMAL)

  • Francois Kiemde ,

    Contributed equally to this work with: Francois Kiemde, Halidou Tinto

    Roles Conceptualization, Methodology, Writing – original draft, Writing – review & editing

    Affiliation Clinical Research Unit of Nanoro, Nanoro, Burkina Faso

  • Halidou Tinto ,

    Contributed equally to this work with: Francois Kiemde, Halidou Tinto

    Roles Conceptualization, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Clinical Research Unit of Nanoro, Nanoro, Burkina Faso

  • Jane Carter,

    Roles Conceptualization, Methodology, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Amref Health Africa, Nairobi, Kenya

  • Toussaint Rouamba,

    Roles Data curation, Formal analysis, Software, Writing – review & editing

    Affiliation Clinical Research Unit of Nanoro, Nanoro, Burkina Faso

  • Daniel Valia,

    Roles Methodology, Writing – review & editing

    Affiliation Clinical Research Unit of Nanoro, Nanoro, Burkina Faso

  • Lesong Conteh,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation London School of Economics and Political Science, London, United Kingdom

  • Elisa Sicuri,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliations London School of Economics and Political Science, London, United Kingdom, ISGlobal, Barcelona, Spain

  • Bryony Simmons,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation London School of Economics and Political Science, London, United Kingdom

  • Bakri Nour,

    Roles Methodology, Writing – review & editing

    Affiliation Blue Nile National Institute for Communicable Diseases, University of Gezira, Wad Medani, Sudan

  • Davis Mumbengegwi,

    Roles Methodology, Writing – review & editing

    Affiliation University of Namibia, Windhoek, Namibia

  • Asrat Hailu,

    Roles Methodology, Writing – review & editing

    Affiliation University of Addis Ababa, Addis Ababa, Ethiopia

  • Stephen Munene,

    Roles Writing – review & editing

    Affiliation Amref Health Africa, Nairobi, Kenya

  • Albadawi Talha,

    Roles Writing – review & editing

    Affiliation Jouf University, Sakakah, Saudi Arabia

  • Mulugeta Aemero,

    Roles Writing – review & editing

    Affiliation Gondar University, Gondar, Ethiopia

  • Paul Meakin,

    Roles Methodology, Writing – review & editing

    Affiliation Innova Partnerships, St Fillans, United Kingdom

  • René Paulussen,

    Roles Writing – review & editing

    Affiliation Mondial Diagnostics, Amsterdam, The Netherlands

  • Scott Page,

    Roles Writing – review & editing

    Affiliation Abingdon Health, York, United Kingdom

  • Norbert van Dijk,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliations Amsterdam Institute for Infection and Immunology, Infectious Diseases Programme, Amsterdam, The Netherlands, Amsterdam University Medical Centres, Academic Medical Centre at the University of Amsterdam, Amsterdam, The Netherlands

  • Petra Mens,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliations Amsterdam Institute for Infection and Immunology, Infectious Diseases Programme, Amsterdam, The Netherlands, Amsterdam University Medical Centres, Academic Medical Centre at the University of Amsterdam, Amsterdam, The Netherlands

  •  [ ... ],
  • Henk Schallig

    Roles Conceptualization, Funding acquisition, Supervision, Writing – original draft, Writing – review & editing

    h.d.schallig@amsterdamumc.nl

    Affiliations Amsterdam Institute for Infection and Immunology, Infectious Diseases Programme, Amsterdam, The Netherlands, Amsterdam University Medical Centres, Academic Medical Centre at the University of Amsterdam, Amsterdam, The Netherlands

  • [ view all ]
  • [ view less ]

Abstract

Background

Rapid Diagnostic Tests (RDTs) have become the cornerstone for the management of malaria in many endemic settings, but their use is constrained for several reasons: (i) persistent malaria antigen (histidine-rich protein 2; HRP2) leading to false positive test results; (ii) hrp2 deletions leading to false negative PfHRP2 results; and (iii) limited sensitivity with a detection threshold of around 100 parasites/μl blood (pLDH- and HRP2-based) leading to false negative tests. Microscopy is still the gold standard for malaria diagnosis, and allows for species determination and quantitation, but requires trained microscopists, maintained microscopes and has detection limit issues. Consequently, there is a pressing need to develop and evaluate more sensitive and accurate diagnostic tests. To address this need we have developed a direct on blood mini PCR-NALFIA test that combines the benefits of molecular biology with low infrastructural requirements and extensive training.

Methods

This is a Phase 3 diagnostic evaluation in 5 African countries. Study sites (Sudan, Ethiopia, Burkina, Kenya and Namibia) were selected to ensure wide geographical coverage of Africa and to address various malaria epidemiological contexts ranging from high transmission to near elimination settings with different clinical scenarios and diagnostic challenges. Study participants will be enrolled at the study health facilities after obtaining written informed consent. Diagnostic accuracy will be assessed following the WHO/TDR guidelines for the evaluation of diagnostics and reported according to STARD principles. Due to the lack of a 100% specific and sensitive standard diagnostic test for malaria, the sensitivity and specificity of the new test will be compared to the available diagnostic practices in place at the selected sites and to quantitative PCR as the reference test.

Discussion

This phase 3 study is designed to validate the clinical performance and feasibility of implementing a new diagnostic tool for the detection of malaria in real clinical settings. If successful, the proposed technology will improve the diagnosis of malaria. Enrolment started in November 2022 (Kenya) with assessment of long term outcome to be completed by 2023 at all recruitment sites.

Trial registration

Pan African Clinical Trial Registry (www.pactr.org) PACTR202202766889963 on 01/02/2022 and ISCRTN (www.isrctn.com/) ISRCTN13334317 on 22/02/2022.

Background

Background and rationale {6a}

Malaria in humans is a life-threatening disease caused by single-cell (protozoan) parasites of the genus Plasmodium: P. falciparum, P. vivax, P. ovale, P. malariae and P. knowlesi. Malaria is a major global public health problem in tropical and sub-tropical regions with approximately half the world’s population at risk. In 2020, about 219 million malaria cases and nearly 450,000 deaths were reported worldwide. The majority of cases (92%) occurred in sub-Saharan Africa (SSA) [1]. Malaria management has been greatly improved due to wide implementation of World Health Organization (WHO) recommendations that all suspected malaria cases should have a parasite-based diagnosis prior to initiating treatment with artemisinin-based combination therapy (ACT) [2]. Malaria parasite specific antigen-detecting rapid diagnostic tests (RDTs) are considered one of the tools to manage febrile illness in malaria endemic settings [1]. The short time needed to obtain a diagnostic result, simple read-out, easy performance by non-technical staff, and relatively low costs have contributed to the acceptance of RDTs in differentiating malaria from other causes of fever [3]. Most commonly used RDTs are Plasmodium falciparum histidine-rich protein 2 (PfHRP2)-based RDTs, specific for Plasmodium falciparum only, and Plasmodium lactate dehydrogenase (pLDH)-based RDTs that detect all Plasmodium species, or combination tests with two test lines (a P. falciparum-specific line and an all Plasmodium test line) [4, 5].

However, the implementation of RDTs is constrained by persisting PfHRP2 after successful treatment, which may lead to false positive test results [68]. Furthermore, studies report false positive results with PfHRP2-based RDTs particularly in seasonal malaria transmission settings or under harsh environmental conditions [9, 10]. Of greater concern are false negative PfHRP2-RDT results increasingly reported from malaria endemic regions due to hrp2 deletions in the Plasmodium genome [1113]. In these settings, a HRP2-based RDT will be negative, even if a P. falciparum infection is present. Finally, RDTs (pLDH-based in particular) have sensitivity and stability limitations, also resulting in false negative results [5, 14]. This is particularly evident at low parasitaemias in near malaria elimination settings [15, 16].

Although malaria microscopy remains the standard for clinical diagnosis, the limit of detection (LoD) of malaria parasites by expert microscopy (which is as low as 10 parasites/μl) could miss very low parasitaemias. The LoD is highly dependent on the quality of the equipment, the microscopic reading technique, the experience of the reader and the daily workload [17].

In this context, there is a pressing need to develop more sensitive and accurate malaria diagnostic tests that circumvent the limitations of RDTs and microscopy. In general, molecular biology-based diagnostic tests are considered to be the most accurate methods for detecting malaria infections, irrespective of low parasite densities or hrp2 deletions [1820]. Several molecular methods have been developed, including conventional and real-time polymerase chain reaction (PCR), nucleic acid sequence based amplification or loop mediated amplification [19]. These platforms are highly sensitive and some allow species differentiation and parasite quantitation. These formats would be ideal for patient management, but their relative complexity hampers their use as near point of care (PoC) tests. In particular, sample processing (DNA extraction) and complicated read-out systems (gel electrophoresis with UV reading or computerised systems) hamper wide implementation [19].

To circumvent these challenges, the DIAGMAL consortium has developed a simple molecular diagnostic platform to diagnose malaria that can be used as a near patient tests (Point of Care, PoC). This platform combines PCR with a nucleic acid lateral flow immunoassay (NALFIA) to detect Plasmodium species in a multiplex format [21]. NALFIA is a simple read-out system, comparable to a dipstick, to visualise amplicons. The PCR-NALFIA system has an analytic sensitivity of 0.1 parasites/μL of blood (>100x more sensitive than conventional malaria diagnostics) with high sensitivity and specificity in clinical settings [21]. Importantly, the platform allows for direct amplification of Plasmodium DNA in whole blood [22] by utilising specific enzymes and buffers that are able to withstand the inhibitory effects usually encountered when directly amplifying DNA in blood. This avoids contamination-prone and labour-intensive parasite DNA extraction from clinical samples. This direct-on-blood (db)-PCR-NALFIA has passed rigorous laboratory evaluations and trials in disease endemic countries [22, 23]. Recently the dbPCR-NALFIA has been optimised by using a mini-PCR system (battery operated, reducing its dependency on electricity) thereby enhancing its field applicability. However, before this near point of care test can be recommended for routine practice, its performance needs to be evaluated in different clinical settings with differing malaria endemicities and health system contexts.

Objectives {7}

The main objective of the project is to evaluate the diagnostic performance of the mini-dbPCR-NALFIA test for malaria in field settings. To achieve this objective the following specific project objectives will be achieved through a blend of clinical, bio-medical and socio-economic research.

Primary objective.

To assess the diagnostic accuracy of the mini-dbPCR-NALFIA test for the diagnosis of malaria compared to routine diagnostic procedure(s) in place (microscopy and/or RDTs) and qPCR in different clinical and field settings: a high malaria incidence region (Sudan); a seasonal malaria transmission setting where HRP2-RDT may have false positive outcomes (Burkina Faso); an area with possible HRP2-deletions and high prevalence of P. vivax malaria (Ethiopia); a low transmission (near elimination) setting (Namibia); and Kenya, which has several different malaria zones: meso-hyperendemic (transmission all year round with seasonal peaks) in the lake and coastal areas; hypoendemic in the semi-arid regions, and potential for outbreaks in the highlands (non-immunes).

Secondary objectives

  1. To determine the direct and indirect costs and benefits of allocating limited resources to implement the mini-dbPCR-NALFIA test for malaria compared to current diagnostic strategies in place.
  2. To identify health system characteristics likely to influence the introduction, implementation, and scale up of the new diagnostic tool (if cost-effective).

The study hypothesis is: “the mini-db-PCR-NALFIA will offer an improved diagnostic platform over microscopy and currently available HRP2-based RDTs for the detection of malaria infection in varied malaria epidemiological settings”.

Trial design {8}

This will be a phase 3 diagnostic trial. Diagnostic performance will be assessed following the WHO/TDR guidelines for the evaluation of diagnostics [24] and the results will be reported according to STARD principles [25]. This phase 3 evaluation will be a prospective multi-centre diagnostic study on populations living in different malaria endemic settings and for which the disease status of each individual is not previously known [18]. Study participants (all ages) will be identified during their visits at the study health facilities. Subjects (or parent or legal guardian in case of minors) with suspected malaria will be asked to participate in the diagnostic study.

Methods: Participants, interventions and outcomes

Study setting {9}

The research will be carried out in 5 African countries (Burkina Faso, Sudan, Ethiopia, Namibia and Kenya), each representing an epidemiology of malaria different from the other:

  • In Burkina Faso, the study will take place at the Clinical Research Unit of Nanoro (CRUN) trial site, located about 90 km from Ouagadougou. Malaria is hyper-endemic and transmission occurs throughout the year, with a peak during the rainy season (June–November). P. falciparum is responsible for >90% of all clinical malaria cases. Children under five years and pregnant women are the populations at highest risk. The total number of malaria cases for 2017 was >11 million. RDT remains the only diagnostic tool available to differentiate malaria from other infectious diseases in primary healthcare settings. The most common RDT used is PfHRP2. A high rate of false positive RDT is reported which leads to misdiagnosis. A recent study showed that almost 50% of other causes of fevers were diagnosed as malaria due to false positive RDT results [9].
  • Malaria transmission in Sudan is highly linked with climatic conditions. There are two transmission peaks; one during the rainy season (affecting most of Sudan) and the other during the winter season (notably in irrigation schemes and urban settings). In Sudan, 75% of the population is at risk. Malaria reported cases represent about 8.7% of total outpatient attendance and around 12.2% of hospital admissions. The main species is P. falciparum (87.6%). Diagnosis is made using microscopy and RDTs. The study will be performed in Gezira State under the supervision of the Blue Nile National Institute for Communicable Diseases (BNNICD)–University of Gezira in the outpatient clinics of three teaching hospitals and health centres with whom BNNICD has previously been conducting malaria research. These study sites may recruit more than 2,000 malaria cases per year.
  • The study in Ethiopia will take place in Arba Minch (Southern Nations, Nationalities, and Peoples’ Region—SNNPR), Melka Werer (Afar) and Maksegnit (Gondar Zuria District). Arba Minch town (estimated population 174,980) is located 505 km south of Addis Ababa in Gamo Gofa zone with an average elevation of 1,209 m above sea level, an average annual temperature is 29.7°C and rainfall of 700 mm. Malaria is seasonal (September to December) and occurs in epidemic type where both P. falciparum and P. vivax are prevalent. There are two public health centres and one public hospital in Arba Minch town that provide healthcare services for the community in the town and surrounding areas. Around 179,386 febrile cases were attended to at these public healthcare facilities in Arba Minch in 2020 (MoH Report).
    • Maksegnit town (Gondar Zuria District) has one health centre and a malaria research unit. Gondar Zaria District is in North Gondar Zone, Amhara National Regional State of Ethiopia. Maksegnit is located at an altitude ranging between 1,107−3,022 meters above sea level, temperature ranging between 14–20°C (mean annual temperature of 17.9°C) and annual rainfall ranging between 1,030–1,223 mm (mean 1,100 mm). Both P. falciparum and P. vivax malaria are endemic.
    • Melka Werer (Amibara District) is located 265 km northeast of Addis Ababa in the Middle Awash valley. The climate of Amibara is generally semi-arid with temperatures ranging from 25°C−35°C and with an average annual rainfall below 600 mm. The altitude of Amibara lies between 720−1100 m above sea level. The 2019 population projection for Amibara District was 102,327. In Amibara District, there is one hospital (Mohammed Akle Memorial Hospital), three health centers (Worer, Sedefaga, and Awash Arba), 10 private clinics, and 17 health posts that provide health services to the population. Malaria is the top leading cause of morbidity in Amibara District. About 386,096 febrile illnesses and 15,0159 malaria cases were reported in 2020 by the health facilities.
  • In Kenya, the study will be performed in two sites: one at the Lake Region (Busia County) which is endemic for malaria, and one in Kajiado County, a seasonal malaria area. At both sites 80% of the population are at risk; all malaria species occur but P. falciparum accounts for 98% of cases. Transmission is highest in May–July and January–March during the two rainy seasons. On a typical day, 50–100 patients with suspected malaria may be seen in a single health facility. Microscopy is the primary diagnostic approach in health facilities with laboratories, with RDTs also used for emergencies.
  • In Namibia, the study will be conducted in an area that is classified as near elimination, the Zambezi region (North Eastern Namibia). The Zambezi region is primarily rural with most of the population engaged in subsistence farming. Malaria transmission is very heterogeneous in Namibia with transmission occurring during the rainy season peaking between January and May. The Zambezi region has accounted for more than 70% of the country’s malaria cases since 2020, the country at large had an incidence of 1.16 cases per 1000 in 2019. The country aims to eliminate malaria by 2022 and conducts case investigation of all malaria cases using Reactive Case Detection as malaria cases (both secondary and asymptomatic) have been shown to cluster around index cases. Reported malaria cases are almost all due to Plasmodium falciparum.

This selection of study sites also ensures a geographical coverage of Africa with partners from western, eastern and southern regions.

Eligibility criteria {10}

For Sudan, Ethiopia, Burkina Faso and Kenya, the study will recruit participants who fulfil the following inclusion criteria:

  1. Patients with clinically suspected malaria of all ages presenting at the health facility;
  2. Coming from the health centre catchment area;
  3. Informed consent from patients, or parents or guardians (in case of minors).

For Namibia, the study will recruit participants who fulfil the following criteria:

  1. Residents of one of the selected households or have slept the night before in this household.
  2. Informed consent from individual participants.

The exclusion criteria are not meeting the above criteria, or parents or guardians (in case of minors).

Who will take informed consent? {26a}

Written informed consent will be obtained from all the study participants (or their legal representatives in case of minors) before enrolment. After an interview with the study clinician community health worker or other qualified member of the study team, the participant (or parent/legal guardian) will be asked to document their consent by signing an informed consent form; if the patient is a minor (according to applicable national law), the consent must be given by a parent or legal guardian. For minors in a specific age range informed assent is also obtained. Signed informed consent (or thumb-print whenever the participant or parents/guardians are illiterate) must be obtained before any blood sample or tests related to the study are carried out.

In addition, consent for the cost effectiveness study will be sought at the same time as enrolment to the diagnostic trial. Written informed consent will also be sought ahead of all structured interviews with key stakeholders for the health systems analysis.

Additional consent provisions for collection and use of participant data and biological specimens {26b}

In the informed consenting procedure, participants and parent/guardians will be informed about future investigations on the collected blood samples. They will be informed that future investigations will only focus on understanding the performance and quality of the diagnostic procedures under study. For this purpose, part of the collected biological specimens may be transported and tested in Amsterdam (The Netherlands). No genetic testing about the human host will be performed. Some patient data will also be used for the health economics evaluation.

Interventions

Explanation for the choice of comparators {6b}

The diagnostic performance of the mini-dbPCR-NALFIA will be compared to the standard malaria diagnostic practices in place in the 5 participating countries (i.e. microscopy and/or rapid diagnostic test). Established qPCR will be used as the reference standard.

Intervention description {11a}

Depending on the routine diagnostic procedures in place at each site, a rapid diagnostic test (RDT) or microscopy, or both, will be performed by the resident staff. RDT will be performed according to the manufacturers’ procedures. Thick and thin blood films will be prepared and Giemsa stained. Blood slides will be independently read by two expert microscopists. Parasite density will be calculated by counting the number of asexual parasites per 500 leucocytes in the thick blood film, based on an assumed WBC of 8,000 /μl by light microscopy at 1000 x magnification. In addition to routine diagnostic procedures in place, an additional blood sample (usually finger prick blood) will be collected for test evaluation (index and reference tests). Blood samples will be properly labelled with participants’ initials, inclusion number, protocol number, the study day and the date the sample is taken. For the index test (mini dbPCR-NALFIA) blood will be collected into an EDTA tube. For reference testing (qPCR), three blood spots will be collected on Whatman 3 filter paper [26]; one sample for qPCR, the second and third samples for QC procedures (10%) or back-up.

Criteria for discontinuing or modifying allocated interventions {11b}

Only a single additional blood sample will be collected for the study. Treatment decisions will be made on the basis of routine diagnostic procedures in place. There will be no interference with standard diagnostic and treatment practices. There is therefore no need to define criteria for discontinuing or modifying interventions.

Strategies to improve adherence to interventions {11c}

This study requires a single sampling point and there is no need for cases to be subjected to further interventions. Consequently, there is no need to design strategies to improve adherence to interventions.

Relevant concomitant care permitted or prohibited during the trial {11d}

Not applicable, as this is a diagnostics study and only a single blood sample per study case will be tested. Prior use of anti-malarial drugs might influence diagnostic test performance, and prior drug use in the 14 days preceding collection of the blood sample will be recorded.

Provisions for post-trial care {30}

As this is a diagnostic trial in which we are not testing any drug, such visits are not absolutely necessary. However, for ethical and safety reasons we will make a reasonable effort to contact all patients to check their health status and make sure they are recovering well. This visit can be done either physically or by telephone contact. Those who are not recovering well will be asked to return to the health facility for assessment and further management by the health facility staff and this action will be recorded in the CRF.

Outcomes {12}

Outcomes will be reported according to STARD principles [25]. For each diagnostic test studied, we will report sensitivity, specificity, negative and positive predictive values (primary outcome). The outcomes of the evaluations will be further analysed using 2 x 2 tables (at 95% confidence intervals), and comparisons of the performance of the diagnostic test under investigation will be made with standard diagnostic procedures in place and qPCR as the accepted reference test to determine agreement between different tests (expressed as Cohen’s kappa values) [24].

Participant timeline {13}

Participants will be asked to provide a clinical specimen and some demographic data on the day of enrolment. No further assessments or visits are planned in the context of this study

Sample size {14}

The sample size for each country has been calculated according to the expected disease prevalence of the field sites to give adequate statistical definition to test sensitivity and specificity [24, 25] Sample size calculation is based on a 95% confidence interval using the equation proposed by Kiemde et al [9]: p +/-1.96 x √[p(1-p)/n] where p = sensitivity (or specificity) measured as a proportion and n = number of samples from infected people (or for specificity from non-infected samples).

Sample size calculations are further based on a conservative estimation of the number of actual cases amongst febrile patients (clinically suspected of having malaria) attending the various health facilities participating in the study. Furthermore, we have taken into account that there might be a withdrawal of consent of around 20% in each setting (most likely less). Based on these assumptions the following sample sizes have been determined for the following countries (note: there is no overall sample size calculation; each site has its own sample size and each is adequately powered; and the data can be analysed separately for each country):

  • Sudan (10% incidence): 876 study cases;
  • Ethiopia (10% incidence): 876 study cases;
  • Burkina Faso (20% incidence): 438 study cases;
  • Kenya (25% incidence): 351 study cases;
  • Namibia: prevalence is <1.5% in the near elimination study region. prevalence is <1.5% in the near elimination study region. Therefore, participants will be recruited using passive and reactive case detection (RACD) targeting 2,000 people in the study areas as was also done in a previous study [27].

Recruitment {15}

Prior to the start of the study, in some sites, communities and community leaders will be informed about the purpose of the study to enhance participation. All study sites have a sufficiently large population and malaria incidence to reach the projected sample size.

Assignment of interventions: Allocation

Sequence generation {16a}

Not applicable, as there will be no allocation to different study arms. All subjects will be subjected to the same procedure; i.e. collection of a blood sample for diagnostic testing.

Concealment mechanism {16b}

Not applicable, as there will be no allocation to different study arms. All cases will receive the same intervention.

Implementation {16c}

Not applicable, as there will be no allocation to different study arms. All cases will receive the same intervention.

Assignment of interventions: Blinding

Who will be blinded {17a}

There is no procedure for blinding as all participants will be following the same study procedure. Study staff executing the different diagnostic tests will be blinded from the results of other tests (.i.e. tests that they are not performing). The results of routine diagnostic testing in place at the study site will be used to make treatment decisions as per guidelines of the respective national Malaria Control Programmes.

Procedure for unblinding if needed {17b}

There is no procedure for unblinding.

Data collection and management

Plans for assessment and collection of outcomes {18a}

Study staff will be adequately trained in execution of diagnostic tests performed in the framework of the study, data collection and data recording prior to the start of the trial. All data must be initially documented in the source documents, and then entered in the Case Record Form. For this study, an electronic database (developed on Open Clinica Software) will be used, which can be defined and entered remotely using the Internet. The CRF and database will allow identification of the study, site and patient; recording of the selection and inclusion of patients in the study; and recording of all data collected at each different study site.

Plans to promote participant retention and complete follow-up {18b}

A singe sample collection is foreseen with no follow-up. Therefore, there is no need to develop a plan to promote participant retention or to complete follow-up.

Data management {19}

Data management will be handled by the Institut de Recherche en Sciences de la Santé (IRSS) which has the required expertise in all components of data management of clinical trials and epidemiological studies. The data management office is located in the main campus of the Clinical Research Unit of Nanoro (CRUN). Data will be collected onto paper-based source documents before being captured into the electronic CRF developed in Open Clinica. Data will be entered online in all five sites and sent to the central server located at CRUN. The central data base will be managed at the CRUN by a data manager, who will run regular consistency checks and identify queries to be resolved by the local investigators in each country. This system will allow the rapid identification of potential problems. Data entry and review will be performed following the Data Entry Guidelines and the Data Management plan provided to the sites by the CRUN. Besides this central management, as mentioned above, a study monitor will visit each site at least once and check the information entered into the electronic CRF against the source documents available on site. Any modification made on the electronic CRF will be automatically registered. The final database will be obtained after resolution of all queries and will be locked for statistical analysis to be carried out according to a pre-established plan that will be developed by the study statistician in collaboration with the site investigators. The statistical analysis plan will specify how to deal with statistical issues such as missing data and protocol violations.

Confidentiality {27}

Every possible measure will be taken to ensure that all personal data collected during the study will be appropriately protected. The collection of personal information will be restricted to meet the objectives of the project, and only data relevant for the execution of the project and interpretation of data will be collected. Collected information will be kept for a minimal time period, which is regulated by national or international law. All personal data collected during the study will be kept confidential. A numerical identifier and participants’ 3 initials will be assigned to each CFR and sample. None of the records contain individual name identification. All signed informed consent and assent forms and other personalised information will be kept under lock and key and will be available only to the project coordinator, principal investigators and data managers. Information stored in electronic databases will be protected by unique usernames and passwords, which will only be made available to appropriate authorised personnel. All records and data entry will be checked independently on-site by the research clinician and/or by the local PI to ensure accuracy. The collected information will never be transferred to countries lacking appropriate data protection or made available without restriction to third parties that are not directly linked to the project.

Plans for collection, laboratory evaluation and storage of biological specimens for genetic or molecular analysis in this trial/future use {33}

Blood samples will be collected for routine malaria diagnostic tests and molecular analysis with PCR, which is used as the reference test for the diagnostic procedures followed in this trial. This work will be restricted to the assessment of the presence of Plasmodium species only. There will be no analysis of human genetic material. Collected specimens could be used for future diagnostic test development and evaluation, and if this will be the case, explicit informed consent from study participants will be obtained.

Statistical methods

Statistical methods for primary and secondary outcomes {20a}

The outcomes of the evaluations will be analysed using 2 x 2 tables (at 95% confidence intervals) and comparisons will be made with standard diagnostic procedures in place (microscopy and/or RDT) and qPCR as the accepted reference test to determine agreement between different tests (expressed as kappa values). Positive and negative predictive values will be calculated. Sensitivity and specificity of the db-PCR-NALFIA are assumed to be 95%.

Interim analyses {21b}

None planned.

Methods for additional analyses (e.g. subgroup analyses) {20b}

Next to the assessment of the diagnostic performance of the molecular platform, an economic evaluation and health systems analysis will be conducted to identify the incremental costs and benefits to healthcare providers and users of introducing and routinely using the mini-dbPCR-NALFIA for P. falciparum detection compared to routine diagnostic practices for malaria in the 5 different study localities (in Burkina Faso, Ethiopia, Kenya, Namibia and Sudan).

Cost effectiveness analysis (CEA).

The performance of the mini-dbPCR-NALFIA in terms of sensitivity and specificity will be combined with costs to the health system (this will include activities associated with the introduction, roll-out and scale-up of the mini-dbPCR-NALFIA within health facilities) to estimate the cost-effectiveness of the novel malaria diagnostic tool. The health outcomes will build on the Phase 3 trial primary endpoints and model the cost per disability-adjusted life years averted.

Health system analysis.

Potential costs, barriers and facilitators associated with the implementation of the mini-dbPCR-NALFIA will be identified from both the supply and demand side and will imply some data collection alongside the main trial.

Supply Side—health system information on barriers and facilitators will include:

  • Introduction / Start-up costs: Information will be gathered through document reviews and during key informant interviews at different health system levels (Ministry of Health/national, region/province/district and health facility) in order to understand which activities should be undertaken for the introduction of the mini-dbPCR-NALFIA and their associated resources and expected costs at each level of the health system (e.g., how many training courses would be needed for introducing the novel tool into routine malaria management?) In response to some of the key learnings of the recent Lancet Commission on Diagnostics [28], we will explore the broader diagnostic context in each of the 5 study countries to inform the introduction of a test such as NALFIA. Specifically, we will explore (i) the extent there is a formal (sub)national diagnostics strategy, (ii) if and how an evidence-based essential diagnostics list (EDL) is utilized and (iii) how diagnostic tools are prioritized and financed.
  • Implementation / Running costs: Interviews will be conducted with key personnel at health facilities where mini-dbPCR-NALFIA will be used as part of the main study to help ascertain the costs and resources needed to routinely use dbPCR-NALFIA. These costs will largely reflect the cost of the tool and associated personnel costs for administration.
  • Feasibility & Scale up: If the mini-dbPCR-NALFIA is cost effective, is it also affordable? How can the supply chain best accommodate this novel diagnostic tool? What would be the market barriers? What is the potential scope for private sector involvement in any scale up? This information will be gathered through document reviews and during key informant interviews in each of the five countries conducting the trial.

Demand side—recipients’ barriers/facilitators will be identified by collecting information from participants involved in the trial on:

  • Costs of seeking diagnosis for fever or other symptoms suggestive of malaria (direct and indirect costs, provider choice, socio-economic characteristics).
  • To understand the potential demand for a new product that is yet to reach the market, such as mini-dbPCR-NALFIA, we will ask patients their willingness to pay (WTP) for the product. WTP is a common economic approach that quantifies the hypothetical value potential users attribute to a product and its various characteristics, and the benefit they expect to obtain from it. Participants enrolled in the trial will be asked to participate in an economic method called the bidding game where they will be asked if they are willing to pay a base amount of money that will go up or down depending on the participants reply at each bid.
  • The perception of risk from malaria may impact on the uptake of the mini-dbPCR-NALFIA and have implications for delivery strategies (e.g. facility-based versus community-based screening). A survey divided into perceptions of local health problems, malaria knowledge, prevention measures, and malaria risk perception will explore how study participants view the threat of malaria and how this may influence their perceptions of the near POC being trialled.

Methods in analysis to handle protocol non-adherence and any statistical methods to handle missing data {20c}

Protocol non-adherence is not expected to occur as the trial only involves a single collection of a blood sample from the study cases. In case missing data occur, the whole data set of a participant will be removed from the analysis. This removal will be compensated by a slight over recruitment in number of study participants.

Plans to give access to the full protocol, participant level-data and statistical code {31c}

The study has been registered in two accessible clinical trial registers and the information contained in these registers provide sufficient insights into the full trial design. The final results of the study will be published in peer-reviewed Open Access journals and presented at scientific meetings. None of the trial material may be disclosed to any party not directly involved in the study without written permission from the consortium partners. Presentation and publication of the trial results will be jointly carried out by the project investigators. Each African collaborator will be in charge of sharing relevant results with their respective health authorities, including the National Malaria Control Programmes. This will be done through ad-hoc meetings, data dissemination workshops and/or during Malaria Days in each country. Trial data will be accessible for inspection by appropriate health and regulatory authorities

Oversight and monitoring

Composition of the coordinating centre and trial steering committee {5d}

The trial is coordinated by dedicated trial staff at CRUN (Nanoro, Burkina Faso) and includes data management. CRUN is responsible for generic study protocol development and implementation. Each country is responsible for the implementation of the protocol in its respective sites, ethics review of the study protocol and other licensing requirements. An independent trial monitor has been appointed who will perform monitoring visits to all 5 study countries.

Composition of the data monitoring committee, its role and reporting structure {21a}

CRUN (Burkina Faso) is responsible for centralised data management and monitoring. The central data base will be managed at CRUN by a dedicated data manager, who will run regular consistency checks and produce queries to be resolved by the local investigators. This system will allow the rapid identification of potential problems. Data entry and review will be performed following the Data Management Plan. Data management is independent from the sponsor.

Adverse event reporting and harms {22}

The intervention is unlikely to result in (unexpected) adverse events or harms. An incidental findings policy is in place. This project will not involve research conducted towards genes and/or the genetic basis of diseases on human subjects. The research is not intended to provide subjects or their families with specific information about their genetic status. Furthermore, the research will be focused on the diagnosis of malaria only (a very common and well known condition in the study sites) and not on any other diseases or conditions, and does not actively search for human genetic disorders. Therefore, any other medical problems detected in patients with malaria or those testing negative for malaria will be managed appropriately within the health system. The risk that incidental findings occur in this study is very low though it might be the case when blood slides are examined by microscopy that there is a chance that other parasites, such as trypanosomes, may be found. In such cases the attending clinician will be informed to undertake appropriate medical actions.

Frequency and plans for auditing trial conduct {23}

Each site will be visited by an independent monitor at least once during the conduct of the trial plus a study initiation visit at the start of study activities and a close-out visit after the last patient has completed the study procedures. The task of the Monitor is to verify the best conduct of the study through frequent contacts by telephone and in person with the Principal Investigator and site staff, in accordance with applicable regulations, Good Clinical Practice requirements and study-specific Standard Operating Procedures. The objectives and specific tasks of the Monitor are described in the ICH Guidelines E6. Source documents will be kept for each participant in the study. All information in the electronic CRF must be traceable to these source documents in each participant’s file. The Monitor, who is bound by a confidentiality agreement to protect participants’ confidentiality, has access to all relevant source documents to confirm their consistency with the electronic CRF entries.

Plans for communicating important protocol amendments to relevant parties (e.g. trial participants, ethical committees) {25}

Protocol amendments will be communicated to the funder (EDCTP), sponsor (AMC) and relevant ethics review bodies in the country concerned.

Dissemination plans {31a}

Dissemination of the study findings is planned through scientific papers and conference attendance, and also through meetings with various audiences of interest, including key stakeholders such as the health facilities involved, public health authorities and diagnostic companies who might be interested in bringing the diagnostic platform to market.

Discussion

Among the factors that have contributed to the introduction of malaria RDTs into the health system in LMICs are the short running time, easy read-out system, limited infrastructural needs combined with their relatively low costs [29, 30]. Unfortunately, the diagnostic reliability of these RDTs still remains a challenge [3134]. Malaria microscopy is still considered the accepted standard for the clinical diagnosis of Plasmodium infections, but requires qualified laboratory technicians, well maintained microscopes and a conventional laboratory. Microscopy also has a detection limit for low density infections and it is not accessible to many patients in endemic areas. This is even truer for diagnostics based on molecular biology, the most sensitive tools for the diagnosis of malaria, which needs specific equipment, sophisticated infrastructure and high-level trained laboratory personnel [35]. To circumvent this challenge in areas without laboratory facilities, the present study presents a diagnostic platform that combines direct-on-blood PCR amplification (circumventing DNA extraction and using simplified miniaturised battery operated equipment) with a simple NALFIA readout system to diagnose Plasmodium species in a multiplex format [21].

This study is designed towards the validation of the clinical performance of the mini-dbPCR-NALFIA for the detection of Plasmodium species in real life conditions. Based on previous studies [21, 22, 23], it is obvious that the proposed technology will improve diagnostic performance, as it is a highly sensitive tool applicable in specific settings that require improved tools for the diagnosis of malaria. These settings include regions where malaria diagnosis with RDT may lead to false positive results, where hrp2 deletion in P. falciparum leads to false negative results, or settings where sensitive diagnostics are needed to detect the last reservoir of parasite infection to achieve malaria elimination [68, 12, 13, 15, 16, 36]. If successful, this study will be able to provide necessary evidence to introduce the new diagnostic platform for the diagnosis of malaria which can be implemented particularly in settings where current diagnostics are inadequate due to sensitivity and/or specificity issues.

This evidence will be complemented with additional data on the costs associated with implementation, and information on patients and healthcare providers’ acceptance of the new diagnostic device. These activities will be implemented in parallel with the assessment of the new diagnostic platform. Despite successful evaluation of the diagnostic test, its integration within the health system may be compromised by patients’ and/or health staff’s low acceptability of the platform [37, 38]. This explorative study will be conducted to determine the acceptability of the new diagnostic platform by heath care providers as well as patients, and identify potential health system implementation bottlenecks in each country.

One of the major expected key deliverables of this project is to pave the route to marketing of the platform. Indeed, RDTs and microscopy will continue to be the backbone of clinical diagnosis in the near future, but performance limitations of RDTs mean that they cannot be used to screen populations for malaria infection in low transmission settings, for surveillance of populations as part of elimination programmes, in settings where RDTs have low specificity such as for treatment follow up, or in regions where HRP2-deleted parasites are becoming increasingly prevalent. It is into these market niches that the mini dbPCR-NALFIA fits very comfortably. For example, there are currently 18 countries with malaria elimination or eradication programmes in place. While these programmes vary in the number of tests carried out per year, the potential market size is estimated at millions of tests per year. The market for a sensitive screening diagnostic test will increase in future years as more countries introduce elimination and eradication programmes or will have measures in place to sustain their malaria free status.

The project may also face some operational challenges. Currently many research resources are allocated to combat the worldwide Covid-19 pandemic. Fortunately, our research sites are highly dedicated to perform malaria research, as this important infectious disease is still considered to have a huge impact on human health in the coming years. This is stressed by the fact that vaccines are not readily available and control measures are starting to lose their effectiveness due to emerging resistance to commonly used anti-malarial drugs. Furthermore, civil unrest is occurring in some of the participating countries. However, so far these have not affected our studies.

Trial status

This is version 1.2, dated 2 July 2020, of the protocol. Ethics approvals have been obtained. Study staff are recruited and trained. At the time of submission, the recruitment of study participants started on 10 November 2021 in Kenya, on 7 December 2021 in Burkina Faso, 4 January 2022 in Sudan and 23 February 2022 in Namibia. Start in Ethiopia is pending. The trial is ongoing. Recruitment is expected to be completed 31 December 2022 and the final results of the study are expected end of 2023.

Acknowledgments

Ethics approval and consent to participate {24}

The study protocol has been reviewed and approved by appropriate ethical review boards in the respective countries. For Burkina Faso: approved by the national ethical committee for research (DELIBERATION N°2021-03-057) and approved by the institutional ethical committee in health sciences (N/Réf. A02-2021/CEIRES); for Sudan: approved by the ethics committee of the University of Gezira, Faculty of Medicine (Date: 07/04/2021), approved by the Ethical Review Board of the Ministry of Health of Gezira State (Date: 25/07/2021) and approved by the Federal Ministry of Health Sudan (Date: 26/07/2021); for Ethiopia: approved by by the Department of Research Ethics Review Committee (DRERC) of the Department of Microbiology, Immunology and Parasitology (DMIP) (Meeting No: DRDRC/04/2021), approved by the Institutional Review Board of the Addis Ababa University, College of Health Science (IRB) (Meeting No: 07/2021) and approved by the Ministry of Education (REF NO: 7/1-61/m259/35); for Kenya: by the Amref Ethics and Scientific Review Committee (REF: AMREF–ESRC P991/2021) and the National Commission for Science, Technology and Innovation (REF: NACOSTI/P/21/12446); and for Namibia: approved by the Ministry of Health and Social Service (Ref: 17/3/3/DRM). Written, informed consent to participate will be obtained from all participants or their legal representatives in case of minors according to the International Conference on Harmonization of Good Clinical Practice and the Helsinki Declaration.

References

  1. 1. WHO. WHO World Malaria Report 2020. Malaria report. 2020.
  2. 2. World Health Organization. 2015. Guidelines for the treatment of malaria 3rd edition. Geneva, Switzerland. WHO Press, World Health Organization. 2015.
  3. 3. UNITAID. Malaria Diagnostics Technology and Market Landscape - 3rd edition (2016). Unitaid Secretariat World Health Organization. 2016;28(April):1–148.
  4. 4. World Health Organization. Malaria Rapid Diagnostic Test Performance. Results of WHO product testing of malaria RDTs: round 7 (2015–2016). WHO Report. 2017.
  5. 5. Li B, Sun Z, Li X, Li X, Wang H, Chen W, et al. Performance of pfHRP2 versus pLDH antigen rapid diagnostic tests for the detection of Plasmodium falciparum: A systematic review and meta-analysis. Vol. 13, Archives of Medical Science. 2017. p. 541–9. pmid:28507567
  6. 6. Kyabayinze DJ, Tibenderana JK, Odong GW, Rwakimari JB, Counihan H. Operational accuracy and comparative persistent antigenicity of HRP2 rapid diagnostic tests for Plasmodium falciparum malaria in a hyperendemic region of Uganda. Malar J. 2008;7:221. pmid:18959777
  7. 7. Kattenberg JH, Tahita CM, Versteeg IAJ, Tinto H, Traoré-Coulibaly M, Schallig HDFH, et al. Antigen persistence of rapid diagnostic tests in pregnant women in Nanoro, Burkina Faso, and the implications for the diagnosis of malaria in pregnancy. Tropical Medicine and International Health. 2012;17(5):550–7. pmid:22469496
  8. 8. Dalrymple U, Arambepola R, Gething PW, Cameron E. How long do rapid diagnostic tests remain positive after anti-malarial treatment? Malaria Journal. 2018;17(1).
  9. 9. Kiemde F, Bonko M dit A, Tahita MC, Lompo P, Rouamba T, Tinto H, et al. Accuracy of a Plasmodium falciparum specific histidine-rich protein 2 rapid diagnostic test in the context of the presence of non-malaria fevers, prior anti-malarial use and seasonal malaria transmission. Malaria Journal. 2017;16(1):294. pmid:28728558
  10. 10. Kiemde F, Tahita MC, Bonko M dit A, Mens PF, Tinto H, Hensbroek MB van, et al. Implementation of a malaria rapid diagnostic test in a rural setting of Nanoro, Burkina Faso: from expectation to reality. Malaria Journal. 2018;17(1):316. pmid:30165849
  11. 11. World Health Organization. False-negative RDT results and implications of new reports of P. falciparum histidine-rich protein 2 / 3 gene deletions. Global Malaria Programme. 2017;2016(May 2016):1–11.
  12. 12. Nderu D, Kimani F, Thiong’o K, Akinyi M, Karanja E, Meyer CG, et al. PfHRP2-PfHRP3 diversity among Kenyan isolates and comparative evaluation of PfHRP2/pLDH malaria RDT with microscopy and nested PCR methodologies. Parasitology International. 2018;67(6):793–9. pmid:30138695
  13. 13. Gendrot M, Fawaz R, Dormoi J, Madamet M, Pradines B. Genetic diversity and deletion of Plasmodium falciparum histidine-rich protein 2 and 3: a threat to diagnosis of P. falciparum malaria. Vol. 25, Clinical Microbiology and Infection. 2019. p. 580–5. pmid:30267926
  14. 14. Jimenez A, Rees-Channer RR, Perera R, Gamboa D, Chiodini PL, González IJ, et al. Analytical sensitivity of current best-in-class malaria rapid diagnostic tests. Malaria Journal. 2017;16(1). pmid:28340585
  15. 15. Britton S, Cheng Q, McCarthy JS. Novel molecular diagnostic tools for malaria elimination: A review of options from the point of view of high-throughput and applicability in resource limited settings. Vol. 15, Malaria Journal. 2016. pmid:26879936
  16. 16. Pham NM, Karlen W, Beck HP, Delamarche E. Malaria and the “last” parasite: How can technology help? Vol. 17, Malaria Journal. 2018. pmid:29996831
  17. 17. Tinto H, Ouédraogo JB, Traoré M, Guiguemdé TR. Attitude à propos de la résistance parasitologique de Plasmodium falciparum aux antipaludiques. Vol. 14, Cahiers Sante. 2004. p. 69–73. pmid:15454363
  18. 18. Adams M, Joshi SN, Mbambo G, Mu AZ, Roemmich SM, Shrestha B, et al. An ultrasensitive reverse transcription polymerase chain reaction assay to detect asymptomatic low-density Plasmodium falciparum and Plasmodium vivax infections in small volume blood samples. Malaria Journal. 2015;14(1). pmid:26701778
  19. 19. Roth JM, Korevaar DA, Leeflang MMG, Mens PF. Molecular malaria diagnostics: A systematic review and meta-analysis. Vol. 53, Critical Reviews in Clinical Laboratory Sciences. 2016. p. 87–105. pmid:26376713
  20. 20. Hofmann NE, Gruenberg M, Nate E, Ura A, Rodriguez-Rodriguez D, Salib M, et al. Assessment of ultra-sensitive malaria diagnosis versus standard molecular diagnostics for malaria elimination: an in-depth molecular community cross-sectional study. The Lancet Infectious Diseases. 2018;18(10):1108–16. pmid:30170986
  21. 21. Mens PF, Moers AP, de Bes LM, Flint J, Sak JR, Keereecharoen L, et al. Development, validation and evaluation of a rapid PCR-nucleic acid lateral flow immuno-assay for the detection of Plasmodium and the differentiation between Plasmodium falciparum and Plasmodium vivax. Malar J. 2012;11(1):279. pmid:22900750
  22. 22. Mens PF, de Bes HM, Sondo P, Laochan N, Keereecharoen L, van Amerongen A, et al. Direct blood PCR in combination with nucleic acid lateral flow immunoassay for detection of Plasmodium species in settings where malaria is endemic. Journal of Clinical Microbiology. 2012;50(11):3520–5. pmid:22915610
  23. 23. Roth JM, de Bes L, Sawa P, Omweri G, Osoti V, Oberheitmann B, et al. Plasmodium Detection and Differentiation by Direct-on-Blood PCR Nucleic Acid Lateral Flow Immunoassay: Development, Validation, and Evaluation. Journal of Molecular Diagnostics. 2018;20(1):78–86.
  24. 24. Banoo Shabir, David Bell PB Alan Herring DM, Poole F Smith PG, Sriram N, et al. TDR Diagnostics Evaluation Expert Panel (WHO/TDR) 2006. Evaluation of diagnostic tests for infectious diseases: general principles. Nat Rev Microbiol. 2006;4(9 suppl):S21–33.
  25. 25. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig L, et al. STARD 2015: An updated list of essential items for reporting diagnostic accuracy studies. The BMJ. 2015;351.
  26. 26. Roth JM, Sawa P, Omweri G, Makio N, Osoti V, De Jong MD, et al. Molecular detection of residual parasitemia after pyronaridine-artesunate or artemether-lumefantrine treatment of uncomplicated plasmodium falciparum malaria in Kenyan children. American Journal of Tropical Medicine and Hygiene. 2018;99(4):970–7. pmid:30105967
  27. 27. Gluud C, Gluud LL. Evidence based diagnostics. British Medical Journal. 2005;330(7493):724–6. pmid:15790646
  28. 28. Fleming KA, Horton S, Wilson ML, Atun R, DeStigter K, Flanigan J, et al. The Lancet Commission on diagnostics: transforming access to diagnostics. Vol. 398, The Lancet. 2021. pmid:34626542
  29. 29. Maltha J, Gillet P, Bottieau E, Cnops L, van Esbroeck M, Jacobs J. Evaluation of a rapid diagnostic test (CareStartTM Malaria HRP-2/pLDH (Pf/pan) Combo Test) for the diagnosis of malaria in a reference setting. Malaria Journal. 2010;9:171.
  30. 30. Mathison BA, Pritt BS. Update on malaria diagnostics and test utilization. Journal of Clinical Microbiology. 2017;55:2009–17. pmid:28404673
  31. 31. Baron EJ, Miller JM, Weinstein MP, Richter SS, Gilligan PH, Thomson RB, et al. A guide to utilization of the microbiology laboratory for diagnosis of infectious diseases: 2013 Recommendations by the Infectious Diseases Society of America (IDSA) and the American Society for Microbiology (ASM). Clinical Infectious Diseases. 2013;57(4):485–8.
  32. 32. Henegariu O, Heerema NA, Dlouhy SR, Vance GH, Vogt PH. Multiplex PCR: Cristical Parameters and Step-by-Step Protocol. Biotechniques. 1997;23(3):504–11.
  33. 33. Posthuma-Trumpie GA, Korf J, Van Amerongen A. Lateral flow (immuno)assay: Its strengths, weaknesses, opportunities and threats. A literature survey. Analytical and Bioanalytical Chemistry. 2009;393(2):569–82.
  34. 34. Noguera P, Posthuma-Trumpie G. Carbon nanoparticles in lateral flow methods to detect genes encoding virulence factors of Shiga toxin-producing Escherichia coli. Analytical and Bioanalytical Chemistry. 2011;399(2):831–838. pmid:21046083
  35. 35. Archibald LK, Reller LB. Clinical microbiology in developing countries. Emerg Infect Dis. 2001;7(2):302–5. pmid:11294729
  36. 36. World Health Organization. False-negative RDT results and implications of new reports of P. falciparum histidine-rich protein 2 / 3 gene deletions. Global Malaria Programme. 2017;2016(May 2016):1–11.
  37. 37. Su TT FS. Determinants of household direct and indirect costs: an insight for health-seeking behaviour in Burkina Faso. Eur J Health Econ. 2013;14:75–84. pmid:21953320
  38. 38. Kabaghe AN, Visser BJ, Spijker R, Phiri KS, Grobusch MP, Van Vugt M. Health workers’ compliance to rapid diagnostic tests (RDTs) to guide malaria treatment: A systematic review and meta-Analysis. Vol. 15, Malaria Journal. 2016. pmid:26979286