Skip to main content
Advertisement
  • Loading metrics

Evaluation of the diagnostic accuracy of the ReLASV Pan-Lassa Antigen Rapid Test for Lassa Fever in Nigeria

Abstract

Lassa fever is a zoonotic disease found in several countries across West Africa, with estimates of up to 300,000 infections and 10,000 deaths yearly. The highest incidence is in Nigeria. Suspected cases are often seen in areas with limited infrastructure and diagnostics capacity, hence the availability of an accurate rapid diagnostic test (RDT) that could be used in the community would be an important public health tool. Unfortunately, few RDTs for Lassa fever exist and have not been thoroughly validated. Toward that end, we conducted a Phase 2 performance evaluation to assess the diagnostic accuracy of the ReLASV Pan-Lassa Antigen Rapid Test (Zalgen Labs, Frederick, MD, USA) using archived, frozen whole blood, plasma, and serum samples collected from individuals in Nigeria to determine its suitability for widespread use as a screening tool for Lassa fever. The overall performance of this RDT was measured against the reference test, the Altona RealStar LASV real-time reverse transcription polymerase chain reaction 2.0 (Altona Diagnostics, Hamburg, Germany). The sensitivity and specificity of the ReLASV Pan-Lassa Antigen Test were 65% and 50.7%, respectively. The low diagnostic accuracy indicated in our and other independent evaluations of the ReLASV Pan-Lassa Antigen Rapid Test suggests that this test, at least until further developed, refined, and validated, is not suitable for making critical diagnostic or treatment decisions for Lassa fever, at least for lineages that commonly circulate in Nigeria. These findings underscore the importance of thoroughly assessing the performance characteristics of tests to ensure their reliability and accuracy.

Introduction

Lassa virus (LASV) is a zoonotic high-consequence priority pathogen under the World Health Organization (WHO) R&D Blueprint [1]. The virus is estimated to infect up to 300,000 persons annually across West Africa, causing a potentially severe viral hemorrhagic disease known as Lassa fever (LF) [2]. Ondo State remains a major epicenter of Lassa fever in Nigeria, consistently reporting high case numbers and mortality rates. Since 2020, the state has recorded about 9,400 suspected cases, 1,779 confirmed cases, and 261 deaths. With an estimated case fatality rate of over 14% in the state, Lassa fever remains one of the deadliest infectious diseases in the region. The disease follows a seasonal pattern, with outbreaks peaking during the dry season (November to April) [3,4,5]. Effective patient management and control measures for LF are highly dependent on accurate and timely diagnosis. Because the presentation of the disease is usually non-specific, making it difficult to diagnose on clinical grounds alone, laboratory confirmation is imperative. However, although LF can be diagnosed by a multitude of modalities, including virus cell culture, molecular diagnostics such as the polymerase chain reaction (PCR), and immunoassays to detect viral antigen and/or LASV-specific antibodies, there is a dearth of well-validated commercially available assays. Diagnosis is further complicated by the fact that LF is typically seen in rural settings where laboratory infrastructure and diagnostics capacity, including the presence of trained laboratory personnel, are limited, especially for a high-consequence pathogen requiring special biosafety precautions [6].

Real-time PCR to detect LASV RNA is currently the most widely used laboratory method for diagnosis of LF, and is considered the “gold standard,” but is still not widely accessible. Rapid diagnostic tests (RDTs) to detect LASV antigen are a promising alternative to provide rapid case identification and guide public health response in decentralized settings due to their simplicity, rapidity, and adaptability for point-of-care use [7,8]. However, there are few RDTs for LF on the market, with limited independent performance data on the ones that do exist [9]. Toward that end, we assessed the performance of a LASV antigen RDT to determine its suitability for widespread use as an essential tool for the rapid diagnosis of LF.

Materials and methods

Study design and sample collection

This was an observational, retrospective, phase 2 [10] diagnostic accuracy study to determine the performance of one LASV antigen RDT using archived, frozen blood samples collected from individuals in Nigeria from October 2021 to September 2022. The evaluation was conducted from 22nd October 2022 to 25th November 2022 at the Federal Medical Center Owo (FMCO), Infection Control and Research Laboratory in Ondo State, Nigeria. The study samples used were archived frozen LASV-positive and LASV-negative whole blood, plasma and serum samples previously collected from individuals in Nigeria with clinical suspicion of LF under the Integrated Biobank Initiative [11] conducted by the international organisation FIND, Geneva, Switzerland, in collaboration with (FMCO). Diagnosis of LF at FMCO is conducted systematically on these individuals who presented to the outpatient and inpatient facilities at the study site with symptoms of Lassa fever through a combination of historical, clinical, and laboratory assessments following the National Guidelines for Lassa Fever Case Management [12]. All participants provided documented informed consent (18 years or older), assent (12-17 years, accompanied by the consent of a parent/legal guardian), or consent of both parents or the parent who had primary responsibility for children below 12 years, as appropriate, for the use of leftover samples for further research purposes. Individuals who were not competent to provide informed consent, as well as individuals with anatomical or health conditions contraindicating blood or bodily fluid collection, were excluded, as were participants for whom effective follow-up was deemed to be unachievable (e.g., those who lived elsewhere or were planning to relocate). In the event of the death of a patient before diagnosis, enrolment was not possible as these samples were collected as part of a separate study, which involved follow-up of confirmed LF cases. Eligible samples for the study included non-haemolyzed whole blood and plasma collected in tubes containing ethylenediaminetetraacetic acid (EDTA), and serum, all maintained at −20°C or lower within 24 hours of collection. These samples were thawed on ice prior to testing.

Investigational product

The index test evaluated in this study was the ReLASV Pan-Lassa Antigen Rapid Test (ReLASV Ag-RT, Zalgen Labs, Frederick, MD, USA), a point-of-care, in vitro RDT designed to detect the most prevalent LASV lineages (II, III and IV), using a cocktail of polyclonal antibodies raised against LASV recombinant nucleoproteins [8]. The ReLASV Pan-Lassa Antigen Rapid Test is performed as a dipstick immunoassay. A whole blood, plasma, or serum sample is added to the Sample Pad. Inserting the dipstick into a test tube containing the sample buffer initiates the sample flow through the reagent pads and across the nitrocellulose membrane. As the anti-LASV NP antibody Test stripe captures these complexes, the deposition of the gold conjugate generates a pink to dark red signal corresponding to the concentration of LASV NP antigen in the sample. Visual interpretation of test and control bands is made between 15-25 minutes of development time [13].

We measured the performance of this RDT against the reference test, the Altona RealStar LASV qRT-PCR 2.0 (Altona Diagnostics, Hamburg, Germany), an in vitro real-time PCR diagnostic test currently used as the gold standard for the qualitative detection of LASV-specific RNA [14], following the manufacturers’ instructions for both tests. The PCR assay targets LASV GPC and L genes, and cycle thresholds are applied according to the manufacturer’s guidelines.

Testing procedures

Sample panels for index and reference testing were prepared by an independent operator and reference test results and clinical information were blinded to the readers of the index test. Testing was performed by highly skilled, well-trained laboratorians at the Lassa fever laboratory at FMCO. The result for each test performed was verified by a second reader before recording. In case of discrepancy, a third reader was included. Any invalid test runs (e.g., no internal control signal/band) were repeated once within the same freeze-thaw cycle on the same day. If the repeat run remained invalid, the sample was reported as such. Valid index test results that were discrepant to the reference result were not repeated.

Statistical considerations

The sample size was calculated using the methodology described in [15], based on an expected sensitivity of 85% and specificity of 90% of the index test in comparison to the reference test, as discussed previously [8], and powered to obtain point estimates of pooled sensitivity and specificity with a 95% confidence interval (CI) based on Wilson’s score method, of total width +/- 20% with 80% power. The primary endpoint was the sensitivity and specificity of the index test when compared with the reference test. Point estimates of diagnostic accuracy metrics were calculated for subgroups of sample type, disease severity defined in [12], Ct values of the reference test (categorized as all Ct < 35, all Ct < 30, all Ct < 25), and sex to assess performance of the index test associated with these parameters. The statistical significance of the difference in the distribution of index test results between groups was assessed using a Chi2 Test or Fisher’s Exact Test, where appropriate, and was set at 0.05. Statistical analyses were performed using R Statistical Software (version 4.3.1; The R Foundation for Statistical Computing). All the items of the STARD Checklist 2015 (S1 Table) were considered during the development of this manuscript.

Ethics statement

Ethics approval (Ref: FMC/OW/380/VOL.CXLIX/137, 21 April 2022) was obtained before the start of the study from the Health Research Ethics Committee of FMCO for the use of archived samples previously obtained under adequate written informed consent and ethics approval scope (Ref: FMC/OW/380/VOL.CXIV/102, 13 April 2021) for future research purposes. The authors did not have access to information that could identify individual participants during or after data collection.

Results

Participant and sample characteristics

There was a total of 172 eligible participants, yielding 101 LASV-positive and 71 LASV-negative samples (Fig 1). One participant was excluded due to a missing reference result. Participant characteristics are shown in Table 1.

Sensitivity and specificity versus reference test

Analysis of the ReLASV Ag-RT compared to qRT-PCR performed on plasma samples showed a sensitivity of 65.0% (95% CI 55.3-73.6) and a specificity of 50.7% (95% CI 39.3-62.0), with a diagnostic odds ratio of 1.91 (95% CI 1.87-1.95), indicating a relatively weak discriminatory power of the index test (Table 2). The performance of the index test using serum samples was similar to that of plasma (Table 2). Significantly lower sensitivity was observed with whole blood, although the specificity (66.2%) on whole blood was slightly higher, with a diagnostic odds ratio of 50.3 (95% CI 42.9-57.7). Sensitivity trended upward with severity of illness and decreasing Ct values, but all confidence intervals overlapped. There were no statistically significant performance differences by sex.

Discussion

In this study, we found low clinical sensitivity and specificity of the ReLASV Ag-RT compared to the PCR reference test for LF. There are at least three other published evaluations of this test, with somewhat discrepant results, two of which were also conducted in Nigeria. In Abakaliki, Nigeria, Elsinga et al conducted a prospective study using fresh samples and found specificity on testing plasma over 90%, while sensitivity (50%) was similar to that noted in our study, dipping down to 10% when testing capillary blood at the bedside, with a poor correlation with viral load [16,17]. In contrast, in a study conducted during a LF outbreak in central Nigeria (which included investigators from the ReLASV Ag-RT manufacturer), Boisen et al reported considerably better performance, with a sensitivity of 83.3% and specificity of 92.8% when compared to composite results of two qPCR assays, using predominantly LASV lineage II samples [8]. All samples with Ct values below 22 on both qPCR assays were positive. The higher pre-test positive predictive value associated with an outbreak may have positively impacted the observed sensitivity in this study [18]. Boisen et al also reported high sensitivity (90%) and specificity (100%) of a previous version of the ReLASV Ag-RT based on paired monoclonal antibodies to LASV lineage IV in Sierra Leone, although the diagnostic standard used in the study, combining clinical suspicion and the results of immunoassays and qPCR, was not always clear [19].

Although we did not, other investigators found a specificity of the ReLASV Ag-RDT over 90%, suggesting that it could potentially be used in the confirmation of LF. However, further evaluation should be undertaken, as well as corresponding diagnostic algorithms, if the test is to be used in this manner. Independent evaluation of this test for detection of LASV in rodents is also warranted, since it has recently been used for this purpose in Sierra Leone [20]. This would inform the use of the test to facilitate the zoonotic surveillance of LASV and inform the exclusion of rodents from human spaces as a primary preventive measure in the absence of therapeutics and vaccines [20].

We note the following factors, including limitations to our study, which may have contributed to the finding of low diagnostic accuracy, as well as the discrepancy in results between our findings and those of other investigators. First, we did not have genomic data to identify the specific lineages of LASV in the tested samples. Diagnostic accuracy might be reduced if the lineages were predominantly discordant from the LASV lineages II, III, and IV on which the ReLASV Ag-RT is based [21,22]. Nevertheless, it should be noted that the study conducted by Elsinga et al in which poor diagnostic accuracy was found was done in an area where LASV lineage II predominates, and thus the result cannot be attributed to a lineage mismatch with the ReLASV RDT [16].

Secondly, as a prospective design is not easily feasible, and best achieved during an outbreak but with an unpredictable magnitude, we chose a retrospective design using a biobank to enable parallel evaluation of the index test on a large population of well-characterized samples. However, the use of archived samples brings possible variations in storage conditions such as temperature fluctuations, freeze-thaw cycles, or prolonged storage durations that could lead to sample degradation and compromise the accuracy of results [23,24]. Nevertheless, since samples in this study were collected within the last 12 months, the likelihood of sample degradation affecting the results is low. There is also the potential for selection bias when using banked biological samples, since the samples may not be representative or capture the diversity of the broader population, thus limiting the generalizability of the study findings [25].

Neither we nor others evaluating the ReLASV Ag-RT controlled for the timing of the sample acquisition during the clinical course. Nor did we measure or correlate with antibody responses to LASV. It is possible that, at least for some samples, the humoral response to LASV infection resulted in the production of antibodies that bound and blocked the LASV NP antigen, making it less detectable by the ReLASV Ag-RT [21,26,27]. Detection of LASV nucleic acid by qPCR would not necessarily be affected by these antibodies, potentially resulting in discordant results and decreased observed sensitivity. Future evaluation of the ReLASV Ag-RT as well as other RDTs for LF should include testing for IgM and IgG antibodies to assess possible antigen-antibody interactions and their impact on test results, although such studies will be challenged by the limited availability of well-validated assays for antibodies to LF as well.

Lastly, considering that this study was powered to prioritize the assessment of the index test’s diagnostic accuracy, we suggest that future diagnostic evaluation studies, where specific subgroups are known to have different clinical performance, should be powered to prioritize the subgroups.

Conclusion

The low diagnostic accuracy indicated in our and other independent evaluations of the ReLASV Ag-RDT suggests that this test, at least until further developed, refined, and validated, is not suitable for making critical diagnostic or treatment decisions for LF, at least for lineages that commonly circulate in Nigeria. This is unfortunate, considering that the vast majority of confirmed cases of LF occur in Nigeria, and the ReLASV Ag-RDT is presently one of only two RDTs for LF on the market [28]. Furthermore, although in recent years there have been advances in the understanding of the epidemiology of LF and the pre-clinical research and development of vaccines and therapeutics against this dangerous disease, the absence of an accurate low-cost robust diagnostic tool that can be used at or near the bedside in the widespread area of LF endemicity across West Africa presents a major bottleneck to further progress. We encourage the biotech research and development community to continue to engage and expand to meet this challenge and fill the critical gap of an accurate RDT for LF. Lastly, these findings underscore the importance of thoroughly assessing the performance characteristics of tests, to ensure their reliability and accuracy in real-world applications, especially in healthcare settings where diagnostic accuracy is critical.

References

  1. 1. World Health Organization (WHO). An R&D blueprint for action to prevent epidemics: a plan of action. Geneva: World Health Organization; 2016. Available from: https://cdn.who.int/media/docs/default-source/blue-print/an-randd-blueprint-for-action-to-prevent-epidemics.pdf?sfvrsn=f890ab4e_1&download=true
  2. 2. World Health Organization (WHO). Lassa fever. Geneva: World Health Organization; 2024. Available from: https://www.who.int/news-room/fact-sheets/detail/lassa-fever
  3. 3. Nigeria Centers for Disease Control and Prevention. An update of Lassa fever outbreak in Nigeria. Available from: https://ncdc.gov.ng/diseases/sitreps/?cat=5&name=An%20update%20of%20Lassa%20fever%20outbreak%20in%20Nigeria
  4. 4. Akinpelu AO, Abiodun OO, Irinoye OO. Prevalence of lassa fever infections in Ondo State, Nigeria. Afr J Health Nursing Midwifery. 2024;7(3):51–6.
  5. 5. Al-Mustapha AI, Adesiyan IM, Orum TG, Ogundijo OA, Lawal AN, Nzedibe OE, et al. Lassa fever in Nigeria: epidemiology and risk perception. Sci Rep. 2024;14(1):27669. pmid:39532966
  6. 6. Medugu N, Adegboro B, Babazhitsu MS, Kadiri M, Abanida EA. A review of the recent advances on Lassa fever with special reference to molecular epidemiology and progress in vaccine development. Af J Clin Exp Micro. 2023;24(2):130–46.
  7. 7. Takah NF, Brangel P, Shrestha P, Peeling R. Sensitivity and specificity of diagnostic tests for Lassa fever: a systematic review. BMC Infect Dis. 2019;19(1):647. pmid:31324229
  8. 8. Boisen ML, Uyigue E, Aiyepada J, Siddle KJ, Oestereich L, Nelson DKS, et al. Field evaluation of a Pan-Lassa rapid diagnostic test during the 2018 Nigerian Lassa fever outbreak. Sci Rep. 2020;10(1):8724. pmid:32457420
  9. 9. Mazzola LT, Kelly-Cirino C. Diagnostics for Lassa fever virus: a genetically diverse pathogen found in low-resource settings. BMJ Glob Health. 2019;4(Suppl 2):e001116. pmid:30899575
  10. 10. Gluud C, Gluud LL. Evidence based diagnostics. BMJ. 2005;330(7493):724–6.
  11. 11. FIND. FIND Integrated Biobanks. Available from: https://www.finddx.org/what-we-do/cross-cutting-workstreams/biobank-services/find-integrated-biobanks/
  12. 12. Nigeria Centre for Disease Control (NCDC). National Guidelines for Lassa Fever Case Management. 2018. Available from: https://ncdc.gov.ng/themes/common/docs/protocols/92_1547068532.pdf
  13. 13. Zalgen Labs. ReLASV Pan-Lassa Antigen Rapid Test – RUO (10376). Available from: https://zalgen.com/product/relasv-pan-lassa-antigen-rapid-test-ruo-50-test-strip-kit/
  14. 14. Okwuraiwe AP, Faye O, Ige FA, James AB, Shaibu JO, Faye M, et al. Surveillance of viral hemorrhagic fever viruses in lassa fever suspects in Ondo State, Nigeria. EJMED. 2022;4(3):78–81.
  15. 15. Zhou X-H, Obuchowski NA, McClish DK. Sample Size Calculations. In: Statistical Methods in Diagnostic Medicine. John Wiley & Sons, Inc. 2011. 193–229
  16. 16. Elsinga J, Sunyoto T, di Stefano L, Giorgetti PF, Kyi HA, Burzio C, et al. Field evaluation of validity and feasibility of Pan-Lassa rapid diagnostic test for Lassa fever in Abakaliki, Nigeria: a prospective diagnostic accuracy study. Lancet Infect Dis. 2024;24(9):1037–44. pmid:38734012
  17. 17. Groger M, Ramharter M. Rapid diagnostic tests for Lassa fever: what do we aim for?. Lancet Infect Dis. 2024;24(9):944–5. pmid:38734013
  18. 18. Safari S, Baratloo A, Elfil M, Negida A. Evidence based emergency medicine part 2: positive and negative predictive values of diagnostic tests. Emerg (Tehran). 2015;3(3):87–8. pmid:26495390
  19. 19. Boisen ML, Hartnett JN, Shaffer JG, Goba A, Momoh M, Sandi JD, et al. Field validation of recombinant antigen immunoassays for diagnosis of Lassa fever. Sci Rep. 2018;8(1):5939. pmid:29651117
  20. 20. Smither AR, Koninga J, Kanneh FB, Foday M, Boisen ML, Bond NG, et al. Novel tools for lassa virus surveillance in peri-domestic rodents. medRxiv. 2023:2023.03.17.23287380. pmid:36993465
  21. 21. Garry RF. Lassa fever - the road ahead. Nat Rev Microbiol. 2023;21(2):87–96. pmid:36097163
  22. 22. Whitmer SLM, Strecker T, Cadar D, Dienes H-P, Faber K, Patel K, et al. New Lineage of Lassa Virus, Togo, 2016. Emerg Infect Dis. 2018;24(3):599–602. pmid:29460758
  23. 23. Østergaard M, Sandfeld-Paulsen B. Preanalytical temperature and storage stability of specific IgE antibodies in serum. Scand J Clin Lab Invest. 2023;83(3):160–5. pmid:36988143
  24. 24. Ransohoff DF, Gourlay ML. Sources of bias in specimens for research about molecular markers for cancer. J Clin Oncol. 2010;28(4):698–704. pmid:20038718
  25. 25. Bradley V, Nichols TE. Addressing selection bias in the UK Biobank neurological imaging cohort. 2022.
  26. 26. Zalgen Labs, LLC. ReLASV Pan-Lassa Antigen Rapid Test. Instructions for use. Doc. No.: PI-01R 00. 2019. Available from: https://zalgen.com/wp-content/uploads/PI-01R-00-PI-for-ReLASV-Pan-Lassa-Antigen-Rapid-Test-Kit-RUO.pdf
  27. 27. Fischer RJ, Purushotham JN, van Doremalen N, Sebastian S, Meade-White K, Cordova K, et al. ChAdOx1-vectored Lassa fever vaccine elicits a robust cellular and humoral immune response and protects guinea pigs against lethal Lassa virus challenge. NPJ Vaccines. 2021;6(1):32. pmid:33654106
  28. 28. FIND. Outbreak Test Directory. Available from: https://finddx.shinyapps.io/testdirexplorer_beta/?_inputs_&sidebar=true&menubar=%22Explorer%22&button_outbreak=1