Figures
Abstract
Introduction
Several multiplex and singleplex PCR systems exist for the detection of Dengue(DENV), Zika(ZIKV), and Chikungunya(CHIKV) viruses; however, their performance characteristics in East Africa remain unassessed. In this study, we investigated the TaqMan® Arbovirus Triplex Kit, which allows for the simultaneous identification of CHIKV, DENV, and ZIKV viruses in serum samples and singleplex assays, including the RealStar® Chikungunya RT-PCR Kit 2.0, RealStar® Dengue RT-PCR Kit 3.0, and RealStar® Zika Virus RT-PCR Kit 1.0.
Methods
We used Clinical Laboratory Improvement validation methods and residual specimens sourced from DENV, CHIKV, and ZIKV outbreaks, from Kenya, Brazil, and the Democratic Republic of Congo(DRC) in March 2024. Quality control was ensured through Quality Control for Medical diagnostics (QCMD) commercial positive panels. Gold standard results were established through consensus from multiple kits, including the TaqMan® Arbovirus Triplex Kit, Illumina viral surveillance panel (Illumina VSP), and Altona singleplex kit. Data were analyzed using R to determine specificity, sensitivity, negative predictive value (NPV), positive predictive value (PPV), and diagnostic odds ratio, with probit analysis employed to evaluate the limit of detection.
Results
The TaqMan® Arbovirus Kit showed sensitivity exceeding 95% for all three virus targets: 97.98% for DENV, and 100% for both CHIKV and ZIKV. Simillarly, the RealStar® RT-PCR Kits exhibited sensitivities: 93.94% for CHIKV, 90.91% for DENV, and 100% for ZIKV. All kits demonstrated specificity above 99%, with a positive predictive value (PPV) over 99% and a negative predictive value (NPV) exceeding 97%. Probit analysis revealed that the TaqMan® Arbovirus Kit also had a lower detection limit compared to the RealStar kit for all tested viruses.
Citation: Kingwara L, Odeny L, Onwonga V, Madada R, Mbeneka M, Okonji J, et al. (2025) Assessment of a multiplex arbovirus PCR Detection Test in an area endemic for Chikungunya, Zika, and Dengue viruses: An evaluation of kit performance characteristics in line with Clinical Laboratory Improvement Amendments (CLIA) Standards. PLoS One 20(6): e0309626. https://doi.org/10.1371/journal.pone.0309626
Editor: Carlos Eduardo Calzavara-Silva, Fundacao Oswaldo Cruz - Instituto Rene Rachou, BRAZIL
Received: September 17, 2024; Accepted: January 27, 2025; Published: June 24, 2025
Copyright: © 2025 Kingwara et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data relevant to this study are available from Dryad at DOI:10.5061/dryad.76hdr7t68 (https://doi.org/10.5061/dryad.76hdr7t68).
Funding: Government of Kenya, Ministry of Health KNPHI-017, Pandemic System Strengthening Kenya National Public Health Institute, Dr. Leonard Kingwara.
Competing interests: No authors have competing interests.
Introduction
To aid in the differential diagnosis of DENV, ZIKV, and CHIKV, it is crucial to employ a triplex kit that can deliver PCR results for all three pathogens, given their overlapping clinical symptoms [1]. This diagnostic strategy not only simplifies the testing process but also significantly enhances clinical management and patient care. Simultaneous identification of these arboviruses can considerably shorten the diagnosis time, which is vital in regions experiencing widespread viral transmission [2]. Earlier research has demonstrated various multiplex real-time polymerase chain reaction (RT-PCR) assays capable of concurrently detecting multiple arboviruses, confirming their effectiveness in clinical environments [3,4]. In Kenya, test kits being used to test DENV, ZIKV and CHIKV range from serological-based to PCR-based. Within these, are several multiplex reverse transcription polymerase chain reaction (rRT-PCR) assays capable of detecting ZIKV, CHIKV, and DENV viruses simultaneously [5]. Most newly developed assays build on the achievements of earlier tools, including a validated triplex RT-qPCR procedure and the newly devised TaqMan™ Arbovirus Triplex Kit [2,6] however, there is still a need to ascertain their performance in a setting where these pathogens are endemic. Kenya being an endemic region for DENV and CHIKV, provide a good setup for evaluating both the assay’s sensitivity and specificity, as well as its practical effectiveness in real-time clinical scenarios, which could revolutionize arboviral diagnosis in areas heavily affected by these viruses [7,8].
The use of polymerase chain reaction (PCR) for diagnosing arboviral infections, especially for DENV, ZIKV, and CHIKV, offers considerable advantages over traditional serological methods. Although serological tests can be helpful, they often present issues such as cross-reactivity, inconsistent antibody responses, and latency in antibody detection, leading to false negatives, particularly in the initial stages of infection [9]. Conversely, PCR directly identifies viral RNA, allowing for early and precise detection of infections during crucial acute phases when timely diagnosis is essential for managing patient care and executing urgent public health measures [10–12]. The advancements in multiplex PCR technology provide the capability for simultaneous detection of multiple viruses, optimizing laboratory workflows and improving diagnostic efficiency. Numerous studies have shown the effectiveness of multiplex assays in simultaneously identifying and quantifying ZIKV, DENV, and CHIKV viruses within a single reaction, thereby minimizing reagent expenses and turnaround times [9,12]. The adoption of such assays has demonstrated enhanced performance characteristics, including greater specificity and sensitivity, compared to traditional serological techniques. These features are critical in regions where these viruses circulate concurrently, as they facilitate accurate diagnoses while also contributing to better epidemiological data and resource distribution during outbreaks [10]. In Kenya, Altona Real star PCR kit which is CE approved have majorly been used in times of outbreak
The TaqMan® Arbovirus kit’s performance characteristics for the simultaneous detection of DENV, CHIKV, and ZIKV have been validated in other settings through rigorous testing against established standards. Multiple studies reveal that this assay maintains high sensitivity and specificity, effectively differentiating between the three arboviruses in clinical specimens [13]. The TaqMan® Arbovirus assay’s sensitivity values are reported to be ≥ 95%, along with a low limit of detection, making it a trustworthy option for early diagnosis in these endemic regions. Furthermore, the ability to identify viral RNA in a single reaction significantly cuts down processing time and resource use compared to traditional methods, typically requiring individual tests for each virus [11,12]. Similarly, the RealStar® singleplex has also been assessed and found to perform well, demonstrating comparable sensitivity and specificity. The assay’s streamlined process allows for the concurrent quantification of DENV, CHIKV, and ZIKV with minimal cross-reactivity [14]. Importantly, the Altona kit’s performance has been validated in various geographical locations as opposed to the newly developed TaqMan® Arbovirus kit. [14,15] While both kits yield excellent results, the decision between them may ultimately hinge on local resource availability, specific laboratory capabilities, and the clinical context of their application. Continued assessments of both kits across different settings will be essential to delineate their respective benefits and applications in real-world usage.
Given the rise in mosquito-borne viral diseases in Kenya, it is vital to perform a comprehensive study on the performance characteristics of TaqMan® Arbovirus kit designed for detecting CHIKV, ZIKV, and DENV. Understanding aspects such as sensitivity, specificity, negative predictive value, positive predictive value, and limit of detection within the resource limited setting such as Kenya is crucial, as most laboratories do not have equivalent resources available in settings where previous validations have been done. Prior evaluations, like that of the Triplex real-time RT-PCR assay, have shown significant promise for rapid detection and accurate diagnosis of these arboviruses [4,12,15], however, their main limitation have been their applications in endemic settings in an outbreak set-up. Moreover, challenges in deploying multiplex assays in endemic regions, as illustrated by the adaptation of human diagnostic kits for mosquito sampling, further underscore the importance of thorough performance evaluations to guide public health responses [15].
Conducting performance evaluations in Kenya and similar contexts is crucial for determining the practical relevance of existing diagnostic kits under local epidemiological conditions. Establishing comprehensive performance metrics will not only assist health authorities in selecting the most appropriate diagnostic tools but also inform future testing strategies, including assessing whether testing can reliably be conducted in triplex or single-plex formats [13]. In this study, we aimed to assess the performance characteristics of the research use only (RUO) TaqMan® Arbovirus Triplex Kit for the simultaneous detection of CHIKV, DENV, and ZIKV in serum samples and Singleplex assays, such as the RealStar® CHIKV RT-PCR Kit 2.0, RealStar® DENV RT-PCR Kit 3.0, and RealStar® ZIKV RT-PCR Kit 1.0, all of which are CE certified by Altona Diagnostics for similar sample type. The performance characteristics (Sensitivity, specificity, Negative predictive value, positive predictive value and limit of detection) was conducted using well-characterized panels made up of outbreak samples from Kenya, the DRC, and Brazil, as well as various commercial panels.
Methods
Samples:
Archived samples were utilized. These samples came from 330 symptomatic individuals during the outbreak and 40 characterised panel from QCMD (quality control for molecular diagnostics). DENV and CHIKV samples were collected in Kenya from September 2022 to April 2023, while 52 ZIKV specimens were obtained from Brazil specimens dated between March and April 2018, with an additional 5 ZIKV samples from the DRC. Kenyan specimens were retrieved from the biorepository at the National Public Health Laboratory and tested between April 6th and 15th, 2024.
We recharacterized the outbreak samples to obtain the Gold standard test results by testing them with both the TaqMan® Arbovirus Kit and Altona Real star assays. Any discrepancies in results were resolved using the Illumina Viral Surveillance Panel assay. We successfully characterized 89 samples positive for Dengue, 89 positive for Chikungunya, 57 positive for Zika, and 100 samples negative for all three viruses.
Sample processing:
Samples were processed at the Genomics and Virology laboratories of the National Public Health Institute in Nairobi, Kenya, using serum specimens retrieved from a biorepository. RNA was extracted from 200 μL of each serum sample with the MagMAX™ Pathogen RNA/DNA Kit on the KingFisher™ Flex system, following the manufacturer’s guidelines The process included incubation at room temperature after thawing, followed by centrifugation and extraction using King fisher flex as per the MagMax extraction protocol. For PCR detection, the BioRad CFX96™ and QuantStudio™ 5 Flex systems were utilized with RealStar® assays and the TaqMan® Arbovirus Kit, adhering to specific cycling conditions. To reduce inter-operator variability, all laboratory staff underwent standardized training, and automated RNA extraction platforms were employed to ensure consistency and minimize handling errors. The strict adherance to the manufacturer procedures were vital in achieving accurate and reliable results regarding the diagnostic performance of the TaqMan® Arbovirus Triplex Kit. The study staff adhered to established protocols for nucleic acid extraction and real-time PCR analysis within the Kit inserts.
Laboratory quality assurance:
Quality control was upheld during the study through the use of external positive and negative controls from Thermo Fisher Scientific, which guaranteed the testing process’s integrity. We also obtained commercial positive and negative samples for DENV, CHIKV, and ZIKV from QCMD. Furthermore, the laboratories conducting the analysis conforms to ISO/IEC 17025:2022 ISO 15189 standards.
Statistical evaluation of performance characteristics:
We conducted all statistical analyses using R. We evaluated the sensitivity, specificity, and agreement rates of the assays by comparing test results from outbreak and commercial panel samples for both the TaqMan® Arbovirus kit and the RealStar® singleplex assays against the gold standard results. Additionally, we applied a regression model to examine the relationship between Ct cycle and input concentration for both the TaqMan Arbovirus Kit and RealStar® singleplex assays, and subsequently generated probit curves using GraphPad Prism version 9.1.1.
Results
We established the Gold standard results by reconciling previous clinical findings and resolving all discrepancies between the TaqMan® Arbovirus Kit and Altona Realstar through metagenomics. Against the Gold standard results, the TaqMan® Arbovirus Kit had a sensitivity rate exceeding 95% for all three targets tested (DENV: 0.9798, ZIKV: 1.000, and CHIKV: 1.000). Similarly, the Altona Realstar Kits demonstrated a sensitivity greater than 90% for these targets (DENV: 0.9091, ZIKV: 1.000, and CHIKV: 0.9394). The above results are shared in Table 1 and Fig 1. Both kits exhibited comparable specificity across the three targets. Furthermore, the positive predictive value (PPV), negative predictive value (NPV), and diagnostic odds ratio were similar for all three viruses (DENV, ZIKV, and CHIKV) as shown on Table 1 and Fig 1.
Comparative sensitivity and spevcificity between the triplex test and Altona Real star
Both kits demonstrated an inverse relationship between concentration and Ct cycle, which aligns with the expected PCR behavior as shown in Fig 2. Probit analysis revealed that the TaqMan® Arbovirus Kit had a lower limit of detection than the Altona Realstar kit for all three targets tested: Zika, Dengue, and Chikungunya as per Fig 3 below.
Inverse relationship observed across the Altona Realstar and TaqMan Kit tests confirming expected PCR behaviour. TaqMan Kit of detection is comparatively lower on all the three targets(DENV,ZIKV, and CHIKV)
The probit curve analysis of DENV, CHIKV,and ZIKV, showing the comparative sensitivity of altona Realstar and TaqMan Kit. Across all the three viruses, TaqMan triplex kit was more sensitive
Discussion
The TaqMan® Arbovirus Triplex Kit exhibited performance comparable to the CE-certified RealStar® CHIKV RT-PCR Kit 2.0, RealStar® DENV RT-PCR Kit 3.0, and RealStar® ZIKV RT-PCR Kit 1.0 in terms of performance characteristics including sensitivity, specificity, negative predictive value, positive predictive value, and limit of detection. The TaqMan® Arbovirus Triplex Kit demonstrated a lower detection limit in comparison to its sensitivity for DENV and CHIKV, while its results for ZIKV were similar across all kits. Our findings are supported by findings generated by the center for disease control in their validation study [11].Furthermore, both the TaqMan® Arbovirus Triplex Kit and the RealStar® kits showed an inverse relationship between concentration and Ct cycle, which confirmed the expected behavior of PCR and validated the laboratory pipetting procedures as shown in other PCR-validated studies [13].
Although this study has provided a comparison of the performance between the two test kits, it was not specifically designed to generate such results. Therefore, additional studies explicitly designed to obtain comparative data should be conducted. Our research primarily focused on samples collected from Kenya, with ZIKV samples sourced from the DRC and Brazil during an outbreak. In contrast, other comparable studies that have reported similar findings have primarily utilized cultured specimens ([9,12]. While some studies have indeed analyzed outbreak-related clinical specimens, these were conducted outside of East Africa, DRC, and Brazil [10–12], making their conclusions potentially inapplicable to our context due to the varying molecular epidemiological patterns of ZIKV, CHIKV, and DENV across different regions [16–18].
The probit regression analysis has uncovered some unexpected insights. There is a strong correlation between lower cycle threshold values and improved detection sensitivity [19,20]. Infections with CHIKV, ZIKV, and DENV significantly affect positive disease outcomes, underscoring the necessity for early detection and control strategies for these pathogens at the early phase when the viral load is low [20]. As such, the type of test kit used and ZIKV, DENV and CHIKV infection could have a significant influence on disease care in the early phase. Both the TaqMan® Arbovirus Triplex kit and the CE, IVD-approved kit produced similar results, although the TaqMan® kit demonstrated greater sensitivity compared to the Single-Plex RealStar® kit, as shown in our probit curves. Future studies designed with sufficient power could provide more reliable comparative results.
In conclusion, the TaqMan® Arbovirus Triplex kit is comparable to established single-plex RT-PCR test kits for detecting ZIKV, DENV, and CHIKV. Additionally, the sensitivity and specificity for all tested viruses were above 95%. The high level of agreement between the two tests suggests that the new test can be used in areas requiring multi-disease case detection without compromising results. These agreement results further demonstrate that the performance of the TaqMan® Arbovirus Triplex is comparable to that of established Altona RealStar® single-plex assays. One advantage of the TaqMan® Arbovirus assay is its ability to detect the three most common arboviruses in one reaction, reducing variations between experiments as compared to single-plex assays.
Conclusion
The TaqMan® Arbovirus Triplex Kit can be used as a substitute for the CE-certified RealStar® CHIKV RT-PCR Kit 2.0, RealStar® DENV RT-PCR Kit 3.0, and RealStar® ZIKV RT-PCR Kit 1.0 during an outbreak scenario. A significant benefit of the TaqMan® Arbovirus Triplex Kit is that it provides results for all three viruses simultaneously.
Limitations of the study
The study was not designed to provide a comparative analysis of the performance between the TaqMan® Arbovirus Triplex Kit and the CE-certified RealStar® CHIKV RT-PCR Kit 2.0, RealStar® DENV RT-PCR Kit 3.0, and RealStar® ZIKV Virus RT-PCR Kit 1.0. Therefore, additional studies should be designed to generate these comparative results if necessary.
References
- 1. Pabbaraju K, Wong S, Gill K, Fonseca K, Tipples GA, Tellier R. Simultaneous detection of Zika, Chikungunya and Dengue viruses by a multiplex real-time RT-PCR assay. J Clin Virol. 2016;83:66–71. pmid:27614319
- 2. Cantero C, Cardozo F, Waggoner JJ, Pinsky BA, Espínola A, Infanzón B, et al. Implementation of a Multiplex rRT-PCR for Zika, Chikungunya, and Dengue Viruses: Improving Arboviral Detection in an Endemic Region. Am J Trop Med Hyg. 2020;102(3):625–8. pmid:31933462
- 3. Wu W, Wang J, Yu N, Yan J, Zhuo Z, Chen M. Development of multiplex real-time reverse-transcriptase polymerase chain reaction assay for simultaneous detection of Zika, dengue, yellow fever, and chikungunya viruses in a single tube. J Med Virol. 2018;90(11).
- 4. Lura T, Su T, Thieme J, Brown MQ. A validated triplex RT-qPCR protocol to simultaneously detect chikungunya, dengue and Zika viruses in mosquitoes. J Vector Borne Dis. 2022;59(3):198–205. pmid:36511035
- 5. Mansuy J-M, Lhomme S, Cazabat M, Pasquier C, Martin-Blondel G, Izopet J. Detection of Zika, dengue and chikungunya viruses using single-reaction multiplex real-time RT-PCR. Diagn Microbiol Infect Dis. 2018;92(4):284–7. pmid:30029808
- 6. Álvarez-Díaz DA, Valencia-Álvarez E, Rivera JA, Rengifo AC, Usme-Ciro JA, Peláez-Carvajal D, et al. An updated RT-qPCR assay for the simultaneous detection and quantification of chikungunya, dengue and zika viruses. Infect Genet Evol. 2021;93:104967. pmid:34116240
- 7. Mejía MFÁ, Shu PY, Ji D Der. Accuracy of dengue, chikungunya, and Zika diagnoses by primary healthcare physicians in Tegucigalpa, Honduras. BMC Infect Dis. 2023;23(1).
- 8. Carreto C, Gutiérrez-Romero R, Rodríguez T. Climate-driven mosquito-borne viral suitability index: measuring risk transmission of dengue, chikungunya and Zika in Mexico. Int J Health Geogr. 2022;21(1).
- 9. Santiago GA, Vázquez J, Courtney S, Matías KY, Andersen LE, Colón C, et al. Performance of the Trioplex real-time RT-PCR assay for detection of Zika, dengue, and chikungunya viruses. Nat Commun. 2018;9(1):1391. pmid:29643334
- 10. Santiago GA, Vazquez J, Munoz-Jordan JL. Clinical and analytical performance of the Trioplex real time RT-PCR assay during the 2016 zika epidemic in Puerto Rico. American Journal of Tropical Medicine and Hygiene. 2018;99(4).
- 11. Colombo TE, Versiani AF, Dutra KR, Rubiato JGD, Galvão TM, Negri Reis AF, et al. Performance of CDC Trioplex qPCR during a dengue outbreak in Brazil. J Clin Virol. 2019;121:104208. pmid:31707203
- 12. Santiago GA, Vazquez J, Muñoz-Jordan JL. Performance of the CDC trioplex real time RT-PCR during the 2016 zika epidemic in Puerto Rico. American Journal of Tropical Medicine and Hygiene. 2017;97(5).
- 13. Shubing C, Zeinab HH, Kenneth SP, Paulo V, Antonio G, Mazhar IK. Development of a TaqMan real time reverse transcriptase PCR assay for detection of Zika, Yellow Fever and Dengue-4 viruses simultaneously in a single reaction. Afr J Microbiol Res. 2020;14(11).
- 14. L’Huillier AG, Lombos E, Tang E, Perusini S, Eshaghi A, Nagra S, et al. Evaluation of Altona Diagnostics RealStar Zika Virus Reverse Transcription-PCR Test Kit for Zika Virus PCR Testing. J Clin Microbiol. 2017;55(5):1576–84. pmid:28298448
- 15. Calvo EP, Sánchez-Quete F, Durán S, Sandoval I, Castellanos JE. Easy and inexpensive molecular detection of dengue, chikungunya and zika viruses in febrile patients. Acta Trop. 2016;163:32–7. pmid:27477452
- 16. Higuera A, Ramírez JD. Molecular epidemiology of dengue, yellow fever, Zika and Chikungunya arboviruses: An update. Acta Tropica. 2019;190.
- 17. de França Cirilo MV, Pour SZ, de Fatima BenedettiV, Farias JP, Fogaça MMC, da Conceição Simões R, et al. Co-circulation of Chikungunya virus, Zika virus, and serotype 1 of Dengue virus in Western Bahia, Brazil. Front Microbiol. 2023;14.
- 18. Chand G, Godbole S, Shivlata L, Sahare LK, Ukey M, Kaushal LS, et al. Molecular xenomonitoring of Dengue, Chikungunya and Zika infections: a year-round study from two Dengue endemic districts of central India. J Vector Borne Dis. 2021;58(2):135–40. pmid:35074947
- 19. Steinhauser S, Schumacher M, Rücker G. Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies. BMC Med Res Methodol. 2016;16(1):97. pmid:27520527
- 20. Shinkins B, Yang Y, Abel L, Fanshawe TR. Evidence synthesis to inform model-based cost-effectiveness evaluations of diagnostic tests: a methodological review of health technology assessments. BMC Med Res Methodol. 2017;17(1):56. pmid:28410588