31 Jul 2013: Santiago GA, Vergne E, Quiles Y, Cosme J, Vazquez J, et al. (2013) Correction: Analytical and Clinical Performance of the CDC Real Time RT-PCR Assay for Detection and Typing of Dengue Virus. PLOS Neglected Tropical Diseases 7(7): 10.1371/annotation/ae27d48b-025f-47ce-8427-4af59f821ad7. https://doi.org/10.1371/annotation/ae27d48b-025f-47ce-8427-4af59f821ad7 View correction
Dengue is an acute illness caused by the positive-strand RNA dengue virus (DENV). There are four genetically distinct DENVs (DENV-1–4) that cause disease in tropical and subtropical countries. Most patients are viremic when they present with symptoms; therefore, RT-PCR has been increasingly used in dengue diagnosis. The CDC DENV-1–4 RT-PCR Assay has been developed as an in-vitro diagnostic platform and was recently approved by the US Food and Drug Administration (FDA) for detection of dengue in patients with signs or symptoms of mild or severe dengue. The primers and probes of this test have been designed to detect currently circulating strains of DENV-1–4 from around the world at comparable sensitivity. In a retrospective study with 102 dengue cases confirmed by IgM anti-DENV seroconversion in the convalescent sample, the RT-PCR Assay detected DENV RNA in 98.04% of the paired acute samples. Using sequencing as a positive indicator, the RT-PCR Assay had a 97.92% positive agreement in 86 suspected dengue patients with a single acute serum sample. After extensive validations, the RT-PCR Assay performance was highly reproducible when evaluated across three independent testing sites, did not produce false positive results for etiologic agents of other febrile illnesses, and was not affected by pathological levels of potentially interfering biomolecules. These results indicate that the CDC DENV-1–4 RT-PCR Assay provides a reliable diagnostic platform capable for confirming dengue in suspected cases.
Significant expansion of the four DENV serotypes (DENV-1, -2, -3 and -4) has been reported throughout tropical and sub-tropical regions of the world, with estimates of 390 million cases annually. The need has arisen for expanded diagnostic testing for DENV infections in the United States, as dengue infection has been added to the list of national notifiable diseases. Timely and accurate diagnosis of dengue is important for clinical care, disease surveillance, disease prevention, and control activities. However, current testing is performed with laboratory-developed research-based assays available only in a limited number of laboratories that have not been validated or approved for diagnostic testing in the United States. Here we report the development and evaluation of the CDC DENV-1–4 Real Time RT-PCR Assay, the first molecular test approved by the US Food and Drug Administration for the diagnosis and serotyping of DENV in human serum or plasma samples. This test was designed and validated for the detection of contemporary, clinically relevant DENV strains transmitted globally, facilitating the global deployment of the test and increase detection of traveler-associated dengue cases.
Citation: Santiago GA, Vergne E, Quiles Y, Cosme J, Vazquez J, Medina JF, et al. (2013) Analytical and Clinical Performance of the CDC Real Time RT-PCR Assay for Detection and Typing of Dengue Virus. PLoS Negl Trop Dis 7(7): e2311. https://doi.org/10.1371/journal.pntd.0002311
Editor: Eva Harris, University of California, Berkeley, United States of America
Received: December 13, 2012; Accepted: May 31, 2013; Published: July 11, 2013
This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Funding: This study was funded by the Centers for Disease Control and Prevention agency budget for the Division of Vector-Borne Diseases and the Dengue Branch. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Dengue is a human disease caused by infection with any one of four genetically related dengue virus serotypes (DENV-1, -2, -3 and - 4), which are transmitted to humans by Aedes sp mosquitoes. Dengue is the most widespread mosquito-borne viral disease, with an estimated 390 million cases reported annually worldwide –. Infection by one DENV serotype confers long-term homotypic immunity but only transient heterotypic protection. Therefore, sequential heterotypic infections are common in dengue endemic areas . In non-endemic regions of the United States (US), dengue is the most frequent cause of febrile illness among travelers returning from the Caribbean, Latin America, and Asia –. Occasional outbreaks occur in regions of the US where the mosquito vector is present, such as along the US-Mexico border and the states of Florida and Hawaii –. Frequent co-circulation of multiple DENV serotypes occurs in several US-associated territories where dengue is endemic, including Puerto Rico, the Virgin Islands, American Samoa, and other US-affiliated Pacific Islands –.
Approximately 75% of DENV infections are acute, self-resolving, and asymptomatic . Patients with dengue symptoms experience an illness that features three phases. The acute phase is characterized by fever lasting 2–7 days, which is often associated with one or more of the following symptoms: headache, retro-orbital eye pain, arthralgia, myalgia and/or bone pain, rash, mild hemorrhagic manifestations (e.g., nose or gum bleeding, petechiae, easy bruising) and leukopenia. The critical phase begins at defervescence, marking a 24–48 hour period in which plasma leakage, internal hemorrhage, severe organ impairment and compensated or decompensated shock may occur due to increased capillary permeability with plasma leakage, producing ascites, pleural effusions, and ‘third spacing’ of fluids –. These manifestations are currently termed severe dengue, a designation that has replaced dengue hemorrhagic fever (DHF) or dengue shock syndrome (DSS) . Warning signs of severe dengue include abdominal pain, vomiting, thrombocytopenia, and mild to severe hemorrhagic manifestations. The convalescent phase of dengue may extend for several days and follows the febrile or critical phase of illness.
Early laboratory diagnosis of dengue is best made during the acute phase of the illness when viremia levels are high (0–5 days post onset of illness) and the viral RNA or soluble antigens (i.e. NS1 antigen) can be detected , –. IgM anti-DENV only becomes detectable 4 or 5 days post symptoms onset. Several RT-PCR assays, including the increasingly common real-time systems, have been developed for DENV detection and serotype identification with a high level of sensitivity and specificity , , –. Coupled with automated RNA extraction protocols, these assays can now facilitate the faster and more accurate diagnosis of dengue suspected cases. It has been a common practice that an RT-PCR negative result during the acute phase of illness requires the collection of a second, convalescent sample to be tested for the presence of IgM anti-DENV antibodies. However, with RT-PCR assays becoming more sensitive, faster and affordable, it is now more feasible to diagnose dengue on the single sample obtained during the patient's first visit to the clinician.
Among each DENV serotype, several distinct genetic lineages designated as genotypes have been identified and differ by approximately 5–6% in their genomic sequence –. This genotype variability has been associated with the evolution of DENV over a wide geographic distribution and occasionally with epidemic potential –. Consequently, molecular diagnostic tools should consider the genomic sequence variability among circulating strains of current genotypes.
Nucleic acid detection tests for dengue diagnosis were first developed over 20 years ago  and have been generally used for research, but not validated for diagnostic use in the US or globally. Although the most effective method to diagnose dengue in the acute phase of the illness recommended by the WHO (WHO dengue guidelines 2009) is detection of DENV RNA, widespread use of dengue molecular diagnostics has been hampered by lack of validated tests and testing capability, perceptions that molecular diagnostics are cost prohibitive compared to immunoassays and lack of recommendations for their use.
To meet some of the challenges that have limited the use of dengue molecular diagnostics in the US and the world, we developed the CDC DENV-1–4 Real-Time RT-PCR Assay and carried it thorough the FDA 510K process for approval as an in vitro diagnostic device for human patient diagnosis of dengue. This test runs on the same instrumentation, software, and reagents used by other Centers for Disease Control and Prevention (CDC) diagnostic platforms approved by the FDA, such as the CDC Human Influenza Real-Time RT-PCR Diagnostic Panel (cat# KT0096) (http://www.cdc.gov/media/releases/2011/p0902_diag_lab.html). Here, we report the performance of this assay, including its capability to detect DENV from multiple lineages, and the clinical sensitivity and specificity for diagnosis in dengue suspected human cases.
Materials and Methods
Serum samples for the clinical performance studies were obtained from the Dengue Surveillance System sample collection under guidelines approved by the CDC institutional review board (IRB). Patients did not provide verbal or written consent for this study. Samples were de-linked from patient identifiers according to CDC's IRB.
Dengue Virus Isolates
Several DENV panels were used to evaluate the analytical performance of the RT-PCR Assay. A 5 replica panels of eight 1∶10 dilutions of quantified (GCE/mL) laboratory-adapted, heat inactivated DENV strains (DENV-1 Haw, DENV-2 NGC, DENV-3 H87, DENV-4 H241) were prepared in human serum or plasma (Bioreclamation Inc). A second panel consisted of 29 DENV-1–4 isolates obtained from serum samples from patients residing in different countries world-wide, cultured, and quantified as described previously . Briefly, serum was inoculated into C6/36 (Aedes albopictus) cell culture maintained in Dulbecco's Minimal Essential Medium and incubated at 33°C for 5 days. The quantified stocks were diluted in human serum at 1∶10 dilutions down to 102 GCE/mL. Triplicate samples of each dilution were tested. Serum samples were collected under guidelines approved by the CDC IRB.
Virus Stock Quantification
In vitro-transcribed RNA was used as the copy number control to quantify stocks of laboratory-adapted DENV strains as previously described . Briefly, templates were developed by amplifying DENV-1–4 using the same corresponding primer pairs in the CDC DENV-1–4 Real Time RT-PCR Assay (Table 1) and cloned into a TOPO TA vector (Invitrogen, cat# K4600-01). Target RNA was transcribed with T7 RNA polymerase using AmpliScribe T7 Flash Transcription Kit (Epicentre, cat# ASF3257). The resulting RNA was quantified by spectrophotometry and expressed as genome copy equivalents per mL (GCE/mL).
CDC DENV-1–4 Real Time RT-PCR Assay
The Assay includes a set of oligonucleotide primers and dual-labeled 5′-fluorescent (Taqman) probes for in vitro, qualitative detection of DENV-1–4. The targeted regions of DENV RNA are transcribed into complimentary DNA (cDNA) and amplified by the polymerase chain reaction (PCR). The fluorophore-labeled probes anneal to amplified DNA fragments and the fluorescent signal intensity is monitored by the ABI 7500 Fast Dx instrument during each PCR cycle. Target amplification is recorded as increase and accumulation of fluorescence over time in contrast to background signal. The assay can be run in singleplex (each DENV serotype detected in a separate reaction) or in multiplex (the four DENV serotypes are run in the same reaction) formats facilitated by the targeting of each DENV serotype with a different colored probe, i.e. each Taqman probe targets a single DENV serotype and is conjugated to a fluorophore that emits fluorescence at different excitation wavelengths: 5′-FAM DENV-1 BHQ1-3′, 5′HEX DENV-2 BHQ1-3′, 5′-TR DENV-3 BHQ2-3′, and 5′-Cy5 DENV-4 BHQ3-3′. All validations in this study were performed using the CDC DENV-1–4 Real Time RT-PCR Assay in accordance to the manufacturer's instructions (Package Insert, KK0128 available at www.cdc.gov/dengue). Viral RNA was extracted using the QIAamp DSP Viral RNA Mini kit (Qiagen cat# 61904) following manufacturer's suggested protocol. All RT-PCR reactions were performed and validated using SuperScript III Platinum One-Step Quantitative RT-PCR System without Rox (Invitrogen, cat# 11732-088). To assemble a multiplex RT-PCR reaction, 5 µL of RNA were mixed with the following reagents: 2.2 µL of nuclease-free H2O, 12.5 µL of 2× premix, 0.5 µL of forward and reverse primers for DENV-1 and DENV-3 (final concentration 1 µM), 0.25 µL of forward and reverse primers for DENV-2 and DENV-4 (final concentration 500 nM), 0.45 µL of each Taqman probe (final concentration 180 nM), and 0.5 µL of SuperScript III RT/Platinum Taq mix to a final reaction volume of 25 µL. Individual reactions were run in either 8-tube optical strips or 96-well plates and placed in the ABI 7500 FAST Dx thermocycler (Applied Biosystems, cat# 4406985). The standard cycling method was selected and fluorescence capture set to detect emissions through the FAM, HEX, Texas Red, and CY5 channels in each well. Thermocycling parameters were as follows: reverse transcription (RT) at 50°C for 30 min, RT inactivation at 95°C for 2 min and fluorescence detection for 45 cycles of 95°C for 15 seconds and annealing at 60°C for 1 min. Amplification curves were evaluated by serotype and the threshold line placed above overt background signal, usually intersecting the initial exponential phase of the curve for each serotype individually. Amplification curves with CT values >37 render erratically and are difficult to ascertain with increasing CT values; therefore present unreliable results and were considered negative.
RNA Extraction Methods
Several viral RNA extraction methods, manual or automated, were validated for use with this assay. The QIAamp DSP Viral RNA Mini kit (Qiagen, cat# 9001292), used manually or in the automated QIAcube and the MagNA Pure LC 2.0 automated system (Roche, cat# 05-197-686-001) were extensively validated. Additional kits and platforms were tested and found to have similar performance, including QIAamp Viral RNA mini kit (Qiagen, cat#s 52904 and 52906) manual or on QIAcube; the automated BioRobot Universal System (Qiagen, cat# 9001094); the automated BioRobot M48 System (Qiagen, cat# 9000708).
Sequence and Phylogenetic Analysis
Sequencing of the DENV envelope glycoprotein (E) gene was performed as a comparative method to confirm diagnostic results obtained with the assay. The E gene (1,485 bp) from every isolate was sequenced. Briefly, E gene was amplified using BluePrint One-Step RT-PCR kit (Takara #RR755A) with serotype-specific primers following manufacturer suggested protocol. The sequences were determined by BigDye Terminator v3.1 Cycle sequencing kit (Life Technologies, cat#4337455) following manufacturer suggested protocol and bi-directional Sanger method. All amplification and sequencing primers are listed in Supporting Table S1. The coding sequences were assembled using SeqMan found in DNASTAR Lasergene 9 Core Suite (http://www.dnastar.com/t-products-lasergene.aspx). All sequence alignments were performed using the ClustalW module from MEGA5 (www.megasoftware.net). Phylogenetic analyses were performed by generating maximum likelihood trees under the GTR+I+Γ4 nucleotide substitution model available in MEGA5. GenBank accession numbers are available upon request.
Clinical Performance Studies
A total of 86 acute serum samples were collected from febrile patients in Puerto Rico and Costa Rica (2009–2011) suspected of having dengue 0–5 days after onset of symptoms and whose average age was 14.3 years, in a study approved by the CDC IRB. Viral RNA was extracted using the Qiagen QIAamp DSP Viral RNA Mini Kit following the manufacturer's protocol. Viral RNA was tested by the multiplex format of the RT-PCR Assay and results were confirmed by DENV E gene sequencing. No convalescent specimens were obtained from these patients to test for IgM anti-DENV seroconversion. The CDC DENV-1–4 Real-Time RT-PCR Assay was further evaluated by testing 371 archived, paired acute and convalescent serum samples obtained (2007–2011) from CDC's routine passive dengue surveillance system in Puerto Rico and 19 countries: Trinidad and Tobago, St. Martin, Venezuela, Mexico, Colombia, Brazil, Dominican Republic, India, Barbados, Samoa, Haiti, Ecuador, Costa Rica, Grenada, Honduras, Thailand, and other Netherland Antilles in accordance with a CDC IRB approved protocol. The convalescent samples, all collected at least 6 days after onset of symptoms, were tested with the IgM anti-DENV Capture Enzyme Linked Immunosorbent Assay (CDC MAC-ELISA) .
The following twelve organisms in the differential diagnosis of patients with a febrile illness suspected of dengue were selected for the specificity validation: West Nile Virus (WNV), yellow fever virus (YFV), St. Louis encephalitis virus (SLEV), Chikungunya virus (CHIKV), herpes simplex virus 1 and 2 (HSV-1-2), cytomegalovirus (CMV), varicella zoster virus (VZV), and bacterial organisms Leptospira, and Borrelia. These pathogens were obtained from CDC repositories.
Laboratory-grade, human endogenous interferent biomolecules were obtained and diluted in normal human serum to the following physiologically relevant pathological concentrations: bilirubin (342 µmol/L), cholesterol (13 mmol/L), hemoglobin (2 g/L), triglycerides (37 mmol/L) and genomic DNA (400 µg/100 mL). These concentrations follow guidelines published by the National Committee for Clinical Laboratory Standards (NCCLS), EP7-A2 (2005).
The CDC DENV-1–4 Real-Time RT-PCR Assay was designed to detect a wide variety of current clinically relevant strains of DENV-1, -2, -3, and -4 RNA in serum or plasma. Each probe was labeled with a distinct fluorophore-color allowing the simultaneous detection of the four DENV serotypes in a single reaction. The RT-PCR reactions can be assembled in singleplex or multiplex formats; both of these formats have been shown to provide equivalent sensitivity. The assay kit includes a positive control virus mix, which consists of heat-inactivated DENV-1 Haw, DENV-2 NGC, DENV-3 H87, and DENV-4 H241, and an assay internal control, termed Human Specimen Control (HSC). HSC consists of non-infectious cultured human cell material derived from the A549 cell line supernatant that tests positive for the presence of human RNaseP RNA (RP). RP RNA is present in most clinical samples and a positive signal confirms the integrity of the extraction reagents and the successful recovery of RNA. The sequence of primers and probes for both, HSC and RP, were obtained from the CDC Human Influenza Virus Real Time RT-PCR Diagnostic Panel (cat# KT0096).
The primers and probes used in the Assay were originally based on sequences previously published by Johnson et al., 2005 , however, significant modifications were introduced to increase complementarity with contemporary DENV sequences available in GenBank (Table 1). We selected 48 DENV-1, 50 DENV-2, 51 DENV-3, and 18 DENV-4 complete genome sequences as design templates from viruses isolated between 1998–2012, representing contemporary genotypes, and covering a wide geographical distribution. Figure 1 shows maximum likelihood trees representing the phylogeny of currently circulating lineages of each DENV serotype. Every primer and probe of the new CDC DENV-1–4 RT-PCR was compared to the corresponding serotype alignment and determined the frequency of every base in the oligonucleotide. Mismatches between PCR oligonucleotides and the sequence alignments were attended to as follows: degeneracy was introduced in a given nucleotide position when mismatch was 30% or greater between 2 or more strains; a base was replaced by another fixed base when mismatch was 90% or greater between 2 or more strains in a given position. International Union of Pure and Applied Chemistry (IUPAC) codes were used for all degenerate bases. The modified primer and probe sequences in the CDC DENV-1–4 Real-Time RT-PCR Assay are shown in Table 1 compared to the previously published sequences. The frequency in which each nucleotide position is matched to the representative strains of every serotype is also indicated. Additional information includes: target gene per serotype, target positions of every oligonucleotide relative to genome, and length of the amplicons. We found low probability of homodimer or heterodimer formation using OligoAnalyzer 3.1 (www.idtdna.com/analyzer) with predicted ΔG≥−9 kcal/mol between most oligonucleotide pair combination considering multiplex reaction conditions. This was confirmed experimentally running multiple oligonucleotide combinations in non-template control reactions and after the evaluation of all our clinical and analytical sample panels.
Representative DENV strains from currently circulating genotypes considered for primer and probe modifications. Full genome sequences were used. Each taxa is labeled: country of origin, year of isolation, and GenBank accession number. Due to figure space limitations, only a representative subset of strains were used to generate these ML trees. DENV-1 Asian (I) and American-African (III) genotypes , DENV-2 Asian I (IIIa), American-Asian (IIIb), and Cosmopolitan (IV) genotypes , DENV-3 South Pacific (I), Thailand (II), and Indian Subcontinent (III) genotypes , , DENV-4 Southeast (I) and Indonesian (II) genotypes .
Once the Assay was designed and optimized, we compared performance and sensitivity against the real time RT-PCR assay designed by Johnson et al., 2005. In vitro transcribed RNA derived from the target regions was used as template and spiked normal human serum: 8 serial dilutions 1∶10, 5 replicates. Both assays were simultaneously run with the same samples in singleplex and multiplex formats according to each suggested protocol. The concentrations of virus RNA detected were measured in GCE/reaction. The CDC Real Time DENV-1–4 RT-PCR assay outperformed the Johnson 2005 assay detecting 10-fold less target RNA in 100% of the replicates in DENV-1 and DENV-2 singleplex format and DENV-1, -2, and -4 in multiplex format (Figure 2A and B respectively). Efficiency of amplification and overall performance was similar between both assays.
Performance and sensitivity of the assay was compared to the Johnson et al., 2005 real time RT-PCR assay by detection of (8) ten-fold dilutions of in vitro transcribed RNA derived from target regions, 5 replicas per dilution. Both assays, CDC and Johnson 2005, were performed in singleplex (A) and multiplex (B) formats. Viral RNA was quantified using a standard curve measured in genome copy equivalents per RT-PCR reaction (GCE/rx) log transformed for linear scale plotting. Each data point reflects the average CT of 5 replicates. A linear regression was estimated for CDC (black solid lines) and Johnson 2005 (black dashed lines). Regression coefficient (R2) is shown for every regression and every serotype. Error bars indicate standard deviation.
Limit of Detection
The limit of detection (LoD) was defined as the last dilution in which virus was detected in all replicates and 100% reproducibility can be guaranteed. The LoD of the assay was determined using a panel of quantified (GCE/mL) DENV stocks diluted in human serum or plasma for eight 1∶10 dilutions with 5 replicates of each dilution. Viral RNA from every replicate was extracted and tested following the package insert protocol. The RT-PCR Assay was run quantitatively to compare the LoD of different assay formats. The amount of serum sample processed for RNA extraction, the RNA elution volume, and the amount of RNA elution added per RT-PCR reaction were considered in order to calculate the viral RNA concentration per reaction and converted to units per mL of serum. Virus detection, measured in genome copy equivalents per mL of sample (GCE/mL), was compared between virus dilutions in human serum and plasma in singleplex and multiplex formats (Figures 3A and B, respectively). Viral RNA was occasionally detected in dilutions with 1×102-1×101 GCE/mL; however the LoD was determined to be between 1×104 and 1×103 GCE/mL for all serotypes in both formats in serum and plasma.
The limit of detection of the Assay was evaluated by detection and quantification of (8) ten-fold dilutions of laboratory-adapted DENV-1–4 strains, 5 replicas per dilution. The Assay was performed in singleplex (A) and multiplex formats (B). Viral RNA concentration was quantified using a standard curve measured in genome copy equivalents per milliliter of serum or plasma (GCE/mL). A linear regression was estimated for dilutions of virus stocks in plasma (dashed lines) or serum (solid line). Regression coefficient (R2) is shown for each serotype. Error bars indicate standard deviation of measurements from 5 replicas in GCE/mL.
Viral RNA extractions were performed using the Qiagen QIAamp DSP Viral RNA Mini Kit in the initial evaluations and compared with other manual or automated viral RNA extraction kits. The performance of each kit was measured by extracting viral RNA from a similar panel of viruses diluted in human serum. The lowest titer of RNA detection from each kit was determined as shown in Supporting Table S2. Virus concentrations at the LoD dilution (1×103 GCE/mL) or at a 1∶10 dilution below the LoD (1×102 GCE/mL) were detected for each virus-type. These results validate comparable levels of DENV-1–4 RNA detection after viral RNA extraction with the selected methods.
The RT-PCR Assay was evaluated to determine detection of contemporary DENV strains from a broad geographical distribution at a LoD comparable to the reference panel described above. 29 DENV-1–4 strains from global locations were cultured, quantified and serial 1∶10 dilutions in human serum down to 1×102 GCE/mL were tested in triplicate. The observed LoD was similar to that obtained from the reference panel described above (Table 2).
The analytical specificity of the assay was evaluated by testing the nucleic acid extracted from the 12 organisms described in Methods, in triplicate, to determine if a positive signal was generated compared to samples spiked with DENV. No sample, except those containing DENV, produced a positive signal; therefore no cross-reaction was observed (Table 3).
In order to evaluate if DENV RNA detection is interfered by the presence human endogenous biomolecules, pathological concentrations of a selection of biomolecules were prepared in normal human serum. Each preparation was then spiked with the cultured DENV-1–4 laboratory-adapted strains mentioned above at concentrations of 1∶10 above the LoD (1×104 GCE/mL), equal to the LoD (1×103 GCE/mL), and 1∶10 below the LoD (1×102 GCE/mL). None of the tested biomolecules showed any significant interference in DENV detection (Table 4).
Carry Over or Cross Contamination
To evaluate possible cross-contamination of samples while performing the Assay, we used a panel of DENV-1–4 at high positive (107 GCE/mL) and below LoD (5×102 GCE/mL) concentrations, respectively. Samples below LoD are composed of normal human serum spiked with DENV to a concentration just below the LoD. Eight replicates of the high positive and below LoD DENV concentrations were extracted using the Qiagen QIAamp DSP Viral RNA Mini Kit and tested in alternating series. All negative samples tested negative (32/32) and all DENV positive samples tested positive for DENV (32/32) (Table 5). Several below LoD samples produced CT values >37 that may correspond to detection of DENV RNA; however these results are not 100% reproducible.
Result reproducibility was evaluated at the CDC Dengue Branch and two external public health laboratories: the Puerto Rico Department of Health and the National Reference Laboratory in Costa Rica. Operator to operator, run to run, and site to site reproducibility was evaluated using five test panels which include negative, below LoD, low positive, and moderate positive samples. Cultured and quantified (GCE/mL) stocks of heat-inactivated laboratory strains DENV-1–4 were used in the panel. Two different operators tested each sample in the panel twice a day for at least 5 days. Each operator ran the entire panel twice. Every sample in the test panel was blinded for each operator, run, and device. Two different RNA extraction methods previously validated for the assay were used in the study. The CDC Dengue Branch Laboratory and one external site used the Qiagen QIAamp DSP Viral RNA Mini Kit and the second external site used the Roche MagNA Pure LC Total Nucleic Acid Isolation Kit following the manufacturer's protocol. Results of high reproducibility were obtained from each site and compared to determine the proportion agreement with the expected results (Table 6).
86 acute phase (0–5 days of illness: 8 DPO = 1; 12 DPO = 2; 22 DPO = 3; 29 DPO = 4; 15 DPO = 5; Avg DPO = 3.3, Std Dv = 1.2) serum samples were tested in the multiplex format of the assay and corroborated by E gene sequencing. A total of 48 samples produced positive sequence results, of which 47 were positive on the RT-PCR Assay (16 DENV-1, 11 DENV-2, 5 DENV-3 and 15 DENV-4). The single discordant sample was identified as DENV-3 by sequencing. The 38 samples with RT-PCR negative results in the Assay were also negative by sequencing. Applying sequencing as the reference method, the RT-PCR Assay had a 97.92% positive agreement and 100% negative agreement (Table 7). All samples tested positive for the RP control.
Of the 371 serum samples (0–5 days of illness: 36 DPO = 1; 56 DPO = 2; 81 DPO = 3; 115 DPO = 4; 83 DPO = 5; Avg DPO = 3.4, Std Dv = 1.2) tested in this evaluation, 102 had IgM anti-DENV seroconversion in the convalescent specimen. 100 out of these 102 samples were positive in the RT-PCR Assay using the multiplex format (98.04% positive agreement). Of the 2 discordant samples, one was positive for DENV-3 by singleplex and further confirmed by E gene sequencing. The other discordant specimen was repetitively negative by multiplex and singleplex, but DENV-3 positive by sequencing. Of the 269 samples with an IgM anti-DENV negative convalescent sample, 265 were negative by the RT-PCR Assay (98.51% negative agreement; Table 8); however, the remaining four samples were positive by sequencing (2 DENV-3 and 2 DENV-4). All serotypes were identified in this study (26 DENV-4, 29 DENV-2, 22 DENV-3 and 23 DENV-4) and all 371 samples had a RP positive control reaction.
Performance in Fresh vs. Frozen Specimens
To determine the effect of temperature variations on Assay performance, we compared detection of DENV-spiked human serum samples after multiple freeze/thaw cycles. Moderate and low positive dilutions were prepared in triplicate, frozen at −80°C for 24 hours, and subjected to five consecutive freeze/thaw cycles. Once thawed, every sample was processed according to the Assay protocol. We obtained a 100% qualitative agreement between the initial and post freeze/thaw cycle (1, 2, 3, 4, and 5) detection results (Supporting Figure S1).
Early diagnosis of dengue based on a single serum sample obtained in the febrile phase of the illness has been a challenge for the public health and clinical communities. The commonly used IgM anti-DENV test is only capable of diagnosing dengue upon the rise of the antibody response, usually after 4–5 days upon illness onset. NS1 antigen detection tests are not serotype-specific and recent evaluations suggest that they are not highly sensitive and are best utilized at defervescence , . The presence of DENV viremia during the first 5 days of illness renders molecular methods optimal for dengue diagnostics. The development of the CDC DENV-1–4 Real-Time RT-PCR Assay for the detection and serotyping of DENV facilitates dengue diagnosis in both the clinical and public health surveillance settings. In addition, the evaluation and approval of this diagnostic platform by the FDA provides a benchmark for other DENV detection assays.
The CDC DENV-1–4 Real-Time RT-PCR Assay was developed over the same diagnostic platform used by other CDC-developed, FDA-approved diagnostic platforms including the CDC Human Influenza Virus Real-time RT-PCR Diagnostic Panel (cat# KT0096). During and after the influenza A H1N1 pandemic in 2009, many national and international laboratories acquired the CDC flu diagnostic platform through a dedicated network for supplies distribution, including the recommended ABI 7500Dx thermocycler. The CDC DENV-1–4 Real Time RT-PCR Assay was designed to be compatible and utilize the same reagents and equipment, such that laboratories that previously acquired the CDC flu platform can now acquire the DENV assay with minimal investment through a similar network for supplies. An important caveat is that the dengue platform requires a 4-color real time thermocycler even if the assay is run in singleplex format. Since the approval of the CDC DENV-1–4 RT-PCR assay in May 2012, more than 100 public health laboratories worldwide have begun to run this Assay, resulting in decentralization and uniformity of dengue diagnosis. The implementation of this sensitive test for early diagnosis of dengue strengthens laboratory surveillance and allows the diagnosis and management of a higher proportion of dengue cases faster, possibly defining outbreaks more promptly.
Our evaluation shows that the CDC DENV-1–4 Real Time RT-PCR Assay confirms more than 90% of dengue cases. Although the analytical sensitivity of this Assay is comparable among other real time RT-PCR-based diagnostic assays, this Assay was designed to detect viruses from a wide geographical distribution identified during recent outbreaks, significantly enhancing the capacity to detect a wide range of DENV genetic variants. This design distinguishes the CDC Assay from other published assays that are mostly based on laboratory-adapted DENV strains originally isolated decades ago and belonging to extinct or rarely transmitted genotypes , , , . The ability to detect a wide range of international DENV strains provides diagnostic laboratories the capacity to detect DENV introductions or resolve traveler-associated cases.
Our sequence analysis considered the 5–6% genomic difference between genotypes and predicted that the significant number of mismatches would impair the successful detection of many contemporary strains when an assay is designed based on prototype strains. In order to achieve detection of DENV strains with high genetic divergence, we compared the target genetic sequence of a large number of contemporary DENV strains from a wide geographic distribution to the primers and probes of the CDC DENV-1–4 Real-Time RT-PCR Assay. Oligonucleotide positions with frequent mismatches were substituted with degenerate nucleotides; therefore the primer and probe mix contains a cocktail of oligonucleotides with 2 or more different nucleotide options at the degenerate base position. This cocktail of oligonucleotide sequences within the same primer mix is expected to increase the probability of finding a complete match between primer and target virus sequence, consequently increasing the likelihood of detecting virus strains with a high degree of genetic divergence. Other assays have incorporated the use of nucleic acid degeneracy, however these assays were based on laboratory-adapted strains , required long, labor-intensive protocols ,  or are not capable of serotype identification .
These evaluations also demonstrated the high specificity of this Assay which did not produce false DENV positive or false negative results even in samples from patients affected by diseases in the differential diagnosis of dengue nor the presence of interfering substances at pathogenic levels. The analytical performance of this Assay showed comparable sensitivity detecting the four DENV serotypes in both the singleplex and multiplex formats, which allows users to run only one test per sample and maximize use of reagent, consumables and equipment. Minimal cross-reactivity between oligonucleotides in the multiplex reaction is expected in this type of format and was observed at high CTs (>37) in some non-template controls. This could also explain the differences in sensitivity (≤1 log) between serotypes and formats. The PCR reaction in this Assay targets a different genomic region for each serotype; therefore different reaction efficiencies, which may affect amplification and sensitivity, are expected. Users of this Assay will have the capability of diagnosing dengue with confidence among undifferentiated or acute febrile patients. Moreover, we show that the capacity of this Assay to detect DENV RNA even on samples that have endured multiple freeze-thaw cycles, thus demonstrating that this Assay can be used with confidence on archival or mishandled samples. Two independent indicators were used to assess the performance of the RT-PCR Assay: sequencing of the E gene from DENV RNA in the same sample where the RT-PCR was performed, and IgM anti-DENV seroconversion in paired samples from each case. Of the 4 non-concordant, a possible explanation is that IgM anti-DENV was not detected in the convalescent samples due to low levels of IgM antibodies in secondary DENV infections. Further studies are needed to determine the true frequency of this observation and establish the proportion of RT-PCR positive cases beyond the first 5 days of illness. Importantly, the sensitivity of the E gene sequencing has not been extensively evaluated for its potential as a diagnostic test or its sensitivity and it has served in this study as an additional comparator to confirm DENV serotype detection in acute samples due to lack of more sensitive tests for dengue.
The inclusion of the RP control in the RT-PCR Assay further facilitates results interpretation. The RP reaction detects human RNA and could potentially detect DNA; however the viral RNA extraction eliminates must of the contaminating DNA. Importantly, samples with a positive DENV result should be considered positive even when they may occasionally have a RP negative control. However a DENV negative result on a sample with RP-negative should be considered inconclusive since this result is likely due to poor RNA extraction or sample quality; such samples should be retested. Despite the high sensitivity, a negative RT-PCR result does not preclude the diagnosis of dengue and should not be used as a sole basis for treatment or other patient management decisions. If results of the DENV RT-PCR Assay are negative during an acute dengue-like illness, anti-DENV IgM testing should be considered.
The adaptation of the CDC DENV-1–4 Real-Time RT-PCR Assay for use on the ABI 7500 FAST Dx thermocycler using readily available reagents provides the end-user a dengue diagnostic capability over an operating platform already available in many clinical and reference diagnostic laboratories. Development of diagnostic platforms evaluated by a rigorous regulatory authority such as the FDA should encourage and benchmark development of other assays to meet the needs of dengue endemic areas. It is clear that platforms with similar performance characteristics are needed for different clinical care setting in order to improve case management and disease surveillance. Laboratories equipped with other thermocyclers are encouraged to validate this Assay within their particular technical capabilities. For a high incidence disease such as dengue, which could potentially become a vaccine-preventable disease in the future, diagnostic tests with similar performance to the CDC RT-PCR Assay are needed for resource-limited areas that are instrument independent or that require minimal instrumentation.
Checklist prepared to indicate the specific page in which each part of the study can be found in this manuscript.
Assay performance in fresh vs. frozen samples. Moderate (black circle) and low (black square) positive concentrations of laboratory-adapted DENV strains diluted in serum were frozen at −80°C for 24 hrs and subject to five consecutive freeze/thaw cycles. Detection measurements are shown in CT values and error bars indicate standard deviation. Dashed line shows the threshold of positivity at CT = 37.
Two flowcharts were created to indicate the diagnostic algorithm used in the Retrospective and Prospective studies in which the performance of the CDC DENV-1–4 Real Time RT-PCR Assay was evaluated.
DENV E gene amplification and sequencing primers. List of all primer sequences used for E gene amplification and sequencing. Corresponding serotype, specific primer function and final concentration per reaction are indicated. Every primer is labeled with serotype and genome position. Reverse primers are labeled (cD).
Performance of the CDC DENV-1–4 Real Time RT-PCR Assay using different viral RNA extraction methods. Viral RNA from serial dilutions of stock quantitated DENV-1–4 was extracted using several viral RNA extraction kits. The lowest virus titer detected is indicated in genome copy equivalents per mL (GCE/mL).
We thank Dr. Julie Villanueva and Dr. James Johnson from the CDC Influenza Division for advice during the developmental stages of the Assay and critical review of the data, and Susan E. Hollingsworth and Hye-Joo Kim from the CRC Office of Regulatory Affairs for their valuable work during the 510K process, and the Puerto Rico Department of Health and the National Reference Laboratory of Costa Rica for their participation in the reproducibility studies. We also thank members of the CDC Dengue Branch Serology Laboratory and Epidemiology Activity whose previous work provided the characterized samples used in these studies; Luis Manuel Santiago for his statistical advice, and members of the CDC Arboviral Diseases Branch for sequencing of samples in this study.
Conceived and designed the experiments: GAS EV JLMJ. Performed the experiments: GAS EV YQ JC JV JFM FM. Analyzed the data: GAS EV FM CC. Contributed reagents/materials/analysis tools: CC HM. Wrote the paper: GAS HM JLMJ.
- 1. Gubler DJ (2002) Epidemic dengue/dengue hemorrhagic fever as a public health, social and economic problem in the 21st century. Trends Microbiol 10: 100–103.
- 2. World-Health-Organization (2010) Impact of Dengue. http://www.who.int/csr/disease/dengue/impact/en/index.html.
- 3. Bhatt S, Gething PW, Brady OJ, Messina JP, Farlow AW, et al. (2013) The global distribution and burden of dengue. Nature 496: 504–507.
- 4. Guzman MG, Halstead SB, Artsob H, Buchy P, Farrar J, et al. (2010) Dengue: a continuing global threat. Nat Rev Microbiol 8: S7–16.
- 5. Sharp TM, Pillai P, Hunsperger E, Santiago GA, Anderson T, et al. (2012) A cluster of dengue cases in American missionaries returning from Haiti, 2010. Am J Trop Med Hyg 86: 16–22.
- 6. Mohammed HP, Ramos MM, Rivera A, Johansson M, Munoz-Jordan JL, et al. (2008) Travel-associated dengue infections in the United States, 1996 to 2005. J Travel Med 17: 8–14.
- 7. Ayala A, Rivera A, Johansson M, Muñoz-Jordán JL (2006) Travel-Associated Dengue -United States, 2005. MMWR 55: 700–702.
- 8. Condon R, Taleo G, Stewart T, Sweeney T, Kiedrzynski T (2000) Dengue surveillance in the Pacific Islands. Pac Health Dialog 7: 122–126.
- 9. Radke EG, Gregory CJ, Kintziger KW, Sauber-Schatz EK, Hunsperger EA, et al. (2012) Dengue outbreak in Key West, Florida, USA, 2009. Emerg Infect Dis 18: 135–137.
- 10. Centers for Disease C, Prevention (2010) Locally acquired Dengue–Key West, Florida, 2009–2010. MMWR Morb Mortal Wkly Rep 59: 577–581.
- 11. Franco C, Hynes NA, Bouri N, Henderson DA (2010) The dengue threat to the United States. Biosecur Bioterror 8: 273–276.
- 12. Ramos MM, Mohammed H, Zielinski-Gutierrez E, Hayden MH, Lopez JL, et al. (2008) Epidemic Dengue and Dengue Hemorrhagic Fever at the Texas-Mexico Border: Results of a Household-based Seroepidemiologic Survey, December 2005. Am J Trop Med Hyg 78: 364–369.
- 13. Brunkard JM, Robles Lopez JL, Ramirez J, Cifuentes E, Rothenberg SJ, et al. (2007) Dengue Fever Seroprevalence and Risk Factors, Texas-Mexico Border, 2004. Emerg Infect Dis 13: 1477–1483.
- 14. Effler PV, Pang L, Kitsutani P, Vorndam V, Nakata M, et al. (2005) Dengue fever, Hawaii, 2001–2002. Emerg Infect Dis 11: 742–749.
- 15. Steel A, Gubler DJ, Bennett SN (2010) Natural attenuation of dengue virus type-2 after a series of island outbreaks: a retrospective phylogenetic study of events in the South Pacific three decades ago. Virology 405: 505–512.
- 16. Descloux E, Cao-Lormeau VM, Roche C, De Lamballerie X (2009) Dengue 1 diversity and microevolution, French Polynesia 2001–2006: connection with epidemiology and clinics. PLoS Negl Trop Dis 3: e493.
- 17. Tomashek KM, Rivera A, Munoz-Jordan JL, Hunsperger E, Santiago L, et al. (2009) Description of a large island-wide outbreak of dengue in Puerto Rico, 2007. Am J Trop Med Hyg 81: 467–474.
- 18. Rigau-Perez JG, Ayala-Lopez A, Garcia-Rivera EJ, Hudson SM, Vorndam V, et al. (2002) The reappearance of dengue-3 and a subsequent dengue-4 and dengue-1 epidemic in Puerto Rico in 1998. Am J Trop Med Hyg 67: 355–362.
- 19. McElroy KL, Santiago GA, Lennon NJ, Birren BW, Henn MR, et al. (2011) Endurance, refuge, and reemergence of dengue virus type 2, Puerto Rico, 1986–2007. Emerg Infect Dis 17: 64–71.
- 20. Mohammed H, Ramos M, Armstrong J, Munoz-Jordan J, Arnold-Lewis KO, et al. (2010) An outbreak of dengue fever in St. Croix (US Virgin Islands), 2005. PLoS One 5: e13729.
- 21. Gregory CJ, Santiago LM, Arguello DF, Hunsperger E, Tomashek KM (2010) Clinical and laboratory features that differentiate dengue from other febrile illnesses in an endemic area–Puerto Rico, 2007–2008. Am J Trop Med Hyg 82: 922–929.
- 22. Gregory CJ, Tomashek KM (2012) Management of severe dengue. Pediatr Crit Care Med 13: 125 author reply 125–126.
- 23. Thomas L, Moravie V, Besnier F, Valentino R, Kaidomar S, et al. (2012) Clinical presentation of dengue among patients admitted to the adult emergency department of a tertiary care hospital in Martinique: implications for triage, management, and reporting. Ann Emerg Med 59: 42–50.
- 24. Low JG, Ong A, Tan LK, Chaterji S, Chow A, et al. (2011) The early clinical features of dengue in adults: challenges for early clinical diagnosis. PLoS Negl Trop Dis 5: e1191.
- 25. Chau TN, Anders KL, Lien le B, Hung NT, Hieu LT, et al. (2010) Clinical and virological features of Dengue in Vietnamese infants. PLoS Negl Trop Dis 4: e657.
- 26. Alexander N, Balmaseda A, Coelho IC, Dimaano E, Hien TT, et al. (2011) Multicentre prospective study on dengue classification in four South-east Asian and three Latin American countries. Trop Med Int Health 16(8): 936–48.
- 27. Organization WH (2009) Dengue guidelines for diagnosis, treatment, prevention and control. Geneva http://whqlibdoc.who.int/publications/2009/9789241547871_eng.pdf.
- 28. Tricou V, Minh NN, Farrar J, Tran HT, Simmons CP (2011) Kinetics of viremia and NS1 antigenemia are shaped by immune status and virus serotype in adults with dengue. PLoS Negl Trop Dis 5: e1309.
- 29. Dussart P, Petit L, Labeau B, Bremand L, Leduc A, et al. (2008) Evaluation of Two New Commercial Tests for the Diagnosis of Acute Dengue Virus Infection Using NS1 Antigen Detection in Human Serum. PLoS Negl Trop Dis 2: e280.
- 30. Bessoff K, Delorey M, Sun W, Hunsperger E (2008) Comparison of two commercially available dengue virus (DENV) NS1 capture enzyme-linked immunosorbent assays using a single clinical sample for diagnosis of acute DENV infection. Clin Vaccine Immunol 15: 1513–1518.
- 31. Hsieh CJ, Chen MJ (2009) The commercial dengue NS1 antigen-capture ELISA may be superior to IgM detection, virus isolation and RT-PCR for rapid laboratory diagnosis of acute dengue infection based on a single serum sample. J Clin Virol 44: 102.
- 32. Munoz-Jordan JL, Collins CS, Vergne E, Santiago GA, Petersen L, et al. (2009) Highly sensitive detection of dengue virus nucleic acid in samples from clinically ill patients. J Clin Microbiol 47: 927–931.
- 33. Gomes AL, Silva AM, Cordeiro MT, Guimaraes GF, Marques ET Jr, et al. (2007) Single-tube nested PCR using immobilized internal primers for the identification of dengue virus serotypes. J Virol Methods 145: 76–79.
- 34. Johnson BW, Russell BJ, Lanciotti RS (2005) Serotype-specific detection of dengue viruses in a fourplex real-time reverse transcriptase PCR assay. J Clin Microbiol 43: 4977–4983.
- 35. Lanciotti RS (2003) Molecular amplification assays for the detection of flaviviruses. Adv Virus Res 61: 67–99.
- 36. Chien LJ, Liao TL, Shu PY, Huang JH, Gubler DJ, et al. (2006) Development of real-time reverse transcriptase PCR assays to detect and serotype dengue viruses. J Clin Microbiol 44: 1295–1304.
- 37. De Simone TS, Nogueira RM, Araujo ES, Guimaraes FR, Santos FB, et al. (2004) Dengue virus surveillance: the co-circulation of DENV-1, DENV-2 and DENV-3 in the State of Rio de Janeiro, Brazil. Trans R Soc Trop Med Hyg 98: 553–562.
- 38. Hue KD, Tuan TV, Thi HT, Bich CT, Anh HH, et al. (2011) Validation of an internally controlled one-step real-time multiplex RT-PCR assay for the detection and quantitation of dengue virus RNA in plasma. J Virol Methods 177: 168–173.
- 39. Rico-Hesse R (2007) Dengue virus evolution and virulence models. Clin Infect Dis 44: 1462–1466.
- 40. Holmes EC, Twiddy SS (2003) The origin, emergence and evolutionary genetics of dengue virus. Infect Genet Evol 3: 19–28.
- 41. Rico-Hesse R (1990) Molecular evolution and distribution of dengue viruses type 1 and 2 in nature. Virology 174: 479–493.
- 42. Twiddy SS, Farrar JJ, Vinh Chau N, Wills B, Gould EA, et al. (2002) Phylogenetic relationships and differential selection pressures among genotypes of dengue-2 virus. Virology 298: 63–72.
- 43. Gubler DJ, Suharyono W, Lubis I, Eram S, Gunarso S (1981) Epidemic dengue 3 in central Java, associated with low viremia in man. Am J Trop Med Hyg 30: 1094–1099.
- 44. Leitmeyer KC, Vaughn DW, Watts DM, Salas R, Villalobos I, et al. (1999) Dengue virus structural differences that correlate with pathogenesis. J Virol 73: 4738–4747.
- 45. Lanciotti RS, Calisher CH, Gubler DJ, Chang GJ, Vorndam AV (1992) Rapid detection and typing of dengue viruses from clinical samples by using reverse transcriptase-polymerase chain reaction. J Clin Microbiol 30: 545–551.
- 46. Gubler DJ, Kuno G, Sather GE, Velez M, Oliver A (1984) Mosquito cell cultures and specific monoclonal antibodies in surveillance for dengue viruses. Am J Trop Med Hyg 33: 158–165.
- 47. Chao DY, Davis BS, Chang GJ (2007) Development of multiplex real-time reverse transcriptase PCR assays for detecting eight medically important flaviviruses in mosquitoes. J Clin Microbiol 45: 584–589.
- 48. Martin DA, Muth DA, Brown T, Johnson AJ, Karabatsos N, et al. (2000) Standardization of immunoglobulin M capture enzyme-linked immunosorbent assays for routine diagnosis of arboviral infections. J Clin Microbiol 38: 1823–1826.
- 49. Alcon S, Talarmin A, Debruyne M, Falconar A, Deubel V, et al. (2002) Enzyme-linked immunosorbent assay specific to Dengue virus type 1 nonstructural protein NS1 reveals circulation of the antigen in the blood during the acute phase of disease in patients experiencing primary or secondary infections. J Clin Microbiol 40: 376–381.
- 50. Naze F, Le Roux K, Schuffenecker I, Zeller H, Staikowsky F, et al. (2009) Simultaneous detection and quantitation of Chikungunya, dengue and West Nile viruses by multiplex RT-PCR assays and dengue virus typing using high resolution melting. J Virol Methods 162: 1–7.
- 51. Callahan JD, Wu SJ, Dion-Schultz A, Mangold BE, Peruski LF, et al. (2001) Development and evaluation of serotype- and group-specific fluorogenic reverse transcriptase PCR (TaqMan) assays for dengue virus. J Clin Microbiol 39: 4119–4124.
- 52. Henchal EA, Polo SL, Vorndam V, Yaemsiri C, Innis BL, et al. (1991) Sensitivity and specificity of a universal primer set for the rapid diagnosis of dengue virus infections by polymerase chain reaction and nucleic acid hybridization. Am J Trop Med Hyg 45: 418–428.
- 53. Sanchez-Seco MP, Rosario D, Hernandez L, Domingo C, Valdes K, et al. (2006) Detection and subtyping of dengue 1–4 and yellow fever viruses by means of a multiplex RT-nested-PCR using degenerated primers. Trop Med Int Health 11: 1432–1441.
- 54. Huhtamo E, Hasu E, Uzcategui NY, Erra E, Nikkari S, et al. (2010) Early diagnosis of dengue in travelers: comparison of a novel real-time RT-PCR, NS1 antigen detection and serology. J Clin Virol 47: 49–53.
- 55. Zhang C, Mammen MP Jr, Chinnawirotpisan P, Klungthong C, Rodpradit P, et al. (2005) Clade replacements in dengue virus serotypes 1 and 3 are associated with changing serotype prevalence. J Virol 79: 15123–15130.
- 56. Klungthong C, Zhang C, Mammen MP Jr, Ubol S, Holmes EC (2004) The molecular epidemiology of dengue virus serotype 4 in Bangkok, Thailand. Virology 329: 168–179.