2 Nov 2011: Poritz MA, Blaschke AJ, Byington CL, Meyers L, Nilsson K, et al. (2011) Correction: FilmArray, an Automated Nested Multiplex PCR System for Multi-Pathogen Detection: Development and Application to Respiratory Tract Infection. doi: info:doi/10.1371/annotation/468cfdcd-184c-42f7-a1d0-3b72a2f6a558 View correction
The ideal clinical diagnostic system should deliver rapid, sensitive, specific and reproducible results while minimizing the requirements for specialized laboratory facilities and skilled technicians. We describe an integrated diagnostic platform, the “FilmArray”, which fully automates the detection and identification of multiple organisms from a single sample in about one hour. An unprocessed biologic/clinical sample is subjected to nucleic acid purification, reverse transcription, a high-order nested multiplex polymerase chain reaction and amplicon melt curve analysis. Biochemical reactions are enclosed in a disposable pouch, minimizing the PCR contamination risk. FilmArray has the potential to detect greater than 100 different nucleic acid targets at one time. These features make the system well-suited for molecular detection of infectious agents. Validation of the FilmArray technology was achieved through development of a panel of assays capable of identifying 21 common viral and bacterial respiratory pathogens. Initial testing of the system using both cultured organisms and clinical nasal aspirates obtained from children demonstrated an analytical and clinical sensitivity and specificity comparable to existing diagnostic platforms. We demonstrate that automated identification of pathogens from their corresponding target amplicon(s) can be accomplished by analysis of the DNA melting curve of the amplicon.
Citation: Poritz MA, Blaschke AJ, Byington CL, Meyers L, Nilsson K, Jones DE, et al. (2011) FilmArray, an Automated Nested Multiplex PCR System for Multi-Pathogen Detection: Development and Application to Respiratory Tract Infection. PLoS ONE 6(10): e26047. doi:10.1371/journal.pone.0026047
Editor: Cristina Costa, University Hospital San Giovanni Battista di Torino, Italy
Received: July 27, 2011; Accepted: September 16, 2011; Published: October 19, 2011
Copyright: © 2011 Poritz et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by grants from the National Institutes of Health: National Institute of Allergy and Infectious Diseases: 1R43 AI063695-01 (SFD), U01 AI061611 (MAP, AJB, CLB), U01 AI074419 (SFD and CLB), 1K23-AI079401-01A1 (AJB) and the Eunice Kennedy Shriver National Institute of Child Health and Human Development: K24HD047249 (CLB); the H. A. and Edna Benning Society (CLB); the United States Air Force Surgeon General; and by funds from Idaho Technology. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: I have read the journal's policy and have the following conflicts: Several authors are current or former employees of Idaho Technology. PCT Applications WO2006/121997 and WO2008/140568 have been filed on aspects of the work described here. AJB, JD, AH and CLB collaborate with Idaho Technology, Inc., on several National Institutes of Health and Centers for Disease Control-funded projects (see funding). There are no other relevant declarations relating to employment, consultancy, patents, products in development or modified products. This does not alter our adherence to all the PLoS ONE policies on sharing data and materials.
The ability to rapidly detect and distinguish multiple infectious organisms is critical for the accurate diagnosis of seasonal and sporadic outbreaks, emerging pathogens and agents of bioterrorism , , , . Accurate pathogen identification allows clinicians to determine the need for additional ancillary diagnostic testing, antibacterial or antiviral therapy and can inform decisions regarding hospitalization and infection control measures , , , , .
Standard microbiological testing can require several days for initial identification of a pathogenic organism, and many organisms cannot be recovered using conventional techniques , . Molecular methods, particularly the polymerase chain reaction (PCR) have expanded the range of pathogens that can be identified in clinical laboratories. However, existing diagnostic assays and technologies are either limited in scope or highly complex .
Although it has many advantages, the introduction of PCR into the standard clinical microbiology and virology laboratory has been associated with practical challenges  that have limited routine use to large hospital or reference laboratories. Specialized training and facilities are required for technicians to perform PCR-based testing. For example, physically separated locations for sample preparation, formulation of reagents, reaction set up and amplification are needed to minimize the potential for contamination which can lead to false positive results. Even simple PCR platforms have instrument requirements that may challenge the capacity of clinical laboratories , , , .
PCR assays for infectious disease range from the relatively simple, in which a pathogen is identified by the detection of a single positive amplification product, to multiplex assays for groups of pathogens . Multiplex PCR allows the potential amplification of many nucleic acid targets within a single reaction , , , , , , , , , , and in theory is an ideal method for multi-pathogen detection. However, multiplex PCR has several practical limitations. Non-specific products generated through primer-primer interactions interfere with amplification of the actual targets and decrease sensitivity. In addition, as more true targets are amplified, it becomes increasingly difficult to distinguish the amplification products, although both bead-array and microchips have been used to accomplish this , , , , . These constraints have limited the ability of multiplex PCR to interrogate a large number of targets, and reports of more than 8-deep multiplexing are uncommon , , , , , , .
Despite the limitations, multiplex PCR strategies have already demonstrated clinical utility, particularly for detection and identification of pathogens causing respiratory tract infection , , , , , . Multiplex PCR is an attractive diagnostic option for respiratory infections for several reasons. The differential diagnosis of respiratory infections, such as bronchiolitis and pneumonia, includes a large number of potential pathogens that cause similar signs and symptoms , , . Further, conventional diagnostic testing for respiratory pathogens is limited by poor sensitivity or prolonged turnaround time of antigen or culture-based testing. Finally the emergence of novel pathogens that may result in severe disease, such as SARS and swine-origin influenza A (H1N1-2009), requires the availability of diagnostic testing with enough flexibility to introduce new targets rapidly.
Sensitivity of detection is another important consideration when developing diagnostic tests, as even very low levels of pathogen can cause disease. Nested PCR is an exquisitely sensitive methodology in which a target is amplified in a two-step process. In the first stage, a template is amplified using a pair of “outer” primers. This PCR product is diluted and subjected to a second stage amplification using primers located within the first PCR amplicon. The second stage product can be detected by real-time or end-product analysis. Nested PCR increases sensitivity over conventional PCR due to the ability to perform up to 50 or 60 total cycles of PCR. Specificity of nested PCR is similar to that of probe-based assays, as all 4 primers must match the template , , , , , , . Although the use of nested primer sets was described very early in the history of PCR  it has not been widely deployed in clinical settings because, in most systems, it is an open-tube procedure that is highly subject to self-contamination.
An integrated system that can interrogate a clinical sample for a broad range of pathogens is highly desirable in both diagnostic laboratory and clinical settings , , . Here we describe a novel diagnostic platform, the “FilmArray®”, which combines automated sample preparation, nucleic acid extraction and PCR-based detection of 31 separate targets from a single unprocessed sample in one hour. It combines nesting and multiplexing of the PCR (referred to here as nested multiplex or “nmPCR”) together with DNA melting curve analysis  to detect and distinguish multiple pathogens simultaneously. Because the sample manipulations and reactions are performed in an enclosed pouch, there is low risk of laboratory contamination. We detail our validation of the system using cultured respiratory pathogens and demonstrate its utility using clinical samples obtained from children with respiratory infections. The FilmArray and the FilmArray Respiratory Panel (RP) pouch have since received FDA clearance for use as an in vitro diagnostic (IVD) device.
Each FilmArray pouch is comprised of an injection molded polypropylene reservoir (the “fitment”, 120 mm long, 10 mm wide, 25 mm high, “A” in Figure 1B) heat welded to two sheets of a polyester/polypropylene film containing a copolymer adhesive layer. The sheets of film are welded together using heated plates to form the pattern of channels and “blisters” (“C” through “H” in Figure 1B) comprising the sample processing stations and an area containing a 102-well array for the second stage PCR. The fitment contains 12 reservoirs (6 mm inner diameter on 9 mm spacing) that hold the biochemical reagents. During pouch manufacture three additional reagents are inserted into the appropriate blisters of the pouch and the film is sealed shut under vacuum. Ceramic beads are inserted into the sample lysis blister (“C” in Figure 1). A lyophilized pellet of silica-magnetic beads is inserted into blister “E” (Figure 1). A lyophilized pellet of the oligonucleotides (Idaho Technology, Inc. (ITI)) used in the first stage multiplex PCR is inserted into blister “G”.
(A) A FilmArray pouch was injected with mock sample (here colored blue for illustrative purposes) in the left side injection port and hydration solution (colored red) in the right side injection port. (B) The blisters of a FilmArray pouch were filled with different coloring (and the channels between the blisters heat sealed shut). In this pouch the plunger tree was made from plastic dyed blue. The fitment and film are normally at right angles to each other; for clarity the pouch has been flattened. (C) A schematic of the pouch showing a trace of the blisters, channels and array wells (black) and the functional areas of the pouch (red).
The second stage PCR array is manufactured from 0.5 mm thick black polycarbonate plastic. 102 wells of 1 µl volume each are drilled into the array (“I” of Figure 1B and Figure 2). Laminating film is heat-sealed to the back of each array and 96 arrays are placed on a platen on the bed of a piezo-electric microarraying instrument (Nano-Plotter NP2.1e, GeSiM, Großerkmannsdorf, Germany). The second stage primer sets are dispensed into the wells of the array using the standard GeSiM Nano-Tip. After spotting, the arrays are sealed with a second layer of laminating film containing a matching array of holes (Figure 2) and then attached to the outside of the pouch (“I” in Figure 1) using pressure sensitive adhesive film.
The layers of film and adhesive attaching the array to the pouch are separated to show the flow of liquid into the cells of the array (figure is not to scale). From the top the layers are: 2nd pouch film, 1st pouch film, array adhesive layer (orange), pricked cover film, array (black, with wells), and array cover film. All of the actual layers are transparent except for the array itself. Second stage PCR primers are spotted into the cells during manufacture and air-dried (Methods). Arrows show the flow of PCR master mix (without primers) entering the array through a hole cut in the 1st pouch film.
All of the other biochemical reagents are freeze-dried into the 12 wells of the fitment. Moving from left to right in Figure 1 the wells contain:
Well 1: Process control material (Schizosaccharomyces pombe cells).
Wells 2, 3, 4, 5: Wash buffer
Well 6: Nucleic acid elution buffer.
Well 7: Reverse transcription/first stage PCR master mix:
Well 8: Dilution buffer
Wells 9, 10: Second stage PCR master mix: containing LCGreen® Plus+ (ITI),
Well 11: empty
Well 12: Overflow reservoir for the second stage PCR mix.
After these reagents are loaded into pouches a “plunger tree” (“B” in Figure 1B) is inserted into the fitment and the pouches are placed in a Genesis Lyophilizer (VirTis, Gardiner, NY). At the end of the lyophilization cycle, while the pouches are still under vacuum, the plunger tree is pushed down into the fitment so as to preserve the vacuum in each of the wells. To maintain the vacuum (in the fitment and blisters) during long term storage, pouches are packaged in a cylindrical aluminum can and sealed under vacuum inside an aluminized polyester bag. Vacuum storage of the pouch serves three functions. It helps to maintain the integrity of the freeze dried reagents during long term storage, it enables sample and hydration solution to be delivered in an unmetered fashion and it minimizes the formation of air bubbles in the pouch, which can be difficult to control or remove from microfluidic systems .
The FilmArray instrument is 39.1 cm long×25.4 cm wide×16.3 cm high, weighs 8.2 kg (Figure 3) and runs on 120–220 V AC power. It communicates with PC side software through USB and IEEE 1394 (Firewire™) cables. The instrument contains two Peltier devices to thermocycle the first and second stage PCR reactions, a blue LED to illuminate the second stage PCR array and a digital camera to record fluorescence generated in the second stage PCR.
The movement of liquid through the pouch is controlled by three pneumatic elements within the instrument. Pistons (located behind “B” in Figure 1) depress the plungers in the top of the fitment and thus inject reagents from the fitment into the pouch. Silicone bladders inflate over the pouch blisters to move liquid between blisters. Blunt edged pistons (“Hard seals”), positioned over the channels connecting the blisters control liquid movement between the blisters. Electronically controlled valves activate the pistons, bladders and hard seals in a coordinated pattern to regulate the flow of liquid through the pouch.
Nested PCR assay design
Organism related sequence information (complete genomes, gene sequences and partial gene sequences) was obtained from NCBI (http://www.ncbi.nlm.nih.gov). Regions containing large conserved segments of protein sequence or conserved 5′ UTR sequences (for human Rhinovirus (HRV) and Bordetella pertussis (B. per)) were selected for assay targets (Table 1). Nearest neighbor information was obtained through the NCBI Taxonomy database http://www.ncbi.nlm.nih.gov/Taxonomy ,  and used in alignments to ensure specificity of assay design. Assays were designed with a first stage PCR amplicon length of 145 to 450 (median 193) base pairs (bp). Primer sites for the second stage PCR amplicons were located within the first stage PCR amplicon and were designed to generate an amplicon of approximately 49 to 180 (median 88) bp. Primer lengths were between 17 and 37 bp and the annealing temperatures ranged from 54°C to 72°C. Degeneracy of up to 64-fold was used in some primer designs in order to accommodate sequence diversity but degenerate bases were not allowed within 4 bases of the 3′ end. In order to avoid higher order degenerate primers, some assays utilize multiple independent primers. When multiple primers were needed to achieve full coverage of diverse organisms, they were either separated as pairs in distinct wells of the array, or combined as a multiplex in single wells.
1st and 2nd stage assays were initially tested separately to ensure that they produced the expected amplification product, and that RNA assays were dependent on the presence of reverse-transcriptase in the reaction mix. An additional criterion was that all 1st and 2nd stage primers must function well at the same annealing temperature. First and 2nd stage assays were then combined to form a singleplex, nested assay and tested for efficiency, sensitivity and specificity using quantification cycles (Cq, ) as the readout. The first stage primers from nested assays with good overall amplification efficiency were subsequently combined as a multiplex. The Cqs for each assay performed either as a singleplex or multiplex in the first stage were then compared. For most assays the Cqs were quite similar. For the few cases where this was not true, moving one or the other primer a few nucleotides along the target sequence was sufficient to rescue the performance in the first stage multiplex PCR. After each redesign all assays were retested as described.
Performing a FilmArray run
The freeze-dried reagents in the fitment are resuspended with hydration solution using a 3 ml syringe fitted with a blunt metal cannula. The cannula is inserted into the hydration port (“X” in Figure 1B) where it breaks a septum in the port. The vacuum in the fitment draws liquid to fill wells 2 through 11 (∼80 µl each). Sample to be tested (a nasopharyngeal aspirate (NPA) in PBS or a nasopharyngeal swab (NPS) in viral transport medium) is mixed with two volumes of a denaturing sample buffer and injected into the pouch through the sample injection port (“Y” in Figure 1B). Well 1 draws in 300 µl of this mixture). The loaded pouch is then inserted into the FilmArray instrument, and the pouch and sample are identified to the instrument by the operator using a hand-held bar code reader. After the run is started all further steps are performed by the instrument.
Sample injection into the pouch is performed in a biosafety cabinet following the appropriate biohazard guidelines for working with potentially infectious samples. For the RP pouch, the FilmArray instrument may be operated on a laboratory bench or inside a biosafety hood.
Well 1 of the fitment contains the sample together with S. pombe yeast cells freeze-dried into the well as a processing control. A piston adjacent to the fitment forces the contents of well 1 into the large cell lysis blister (“C” of Figure 1) where viruses and bacteria (as well as the yeast control material freeze dried into well 1) are mechanically disrupted by 60 seconds of vigorous agitation with ceramic beads. The force for this disruption comes from a rotating metal bar located behind the plane of the pouch shown in Figure 1.
Nucleic acid purification.
Total nucleic acid in the sample is isolated by moving the sample lysate across the silica-magnetic beads particles present in well “E”. A retractable permanent magnet (located behind blister “E” in Figure 1) is used to collect the magnetic beads in this blister. Magnetic beads are concentrated in blister “E” with the magnet and washed 3 times with buffer from wells 3, 4 and 5. After the nucleic acid binding step, blister “C” serves as a waste container for later steps in the process. Nucleic acid is eluted with buffer brought in from well 6 and all of the eluted material is moved through blister “F” into blister “G” where the mixture serves to resuspend the freeze dried pellet of first stage PCR primers.
cDNA synthesis and outer multiplex PCR.
Reverse transcription and first stage PCR occur in blisters “F” and “G”. PCR master mix (containing the reverse transcriptase) from well 7 of the fitment is pushed into blister “F”. Bladders push both blisters against a Peltier device behind the pouch. A mechanical hot start is achieved by holding the contents of the two blisters separate (using a hard seal between them) until they reach 54°C. Reverse transcription occurs during an initial 3 minute hold at 54°C. The first stage PCR consists of 26 cycles of 94°C for 4 seconds followed by 60°C for 19 seconds. During reverse transcription and PCR cycling the contents of the reaction are mixed by moving the liquid between blisters “F” and “G”. At the end of cycling the reaction is diluted approximately 225-fold into second stage PCR master mix by two successive dilution steps, first with TE buffer from well 8 and then with PCR master mix from wells 9 and 10.
The second stage PCR occurs in the wells of the array (“I” in Figure 1). A mechanical hot start is achieved by holding the second stage PCR master mix/diluted template mixture at 90°C while the array is heated to 75°C. The array is then flooded with this mixture (shown schematically in Figure 2) which hydrates the inner primers in their individual wells. To seal the PCR wells shut, a clear plastic bladder in the instrument is inflated over the array after it is flooded. Second stage PCR cycling conditions are 94°C for 4 seconds and 63°C for 19 seconds for 30 cycles. Ramp rates are approximately 1.7°C/sec. Images can be acquired once per PCR cycle in order to generate conventional real-time PCR amplification curves.
Amplicon melt analysis.
After the final PCR cycle the sample is held at 63°C for 5 sec followed by a linear ramp in temperature from 68°C to 95°C at a nominal rate of 0.5°C/second. Images are acquired 10 times per second.
FilmArray data analysis
The FilmArray instrument is capable of collecting fluorescence images and corresponding temperature data during the temperature ramp performed after the second stage PCR. The melt curve, defined as the average fluorescence intensity of each well as a function of temperature, is the basis for the automated organism detection algorithm described below. During the development of the system, the instrument was also programmed to acquire images once per PCR cycle in order to generate conventional real-time PCR amplification curves and corresponding Cq values. However the amplification data are not used in the automated organism calls for the commercial FilmArray system (see Results).
For the automated analysis, a hierarchy of calls is made: first for individual wells, then for individual assays (when specific primers are replicated in multiple wells of the array) and finally for each organism. This analysis is first performed on the control assays. If the controls return positive results, the analysis proceeds to the pathogen assays and the results are reported. If controls assays return a negative result, the run is declared ‘Invalid’ and no organism results are reported.
For each well, curve shape and peak location analyses of the melt curve are used to make a “Positive” (amplicon present) or “Negative” call. If two or more replicate wells are Negative for any one assay, then assay is called “Negative”. Next, if two of the melting temperatures (Tms) for positive replicates are within assay-specific limits (see Results) then the software assigns a positive call to the assay. For organisms with a single associated assay the final test result of ‘Detected’ or ‘Not Detected’ is based on the assay call. For influenza A and Rhinovirus/Enterovirus, the final test result is based on the integration of all associated assays.
Sources of viruses, bacteria and clinical samples
Viruses and bacteria used in this study are indicated in Table S1. Growth, quantification and verification of viral and bacterial cultures were performed by Zeptometrix (Buffalo, NY). Bocavirus (BoV) and Coronavirus (CoV) HKU1 could not be grown in culture. Instead, well-characterized clinical specimens were utilized and quantified in copies per ml by real-time PCR against a standard curve of synthetic template.
Residual clinical NPA specimens (stored frozen at −80°C) came from children younger than 18 years who had NPA collected for respiratory viral testing by direct fluorescent antibody (DFA) and culture at Primary Children's Medical Center (PCMC), Salt Lake City, UT between 2006 and 2008. Approximately half of the NPA specimens chosen for analysis were negative by DFA and viral culture. FilmArray testing was performed at both PCMC and ITI. PCR results were not used to inform clinical management or reported to microbiology technicians performing DFA and viral culture.
FilmArray data used for tuning the melt calling algorithm were acquired at sites performing beta testing of the instrument. The data used to validate the algorithm were acquired during clinical trials of the FilmArray system and RP pouch at the Medical University of South Carolina (Frederick S. Nolte, PhD), Detroit Medical Center (Hossein Salimnia, PhD), and Children's Medical Center of Dallas (Beverly Rogers, M.D.).
The institutional review boards of the University of Utah and PCMC approved this study and granted a waiver of informed consent because the patient samples were de-identified. All external clinical studies were performed with appropriate IRB approval. Data from these sites were de-identified before being sent to Idaho Technology.
Direct Fluorescent Antibody testing and viral culture
The PCMC microbiology laboratory performs DFA for seven respiratory viruses: Influenza A (FluA), Influenza B (FluB), Respiratory Syncytial Virus (RSV), Parainfluenza viruses 1–3 (PIV 1–3) and Adenovirus (AV) using a panel of DFA assays (Simulfluor respiratory screen, Light Diagnostics, Temecula, CA) with reflex to viral culture. Human metapneumovirus (hMPV) is detected with a specific hMPV monoclonal antibody (Diagnostic Hybrids, Athens, OH).
Viral cultures are performed using a single cell line (R-Mix-Too; Diagnostic Hybrids) with an exit stain at 72 hours. The sensitivity of DFA testing, compared with viral culture, was 90% for FluA, 72% for FluB, 99% for RSV, 77% for PIVs, and 92% for hMPV, with specificity of 90% for all of the viruses in the PCMC laboratory , . Technicians at ITI and PCMC were blinded to DFA results while evaluating NPA samples using FilmArray. Reproducibility was not evaluated in this study.
Statistical analysis of the FilmArray versus DFA results
McNemar's test is used to compare the DFA results to the FilmArray results . The test compares the number of discordant results, shown in the off diagonals of the paired 2×2 table (Table 2), to estimate the probability that the two methods have equal sensitivity and specificity. We chose to use the terms positive % agreement and negative % agreement to report the test characteristics of the FilmArray respiratory panel. Positive percent agreement (sensitivity) is the percent of time that FilmArray RP detected a virus when DFA detected it. Similarly, negative percent agreement (specificity) is the percent of time that FilmArray RP did not detect a virus when DFA did not detect it.
If the sensitivity and specificity of the two methods are equal, the two off diagonals should be approximately equal and the estimated probability of being the same should be high. If one method is more sensitive or specific than the other, one of the off diagonal cell counts would be larger than the other and the estimated probability that the two methods have the same sensitivity and specificity would be low. The test does not provide the user with the information to determine that one method is more sensitive or the other is more specific, rather only gives them the power to say that they are different.
Optimization of the FilmArray chemistry
Initial development of the system was performed using DNA and RNA targets from Saccharomyces cerevisiae and Schizosaccharomyces pombe. To optimize the amplification of RNA targets we used intron-spanning primers to detect mRNAs and to exclude genomic DNA. Nested assays developed on conventional PCR instruments were moved into the FilmArray platform. Whole organisms or purified nucleic acid were tested in different steps of the pouch to evaluate both the nucleic acid purification and nmPCR portions of the process.
To maximize the sensitivity of the system, we determined the number of cycles in the first stage PCR that are needed to enter the plateau phase of the reaction , . For the first 25 cycles of the 1st stage multiplex reaction, amplification of specific product is efficient, and each additional 1st stage cycle reduces the Cq in the nested reaction by one. After this point there is diminished efficiency of the first stage PCR and for this reason, the first stage PCR is run for 26 cycles.
The completed first stage PCR mixture is diluted and then mixed into fresh PCR reagents. We determined empirically that two successive dilutions of ∼15 fold were necessary and sufficient to minimize primer carryover from the first stage PCR. Dilution of less than 100 fold generated nonspecific amplification products in the second stage PCR. Dilution of more than 300 fold caused a reduction in sensitivity.
The second stage PCRs are performed in individual wells of a high-density polycarbonate array (“I” in Figure 1 and shown schematically in Figure 2). The format of the array is analogous to that of a microarray, in which analyte assays are spatially separated for identification. In contrast to a standard microarray, PCR amplification is performed in each well. Specific primers that nest within a particular first stage PCR amplicon are dried into each well; each assay is present in triplicate within the array. The double-stranded DNA binding dye LCGreen® Plus ,  is used to monitor fluorescence changes during PCR amplification and during a post-PCR amplicon melt.
The FilmArray pouch incorporates three controls to assess the performance of key steps in the system. As an RNA process control, the yeast S. pombe is freeze dried into the first well of the fitment. Outer and inner primers targeting a spliced mRNA from S. pombe are included in the pouch. A positive result for this assay provides evidence that all steps of the pouch completed correctly. A double stranded DNA oligonucleotide in the first stage PCR master mix and the appropriate nested assay monitors all steps from the first stage PCR forward. A different DNA oligonucleotide is spotted into the array along with the appropriate forward and reverse primers to monitor the second stage PCR.
Development of respiratory pathogen assays for the FilmArray
In parallel with the development of the FilmArray instrument and pouch we designed a panel of assays to detect viruses and bacteria known or suspected to cause upper respiratory tract infection in humans. Pathogens were chosen in consultation with pediatric infectious disease experts (AJB, CLB). Primers were designed to amplify conserved regions of the targets using standard software and alignment tools. The assays were initially optimized in conventional PCR instruments, using as template either organism from reference collections or pediatric NPA samples that tested positive for respiratory viruses by conventional (DFA) testing or the assays described here. Sequencing was used to confirm target identity. A successful set of assays for 23 targets from 21 pathogens was transferred to the pouch. The final FilmArray RP pouch contains 61 primers in the outer multiplex (of which four are for controls) and 31 inner second stage PCR assays (spotted in triplicate on the array with nine empty wells as negative controls). Pathogens and gene targets in the optimized RP pouch are listed in Table 1. The yeast RNA process control and the second stage PCR control are used to catch failures in the different steps of the pouch.
Detection of virus and bacteria using the FilmArray instrument and pouch
Typical amplification and melt curves generated using a research version of the FilmArray instrument and RP pouch are shown in Figure 4. FluA H1 virus (200 Tissue Culture Infectious Doses-50% (TCID50)) injected into an RP pouch produced amplification products in the wells of the array containing PCR primers specific for all of the FluA H1 specific targets (Figure 4A). Melting curves generated from wells for a given assay have Tms that are characteristic of the amplicons from those targets (Figure 4B). The FluA H3 assay, which should not be positive for this virus, does not show evidence of amplification or melt peaks. Figure 4E and F show the result of injecting a very high level of another organism, B. per, into a FilmArray pouch. The amplification curves for the B. per assay replicates have a Cq of 5. This is the earliest Cq observed in the system and represents dilution and second stage amplification of an outer amplicon that has fully entered plateau in the first stage reaction.
Respiratory Pathogen pouches were injected with viral transport medium spiked with 200 TCID50 FluA H1-seasonal (panels A and B), 4×106 cfu B. per and 200 TCID50 FluA-H1 (panels C and D), or 4×106 cfu B. per (panels E and F) and run on the FilmArray instrument. Real time amplification curves (panels A and C and E) and post-amplification melt curves (panels B and D and F) for selected wells on the array are shown. Assays are spotted in triplicate: FluA-pan1 (orange), FluA-pan2 (pink), FluA-H1-pan (red), FluA-H3 (black), B. per (Green), Yeast RNA process control (dark blue), Second stage PCR control (light blue). For clarity the controls are shown in panels E and F only.
FilmArray can detect multiple targets in a single assay, and in particular, detect a low-copy target in the presence of a different, high-copy target. Figure 4C and D shows the results from a pouch in which both the high-titer B. per and low-titer FluA were injected. The B. per is detected early (low Cq), as expected. In addition, all of the Flu A target amplicons are detected, with similar Cqs and Tms as found for the FluA sample alone.
Figure 4E and 4F also show the RNA process control and the second stage PCR control. The assays amplify and produce the expected characteristic melts indicating that 1) all of the different steps of the pouch performed as expected and 2) the sample did not inhibit the pouch chemistry.
Pre-clinical evaluation of the FilmArray with pediatric NPA samples
To determine whether the FilmArray system would detect organisms in patient samples, we performed a study using pediatric NPA samples previously tested for respiratory infection at PCMC by DFA. Pre-clinical testing was performed at ITI and also during a 2-month placement of an instrument within the PCMC microbiology laboratory. Positive organism calls were made by expert users examining the amplification and melt curves. Three hundred and twenty eight samples were tested by both DFA and FilmArray. The results were compared for those viruses identified by both testing methods. When analyzed separately, similar results were obtained from both the research and clinical laboratories (data not shown) and thus combined data is presented.
The FilmArray, with 21 respiratory pathogen assays, identified significantly more pathogens than DFA in these pediatric samples (Figure 5). FilmArray testing decreased the number of clinical samples with no pathogen identified from 63% by DFA to 19% by FilmArray (p value<0.0001). For the pathogens tested by DFA, the concordance between FilmArray and DFA testing was high. Positive percent agreement with DFA ranged from 55%–100%, although for most the agreement was >90% (Table 2). The two pathogens with the lowest percent agreement were PIV1 (55%) and hMPV (67%). Some samples that were PIV1 positive by DFA were PIV3 positive by FilmArray and were confirmed to be PIV3 by sequence analysis. Because the FilmArray testing was done retrospectively, DFA could not be repeated. For hMPV, there were too few positive samples to fully interpret discordant results.
Pediatric NPA samples (N = 328) were tested either by DFA at PCMC (yellow bars) or on the FilmArray (Blue bars). The percent of samples in which no virus (Negative) or one of the indicated viruses was detected is shown. The viruses are grouped into those in which both DFA and FilmArray assays are available or only the FilmArray assay is available.
Using amplicon melting to automate analysis of the assay results
A diagnostic system that automates the technically demanding steps of nucleic acid isolation and PCR amplification would benefit from automated analysis of the PCR results. FilmArray runs generate large amounts of data in the form of real time amplification curves and the associated melt curves. In similar systems the properties of the amplification curve are used to make a positive or negative call for that assay . In the course of analyzing the FilmArray data from reference strains and clinical samples, we observed that the amplicon melt curve shapes and Tms were highly specific to the organism targeted by the nested PCR and thus could provide an additional filter for detecting each organism. For high or moderate titer organisms, the FilmArray system produces both robust amplification and melt curves with a high signal-to-noise ratio (Figure 4A and B). For very low titer organisms, the amplification curve is often obscured by the noise inherent in thermocycling. For example, Figure 6 shows the amplification and melt curve data from a pouch injected with a very low level FluA sample (1/200th of that in Figure 4). Of the three assays in the pouch that can detect this organism, neither the FluA pan2 nor the FluA H1 pan amplification curves show a rise above baseline; only the FluA pan1 assay produced significant amplification. By contrast, a robust signal can be detected in the melt curves for the same sample (Figure 6B). The automated analysis of the melt curves produced a positive result for the FluA pan1 and pan2 assays (2 or more of the 3 replicates were positive) and a negative result for the FluA H1 pan assay (only one melt curve was positive).
Respiratory Pathogen pouches were injected with viral transport medium spiked with 1 TCID50 of the FluA- H1 seasonal virus used in Figure 4, and run on the FilmArray instrument. Real-time amplification curves (A) and post-amplification melt curves (B) for selected wells on the array are shown. Assays are spotted in triplicate: FluA-pan1 (orange), FluA-pan2 (pink), FluA-H1-pan (red). The ordinate scales are the same as in Figure 4.
To compare the sensitivity of a detection algorithm based on melt curve analysis to one based on amplification curves, we had expert users annotate a total of 18,156 amplification and melting curves as positive or negative. Automated analysis of the data using both the amplification and melt profiles produced a sensitivity of 94.7%, a specificity of 99.95%, and an error rate of 4.15% compared to the expert user's annotations. By comparison, analysis of the melt curves alone produced a sensitivity of 97.49%, a specificity of 99.6%, and a total error rate of 2.92% compared to the expert calls. The higher error rate of the combined analysis is explained by false negative calls for weak amplification curves. Therefore we proceeded to develop an automated analysis of the FilmArray data using only the melt curves.
To maximize the specificity of melt curve analysis, we determined the range of possible Tms for amplicons from each different organism assay. The theoretical melting temperature of a DNA sequence on the FilmArray instrument was calculated using the model (modified from ):(1)where GC is the mole fraction of G and C bp in the sequence, L is the length of the amplicon, and To, TGC, and TL are empirically fit parameters estimated using FilmArray data from samples of known sequence. GenBank was searched for sequence variants of each organism and these data were trimmed to the inner PCR product of the nmPCR. Predicted Tms for these variants were calculated using the mathematical model determined above (the data for hMPV are shown in Figure 7A). This distribution of Tms was used to establish the expected melt range for each assay. These ranges were expanded beyond the minimum and maximum predicted Tms to account for system variability (determined by the Tms of the control assays) and the Tms obtained from initial clinical testing (Figure 7B). To validate these predictions, the distributions of Tm data from testing of reference strains (Figure 7C) and from further clinical evaluations (Figure 7D) were compared to the initial melt range. The overlap in distribution of Tms between the different sample sets suggested that the melt ranges adequately, capture the full diversity of amplicon Tms for this organism. Narrowing the melt window in this way eliminates some false positives due to nonspecific amplification (data not shown).
Histograms of the theoretical or observed Tms of the hMPV assay are shown. Tm data for the FilmArray runs includes each of the three replicates of the second stage PCR. A: Tms calculated from 13 sequence variants published in the NCBI databases. B: Tm data generated during the system beta-testing with 37 banked hMPV-positive patient samples. C: Tm data generated during the inclusivity testing with 10 hMPV strains representing subtypes A1, A2, B1 and B2. Multiple FilmArray runs of these strains are included in this data set. D: Tm data from 74 hMPV-positive patient samples collected during the clinical evaluation.
To maximize sensitivity and specificity of the melting curve detection algorithm we optimized it using a large training dataset comprising 1566 RP pouch runs performed both at Idaho Technology (900 runs) and at external sites (666 runs) (Methods). The majority of the data generated at Idaho Technology was derived from contrived samples spiked with dilution series of the various target organisms (Table S1). Data from external sites was primarily composed of residual archived clinical samples evaluated during beta testing of the system. Using a semi-automated process, the detection algorithm was tuned so that the sensitivity and specificity are greater than 99% (Table 3, Training Set). To validate the performance of the detection algorithm, a second independent dataset consisting of 511 FilmArray runs of clinical samples was annotated by expert users. As shown in Table 3 (Validation Set), the detection algorithm is able to differentiate positive and negative melt curves with a high degree of accuracy (>99.5%).
Using the same training and validation data set, the FilmArray automated analysis was compared to expert calls for the assay results (Table 4). Data from the triplicate wells of each assay were combined to produce a “Positive” or “Negative” assay call. In this case the results of the automated analysis of the FilmArray RP system resulted in sensitivity and specificity >99.6%.
Determination of the analytical Limit of Detection for the FilmArray RP system
To determine at what level the PCR assays in the FilmArray system could correctly and consistently identify organisms, titered viral and bacterial respiratory pathogens were spiked into negative NPS sample matrix collected from healthy individuals or into a simulated NPS matrix consisting of viral transport medium (VTM) and a human epithelial cell line. Serial dilutions of the viruses and bacteria were spiked into NPS samples, both singly and in combinations of up to 5 organisms per sample. The spiked NPS samples were then tested on the FilmArray instrument. Quantification by TCID50 is a measure based on infectivity or cytotoxicity rather than number of organisms or copies of nucleic acid. LoD determined in TCID50/mL may not be an accurate indicator of the relative sensitivity of detection between different organisms.
An initial estimate of the system Limit of Detection (LoD95, or the concentration of organism that can be reliably detected in 95% or more of the samples tested) was based on the serial dilutions. Additional samples were then prepared and tested at the estimated LoD concentration and 10-fold lower to confirm that the correct organism was detected in at least 95% of the samples at LoD and in less than 95% of the samples containing 10-fold less organism. A positive organism detection was determined according to the automated analysis performed by the FilmArray software. For multi-assay organism calls such as FluA subtypes, all relevant assays were required to be positive at the LoD95 level. Column C in Table 1 shows the FilmArray LoD95 for each pathogen.
The sensitivity of detection was comparable between samples containing a single organism and those containing up to five different organisms. Subsequent clinical evaluations determined that the sensitivity of each assay was appropriate for accurate detection of clinically relevant pathogen levels in NPS specimens. It is worth noting in this regard that the LoD concentration for Coronavirus HKU1 (1.9×106 RNA copies/mL) is below the published viral load detected in acute Coronavairus HKU1 infection (8.5–9.6×106 RNA copies/ml during the first week of the illness ). A full description of the clinical evaluation of the FilmArray RP pouch for testing NPS samples, performed using the automated calling algorithm described above, will be published elsewhere.
In the last decade advances in diagnostic testing have led to changes in clinical laboratory evaluation that have translated into improved clinical care , , , , , , , . Despite these advances, limitations remain in the arena of rapid testing for multiple pathogens and the ability to move molecular testing into clinical laboratories, particularly those unable to perform high-complexity testing. The FilmArray system addresses these concerns in that it has the capability for high-order multiplex testing, yet is simple to use and requires minimal hands-on time. Here we have demonstrated that the system can accurately detect and identify both DNA and RNA targets from whole organisms, including those contained within clinical respiratory specimens. The FilmArray can also effectively detect multiple targets in a single sample. We have developed and tested the performance of a clinically relevant panel of respiratory pathogens, including both viruses and bacteria, and shown good performance of the system when compared to standard laboratory methods.
FilmArray implements nmPCR in a closed “lab-in-a-pouch” format
The FilmArray is a realization of a “Lab-on-a-Chip” or μTAS system (micro total analysis system, , ). It implements the highly sensitive and specific technique of nested multiplex PCR in an enclosed disposable, the FilmArray pouch. This enables the considerable benefits of this form of PCR to be realized in settings where even moderate contamination risk of pathogen or of amplicon is unacceptable. Ultimately, this “Lab-on-a-Chip”-type format could allow complex molecular methods to be adopted in “point-of-care” settings or field situations, where the patient presents initially to the healthcare provider , , , .
Although the FilmArray pouch manipulates relatively large volumes of liquid for a μTAS system, it shares several advantages with such systems. The steps of the system are automated which reduces operator work-load and error. The process is rapid: the time lag between one step of the chemistry and the next is measured in seconds. The physical separation of reagents between the fitment and the blisters also enables a hot start for both the first and second stage PCRs (see Methods). This eliminates the expense and inefficiency associated with using chemical or biochemical means of inhibiting Taq. A physical hot start also has the additional, unique, advantage that the reverse transcriptase is prevented from interacting with primers below the desired temperature of the reaction. This minimizes the formation of primer dimers or other nonspecific products in the deep multiplex of the first stage PCR.
The FilmArray lab-in-a-pouch is also an efficient solution to the “sample to assay” problem that many microfluidics systems must solve , , . Typically, for low abundance pathogens, sensitivity comes from testing a large input sample volume. However, for multiplex testing, sample will often be limiting and to keep reagents costs down, the many individual tests must be done in small volumes. The FilmArray first stage multiplex PCR uses all of the nucleic acid recovered from the input material (100 µl of patient sample). The second stage amplification then allows specific detection of the analytes in individual 1 µl PCRs without the loss of sensitivity common in small volume PCRs.
In addition to its increased sensitivity and specificity, nested PCR simplifies the development of complex multiplex PCR panels. In order to detect viruses with great sequence diversity (e.g. AV and HRV) the first stage PCR contains moderately degenerate primers, or multiple primer sets. Unlike the common observation with single-stage multiplex PCR reactions , , we observed no loss of assay sensitivity when comparing nested PCR with the full complement of primers in the first stage versus a single set of primers in the first stage (data not shown). For every primer set that did show a loss of sensitivity, a redesign of the first stage assay was enough to restore sensitivity without perturbing other assays.
Whiley et al  have argued that multiple independent nucleic acid tests are required to ensure adequate sensitivity for detecting organisms that have significant sequence variation. Nesting of the PCRs allows a high level of multiplex in the first stage PCR, which addresses this concern. We have tested FilmArray multiplex designs that include 40 different assays and see no loss of sensitivity compared to single assay formats (M. Rogatcheva, unpublished data). In the FilmArray RP pouch described here, there are two pan-influenza A assays (pan1 and pan2 for the MA and NS2 genes respectively). This increases the likelihood that a novel pandemic influenza will be detected by the system (as a “non-subtypeable” FluA) because there is a high probability that either one or the other pan assay will be reactive.
nmPCR is also highly resistant to target competition (Figure 4). An organism present at very high concentration (10,000× LoD95, calculated from the data in Table 1) does not inhibit the detection of a second organism present at low concentration (10× LoD95). This occurs because the first stage PCR is not the direct readout for the presence of each analyte. Instead it gives the lower concentration organism adequate amplification boost, (i.e. enrichment) for detection in the second stage PCR.
Detecting organism based on amplicon melts
The automated analysis of FilmArray data is robust to sequence variation in the target amplicon as well as potential instrument and pouch variation. The combination of melt detection in individual wells of the array together with the redundancy provided by the well-to-well comparison of replicate melt curves results in exceptionally sensitive and specific organism detection.
We have observed that melting curve analysis is more sensitive than amplification curves analysis for the detection of input material. The amount of data collected during the gradual temperature ramp of the amplicon melt greatly exceeds that collected during the relatively dynamic temperature cycling of the second stage PCR. The resulting melt curves have a higher signal to noise ratio than that of the amplification curves. For several reasons (e.g. loss of resolution at the high end of dynamic range, lack of a standard curve on a single sample instrument) the FilmArray Cq is not a meaningful measure of organism load in the sample. For this reason, amplification curve data are not reported in the commercial version of the instrument.
Clinical utility of the FilmArray system
The initial testing of the FilmArray RP pouch with clinical samples demonstrates a successful real-world application of this technology. When compared to DFA using pediatric NPA samples, the platform showed high percent agreement. The most common reason for discordance was the detection of pathogens by FilmArray in DFA-negative samples. We believe this is due to the increased sensitivity of PCR when compared to DFA. In addition, the ability to test for a much larger panel of pathogens led to a decrease in the number of negative samples when compared to conventional testing, and increased the number of instances in which more than one pathogen was detected in a sample. Other multiplex PCR-based studies have reported similar findings .
The FilmArray instrument and a subset of the assays in the RP pouch have recently been cleared by the FDA for IVD use and an initial comparison of the FilmArray instrument with the xTAG RVP (Luminex Corporation, Austin TX) and conventional detection methods have been reported . The clinical studies performed to support the FilmArray application to the FDA used NPS as the sample matrix. Because the data presented here were generated on a development version of the instrument and pouch we do not know the true clinical sensitivity and specificity of the FilmArray system when using NPA samples.
The advent of diagnostic platforms with the capability of medium level multiplexing , , , , ,  opens up the potential for development of a set of multi-pathogen panels that are focused on a specific disease indication rather than a specific organism. FilmArray assay panels under development will target organisms associated with sepsis, meningitis, diarrhea, sexually transmitted infections, or bioterrorism, as well as genes conferring antibiotic resistance.
Source of Virus and Bacteria used in this study.
The authors thank FilmArray chemistry technicians, engineers, programmers (ITI), Trenda Barney for running samples on the FilmArray (PCMC) and Hsin-Yi Weng and Greg Stoddard (University of Utah School of Medicine) for statistical analysis, Carl Wittwer and our colleagues at ITI for editorial review of the manuscript and Mark Kessler and Kent Moyle for help with the figures. We thank the beta and clinical trials sites for the FilmArray data used for melt detection tuning and validation.
Conceived and designed the experiments: MAP AJB CLB LM KN DEJ SAT BL EA AH JD SFD DH-FT KMR. Performed the experiments: MAP LM KN DEJ SAT KMR. Analyzed the data: MAP AJB CLB LM DEJ SAT TR BL EA AH JD DH-FT KMR. Contributed reagents/materials/analysis tools: JD CLB TR. Wrote the paper: MAP AJB CLB TR.
- 1. Zhang ZW, Zhou YM, Zhang Y, Guo Y, Tao SC, et al. (2005) Sensitive detection of SARS coronavirus RNA by a novel asymmetric multiplex nested RT-PCR amplification coupled with oligonucleotide microarray hybridization. Methods Mol Med 114: 59–78.
- 2. Petric M, Comanor L, Petti CA (2006) Role of the laboratory in diagnosis of influenza during seasonal epidemics and potential pandemics. J Infect Dis 194: Suppl 2S98–110.
- 3. Fox JD (2007) Respiratory virus surveillance and outbreak investigation. J Clin Virol 40: Suppl 1S24–30.
- 4. Lessa FC, Gould PL, Pascoe N, Erdman DD, Lu X, et al. (2009) Health care transmission of a newly emergent adenovirus serotype in health care personnel at a military hospital in Texas, 2007. J Infect Dis 200: 1759–1765.
- 5. Dundas NE, Ziadie MS, Revell PA, Brock E, Mitui M, et al. (2011) A lean laboratory: operational simplicity and cost effectiveness of the Luminex xTAG respiratory viral panel. J Mol Diagn 13: 175–179.
- 6. Barenfanger J, Drake C, Leon N, Mueller T, Troutt T (2000) Clinical and financial benefits of rapid detection of respiratory viruses: an outcomes study. J Clin Microbiol 38: 2824–2828.
- 7. Mahony JB, Blackhouse G, Babwah J, Smieja M, Buracond S, et al. (2009) Cost Analysis of Multiplex PCR Testing for Diagnosing Respiratory Virus Infections. J Clin Microbiol.
- 8. Woo PC, Chiu SS, Seto WH, Peiris M (1997) Cost-effectiveness of rapid diagnosis of viral respiratory tract infections in pediatric patients. J Clin Microbiol 35: 1579–1581.
- 9. Falsey AR, Murata Y, Walsh EE (2007) Impact of rapid diagnosis on management of adults hospitalized with influenza. Arch Intern Med 167: 354–360.
- 10. Hatchette TF, Bastien N, Berry J, Booth TF, Chernesky M, et al. (2009) The limitations of point of care testing for pandemic influenza: what clinicians and public health professionals need to know. Can J Public Health 100: 204–207.
- 11. McCabe KM, Khan G, Zhang YH, Mason EO, McCabe ER (1995) Amplification of bacterial DNA using highly conserved sequences: automated analysis and potential for molecular triage of sepsis. Pediatrics 95: 165–169.
- 12. Endimiani A, Hujer KM, Hujer AM, Kurz S, Jacobs MR, et al. (2011) Are we ready for novel detection methods to treat respiratory pathogens in hospital-acquired pneumonia? Clin Infect Dis 52: Suppl 4S373–383.
- 13. Forbes BA (2003) Introducing a molecular test into the clinical microbiology laboratory: development, evaluation, and validation. Arch Pathol Lab Med 127: 1106–1111.
- 14. Mackay IM (2004) Real-time PCR in the microbiology laboratory. Clin Microbiol Infect 10: 190–212.
- 15. Mothershed EA, Whitney AM (2006) Nucleic acid-based methods for the detection of bacterial pathogens: present and future considerations for the clinical laboratory. Clin Chim Acta 363: 206–220.
- 16. Van Eldere J (2005) Changing needs, opportunities and constraints for the 21st century microbiology laboratory. Clin Microbiol Infect 11: Suppl 115–18.
- 17. Yang S, Rothman RE (2004) PCR-based diagnostics for infectious diseases: uses, limitations, and future applications in acute-care settings. Lancet Infect Dis 4: 337–348.
- 18. Persing DH, editor. (2010) Molecular Microbiology: Diagnostic Principles and Practice. 2nd ed. Washington DC: ASM Press.
- 19. Chia JH, Chu C, Su LH, Chiu CH, Kuo AJ, et al. (2005) Development of a multiplex PCR and SHV melting-curve mutation detection system for detection of some SHV and CTX-M beta-lactamases of Escherichia coli, Klebsiella pneumoniae, and Enterobacter cloacae in Taiwan. J Clin Microbiol 43: 4486–4491.
- 20. Choi SM, Kim SH, Kim HJ, Lee DG, Choi JH, et al. (2003) Multiplex PCR for the detection of genes encoding aminoglycoside modifying enzymes and methicillin resistance among Staphylococcus species. J Korean Med Sci 18: 631–636.
- 21. Colom K, Perez J, Alonso R, Fernandez-Aranguiz A, Larino E, et al. (2003) Simple and reliable multiplex PCR assay for detection of blaTEM, bla(SHV) and blaOXA-1 genes in Enterobacteriaceae. FEMS Microbiol Lett 223: 147–151.
- 22. Ginevra C, Barranger C, Ros A, Mory O, Stephan JL, et al. (2005) Development and evaluation of Chlamylege, a new commercial test allowing simultaneous detection and identification of Legionella, Chlamydophila pneumoniae, and Mycoplasma pneumoniae in clinical respiratory specimens by multiplex PCR. J Clin Microbiol 43: 3247–3254.
- 23. Martineau F, Picard FJ, Grenier L, Roy PH, Ouellette M, et al. (2000) Multiplex PCR assays for the detection of clinically relevant antibiotic resistance genes in staphylococci isolated from patients infected after cardiac surgery. The ESPRIT Trial. J Antimicrob Chemother 46: 527–534.
- 24. Perez-Roth E, Claverie-Martin F, Villar J, Mendez-Alvarez S (2001) Multiplex PCR for simultaneous identification of Staphylococcus aureus and detection of methicillin and mupirocin resistance. J Clin Microbiol 39: 4037–4041.
- 25. Stockton J, Ellis JS, Saville M, Clewley JP, Zambon MC (1998) Multiplex PCR for typing and subtyping influenza and respiratory syncytial viruses. J Clin Microbiol 36: 2990–2995.
- 26. Strommenger B, Kettlitz C, Werner G, Witte W (2003) Multiplex PCR assay for simultaneous detection of nine clinically relevant antibiotic resistance genes in Staphylococcus aureus. J Clin Microbiol 41: 4089–4094.
- 27. Wittwer CT, Herrmann MG, Gundry CN, Elenitoba-Johnson KS (2001) Real-time multiplex PCR assays. Methods 25: 430–442.
- 28. Zhang K, Sparling J, Chow BL, Elsayed S, Hussain Z, et al. (2004) New quadriplex PCR assay for detection of methicillin and mupirocin resistance and simultaneous discrimination of Staphylococcus aureus from coagulase-negative staphylococci. J Clin Microbiol 42: 4947–4955.
- 29. Cockerill FR 3rd (2003) Application of rapid-cycle real-time polymerase chain reaction for diagnostic testing in the clinical microbiology laboratory. Arch Pathol Lab Med 127: 1112–1120.
- 30. Versalovic J, Lupski JR (2002) Molecular detection and genotyping of pathogens: more accurate and rapid answers. Trends Microbiol 10: S15–21.
- 31. Nolte FS (2008) Molecular diagnostics for detection of bacterial and viral pathogens in community-acquired pneumonia. Clin Infect Dis 47: Suppl 3S123–126.
- 32. Mahony JB (2008) Detection of respiratory viruses by molecular methods. Clin Microbiol Rev 21: 716–747.
- 33. Ratcliff RM, Chang G, Kok T, Sloots TP (2007) Molecular diagnosis of medical viruses. Curr Issues Mol Biol 9: 87–102.
- 34. Khanna M, Fan J, Pehler-Harrington K, Waters C, Douglass P, et al. (2005) The pneumoplex assays, a multiplex PCR-enzyme hybridization assay that allows simultaneous detection of five organisms, Mycoplasma pneumoniae, Chlamydia (Chlamydophila) pneumoniae, Legionella pneumophila, Legionella micdadei, and Bordetella pertussis, and its real-time counterpart. J Clin Microbiol 43: 565–571.
- 35. Kehl SC, Henrickson KJ, Hua W, Fan J (2001) Evaluation of the Hexaplex assay for detection of respiratory viruses in children. J Clin Microbiol 39: 1696–1701.
- 36. Kim SR, Ki CS, Lee NY (2009) Rapid detection and identification of 12 respiratory viruses using a dual priming oligonucleotide system-based multiplex PCR assay. J Virol Methods 156: 111–116.
- 37. Lam WY, Yeung AC, Tang JW, Ip M, Chan EW, et al. (2007) Rapid multiplex nested PCR for detection of respiratory viruses. J Clin Microbiol 45: 3631–3640.
- 38. Mahony J, Chong S, Merante F, Yaghoubian S, Sinha T, et al. (2007) Development of a respiratory virus panel test for detection of twenty human respiratory viruses by use of multiplex PCR and a fluid microbead-based assay. J Clin Microbiol 45: 2965–2970.
- 39. Nolte FS, Marshall DJ, Rasberry C, Schievelbein S, Banks GG, et al. (2007) MultiCode-PLx system for multiplexed detection of seventeen respiratory viruses. J Clin Microbiol 45: 2779–2786.
- 40. Palka-Santini M, Cleven BE, Eichinger L, Kronke M, Krut O (2009) Large scale multiplex PCR improves pathogen detection by DNA microarrays. BMC Microbiol 9: 1.
- 41. Lassauniere R, Kresfelder T, Venter M (2010) A novel multiplex real-time RT-PCR assay with FRET hybridization probes for the detection and quantitation of 13 respiratory viruses. J Virol Methods.
- 42. Li H, McCormac MA, Estes RW, Sefers SE, Dare RK, et al. (2007) Simultaneous detection and high-throughput identification of a panel of RNA viruses causing respiratory tract infections. J Clin Microbiol 45: 2105–2109.
- 43. Lieberman D, Lieberman D, Korsonsky I, Ben-Yaakov M, Lazarovich Z, et al. (2002) A comparative study of the etiology of adult upper and lower respiratory tract infections in the community. Diagn Microbiol Infect Dis 42: 21–28.
- 44. Meury S, Zeller S, Heininger U (2004) Comparison of clinical characteristics of influenza and respiratory syncytial virus infection in hospitalised children and adolescents. Eur J Pediatr 163: 359–363.
- 45. Sung RY, Chan PK, Tsen T, Li AM, Lam WY, et al. (2009) Identification of viral and atypical bacterial pathogens in children hospitalized with acute respiratory infections in Hong Kong by multiplex PCR assays. J Med Virol 81: 153–159.
- 46. Belak S, Thoren P (2001) Molecular diagnosis of animal diseases: some experiences over the past decade. Expert Rev Mol Diagn 1: 434–443.
- 47. Lopez MM, Bertolini E, Olmos A, Caruso P, Gorris MT, et al. (2003) Innovative tools for detection of plant pathogenic viruses and bacteria. Int Microbiol 6: 233–243.
- 48. Narayanan S (1996) Concepts, principles, and applications of selected molecular biology techniques in clinical biochemistry. Adv Clin Chem 32: 1–38.
- 49. Nakamura S, Katamine S, Yamamoto T, Foung SK, Kurata T, et al. (1993) Amplification and detection of a single molecule of human immunodeficiency virus RNA. Virus Genes 7: 325–338.
- 50. Dear P (2004) Single-Molecule PCR - Basic Protocols and Applications. In: Weissensteiner T, Griffin H, Griffin A, editors. PCR Technology: Current Innovations. Boca Raton: CRC Press. pp. 245–257.
- 51. Sotlar K, Diemer D, Dethleffs A, Hack Y, Stubner A, et al. (2004) Detection and typing of human papillomavirus by e6 nested multiplex PCR. J Clin Microbiol 42: 3176–3184.
- 52. Mullis KB, Faloona FA (1987) Specific synthesis of DNA in vitro via a polymerase-catalyzed chain reaction. Methods Enzymol 155: 335–350.
- 53. Espy MJ, Uhl JR, Sloan LM, Buckwalter SP, Jones MF, et al. (2006) Real-time PCR in clinical microbiology: applications for routine laboratory testing. Clin Microbiol Rev 19: 165–256.
- 54. Ririe KM, Rasmussen RP, Wittwer CT (1997) Product differentiation by analysis of DNA melting curves during the polymerase chain reaction. Anal Biochem 245: 154–160.
- 55. Kang JH, Kim YC, Park JK (2008) Analysis of pressure-driven air bubble elimination in a microfluidic device. Lab Chip 8: 176–178.
- 56. Benson DA, Karsch-Mizrachi I, Lipman DJ, Ostell J, Sayers EW (2010) GenBank. Nucleic Acids Res 38: D46–51.
- 57. Sayers EW, Barrett T, Benson DA, Bolton E, Bryant SH, et al. (2010) Database resources of the National Center for Biotechnology Information. Nucleic Acids Res 38: D5–16.
- 58. Bustin SA, Benes V, Garson JA, Hellemans J, Huggett J, et al. (2009) The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clin Chem 55: 611–622.
- 59. Korgenski EK, Barney A, Braogdon R, Noordewier E, Daly JA (2007) Epidemiology, clinical and financial outcome of human metapneumovirus in a pediatric tertiary care medical center located in the Intermountain West; Clearwater Beach, Florida.
- 60. Rocholl C, Gerber K, Daly J, Pavia AT, Byington CL (2004) Adenoviral infections in children: the impact of rapid diagnosis. Pediatrics 113: e51–56.
- 61. Pepe MS (2003) The Statistical Evaluation of Medical Tests for Classification and Prediction. New York: Oxford.
- 62. O'Shea MK, Cane PA (2004) Development of a highly sensitive semi-quantitative real-time PCR and molecular beacon probe assay for the detection of respiratory syncytial virus. J Virol Methods 118: 101–110.
- 63. Wittwer CT, Herrmann MG, Moss AA, Rasmussen RP (1997) Continuous fluorescence monitoring of rapid cycle DNA amplification. Biotechniques 22: 130–131, 134–138.
- 64. Wittwer CT, Reed GH, Gundry CN, Vandersteen JG, Pryor RJ (2003) High-resolution genotyping by amplicon melting analysis using LCGreen. Clin Chem 49: 853–860.
- 65. Nolte FS, Rogers BB, Tang YW, Oberste MS, Robinson CC, et al. (2011) Evaluation of a rapid and completely automated real-time reverse transcriptase PCR assay for diagnosis of enteroviral meningitis. J Clin Microbiol 49: 528–533.
- 66. Baldino F Jr, Chesselet MF, Lewis ME (1989) High-resolution in situ hybridization histochemistry. Methods Enzymol 168: 761–777.
- 67. Woo PC, Lau SK, Chu CM, Chan KH, Tsoi HW, et al. (2005) Characterization and complete genome sequence of a novel coronavirus, coronavirus HKU1, from patients with pneumonia. J Virol 79: 884–895.
- 68. Ramers C, Billman G, Hartin M, Ho S, Sawyer MH (2000) Impact of a diagnostic cerebrospinal fluid enterovirus polymerase chain reaction test on patient management. JAMA 283: 2680–2685.
- 69. Stellrecht KA, Harding I, Woron AM, Lepow ML, Venezia RA (2002) The impact of an enteroviral RT-PCR assay on the diagnosis of aseptic meningitis and patient management. J Clin Virol 25: Suppl 1S19–26.
- 70. Archimbaud C, Chambon M, Bailly JL, Petit I, Henquell C, et al. (2009) Impact of rapid enterovirus molecular diagnosis on the management of infants, children, and adults with aseptic meningitis. J Med Virol 81: 42–48.
- 71. Byington CL, Castillo H, Gerber K, Daly JA, Brimley LA, et al. (2002) The effect of rapid respiratory viral diagnostic testing on antibiotic use in a children's hospital. Arch Pediatr Adolesc Med 156: 1230–1234.
- 72. Byington CL, Zerr DM, Taggart EW, Nguy L, Hillyard DR, et al. (2002) Human herpesvirus 6 infection in febrile infants ninety days of age and younger. Pediatr Infect Dis J 21: 996–999.
- 73. Robinson CC, Willis M, Meagher A, Gieseker KE, Rotbart H, et al. (2002) Impact of rapid polymerase chain reaction results on management of pediatric patients with enteroviral meningitis. Pediatr Infect Dis J 21: 283–286.
- 74. Wu W, Tang YW (2009) Emerging molecular assays for detection and characterization of respiratory viruses. Clin Lab Med 29: 673–693.
- 75. Yager P, Edwards T, Fu E, Helton K, Nelson K, et al. (2006) Microfluidic diagnostic technologies for global public health. Nature 442: 412–418.
- 76. Whitesides GM (2006) The origins and the future of microfluidics. Nature 442: 368–373.
- 77. Charles PG (2008) Early diagnosis of lower respiratory tract infections (point-of-care tests). Curr Opin Pulm Med 14: 176–182.
- 78. Henrickson KJ (2004) Advances in the laboratory diagnosis of viral respiratory disease. Pediatr Infect Dis J 23: S6–10.
- 79. Weitzel T, Schnabel E, Dieckmann S, Borner U, Schweiger B (2007) Evaluation of a new point-of-care test for influenza A and B virus in travellers with influenza-like symptoms. Clin Microbiol Infect 13: 665–669.
- 80. Auroux PA, Koc Y, deMello A, Manz A, Day PJ (2004) Miniaturised nucleic acid analysis. Lab Chip 4: 534–546.
- 81. Chen L, Manz A, Day PJ (2007) Total nucleic acid analysis integrated on microfluidic devices. Lab Chip 7: 1413–1423.
- 82. Oh KW, Park C, Namkoong K, Kim J, Ock KS, et al. (2005) World-to-chip microfluidic interface with built-in valves for multichamber chip-based PCR assays. Lab Chip 5: 845–850.
- 83. Kosters K, Reischl U, Schmetz J, Riffelmann M, Wirsing von Konig CH (2002) Real-time LightCycler PCR for detection and discrimination of Bordetella pertussis and Bordetella parapertussis. J Clin Microbiol 40: 1719–1722.
- 84. Whiley DM, Sloots TP (2005) Comparison of three in-house multiplex PCR assays for the detection of Neisseria gonorrhoeae and Chlamydia trachomatis using real-time and conventional detection methodologies. Pathology 37: 364–370.
- 85. Whiley DM, Lambert SB, Bialasiewicz S, Goire N, Nissen MD, et al. (2008) False-negative results in nucleic acid amplification tests-do we need to routinely use two genetic targets in all assays to overcome problems caused by sequence variation? Crit Rev Microbiol 34: 71–76.
- 86. Fox JD (2007) Nucleic acid amplification tests for detection of respiratory viruses. J Clin Virol 40: Suppl 1S15–23.
- 87. Rand KH, Rampersaud H, Houck HJ (2011) Comparison of Two Multiplex Methods for Detection of Respiratory Viruses: FilmArray RP and xTAG RVP. J Clin Microbiol 49: 2449–2453.
- 88. Lee WM, Grindle K, Pappas T, Marshall DJ, Moser MJ, et al. (2007) High-throughput, sensitive, and accurate multiplex PCR-microsphere flow cytometry system for large-scale comprehensive detection of respiratory viruses. J Clin Microbiol 45: 2626–2634.
- 89. Marshall DJ, Reisdorf E, Harms G, Beaty E, Moser MJ, et al. (2007) Evaluation of a multiplexed PCR assay for detection of respiratory viral pathogens in a public health laboratory setting. J Clin Microbiol 45: 3875–3882.
- 90. Kodani M, Yang G, Conklin LM, Travis TC, Whitney CG, et al. (2011) Application of TaqMan Low-Density Arrays for Simultaneous Detection of Multiple Respiratory Pathogens. J Clin Microbiol 49: 2175–2182.
- 91. Ecker DJ, Sampath R, Blyn LB, Eshoo MW, Ivy C, et al. (2005) Rapid identification and strain-typing of respiratory pathogens for epidemic surveillance. Proc Natl Acad Sci U S A 102: 8012–8017.