Figures
Abstract
Bacterial and viral infections are often clinically indistinguishable, leading to inappropriate patient management and antibiotic misuse. Bacterial-induced host proteins such as procalcitonin, C-reactive protein (CRP), and Interleukin-6, are routinely used to support diagnosis of infection. However, their performance is negatively affected by inter-patient variability, including time from symptom onset, clinical syndrome, and pathogens. Our aim was to identify novel viral-induced host proteins that can complement bacterial-induced proteins to increase diagnostic accuracy. Initially, we conducted a bioinformatic screen to identify putative circulating host immune response proteins. The resulting 600 candidates were then quantitatively screened for diagnostic potential using blood samples from 1002 prospectively recruited patients with suspected acute infectious disease and controls with no apparent infection. For each patient, three independent physicians assigned a diagnosis based on comprehensive clinical and laboratory investigation including PCR for 21 pathogens yielding 319 bacterial, 334 viral, 112 control and 98 indeterminate diagnoses; 139 patients were excluded based on predetermined criteria. The best performing host-protein was TNF-related apoptosis-inducing ligand (TRAIL) (area under the curve [AUC] of 0.89; 95% confidence interval [CI], 0.86 to 0.91), which was consistently up-regulated in viral infected patients. We further developed a multi-protein signature using logistic-regression on half of the patients and validated it on the remaining half. The signature with the highest precision included both viral- and bacterial-induced proteins: TRAIL, Interferon gamma-induced protein-10, and CRP (AUC of 0.94; 95% CI, 0.92 to 0.96). The signature was superior to any of the individual proteins (P<0.001), as well as routinely used clinical parameters and their combinations (P<0.001). It remained robust across different physiological systems, times from symptom onset, and pathogens (AUCs 0.87-1.0). The accurate differential diagnosis provided by this novel combination of viral- and bacterial-induced proteins has the potential to improve management of patients with acute infections and reduce antibiotic misuse.
Citation: Oved K, Cohen A, Boico O, Navon R, Friedman T, Etshtein L, et al. (2015) A Novel Host-Proteome Signature for Distinguishing between Acute Bacterial and Viral Infections. PLoS ONE 10(3): e0120012. https://doi.org/10.1371/journal.pone.0120012
Academic Editor: Oliver Schildgen, Kliniken der Stadt Köln gGmbH, GERMANY
Received: December 2, 2014; Accepted: February 2, 2015; Published: March 18, 2015
Copyright: © 2015 Oved et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This study was funded by MeMed. KO, AC, OB, RN, TF, LE, EB and EE are employed by MeMed. YF and OK were previously employed by MeMed. MeMed provided support in the form of salaries for authors KO, AC, OB, RN, TF, LE, EB, EE, YF and OK, and was responsible for protein measurements and multiparametric signature development. Clinical investigators and MeMed affiliated authors collaborated on the study design, data collection and analysis, decision to publish, and preparation of the manuscript as articulated in the ‘author contributions’ section. Galit Denkberg is employed by Applied Immune Technologies. GD contributed to this work in her free time without any compensation from MeMed or Applied Immune Technologies. Applied Immune Technologies did not have a role in the study, design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific role of this author is articulated in the ‘author contributions’ section.
Competing interests: This study was funded by MeMed. KO, AC, OB, RN, TF, LE, EB and EE are employed by MeMed. TF and KO were previously employed by MeMed. Professors PF, IP, and YR report holding equity ownership or stock-options in MeMed. Drs. IC, YD, MG, and AH were part of the clinical expert panel and received hourly fees from MeMed. Prof. RD received consulting fees from MeMed. All MeMed affiliated authors hold stock options. GD is employed by Applied Immune Technologies. Dr. GD contributed to this work in her free time without any compensation from MeMed or Applied Immune Technologies. Drs. EE and KO have two related patents: WO 2011/132086 (Signatures and determinants for distinguishing between a bacterial and viral infection and methods of use thereof) and WO 2013/117746 (Signatures and determinants for diagnosing infections and methods of use thereof). MeMed has the following related products: ImmunoXpert™ and ImmunoPoC™ (in development). This does not alter the authors’ adherence to PLOS ONE policies on sharing data and materials.
Introduction
Antibiotic overuse, typically stemming from use of these drugs to treat non-bacterial infections, has severe global health and economic consequences, including the emergence of antibiotic-resistant bacteria [1,2]. Antibiotic underuse due to delayed or missed diagnosis is also common (24%-40% of all bacterial infections) [3–6], and may result in prolonged disease state and medical complications [7–10]. A major cause of antibiotic overuse and underuse is the difficulty of distinguishing between bacterial and non-bacterial (mostly viral) etiologies [3,11]. While routinely used microbiological diagnostic tests such as culture, serology, and more recently nucleic acid based tests (e.g., RT-PCR) can assist the clinician in the etiological determination of the underlying infectious process, several challenges remain. These include: (i) pathogen detection in cases where the infection site is not readily accessible (e.g., pneumonia), or is unknown (e.g., fever without source); (ii) time to microbiological laboratory results may be lengthy (hours or days); (iii) interpreting whether a detected bacteria is the disease causing agent or a mere colonizer [12–14], and (iv) identification of a virus does not preclude the possibility that an undetected bacteria may be the cause of the underlying illness (i.e. a case of mixed infection with both virus and bacteria) [15,16].
An approach that has the potential to address these challenges relies on monitoring the host's immune-response to infection, rather than direct pathogen detection [17]. Recent studies examining host-RNA signatures in response to different infections show promising results [17–21]. However, quantitative and rapid measurements (within minutes) of multiple host-RNAs in the clinical setting remain a technical challenge, especially at the point-of-care where most antibiotics prescriptions are made. Circulating host-proteins are an attractive alternative as they can be rapidly measured at the point of need. Proteins that are routinely used to support diagnosis of infection include procalcitonin, C-reactive protein (CRP), and Interleukin-6 (IL-6) [22]. However, these markers are sensitive to inter-patient variability, including time from symptom onset, clinical syndrome, and pathogen species [22–27]. For example, multiple studies found that procalcitonin is valuable for guiding antimicrobial therapy duration and for predicting disease severity [28–30], however its diagnostic accuracy for detecting bacterial etiology in cases such as sepsis and pneumonia has been challenged [23,31–34]. Elevated CRP levels are suggestive of a bacterial infection [35], but similar levels may be observed in patients with some viral strains (e.g., adenovirus and influenza) [36], and inflammatory diseases. While IL-6 rises quickly in response to a bacterial trigger, its utility is dampened by a limited window of opportunity for measurement due to its rapid decay within approximately 36 hours [37].
To improve the performance of individual host-proteins, combinations of several proteins into a single predictive score have been proposed [11,38–43]. However, to date, in most studies these combinations provided only limited-to-moderate diagnostic improvement over individual proteins. This may be explained by the predominant focus on bacterial-induced proteins (e.g., procalcitonin, IL-6, IL-8, SAA, CRP and sTREM), which share biological pathways, and are thus inherently sensitive to the same factors. Therefore, we reasoned that the combination of unrelated host-proteins participating in different pathways may improve diagnostic accuracy. In particular, the inclusion of new host-proteins that are up-regulated in viral infections may be an innovative complement to bacterially-induced proteins in current clinical use.
Accordingly, the aims of the present study were threefold: to perform a large-scale screen of novel and traditional host-proteins; to integrate the findings into a computational signature for accurate diagnosis of acute bacterial (or mixed) versus viral infections; and to validate the signature on an independent cohort of patients.
Materials and Methods
Ethics Statement
We prospectively recruited 1002 patients between August 2009 and November 2013 from Hillel-Yaffe and Bnai-Zion Medical Centers, Israel (NCT01917461). The study was approved by the Hillel-Yaffe Medical Center Institutional Review Board (approval ID 0071–10-HYMC), and the Bnai-Zion Medical Center Institutional Review Board (approval ID 0084–12-BNZ). The study was conducted according to the guidelines and recommendations of Good Clinical Practice and the Declaration of Helsinki. Written informed consent was obtained from each participant or legal guardian, as applicable.
Study population
Pediatric patients (≤18 years) were recruited from pediatric emergency departments, pediatric wards and surgical departments, and adults (>18 years) from emergency departments, internal medicine departments and surgical departments. Inclusion criteria for the infectious disease cohort included: clinical suspicion of an acute infectious disease, peak fever >37.5°C since onset of symptoms, and duration of symptoms ≤12 days. Inclusion criteria for the control group included: clinical impression of a non-infectious disease (e.g., trauma, stroke and myocardial infarction), or healthy subjects. Exclusion criteria included: evidence of acute infection in the two weeks preceding enrollment; congenital immune deficiency; treatment with immunosuppressive or immunomodulatory therapy; active malignancy; and human immunodeficiency virus (HIV)-1, or hepatitis B/C virus infection (Fig. 1A). Importantly, in order to enable broad generalizability, antibiotic treatment was not an exclusion criterion.
(A) An overview of the study workflow. nBacterial, nViral and nControl represent the number of bacterial (including mixed bacterial plus viral co-infections), viral and control (with no apparent infectious disease) cases, respectively. CBC—complete blood count. (B) An overview of protein screening, model construction and validation process.
Enrollment process and data collection
For each patient, the following baseline variables were recorded: demographics, medical history, physical examination, complete blood count obtained at enrollment, and chemistry panel. A nasal swab was obtained for microbiological investigation including two multiplex-PCR diagnostic assays (Seeplex RV15 [n = 713; 16 viral strains] and Seeplex PB6 [n = 633; six bacterial strains]), and a blood sample was obtained for host-protein measurements. Additional samples were obtained as deemed appropriate by the physician (e.g., urine [n = 420], stool [n = 66] and blood [n = 420] samples in cases of suspected urinary tract infection [UTI], gastroenteritis [GI] and bacteremia respectively) (S1 Data). Radiological tests were obtained at the discretion of the physician (e.g., chest X-ray for suspected lower respiratory tract infection [LRTI]). Thirty days after enrollment, disease course and response to treatment were recorded.
Establishing the reference standard
For determining the infectious etiology we created a rigorous expert panel reference standard [44], which follows the broadly accepted recommendations of the Standards for Reporting of Diagnostic Accuracy (STARD)[45], and the NHS Health Technology Assessment (NHS-HTA) for evaluation of diagnostic tests [46]. First, we performed a thorough clinical and microbiological investigation for each patient as described above. This was followed by a review of the data collected throughout the disease course by a panel of three physicians. For adult patients the panel included the attending physician and two infectious disease specialists, while for children it included the attending pediatrician, an infectious disease expert and a senior attending pediatrician. Each panel member assigned one of the following diagnostic labels to each patient: (i) bacterial; (ii) viral; (iii) no apparent infectious disease or healthy (controls); and (iv) indeterminate. Patients diagnosed by the panel as having mixed infections (bacteria and virus) were labeled as bacterial because they are managed similarly. The panel members were blinded to the labeling of their peers to prevent group pressure or influential personality bias as recommended by NHS-HTA [46]. Importantly, they were blinded to the results of the signature. Final diagnosis was determined by panel majority (i.e. at least two of the three panel members assigned the same label) (Fig. 1A).
To examine the generalizability of the results it is recommended to examine whether alternative reference standard strategies affect performance [44,46]. Thus, two additional strategies were applied: (i) Unanimous sub-cohort: Patients were assigned the same label by all three panel members; and (ii) Microbiologically confirmed sub-cohort: Bacterial labeled patients were unanimously diagnosed by all three panel members and had one of the following microbiological confirmations: bacteremia (with positive blood culture), bacterial meningitis (with positive CSF culture), lower UTI (with positive urine culture), upper UTI (with positive urine culture and ultrasound demonstration of renal involvement) or peritonsillar abscess (proven by surgical exploration or computerized tomography). Viral labeled patients were unanimously diagnosed by panel members and had at least one laboratory detected virus.
Samples, procedures and protein measurements
Venous blood samples were stored at 4°C for up to 5 hours, subsequently fractionated into plasma, serum and total leukocytes, and stored at -80°C. Nasal swabs and stool samples were stored at 4°C for up to 72 hours and subsequently transported to a certified service laboratory for multiplex PCRs. In the screening phase, host-proteins were measured using enzyme-linked immunosorbent-assay (ELISA), Luminex, protein-arrays and flow-cytometry. The three proteins used in the final signature were measured as follows: CRP using either Cobas-6000, Cobas-Integra-400/800, or Modular-Analytics-P800 (Roche); TRAIL and IP-10 using commercial ELISA kits (MeMed Diagnostics).
Statistical analysis
Primary analysis was based on AUC, Sensitivity (TP/P), Specificity (TN/N), Positive likelihood ratio (LR+ = Sensitivity/[1-Specificity]), Negative likelihood ratio (LR− = [1–Sensitivity]/Specificity) and Diagnostic odds ratio (DOR = LR+/LR−), where P, N, TP and TN correspond to positives (bacterial patients), negatives (viral patients), true positives, and true negatives, respectively. Sample size calculations are presented in S2 Data. Half of the patients in the study were randomly assigned to the training-set (used for protein screening and model development), and the remaining half to a mutually exclusive validation-set (used to assess model performance). Importantly, none of the validation-set patients were used to train the algorithms, or to select the proteins (Fig. 1). A multinomial logistic regression model was used to integrate the levels of multiple proteins into a bacterial likelihood score. Patients whose probability of bacterial infection was intermediate, between 0.35 and 0.55, were flagged. We use the term 'equivocal immune response' to describe these patients because their profile borders between bacterial and viral host-responses. Statistical analysis was performed using MATLAB (MathWorks).
Results
Patient characteristics
Final diagnosis was attained in 765 patients (Fig. 1A). Additionally, 98 patients were labeled as indeterminate because disease etiology could not be established (Table 1). The cohort was balanced with respect to gender (47% females, 53% males) and included 56% pediatric patients (≤18 years) and 44% adults (>18 years). Patients presented with a wide range of clinical syndromes (e.g. RTI, UTI, and GI), maximal temperatures (36–41.5°C), time from symptom onset (0–12 days), comorbidities, and medications (Table 1 and S3 Data). Altogether, 56 pathogen species were detected that are responsible for the majority of acute infections in the Western world (S3 Data).
Host-protein screening and signature development
A general overview of the process for developing, training and validating the multivariate logistic model is depicted in Fig. 1B. We performed a systematic literature and bioinformatics screening to identify 600 proteins that may be differentially expressed in response to infection (S2 Data). Next, each protein candidate was measured on 20–30 patients from the training-set (50% viral, 50% bacterial) and a Wilcoxon rank-sum P-value<0.01 was used to screen 86 proteins exhibiting statistically significant differential expression. Each of these was then evaluated in 100 additional patients (50% viral, 50% bacterial) and further screened using a t-test P<10–3 and a Bonferroni correction for multiple hypothesis testing, enabling downselection to 17 proteins (Fig. 1B). Multiple feature selection algorithms and computational models were evaluated to identify the optimal combination out of the final 17 proteins (S2 Data). The most discriminative signature (AUC of 0.95±0.03 attained on the training-set) used logistic regression to integrate the levels of the following viral- and bacterial-induced proteins (Fig. 2): TRAIL (member of the tumor necrosis factor family implicated in programmed cell death) [47], IP-10 (small cytokine implicated in multiple cellular processes including chemotaxis and cell growth inhibition) [48], and CRP (acute phase protein with diverse roles in tissue injury, infection and other inflammation processes) [49].
Box plots for TRAIL (A), IP-10 (B), and CRP (C), measured over the entire study cohort (n = 765) are presented. Red line and circle correspond to group median and average respectively; t-test p-values between bacterial and viral groups and between infectious (bacterial and viral) vs non-infectious (including healthy subjects) are depicted.
Signature performance on the validation-set
We evaluated the signature performance using an independent validation-set that was neither used to screen the host-proteins nor to develop the signature. The AUC for distinguishing between bacterial and viral infections for the validation-set was 0.94±0.04. Similar results were obtained using leave-10%-out cross-validation on the entire cohort (AUC = 0.94±0.02), which supports signature generalizability (Table 2). The signature significantly outperformed all the individual proteins evaluated in the screening phase (P<10–6).
Next, we used the signature to distinguish between infectious (bacterial or viral) and non-infectious controls, which yielded an AUC of 0.96±0.02 for the validation-set. Further evaluation using leave-10%-out cross-validation confirmed the results (AUC = 0.96±0.01), outperforming any of the individual proteins (P<10–8).
Signature performance is robust across different patient subgroups
To examine whether the signature can maintain steady performance despite patient-to-patient variability, we performed subgroup analyses. The signature robustly distinguished between bacterial and viral infections (AUCs between 0.87 and 1.0) across a wide range of patient characteristics, including age, clinical syndrome, time from symptom onset, maximal temperature, comorbidities and pathogen species (Fig. 3A and S4 Data).
(A) Signature AUCs in subgroups of the study cohort (bacterial and viral) are depicted. Square size is proportional to number of patients and error bars represent 95% CI. In the Pathogens analysis, each virus was compared to bacteria affecting the same physiological system, indicated in brackets. R-respiratory, C-central nervous system, G-gastrointestinal, U-urinary, K-skin, S-systemic (i.e. non-localized). Only pathogens detected in more than 5 patients are presented. PED—pediatric emergency departments, ED—emergency departments. For subgroup definitions see Table 1 legend. (B) Performance of clinical and lab parameters as well as the best performing pair (ANC and Lym %), triplet (ANC, Lym % and Pulse), and quadruplets (ANC, Lym %, Pulse, Mono %) of parameters, the values of which were combined using a logistic regression. Comparison was done on the entire study cohort (n = 653), apart from pulse (recorded in 292 bacterial and 326 viral patients), and respiratory rate (recorded in 292 bacterial and 326 viral patients). The signature performed significantly better (P<10–15) than the optimal quadruplet. (C) The signature performed significantly better (P<10–8) than biomarkers with a well-established role in the host response to infections. For each of the select biomarkers, analysis was performed in a subgroup of the study cohort (43≤n≤154 for each analysis, a convenience sample, n depended on the strength of the signal). Error bars represent 95% CI.
Next, we analyzed the degree to which alternative strategies for determining the reference standard affect performance [44,46]. Two strategies were applied. First, the Unanimous sub-cohort, whereby patient diagnosis was unanimously assigned by all three panel experts (nTotal = 639, nBacterial = 256, nViral = 271, nControl = 112), yielded an AUC of 0.96±0.02 using leave-10%-out cross-validation. Second, the Microbiologically confirmed sub-cohort (nTotal = 353, nBacterial = 68, nViral = 173, nControl = 112) yielded an AUC of 0.96±0.04.
To ensure conservative performance estimates and generalizability of results the analysis that follows focuses on the entire study cohort, rather than on the Unanimous or Microbiologically confirmed sub-cohort, which showed slightly improved performances.
The Signature outperforms laboratory measurements, clinical parameters, and well-established biomarkers
We compared the performance of the signature to that of well-established clinical parameters and laboratory measurements, including white blood count (WBC), absolute neutrophil count (ANC), percentage neutrophils, maximal temperature, pulse, and respiratory rate (Fig. 3B and S6 Data). The signature surpassed all individual parameters (P<10–18). Next, we compared the signature to combinations of clinical parameters, which were developed using the same computational techniques used to construct the signature. The best performing pair, triplet and quadruplet are depicted in Fig. 3B (adding a fifth parameter did not improve performance). The signature surpassed the best performing combination of clinical parameters (AUC = 0.94±0.02 vs 0.77±0.04, P<10–15), which comprised ANC, pulse, % lymphocytes and % monocytes. Next, we compared the performance of the signature to that of procalcitonin and CRP, two proteins used in clinical practice to diagnose bacterial infections. The signature performed significantly better than both proteins and their combination (P<10–8, P<10–6, P<10–6 respectively; S6 Data). The signature also performed better than a wide range of host-proteins with an established role in the immune response to infection, including bacterial-related (e.g. TREM, IL-6 and IL-8), virus-related (e.g. IFN-γ and IL-2), and inflammation-related (e.g. IL-1a and TNF-α) proteins (P<10–8) (Fig. 3C and S6 Data).
Signature performance is unaffected by the presence of potential colonizers
Many disease-causing bacteria are also part of the natural flora, and are frequently found in asymptomatic subjects [12–14]. Such bacteria pose a considerable diagnostic challenge, because merely detecting them does not necessarily imply a causative role in the disease; therefore, appropriate treatment may remain unclear. Accordingly, we asked whether the performance of the signature is affected by the presence of colonizers.
Streptococcus pneumoniae (SP) and Haemophilus influenzae (HI), detected by PCR on nasal swabs, were the two most common bacteria found in the study group (Table 1). High rates of SP and HI were observed amongst both bacterial and viral patients (SP: 36% and 47%; HI: 20% and 32%), substantiating the understanding that their mere presence does not necessarily cause disease [12]. We stratified the patients based on whether or not they had SP (SP+: nBacterial = 116, nViral = 157; SP-: nBacterial = 203, nViral = 177) and compared the AUC performance of the two groups. We did not observe a significant difference (0.93±0.03 vs 0.94±0.02, P = 0.31). The presence or absence of HI did not affect signature performance either (0.94±0.04 vs 0.93±0.02; HI+: nBacterial = 63, nViral = 106; HI-: nBacterial = 256, nViral = 228, P = 0.34). This indicates that the signature is unaffected by potential carriage of SP and HI.
Discussion
The host-protein signature presented here addresses several challenges of current microbiological testing. (i) The difficulty of diagnosing patients whose infection site is inaccessible or unknown. The signature accurately diagnosed such cases, including LRTI (AUC 0.95±0.03, n = 153) and fever without source (AUC = 0.97±0.03, n = 123). (ii) Prolonged time to results (hours to days). The signature measures soluble proteins, which can be quantitated using an ELISA format. Moreover, these proteins are readily amenable to rapid measurement (within minutes) using hospital-deployed automated immunoassay machines and point-of-care devices. (iii) Identification of a virus does not exclude the possibility of mixed infection involving an undetected bacteria [15,16]. The signature classifies mixed infections with pure bacterial infections, thus prompting physicians to manage both groups similarly with regard to antibiotic treatment. (iv) A significant drawback of microbiological tests, PCRs in particular, is the detection of potential colonizers in subjects with non-bacterial diseases [12–14]. The signature performance was unaffected by the presence or absence of potential colonizers.
The proteins included in the signature are not limited to well-established bacterial biomarkers. Six hundred host-proteins were screened (Fig. 1B), which to the best of our knowledge, is the largest quantitative proteome screening of patients with acute infection to date. Bioinformatics analysis was then used to identify a combination of three proteins with complementary dynamics: (i) We found that TRAIL was induced in response to a wide range of viral infections and surprisingly, also exhibited significantly reduced levels in bacterial infected patients (Fig. 2 and 4). Such opposing dynamics make TRAIL particularly suitable for distinguishing between bacterial and viral infections. The increase in viral patients may be related to TRAIL's role in programed cell death, which is a mechanism of infected cells to inhibit the virus from spreading [47]. The underlying reason for its reduction in bacterial infections warrants further studies. (ii) IP-10 levels were highly elevated in viral patients and less elevated in bacterial patients (Fig. 2 and 4). (iii) CRP levels were highly elevated in bacterial patients and less elevated in viral patients (Fig. 2 and 4). While the utility of increased CRP levels to suggest bacterial infections is well established [49], viral-induced proteins such as TRAIL are not used in clinical practice. The combination of novel viral-induced proteins that complement routinely used bacterial-induced proteins, substantially contributed to the signature’s robustness across a wide range of subgroups.
PAMPs—pathogen-associated molecular patterns; PGN—peptidoglycan; LPS—lipopolysaccharide.
Currently, there is no single perfect reference standard for diagnosing bacterial and viral infections in a large fraction of the patients with symptoms of an acute infection. Several strategies can be applied, each with strengths and limitations [46]. Clinical suspicion confirmed by positive microbiological lab results is often used as a reference standard. However, limitations include false-positives due to technical issues (e.g., culture contamination [50,51] and uncertainty due to viral and bacterial carriage [12–14]). Moreover, these patients may represent the more severely ill, and potentially easier to diagnose cases, leading to overly optimistic performance. The expert panel diagnosis is another widely used approach [44,46]. It has the advantage of capturing a wider spectrum of illness severities including difficult-to-diagnose cases, and is therefore likely to generalize well to clinical practice [44,46]. However, the absence of a microbiological confirmation may lead to higher rates of mislabeling. Since these methods complement each other we applied both. A microbiologically confirmed reference standard was used for proof-of-principle on a sub-cohort of the patients yielding particularly high performance (AUC = 0.96±0.02), and the expert panel reference standard was used to generalize the results to the entire patient cohort (AUC = 0.94±0.02). The latter results are more conservative and likely to represent the performance of the signature in the real clinical setting.
A potential limitation of the current study is the heterogeneity of the patient cohort (multiple clinical syndromes, pathogen species, and time from onset of symptoms). We deliberately selected a diverse cohort in order to identify a signature that is insensitive to the inter-patient variability typically encountered in clinical settings. However, this diversity makes it more challenging to control for confounding factors. Although we did not identify significant confounders, follow-up studies on homogenous subgroups are warranted.
Finally, the present signature has broader applications beyond the scope of the present study that warrant further investigation. Future studies should seek to replicate our findings with patients of different ethnic populations, particularly in countries with a high prevalence of endemic chronic pathogens (e.g. Mycobacterium tuberculosis, Plasmodium and HIV). Follow-up time course studies that assess whether the signature can predict response to treatment and patient prognosis are also warranted.
Despite advances in infectious disease diagnosis, timely identification of bacterial infections remains challenging, leading to antibiotic misuse with its profound health and economic consequences. To address the need for better treatment guidance, we developed and validated a signature that combines novel and traditional host-proteins for differentiating between bacterial and viral infections. Our finding in a large sample size of patients is promising. The translational benefit could have a broad impact on the diagnosis and management of patients with acute infections.
Supporting Information
S2 Data. Data analysis and statistical methods.
https://doi.org/10.1371/journal.pone.0120012.s002
(PDF)
S4 Data. The signature performance remains robust across different patient subgroups.
https://doi.org/10.1371/journal.pone.0120012.s004
(PDF)
S5 Data. Performance analysis as a function of the prevalence of bacterial infections.
https://doi.org/10.1371/journal.pone.0120012.s005
(PDF)
S6 Data. Comparison of the signature with alternative diagnostic methods.
https://doi.org/10.1371/journal.pone.0120012.s006
(PDF)
Acknowledgments
We thank Harel Todar and Dr. Mira Peled Kamar for logistic support, Mr. Carlos G. Gonzalez for graphic assistance and Dr. Iris Kulbatski, Dr. Zohar Yakhini and Prof. Itamar Shalit for scientific comments and reviewing the manuscript.
Author Contributions
Conceived and designed the experiments: KO IP YR IS AK EE. Performed the experiments: OB TF LE OK YF RY RW GD YD AH MG IC. Analyzed the data: KO AC OB RN PF MG EE. Wrote the paper: KO AC EB MG IS PF RD IP EE. Interpretation of results: KO AC RN EB RD EE. Critically revised the manuscript: OB RN TF LE OK YF RY RW GD YD AH YR MG IC AK.
References
- 1. Laxminarayan R, Duse A, Wattal C, Zaidi AKM, Wertheim HFL, Sumpradit N, et al. Antibiotic resistance—the need for global solutions. Lancet Infect Dis. 2013;13: 1057–1098. pmid:24252483
- 2.
Threat Report 2013 | Antimicrobial Resistance | CDC [Internet]. [cited 10 Nov 2013]. Available: http://www.cdc.gov/drugresistance/threat-report-2013/
- 3. Craig JC, Williams GJ, Jones M, Codarini M, Macaskill P, Hayen A, et al. The accuracy of clinical symptoms and signs for the diagnosis of serious bacterial infection in young febrile children: prospective cohort study of 15 781 febrile illnesses. BMJ. 2010;340: c1594. pmid:20406860
- 4. Dedier J, Singer DE, Chang Y, Moore M, Atlas SJ. Processes of care, illness severity, and outcomes in the management of community-acquired pneumonia at academic hospitals. Arch Intern Med. 2001;161: 2099–2104. pmid:11570938
- 5. Caterino JM, Hiestand BC, Martin DR. Quality of care in elder emergency department patients with pneumonia: a prospective cohort study. BMC Emerg Med. 2008;8: 6. pmid:18447936
- 6. Houck PM. Timing of antibiotic administration and outcomes for medicare patients hospitalized with community-acquired pneumonia. Arch Intern Med. 2004;164: 637–644. pmid:15037492
- 7. Van Zuijlen DA, Schilder AG, Van Balen FA, Hoes AW. National differences in incidence of acute mastoiditis: relationship to prescribing patterns of antibiotics for acute otitis media? Pediatr Infect Dis J. 2001;20: 140–144. pmid:11224830
- 8. Proulx N, Fréchette D, Toye B, Chan J, Kravcik S. Delays in the administration of antibiotics are associated with mortality from adult acute bacterial meningitis. QJM. 2005;98: 291–298. pmid:15760921
- 9. Lodise TP, McKinnon PS, Swiderski L, Rybak MJ. Outcomes Analysis of Delayed Antibiotic Treatment for Hospital-Acquired Staphylococcus aureus Bacteremia. Clin Infect Dis. 2003;36: 1418–1423. pmid:12766837
- 10. Meehan TP, Fine MJ, Krumholz HM, Scinto JD, Galusha DH, Mockalis JT, et al. Quality of care, process, and outcomes in elderly patients with pneumonia. JAMA J Am Med Assoc. 1997;278: 2080–2084.
- 11. Van den Bruel A, Thompson MJ, Haj-Hassan T, Stevens R, Moll H, Lakhanpaul M, et al. Diagnostic value of laboratory tests in identifying serious infections in febrile children: systematic review. BMJ. 2011;342: d3082. pmid:21653621
- 12. Bogaert D, De Groot R, Hermans PWM. Streptococcus pneumoniae colonisation: the key to pneumococcal disease. Lancet Infect Dis. 2004;4: 144–154. pmid:14998500
- 13.
Rhedin S, Lindstrand A, Rotzén-Östlund M, Tolfvenstam T, Öhrmalm L, Rinder MR, et al. Clinical Utility of PCR for Common Viruses in Acute Respiratory Illness. Pediatrics. 2014; peds.2013–3042. doi:10.1542/peds.2013–3042
- 14. Shaikh N, Leonard E, Martin JM. Prevalence of streptococcal pharyngitis and streptococcal carriage in children: a meta-analysis. Pediatrics. 2010;126: e557–564. pmid:20696723
- 15. Falsey AR, Becker KL, Swinburne AJ, Nylen ES, Formica MA, Hennessey PA, et al. Bacterial Complications of Respiratory Viral Illness: A Comprehensive Evaluation. J Infect Dis. 2013;208: 432–441. pmid:23661797
- 16. Thorburn K, Harigopal S, Reddy V, Taylor N, van Saene HKF. High incidence of pulmonary bacterial co-infection in children with severe respiratory syncytial virus (RSV) bronchiolitis. Thorax. 2006;61: 611–615. pmid:16537670
- 17. Ramilo O, Mejías A. Shifting the paradigm: host gene signatures for diagnosis of infectious diseases. Cell Host Microbe. 2009;6: 199–200. pmid:19748461
- 18. Ramilo O, Allman W, Chung W, Mejias A, Ardura M, Glaser C, et al. Gene expression patterns in blood leukocytes discriminate patients with acute infections. Blood. 2007;109: 2066–2077. pmid:17105821
- 19. Woods CW, McClain MT, Chen M, Zaas AK, Nicholson BP, Varkey J, et al. A host transcriptional signature for presymptomatic detection of infection in humans exposed to influenza H1N1 or H3N2. PloS One. 2013;8: e52198. pmid:23326326
- 20. Zaas AK, Burke T, Chen M, McClain M, Nicholson B, Veldman T, et al. A host-based RT-PCR gene expression signature to identify acute respiratory viral infection. Sci Transl Med. 2013;5: 203ra126.
- 21. Zaas AK, Chen M, Varkey J, Veldman T, Hero AO 3rd, Lucas J, et al. Gene expression signatures diagnose influenza and other symptomatic respiratory viral infections in humans. Cell Host Microbe. 2009;6: 207–217. pmid:19664979
- 22. Limper M, de Kruif MD, Duits AJ, Brandjes DPM, van Gorp ECM. The diagnostic role of Procalcitonin and other biomarkers in discriminating infectious from non-infectious fever. J Infect. 2010;60: 409–416. pmid:20347867
- 23. Tang BM, Eslick GD, Craig JC, McLean AS. Accuracy of procalcitonin for sepsis diagnosis in critically ill patients: systematic review and meta-analysis. Lancet Infect Dis. 2007;7: 210–217. pmid:17317602
- 24. Engel MF, Paling FP, Hoepelman AIM, van der Meer V, Oosterheert JJ. Evaluating the evidence for the implementation of C-reactive protein measurement in adult patients with suspected lower respiratory tract infection in primary care: a systematic review. Fam Pract. 2012;29: 383–393. pmid:22159030
- 25. Quenot J-P, Luyt C-E, Roche N, Chalumeau M, Charles P-E, Claessens Y-E, et al. Role of biomarkers in the management of antibiotic therapy: an expert panel review II: clinical use of biomarkers for initiation or discontinuation of antibiotic therapy. Ann Intensive Care. 2013;3: 21. pmid:23830525
- 26. Van der Meer V, Neven AK, van den Broek PJ, Assendelft WJJ. Diagnostic value of C reactive protein in infections of the lower respiratory tract: systematic review. BMJ. 2005;331: 26. pmid:15979984
- 27. Falk G, Fahey T. C-reactive protein and community-acquired pneumonia in ambulatory care: systematic review of diagnostic accuracy studies. Fam Pract. 2009;26: 10–21. pmid:19074757
- 28.
Henriquez-Camacho C, Losa J. Biomarkers for sepsis. BioMed Res Int. 2014;2014: 547818. doi:10.1155/2014/547818
- 29. Schuetz P, Müller B, Christ-Crain M, Stolz D, Tamm M, Bouadma L, et al. Procalcitonin to initiate or discontinue antibiotics in acute respiratory tract infections. Cochrane Database Syst Rev. 2012;9: CD007498.
- 30. Reinhart K, Meisner M. Biomarkers in the critically ill patient: procalcitonin. Crit Care Clin. 2011;27: 253–263. pmid:21440200
- 31. Pierrakos C, Vincent J-L. Sepsis biomarkers: a review. Crit Care Lond Engl. 2010;14: R15. pmid:20144219
- 32. Musher DM, Roig IL, Cazares G, Stager CE, Logan N, Safar H. Can an etiologic agent be identified in adults who are hospitalized for community-acquired pneumonia: results of a one-year study. J Infect. 2013;67: 11–18. pmid:23523447
- 33. Musher DM, Bebko SP, Roig IL. Serum procalcitonin level, viral polymerase chain reaction analysis, and lower respiratory tract infection. J Infect Dis. 2014;209: 631–633. pmid:24218499
- 34. Polzin A, Pletz M, Erbes R, Raffenberg M, Mauch H, Wagner S, et al. Procalcitonin as a diagnostic tool in lower respiratory tract infections and tuberculosis. Eur Respir J. 2003;21: 939–943. pmid:12797485
- 35. Woodhead M, Blasi F, Ewig S, Garau J, Huchon G, Ieven M, et al. Guidelines for the management of adult lower respiratory tract infections—Full version. Clin Microbiol Infect. 2011;17: E1–E59. pmid:21951385
- 36.
Kunze W, Beier D, Groeger K. Adenovirus Respiratory Infections In Children. Do They Mimic Bacterial Infections? 2010; Available: http://www.webmedcentral.com/article_view/1098
- 37. Waage A, Brandtzaeg P, Halstensen A, Kierulf P, Espevik T. The complex pattern of cytokines in serum from patients with meningococcal septic shock. Association between interleukin 6, interleukin 1, and fatal outcome. J Exp Med. 1989;169: 333–338. pmid:2783334
- 38. Bafadhel M, Clark TW, Reid C, Medina M, Batham S, Barer MR, et al. Procalcitonin and C-reactive protein in hospitalized adult patients with community-acquired pneumonia or exacerbation of asthma or COPD. Chest. 2011;139: 1410–1418. pmid:21030489
- 39. Gibot S, Béné MC, Noel R, Massin F, Guy J, Cravoisy A, et al. Combination biomarkers to diagnose sepsis in the critically ill patient. Am J Respir Crit Care Med. 2012;186: 65–71. pmid:22538802
- 40. Thayyil S, Shenoy M, Hamaluba M, Gupta A, Frater J, Verber IG. Is procalcitonin useful in early diagnosis of serious bacterial infections in children? Acta Paediatr Oslo Nor 1992. 2005;94: 155–158. pmid:15981747
- 41. Galetto-Lacour A, Zamora SA, Gervaix A. Bedside procalcitonin and C-reactive protein tests in children with fever without localizing signs of infection seen in a referral center. Pediatrics. 2003;112: 1054–1060. pmid:14595045
- 42. Lacour AG, Gervaix A, Zamora SA, Vadas L, Lombard PR, Dayer JM, et al. Procalcitonin, IL-6, IL-8, IL-1 receptor antagonist and C-reactive protein as identificators of serious bacterial infections in children with fever without localising signs. Eur J Pediatr. 2001;160: 95–100. pmid:11271398
- 43. Robriquet L, Séjourné C, Kipnis E, D Herbomez M, Fourrier F. A composite score combining procalcitonin, C-reactive protein and temperature has a high positive predictive value for the diagnosis of intensive care-acquired infections. BMC Infect Dis. 2013;13: 159. pmid:23547830
- 44. Bertens LCM, Broekhuizen BDL, Naaktgeboren CA, Rutten FH, Hoes AW, van Mourik Y, et al. Use of expert panels to define the reference standard in diagnostic research: a systematic review of published methods and reporting. PLoS Med. 2013;10: e1001531. pmid:24143138
- 45. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration. Ann Intern Med. 2003;138: W1–W12. pmid:12513067
- 46. Rutjes AWS, Reitsma JB, Coomarasamy A, Khan KS, Bossuyt PMM. Evaluation of diagnostic tests when there is no gold standard. A review of methods. Health Technol Assess Winch Engl. 2007;11: iii, ix–51.
- 47. Falschlehner C, Schaefer U, Walczak H. Following TRAIL’s path in the immune system. Immunology. 2009;127: 145–154. pmid:19476510
- 48. Liu M, Guo S, Hibbert JM, Jain V, Singh N, Wilson NO, et al. CXCL10/IP-10 in infectious diseases pathogenesis and potential therapeutic implications. Cytokine Growth Factor Rev. 2011;22: 121–130. pmid:21802343
- 49. Gabay C, Kushner I. Acute-Phase Proteins and Other Systemic Responses to Inflammation. N Engl J Med. 1999;340: 448–454. pmid:9971870
- 50. Hall KK, Lyman JA. Updated review of blood culture contamination. Clin Microbiol Rev. 2006;19: 788–802. pmid:17041144
- 51. Richter SS, Beekmann SE, Croco JL, Diekema DJ, Koontz FP, Pfaller MA, et al. Minimizing the workup of blood culture contaminants: implementation and evaluation of a laboratory-based algorithm. J Clin Microbiol. 2002;40: 2437–2444. pmid:12089259