Natriuretic peptides (BNP and NT-proBNP) are recognized as gold-standard predictive markers in Heart Failure (HF). However, currently ST2 (member of the interleukin 1 receptor family) has emerged as marker of inflammation, fibrosis and cardiac stress. We evaluated ST2 and CRP as prognostic markers in 178 patients with chronic heart failure in comparison with other classical markers such as clinical established parameters but also biological markers: NT-proBNP, hs-cTnT alone or in combination. In multivariate analysis, subsequent addition of ST2 led to age, CRP and ST2 as the only remaining predictors of all-cause mortality (HR 1.03, HR 1.61 and HR 2.75, respectively) as well as of cardiovascular mortality (HR 1.00, HR 2.27 and HR 3.78, respectively). The combined increase of ST2 and CRP was significant for predicting worsened outcomes leading to identify a high risk subgroup that individual assessment of either marker. The same analysis was performed with ST2 in combination with Barcelona score. Overall, our findings extend previous data demonstrating that ST2 in combination with CRP as a valuable tool for identifying patients at risk of death.
Citation: Dupuy AM, Curinier C, Kuster N, Huet F, Leclercq F, Davy JM, et al. (2016) Multi-Marker Strategy in Heart Failure: Combination of ST2 and CRP Predicts Poor Outcome. PLoS ONE 11(6): e0157159. https://doi.org/10.1371/journal.pone.0157159
Editor: Markus M. Bachschmid, Boston University, UNITED STATES
Received: December 22, 2015; Accepted: May 25, 2016; Published: June 16, 2016
Copyright: © 2016 Dupuy et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: all relevant data are within the paper.
Funding: The authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Heart failure (HF) results from multiple conditions leading to structural and functional changes. Indeed, HF is not simply a mechanical failure of the heart pump. In addition to the classical sympathetic overstimulation, various pathophysiological ways are involved. First, one of the main pathophysiological ways leading to HF is myocardial stress resulting in neurohormonal activation by natriuretic peptides, including B-type natriuretic peptide (BNP) and its amino-terminal cleavage fragment, NT-proBNP. Their interest is well established in both diagnosis and prognosis . Natriuretic peptides are recommended by 2013 ACC/AHA guidelines  and 2012 ESC guidelines for diagnosis and prognosis in chronic HF (class I), and for guidance of evidence based treatments (2013 ACC/AHA guidelines , class IIa). Secondly, local and systemic inflammation are clearly involved and reflected in clinical practice mainly by C-reactive protein (CRP) which is correlated with the severity and prognosis of HF [3–7]. Third, ventricular remodelling is also involved in association with hypertrophy and myocyte death and excessive renewal of the extracellular matrix . Fourth, iterative myocardial injuries could participate and could be reflected by low-level increased troponin without any clinically significant ischemic events. Consistently, low-level elevation of troponins were found correlated with prognosis . Finally, other markers such as oxidative stress or kidney dysfunction have been shown to be involved in the onset and development of HF .
Currently, natriuretic peptides (BNP and NT-proBNP) are recognized as gold-standard predictive markers in HF. However, when considered alone natriuretic peptides are not tailored to reflect the various pathophysiologic pathways in HF. Other markers might be then useful to improve risk stratification for patients with HF. Among emerging markers integrating inflammation, fibrosis and cardiac stress , ST2 (member of the interleukin 1 receptor family), has emerged as a promising prognostic marker. Recently, FDA has recognized the increasing importance of ST2 in chronic HF. ST2 is included in a novel bio-clinical algorithm (Barcelona bio-heart failure risk calculator) in association with NT-proBNP and high-sensitivity cardiac troponin T (hs-cTnT), which allowed accurately prediction of death at 1, 2, and 3 years .
In this context, the aim of our study was to evaluate ST2 as prognosis marker in a population with chronic HF in comparison with other classical markers such as clinical established parameters but also biological markers: NT-proBNP, CRP, hs-cTnT alone or in combination.
Between May 2010 and February 2011, 182 patients with stable HF were prospectively included in a single University Hospital (CHRU Montpellier, France). All participants provided written informed consent. The protocol was performed according to the principles of the Declaration of Helsinki, approved by the Ethic Committee of Montpellier and the biological collection registered by the French government (research Ministery, # DC-2009-1052).
To be eligible to the study, the patients were previously (at least 6 months before the inclusion) diagnosed with acute or chronic HF, as recommended by the European Society of Cardiology . Main inclusion criteria were the ability to give informed consent, age>18 years and confirmed diagnosis of HF, irrespectively of the cause or treatments. All clinical available data at the time of initial visit were collected by two cardiologists from the medical records of each patient. Comorbidities such as hypertension, diabetes, chronic obstructive pulmonary disease (COPD), chronic kidney disease, pulmonary embolism, myocarditis, smoking habit, dyslipidemia were recorded. Other clinical variables as age, gender, New York Heart Association (NYHA) class, ischemic etiology, left ventricular ejection fraction (LVEF), medications (angiotensin converting enzyme inhibitor: ACE or ARBs, betablockers, Ivabradine, aldosterone antagonists use, diuretics use, anti platelet agents and anticoagulants use, digoxin, statin, antiarrhythmic and others medications use) and laboratory values were also reported (Table 1). Main exclusion criteria were unstable angina or acute coronary syndrome in the past month, cardiac surgery and chemotherapy.
Follow up and outcomes
After inclusion, patients were followed by their cardiologist who decided the monitoring frequency according to guidelines. In December 2014, a dedicated physician was in charge of collecting the clinical data: primary endpoint (deaths of all causes), as well as the secondary endpoints (cardiovascular deaths, HF), and prescription of drugs including beta-blockers, ACE inhibitors or ARB, statins and the dosage of loop diuretics (mg/d).
Data collection was performed by analyzing the medical files and by phone with the general practitioner, the patient or the family. Cardiovascular death included death resulting from an acute myocardial infarction, sudden cardiac death, death due to HF, death due to stroke, death due to cardiovascular procedures, death due to cardiovascular hemorrhage.
Venous blood was collected in dry and EDTA tubes and was immediately centrifuged (the samples are transported in a mean total delay of less than 3 hours (all inclusive until frozen); in the biochemistry lab 95% are treated in less than an hour and a half and 50% in less than one hour) and frozen (-80°C) until tested four years later.
From dry tube, the NT-proBNP and hs-cTnT levels were determined using an immuno-electrochemiluminescence assay on the Cobas8000/e602® immunochemistry system (Roche Diagnostics, Meylan, France). Determination of CRP was run on the Cobas8000/e502® analyzer (Roche Diagnostic, Meylan, France) using immunoturbidimetric method.
We used 1 aliquot of the EDTA plasma aliquot for the determination of ST2 (this was the first thawing.), and all patients samples were measured in 1 batch 4 years after the recruitment period. ST2 plasma concentrations were measured with a high sensitivity sandwich monoclonal immunoassay (Presage© ST2 assay, Critical Diagnostics, San Diego, California distributed in France by Eurobio society).
All other biochemistry parameters as urea, creatinine, sodium were performed on Cobas 8000/c701® and ISE (Roche, Meylan, France).
Categorical data are expressed as count (percentage). Continuous data are expressed as mean (standard deviation) or median (1st quartile–3rd quartile) for normal and skewed distributions, respectively. Comparison between two groups was performed using Mann-Whitney U test. Correlation coefficients reported were based on a non-parametric method (Spearman rank).
Survival curves were generated using Kaplan-Meier non parametric estimator. Log-rank test was used to compare multiple survival distributions. Survival analysis was performed using Cox proportional hazard model. A multivariate baseline model was fitted including variables potentially associated with mortality in HF patients. Baseline regression model included age, gender, vascular risk factor, pulmonary risk factor, dyslipidemia, NYHA class, ischemic cardiopathy, LVEF, biological biomarkers including sodium, NT-proBNP and hs-cTnT. The vascular risk factor variable included diabetes, hypertension and estimated glomerular filtration rate (eGFR CKD-EPI equation). The pulmonary risk factor variable combined COPD and tobacco habit. The model was then augmented with CRP and ST2 levels to test whether these biomarkers have an incremental value for predicting mortality. Because of skewed distributions, biomarkers concentrations were log-transformed before modeling. Harrell’s c (C-statistic) was used for evaluating the discrimination ability of the model. Goodness of fit was assessed using Akaike’s Information Criterion (AIC). Comparison of two nested models was performed using the likelihood ratio test.
The Barcelona bio-heart failure risk calculator (BCN Bio-HF calculator) is an estimator of the risk of death in patients with HF described by Lupon et al.  The BCN Bio-HF calculator is based on eight independent models, depending on available data. The clinical models account of clinical and biological characteristics and treatments to predict the risk of mortality at 1, 2 and 3 years. When available, the clinical + biomarker models can also take account of biomarkers concentrations (hs-cTnT, NT-proBNP, ST2) to refine predictions Using these models, prognostic index were computed for each patient in our population. In order to estimate risk stratification allowed by clinical and clinical + biomarkers indexes, Cox models were fitted for prediction of all-cause and cardiovascular mortality. To simplify reading BCN Bio-HF calculator was called Barcelona score or BCN.
The clinical benefit in risk prediction of adding a biomarker to the clinical model was further assessed by reclassification analysis, including both the net reclassification improvement (NRI) and the integrated discrimination index (IDI) [13–14]. Reclassification analysis was proposed to evaluate added usefulness of a new biomarker over preexisting models. Continous NRI as proposed by Pencina et al.  is an extension of NRI, applicable to survival data and doesn’t need to define risk categories, which are known to influence NRI. Statistical analysis was performed using R 3.1.3 (R Development Core Team, Vienna, Austria). A two-sided p<0.05 was considered significant.
Performances of ST2 as discriminator of patient risk
Out of 182 consecutive patients included from May 2010 to February 2011, biochemical measurements and vital status were available for 178, which were included in our analysis. Over a median follow-up period of 42.3 months (range 12.3 to 47.1 months) there were 66 deaths. Clinical and biochemical variables in survivors vs deceased are reported in Table 1. Of the 66 patients who died during the 4 years of follow-up, 36 (54.5%) died from cardiovascular causes and 30 (45.5%) from other causes. Among all comorbidities, only hypertension, diabetes and chronic kidney disease were associated with excess mortality. The NYHA class at baseline tended to be higher among decedents than survivors. Median LVEF was not significantly different between the 2 groups of patients. All median biochemical parameters values including ST2 biomarker were statistically significantly higher in deceased patients versus alive. Mortality clearly increased across quartiles of ST2, NT-proBNP, CRP and hs-cTnT (Fig 1, p<0.001 for all).
In univariate Cox regression analysis over the 42 months, age, vascular risk factor, NYHA class, and the four biomarkers (NT-proBNP, hs-cTnT, CRP and ST2) were associated with all cause as well as cardiovascular mortality (Tables 2 and 3, respectively). In the multivariate baseline model, age, and NT-proBNP, remained independent predictors of all cause mortality, alone the NT-proBNP of cardiovascular mortality (Tables 2 and 3, respectively). After addition of CRP to this model, NYHA was no more associated with mortality whereas age, NT-proBNP and CRP remained significant predictors. Subsequent addition of ST2, led to age, CRP, and ST2 as the only remaining predictors of all-cause mortality (HR 1.039, 95%CI 1.01–1.068, HR 1.61, 95%CI 1.03–2.52 and HR 2.75, 95%CI 1.20–6.28, respectively) as well as of cardiovascular mortality (HR 1.04, 95%CI 1.00–1.089, HR 2.27, 95%CI 1.19–4.33 and HR 3.78, 95%CI 1.18–12.15, respectively). Only ST2 provided incremental value associated with a greatest and significant increase of the c-statistic from 0.647 (in the model that included only age and sex) to 0.717 (p<0.001) (model including age, gender and ST2).
We applied the BCN Bio-HF calculator  to assess the predictive ability of mortality in our population. The model with the three biomarkers (ST2, NT-proBNP and hs-cTnT) had a c-statistic of 0.715 for all cause of mortality and 0.751 for predictive ability of cardiovascular mortality. With a c-index of 0.751, the model including biomarkers was relevant in our population.
CRP enhances the predictive power of ST2 and Barcelona score
First at all, we analysed the correlation of ST2 and CRP with all other cardiac biomarkers (NT-proBNP and hs-cTnT). Overall, the 4 biomarkers showed a significant correlation with each other (Fig 2).
To further evaluate the relationship between ST2 and CRP, Fig 3 shows the plotted correlation that we divided into four parts: patients with high (above median) and low (below median) ST2 and high (above median) and low (below median) CRP. The 2-year survival rates in the group of patients with high levels of ST2 alone and CRP alone were 85% and 71%, respectively. The presence of both elevated biomarkers was associated with a strikingly steeply rising incremental risk of death, reaching more 47% (Fig 3A). The additive value of ST2 and CRP was further analyzed by Cox proportional hazard model. After adjustment for age, gender, co-morbidities, NYHA class, LVEF, biological biomarkers the combined increase of ST2 and CRP was significant for predicting worsened outcomes (HR 5.158, CI 2.33–11.41, p = <0.0001, C-statistic = 0.745) (Fig 3B). Kaplan-Meier curves confirmed the threshold effect between each group for prediction of all cause of mortality. Patients with elevations in both ST2 and CRP had markedly increased, indicating that assessment of both ST2 and CRP was more effective at identifying a high risk subgroup that individual assessment of either marker (Fig 3C). Considering 2-year mortality, CRP improved individual risk prediction in reclassification analysis (Fig 3D). Risk classification analysis was significantly improved with the addition of CRP particularly for cardiovascular mortality (53.7% reclassified; p = 0.005). The improvement is less pronounced for all-cause mortality (38.8% reclassified; p = 0.035). IDI confirmed these results of the reclassification analysis for CRP.
Association of ST2 with CRP levels dichotomized as high or low according to the median of each biomarker (A) Correlation analysis with survival rate in %, (B) Adjusted hazard ratio of death according to combined criteria as median of ST2 and CRP and (C) Kaplan Meier curves for all-cause mortality according to combination of median of ST2 and CRP and (D) Reclassification of two years risk of death for all cause or cardiovascular (CV) mortality. NRI and IDI values were reported when CRP was added to the clinical model in combination with high level of ST2. NRI: net reclassification index; IDI: integrated discrimination index.
The same analysis was performed with the combination of CRP and Barcelona score. The correlation analysis between Barcelona score and CRP showed that combined assessment of these two biomarkers added predictive power with close 51.3% 2-year survival rate vs 88% if we considered BCN alone or 80% with CRP alone (Fig 4A). Similarly, to the association ST2 and CRP, the combined increases of Barcelona score and CRP substantially augmented risk (HR 3.333, CI 1.629–6.817, p = 0.01) (Fig 4B). Kaplan Meier analyses also showed significant separation of survival curves for patients with low and/or high levels of BCN Bio-HF score and CRP for 4-year survival. Patients with both BCN Bio-HF score and CRP above their median experienced a mortality rate of around 65%, equaling the mortality rate for patients with high CRP and BCN levels during follow up (Figs 3C and 4C).
Association of ST2 with Barcelona score levels dichotomized as high or low according to the median of each biomarker (A) Correlation analysis with survival rate, (B) Adjusted hazard ratio of death according to combined criteria as median of ST2 and Barcelona score (C) Kaplan Meier curves for all-cause mortality according to combination of median of ST2 and Barcelona score and (D) Reclassification of two years risk of death for all cause or cardiovascular (CV) mortality. NRI and IDI values were reported when CRP was added to the clinical model in combination with high BCN value. NRI: net reclassification index; IDI: integrated discrimination index; BCN: Barcelona bio-heart failure risk calculator (BCN Bio-HF calculator).
Thus, elevated values of BCN and CRP provided independent and incremental prognostic information. Likewise, risk classification analysis (Fig 4D) revealed also that the CRP reclassified 37.1% (p<0.027) and 51.4% (p<0.011) of patients when added to clinical model in combination with high BCN value. These results were confirmed by IDI analysis.
In our study, we evaluated the prognostic ability of four biomarkers (ST2, NT-proBNP, CRP and hs-cTnT) known to be involved in various pathophysiological pathways closely intertwined, in a population with stable chronic HF.
A combined multimarker model including ST2 and CRP identifies a best risk stratification for death for all-cause mortality as well as cardiovascular mortality. In addition, we confirm the prognostic value of Barcelona score and extend the previous study (10) showing an improvement in combination with CRP.
This study supports the use of ST2 measurements in a multimarker approach including ST2 and CRP, for assessing all cause death over 4 years in patients with chronic HF.
Impact of ST2 as prognosis factor
HF is a complex disease involving various pathophysiological pathways reflected by numerous biomarkers and a biomarker alone, reflecting a single pathophysiological condition, cannot accurately account for all of these aspects . Beyond conventional markers, ST2 has rapidly emerged as promising because of its pluripotent role in inflammation, mechanical strain, remodeling and fibrosis . In addition, it offers advantages when compared to natriuretic peptides, since not affected by age, renal function or BMI . A low intrapatient variation was reported by Wu et al.  (index of individuality<0.25) suggesting that ST2 may be more useful for monitoring long-term HF.
Despite its lack of specificity [18–21], ST2 appears consistently as promising in prognostic prediction of mortality, particularly in combination with natriuretic peptides among patients with chronic HF . Here, we confirme that ST2 alone is an important risk factor for all cause or cardiovascular mortality in chronic HF patients. Even after adjustment for clinical variables including co-morbidities and several others biomarkers (including the gold-standard NT-proBNP), ST2 remains the strongest prognosis biomarker in our population. In addition to natriuretic peptides, ST2 could have additive value with other biomarker (hs-cTnT) or clinical parameters corroborating the interest of the Barcelona score in risk stratification, and providing an external validation.
Relationship to CRP
Inflammation plays a key role in the progression of cardiac dysfunction . As a result, high levels of CRP as well as other markers of inflammation such as TNF–alpha (Tumour Necrosis Factor-alpha) or GDF-15 (growth differentiation factor-15), have been shown to have significant prognostic and therapeutic implications in HF [3–7]. Our results are in line with these data, since we show a significant positive association between CRP levels and risk of all cause and cardiovascular disease mortality.
To the best of our knowledge, combined predictive power of biomarkers that reflect inflammation (CRP), abnormal left ventricular structure and dysfunction (NT-proBNP) and pluripotent effect on HF (ST2) has not been evaluated in previous studies. Our study provides evidence that the combination of high CRP (>6.4mg/L) and ST2 (>47.6ng/mL) dramatically increased the mortality risk and that the further association with NT-proBNP did not provide additive information. CRP, NT-proBNP and ST2 reflect distinct pathophysiological pathways involved in HF, so that their combination could identify synergistically more efficiently subgroups of patients at high risk of mortality.
In addition, the two biomarkers CRP and ST2 are easily accessible and reproducible, so that a multimarker model based on them should be easy to implement.
CRP is also correlated with Barcelona score  and in the model after adjustment by this score, CRP remains an independent predictive marker of mortality. It may be noted that in the Barcelona score , inflammation is perhaps not sufficiently taken into account, since the combination of the Barcelona score and CRP, provides additive information to improve the stratification. On the one hand, the presence of increased CRP and ST2, related in part to inflammation, confirms the existence of a chronically activated acute phase response in our HF population. On the other hand, adding the CRP to the score of Lupon et al.  (Fig 4), as well as adding CRP to ST2 (Fig 3), could improve the prediction of all cause and cardiovascular mortality. This hypothesis is strongly supported by the increase in the c-statistic index and by the Net Reclassification Index. These results, obtained in stable HF, are in total agreement with the recent report by Lassus et al.  suggesting the ability of a multimarker strategy using CRP and ST2 to predict mortality in acute HF . Beyond their close correlation (rho = 0.47, p<0.001) (Fig 2), their combination further improves risk stratification allowing to discriminate well patients at low and high risk. As shown in Figs 3C and 4C, the mortality rate dramatically increases by a three to four-fold ratio when adding CRP to both ST2 or Barcelona score . All these considerations taken in consideration suggest that we could use the combination of either CRP with ST2 or CRP with the Barcelona score. However, further studies are needed to confirm the interest of this approach in clinical practice, both for monitoring and therapy.
The study was limited by the unicentric design and the relatively small sample size. We only measured biomarkers at the time on the recruitment in the study, and only one blood sample was available. In consequence, we did not evaluate the monitoring of the biomarkers which can be also useful as monitoring markers. However, the low value of index of individuality for ST2 reported by Wu et al.  would indicate its role as a prognostic marker. In addition, until now, ST2 assay is not available in many centers, reducing the use of the multimarker strategy at present.
ST2 may be considered as an additional marker of risk mortality in patients with HF, but the likely therapeutic benefit from lowering ST2 remains to be demonstrated in interventional studies. Because of its lack of specificity for cardiac stretch, ST2 should not be considered as a diagnostic marker but rather as a predictor of all cause and cardiovascular death. Our results extend previously published reports in which high ST2 levels are associated with an increased risk of death of all cause or cardiovascular mortality. Clearly, risk assessment has a significant impact on the management of patients with an adapted monitoring and aggressive therapy.
Overall, our findings extend previous data demonstrating that ST2 in combination with CRP as a valuable tool for identifying patients at risk of death. The multimarker approach could represent a promising tool combining markers involved in pathophysiology of HF.
Reagents used in this study as ST2 and hs-cTnT were provided by Eurobio France and Roche Laboratories, respectively. We thank the “CHU de Montpellier, Centre des Ressources Biologiques, Collection Liquides biologiques, Hôpital Lapeyronie, F-34295, Montpellier, France.”
Conceived and designed the experiments: AMD JPC FR. Performed the experiments: AMD JPC. Analyzed the data: CC NK FH FR JPC. Contributed reagents/materials/analysis tools: AMD. Wrote the paper: AMD CC JPC FR. Recruitment of patients: FL JMD.
- 1. Gaggin HK, Januzzi JL Jr. Biomarkers and diagnostics in heart failure. Biochim Biophys Acta. 2013;1832: 2442–50. pmid:23313577
- 2. Sun RR, Lu L, Liu M, Cao Y, Li XC, Liu H, et al. Biomarkers and heart disease. Eur Rev Med Pharmacol Sci. 2014; 18: 2227–2935.
- 3. Cesari M, Penninx B, Newman A, Kritchevsky S, Nicklas B, Sutton-Tyrrell K, et al. Inflammatory Markers and Onset of Cardiovascular Events: Results from The Health Abc Study. Circulation. 2003; 108: 2317–22. pmid:14568895
- 4. Braunwald E. Biomarkers in Heart Failure. N Engl J Med. 2008; 358: 2148–59. pmid:18480207
- 5. Heringlake M, Charitos E, Gatz N, Kabler J, Beilharz A, Holz D, et al. Growth Differentiation Factor 15: A Novel Risk Marker Adjunct to The Euroscore for Risk Stratification in Cardiac Surgery Patients. J Am Coll Cardiol. 2013; 61: 672–681. pmid:23391200
- 6. Kempf T, Von Haehling S, Peter T, Allhoff T, Cicoira M, Doehner W, et al. Prognostic Utility of Growth Differentiation Factor-15 In Patients with Chronic Heart Failure. J Am Coll Cardiol. 2007; 50: 1054–60 pmid:17825714
- 7. Kempf T, Wollert K. Growth-Differentiation Factor-15 In Heart Failure. Heart Fail Clin. 2009; 5: 537–547. pmid:19631178
- 8. Roubille F, Busseuil D, Merlet N, Kritikou EA, Rhéaume E, Tardif JC. Investigational drugs targeting cardiac fibrosis. Expert Rev Cardiovasc Ther. 2014; 12: 111–125. pmid:24218990
- 9. Nagarajan V, Hernandez AV, Tang WH. Prognostic value of cardiac troponin in chronic stable heart failure: a systematic review. Heart. 2012; 98: 1778–86. pmid:23118345
- 10. Dieplinger B, Mueller T. Soluble ST2 in heart failure. Clin Chim Acta. 2015; 443: 57–70. pmid:25269091
- 11. Lupón J, de Antonio M, Vila J, Peñafiel J, Galán A, Zamora E, et al. Development of a novel heart failure risk tool: the barcelona bio-heart failure risk calculator (BCN bio-HF calculator). PLoS One. 2014; 9: e85466. pmid:24454874
- 12. McMurray JJ, Adamopoulos S, Anker SD, Auricchio A, Böhm M, Dickstein K, et al. ESC Guidelines for the diagnosis and treatment of acute and chronic heart failure 2012: The Task Force for the Diagnosis and Treatment of Acute and Chronic Heart Failure 2012 of the European Society of Cardiology. Developed in collaboration with the Heart Failure Association (HFA) of the ESC. Eur Heart J. 2012; 33: 1787–1847. pmid:22611136
- 13. Pencina MJ, D'Agostino RBS, D'Agostino RB Jr, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008; 27:157–72. pmid:17569110
- 14. Cook NR. Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve. Clin Chem. 2008; 54:17–23. pmid:18024533
- 15. Pencina MJ, D'Agostino RB Sr, Steyerberg EW. Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med. 2011; 15:11–21.
- 16. Dieplinger B, Januzzi JL Jr, Steinmair M, Gabriel C, Poelz W, Haltmayer M, et al. Analytical and clinical evaluation of a novel high-sensitivity assay for measurement of soluble ST2 in human plasma—the Presage ST2 assay. Clin Chim Acta. 2009; 409: 33–40. pmid:19699192
- 17. Wu AH, Smith A, Wieczorek S, Mather JF, Duncan B, White CM, et al. Biological variation for N-terminal pro- and B-type natriuretic peptides and implications for therapeutic monitoring of patients with congestive heart failure. Am J Cardiol. 2003; 92:628–31. pmid:12943894
- 18. Kakkar R, Lee RT. The IL-33 ⁄ ST2 pathway: therapeutic target and novel biomarker. Nat Rev. 2008; 7:827–840.
- 19. Tajima S, Bando M, Ohno S, Sugiyama Y, Oshikawa K, et al. ST2 gene induced by type 2 helper T cell (Th2) and proinflammatory cytokine stimuli may modulate lung injury and fibrosis. Exp Lung Res. 2007; 33: 81–97. pmid:17454104
- 20. Oshikawa K, Kuroiwa K, Tago K, Iwahana H, Yanagisawa K, et al. Elevated soluble ST2 protein levels in sera of patients with asthma with an acute exacerbation. Am J Respir Crit Care Med. 2001; 164:277–281. pmid:11463601
- 21. Oshikawa K, Yanagisawa K, Ohno S, Tominaga S, Sugiyama Y. Expression of ST2 in helper T lymphocytes of malignant pleural effusions. Am J Respir Crit Care Med. 2002; 165:1005–9. pmid:11934729
- 22. Araújo JP, Lourenço P, Azevedo A, Friões F, Rocha-Gonçalves F, Ferreira A, et al. Prognostic value of high-sensitivity C-reactive protein in heart failure: a systematic review. J Card Fail. 2009; 15:256–66. pmid:19327628
- 23. Lassus J, Gayat E, Mueller C, Peacock WF, Spinar J, et al. GREAT-Network. Incremental value of biomarkers to clinical variables for mortality prediction in acutely decompensated heart failure: The Multinational Observational Cohort on Acute Heart Failure (MOCA) study. Int J Cardiol. 2013; 3:2186–94.