Figures
Abstract
Objectives
To evaluate the performance of the 2013 ACR/EULAR classification criteria for systemic sclerosis (SSc) in clinical practice in a Chinese patient cohort, and to compare outcomes with the 1980 ACR criteria.
Methods
Patients clinically diagnosed with SSc between September 2013 and May 2015 were prospectively recruited from the EUSTAR database of the Peking Union Medical College Hospital. Diagnosis of SSc was based on the evaluation of three experienced rheumatologists. Patients diagnosed with other connective tissue diseases were recruited as disease controls. The 1980 ACR and 2013 ACR/EULAR criteria were applied to the cohort, and patients who fulfilled the criteria were classified as definite SSc patients. Sensitivity and specificity were analyzed for the 2013 and 1980 criteria.
Results
A total of 143 SSc patients and 87 patients with other connective diseases were recruited. 41 (28.7%) and 102 (71.3%) cases were diffuse cutaneous SSc and limited cutaneous SSc, respectively. Although the sensitivity of the 2013 criteria (94.4%) exceeded the 1980 criteria (72.7%) (P<0.001), the 1980 and 2013 criteria sets showed no significant difference in specificity (97.7% and 93.1%, respectively, P = 0.278). The sensitivity of the 2013 criteria was significantly higher than the 1980 criteria in some SSc subgroups (e.g., lcSSc, abnormal pattern of nailfold videocapillaroscopy [NVC] and presence of Raynaud’s phenomenon [RP]) compared to others.
Citation: Xu D, Hou Y, Zheng Y, Zheng Y, Li M, Zeng X (2016) The 2013 American College of Rheumatology/European League Against Rheumatism Classification Criteria for Systemic Sclerosis Could Classify Systemic Sclerosis Patients at Earlier Stage: Data from a Chinese EUSTAR Center. PLoS ONE 11(11): e0166629. https://doi.org/10.1371/journal.pone.0166629
Editor: Carol Feghali-Bostwick, Medical University of South Carolina, UNITED STATES
Received: June 22, 2016; Accepted: November 1, 2016; Published: November 16, 2016
Copyright: © 2016 Xu et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by the EULAR Scleroderma Trial & Research group (EUSTAR); National Natural Science Foundation of China [81571597]; and Funding scientific research special clinical medicine of the Chinese medical association [12040740374]. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Systemic sclerosis (SSc) is an autoimmune disease characterized by fibrosis, microvascular disease, and presence of autoantibodies. In China, two fatal manifestations, interstitial lung disease (ILD) and pulmonary arterial hypertension (PAH), are the most common SSc complications among connective tissue diseases [1,2]. Thus, classification of SSc during the early disease stages is critical so that treatment can begin sooner. The first widely accepted classification criteria for SSc were published in 1980, and the high specificity of 1980 criteria helped minimize false-positive diagnoses [3]. Nonetheless, improved classification criteria that could diagnose SSc even earlier were urgently needed. In 2001 LeRoy and Medsger proposed modifications to the criteria used to diagnose early SSc [4]. Recently, a joint committee of the American College of Rheumatology (ACR) and the European League Against Rheumatism (EULAR) formulated a new set of SSc classification criteria, which has proven to have increased sensitivity over the 1980 criteria while still preserving the specificity determined from studies conducted in other countries [5,6]. The objective of this study was to validate the sensitivity and specificity of the new classification criteria in Chinese SSc patients.
Patients and Methods
Patients
Patients who were clinically diagnosed with SSc between September 2013 and May 2015 were prospectively recruited from the EUSTAR database of the Peking Union Medical College Hospital (PUMCH). Diagnosis of SSc was based on the evaluation of three experienced rheumatologists from PUMCH. SSc patients were not required to meet any formal classification criteria. Patients diagnosed with other connective tissue diseases were recruited as disease controls according to the respective classification criteria.
Pulmonary arterial hypertension (PAH) was defined as a mean pulmonary arterial pressure of > 25 mmHg, together with a pulmonary capillary wedge pressure of < 15 mmHg determined by right heart catheterization(RHC). Pulmonary fibrosis was defined as ground glass opacification or fibrosis on high-resolution computed tomography (HRCT).
Methods
This study was approved by the Medical Ethics Committee of Peking Union Medical College Hospital and all subjects provided informed written consent. Demographic features, clinical characteristics (including Raynaud’s phenomenon, puffy fingers, telangiectasias, and digital pitting), and laboratory findings (anti-centromere, anti-Scl-70, and anti-RNA polymerase III antibodies, echocardiography and HRCT, and nailfold videocapillaroscopy (NVC) test) were collected for all patients. Patients were classified into limited and diffuse cutaneous subsets based on the definition of Leroy et al. [4]. Disease duration was defined as the time from the first non-RP SSc manifestation to entry. The 1980 ACR and 2013 ACR/EULAR criteria were applied to evaluate the patients diagnosed with SSc clinically and disease controls; patients who fulfilled each criterion were classified as definite SSc patients. Sensitivity and specificity were evaluated for each set of classification criteria. Sensitivity for various SSc subgroups was also evaluated.
Statistical analysis
The Statistical Package for the Social Sciences (SPSS) version 17.0 (SPSS, Chicago, IL) was used for data processing and analysis. Quantitative results were presented as mean ± standard deviation (normal distribution), or median, interquartile range (non- normal distribution). The x2 test was used to analyze enumeration data. P < 0.05 was considered to be statistically significant.
Results
A total of 143 SSc patients and 87 patients with other connective diseases were recruited for this study (Table 1). All patients were of Han nationality. Of the 143 SSc patients, 41 (28.7%) and 102 (71.3%) cases were diffuse cutaneous SSc (dcSSc) and limited cutaneous SSc (lcSSc), respectively. Disease duration was 63.15 ± 59.32 months. 137 of 143 patients with SSc had RP, and it was the initial symptom in 113 patients. The duration from RP and first symptom to entry were 86.61±78.22 months and 87.18±77.22 months, respectively. The clinical features of SSc patients and disease controls are listed in Table 2. On the other hand, pulmonary artery systolic pressure > 40 mmHg at rest based on an echocardiogram test was present in 33 patients in 143 SSc patients. 22 in 33 patients had done the RHC and were confirmed to have PAH. Though the other 11 patients didn’t do the RHC, no matter whether PAH was present in these patients, the validation results for 1980 and 2013 criteria were same. Rodnan scores were 5.0 ± 5.6 in SSc patients. The other clinical features were as following: joint involvement 41.3% (59/143), myositis 10.5% (15/143), gastrointestinal involvement 59.4% (85/143), gastroesophageal reflux 49.7% (71/143), heart conduction block 2.8% (4/143), and scleroderma crisis 0%.
Of the 143 SSc and 87 other disease patients, 104 and 2 patients, respectively, satisfied the 1980 criteria. On the other hand, 135 of the 143 SSc patients and 6 of 87 patients in the other connective diseases group satisfied the 2013 criteria. The sensitivity of the 2013 classification criteria for SSc (94.4%) exceeded the 1980 classification criteria (72.7%) (P<0.001). However, there was no significant difference between the specificity of the two classification criteria (93.1% and 97.7% for 2013 and 1980, respectively; P = 0.278).
Further, we did a sensitivity analysis excluding patients with MCTD since these patients frequently had prominent SSc features and often evolved into SSc, The results were similar. Of the 143 SSc and 78 other disease patients, 104 and 2 patients, respectively, satisfied the 1980 criteria. On the other hand, 135 of the 143 SSc patients and 5 of 78 patients in the other connective diseases group satisfied the 2013 criteria. The sensitivity of the 2013 classification criteria for SSc 94.4% exceeded the 1980 classification criteria 72.7% (P<0.001).
The sensitivities of the 1980 ACR and 2013 ACR/EULAR in various subgroups of SSc patients were further evaluated. There were no significant differences between 1980 and 2013 criteria in male (90% vs. 90%), dsSSc (97.6% vs. 100%), presence of digital ulcers (86.5% vs. 100%), presence of pitting scars (85.7% vs. 100%), absence of abnormal NVC patterns (86.4% vs. 86.4%), absence of RP (50% vs. 66.7%), anti-Scl70 antibody positivity (96.5% vs. 100%). On the other hand, there were significant increased sensitivity in 2013 than 1980 criteria in female (71.4% vs. 94.7%), lcSSc (62.7% vs. 92.2%), absence of digital ulcers (67.9% vs. 92.5%) or pitting scars(70.5% vs. 93.4%), presence of abnormal NVC patterns (70.2% vs. 95.9%) or RP (73.7% vs. 95.6%), anti-Scl70 antibody negativity(57% vs. 90.7%). Moreover, there were also significant increased sensitivity in 2013 than 1980 criteria in disease duration < 3 or ≥ 3 years, presence or absence of Sclerodactyly, telangiectasia, PAH, ILD, ACA and anti-RNP antibody.
Discussion
Skin thickening is a characteristic manifestation of SSc, and many physicians recognize this disease by this feature. However, the diagnosis of SSc patients with mild skin thickening always was delayed. That was a deficiency for the 1980 ACR SSc classification criteria. Consistent with previous studies that examined disease characteristics in patients of other nationalities, our study also showed that the 2013 ACR/EULAR SSc classification criteria had improved sensitivity without affecting specificity in Chinese Han populations [5,6,7–10] (Table 3). Also, the 2013 ACR/EULAR criteria had significantly increased sensitivity relative to the 1980 criteria in most SSC patient subgroups, with the exception of patients with more extensive skin thickening, e.g., diffuse cutaneous SSc. These patients had a high rate of diagnosis even using 1980 criteria due to extensive skin involvement. The 2013 ACR/EULAR criteria had higher sensitivity in patients with mild skin thickening. Interestingly, in our study we found that the 2013 criteria did not produce increased sensitivity in either male patients or patients who were positive for anti-Scl-70 antibody, which may be due to the greater frequency of dcSSc patients in these two subgroups (60% and 53%, respectively).
On the other hand, NVC is widely used to differentiate secondary RP from primary RP [11]. The 2013 criteria includes the NVC test, and our study showed the sensitivity of the 2013 criteria was significantly increased relative to the 1980 criteria in patients with an abnormal NVC pattern, but there was no difference between the old and new criteria for patients with a normal NVC pattern. As we know, abnormal NVC pattern could indicate and accompany with the presence of other microvascular diseases, for example Raynaud’s phenomenon, PAH, and telangiectasia., and these manifestations of microvascular diseases were all included in the 2013 criteria, but not in the 1980 criteria. This maybe was the reason for increased sensitivity in patients with an abnormal NVC pattern. Similarly, one study from a capillaroscopy clinic showed that one of individual variables in 2013 criteria with the best sensitivity was capillaroscopic abnormalities(81.1%)[10]. SSc patients with prominent microvascular diseases maybe could be classified earlier with the 2013 criteria.
To date, only four studies have evaluated the specificity of the old and/or new criteria. As with previous studies, our study showed that the specificity of the 2013 and 1980 criteria was high and the two criteria sets exhibited no significant differences. However, the 1980 criteria had higher specificity than that determined by the ACR/EULAR group, which is similar to results obtained in studies performed in Turkey and Spain. These differences could be due to the choice of controls. The characteristics of the controls in the Turkey study and our study were similar, and almost all control patients had connective tissue diseases with ANA positivity. However, the ACR/EULAR study included more cases with non-CTD scleroderma-like diseases, which had skin thickening similar to that seen in SSc. The inclusion of these patients may thus reduce the specificity of the 1980 criteria in the ACR/EULAR study.
This is the first study to evaluate the performance of the new 2013 criteria in a Han Chinese population. In Chinese SSc patients, the new 2013 criteria had higher sensitivity and similar specificity compared with the 1980 criteria, especially in patients with mild skin thickening or prominent microvascular diseases. It could clarify the SSc patients at earlier stage.
Supporting Information
S1 Data. Primiary data of patients with systemic sclerosis.
This is the data about the patients with SSc.
https://doi.org/10.1371/journal.pone.0166629.s001
(XLS)
S2 Data. Primiary data of patients with disease control.
This is the data about the patients with disease control.
https://doi.org/10.1371/journal.pone.0166629.s002
(XLS)
Author Contributions
- Conceptualization: XFZ MTL.
- Data curation: YFZ YZ.
- Formal analysis: YFZ YZ.
- Funding acquisition: XFZ DX.
- Investigation: DX YH.
- Methodology: DX YH XFZ MTL.
- Resources: DX YH YFZ YZ.
- Software: YFZ YZ.
- Supervision: XFZ MTL.
- Validation: DX YH YFZ YZ.
- Visualization: XFZ MTL.
- Writing – original draft: DX YH.
- Writing – review & editing: XFZ MTL.
References
- 1. Zhang X, Zhang FC, Dong Y. Pulmonary hypertension in connective tissue diseases. Chinese Journal of Rheumatology. 1999;1: 5–7.
- 2. Zhang X, Dong Y, Zhang FC. Pulmonary interstitial fibrosis in connective tissue diseases. Chinese of Rheumatology.1999;3: 247–248.
- 3. Subcommittee for Scleroderma Criteria of the American Rheumatism Association Diagnostic and Therapeutic Criteria Committee. Preliminary criteria for the classification of systemic sclerosis (scleroderma). Arthritis Rheum. 1980;23:581–590. pmid:7378088
- 4. LeRoy EC, Medsger TA.Criteria for the classification of early systemic sclerosis. J Rheumatol. 2001;28:1573–1576 pmid:11469464
- 5. Van den Hoogen F, Khanna D, Fransen J, Johnson SR, Baron M, Tyndall A, et al. 2013 classification criteria for systemic sclerosis: an American College of Rheumatology/European League Against Rheumatism collaborative initiative. Ann Rheum Dis. 2013;72:1747–1755. pmid:24092682
- 6. Pamuk ON, Balcı MA, Onat AM, Zengin O, Cakır N, Kısacık B. Performance of the new American College of Rheumatology classification criteria in Turkish systemic sclerosis patients: a multicenter study. Clin Rheumatol. 2016;35:357–361 pmid:26643772
- 7. Alhajeri H, Hudson M, Fritzler M, Pope J, Tatibouet S, Markland J, et al. The 2013 ACR/EULAR classification criteria for systemic sclerosis out-perform the 1980 criteria. Data from the Canadian Scleroderma Research Group. Arthritis Care Res(Hoboken). 2015; 67:582–587.
- 8. Hoffmann-Vold AM, Gunnarsson R, Garen T, Midtvedt O, Molberg O. Performance of the 2013 American College of Rheumatology/European League Against Rheumatism classification criteria for systemic sclerosis (SSc) in large, well-defined cohorts of SSc and mixed connective tissue disease. J Rheumatol. 2015;42:60–63 pmid:25274890
- 9. Jordan S, Maurer B, Toniolo M, Michel B, Distler O. Performance of the new ACR/EULAR classification criteria for systemic sclerosis in clinical practice. Rheumatol (Oxford). 2015;54:1454–1458
- 10. Melchor S, Joven BE, Andreu JL, Loza E, Garcia de Yebenes MJ, Carmona L, et al. Validation of the 2013 American College of Rheumatology/European League Against Rheumatism classification criteria for systemic sclerosis in patients from a capillaroscopy clinic. Semin Arthritis Rheum. 2016 Jun 3.
- 11. LeRoy EC, Medsger TA Jr. Raynaud’s phenomenon: a proposal for classification. Clin Exp Rheumatol. 1992;10:485–488. pmid:1458701