Skip to main content
Advertisement
  • Loading metrics

A clinical scoring system for the early identification of superinfections in patients with severe fever with thrombocytopenia syndrome: An ambispective multicentre cohort study

  • Yu-Yao Li ,

    Contributed equally to this work with: Yu-Yao Li, Jian-Kang Zhang, Chun Zhang, Zhi-Ping Pan

    Roles Conceptualization, Formal analysis, Methodology, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China

  • Jian-Kang Zhang ,

    Contributed equally to this work with: Yu-Yao Li, Jian-Kang Zhang, Chun Zhang, Zhi-Ping Pan

    Roles Data curation, Investigation

    Affiliation Department of Infectious Diseases, Lu’an People’s Hospital, Lu’an, Anhui, China

  • Chun Zhang ,

    Contributed equally to this work with: Yu-Yao Li, Jian-Kang Zhang, Chun Zhang, Zhi-Ping Pan

    Roles Data curation, Investigation

    Affiliations Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China, Department of Infectious Diseases, Chaohu Hospital of Anhui Medical University, Chaohu, Anhui, China

  • Zhi-Ping Pan ,

    Contributed equally to this work with: Yu-Yao Li, Jian-Kang Zhang, Chun Zhang, Zhi-Ping Pan

    Roles Data curation, Investigation

    Affiliations Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China, Department of Infectious Diseases, Anqing Municipal Hospital, Anqing, Anhui, China

  • Xiao Liu ,

    Roles Formal analysis, Methodology, Validation

    ‡ These authors are senior authors on this work.

    Affiliation Department of Cardiology, Sun Yat-sen Memorial Hospital of Sun Yat-sen University, Guangzhou, Guangdong, China

  • Meng-Yu Liu,

    Roles Investigation

    Affiliation Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China

  • Qiang Chen,

    Roles Investigation

    Affiliation Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China

  • Yuan-Yuan Zhang,

    Roles Investigation

    Affiliation Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China

  • Yuan Jiang,

    Roles Investigation

    Affiliation Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China

  • Xu-Ya Yuan,

    Roles Investigation

    Affiliation Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China

  • Si-Yang Liu,

    Roles Investigation

    Affiliation Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China

  • Xiang Li,

    Roles Investigation

    Affiliation Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China

  • Fei-Dan Yu,

    Roles Investigation

    Affiliations Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China, Anhui Province Key Laboratory of Infectious Diseases, Anhui Medical University, Hefei, China

  • Yu-Feng Gao,

    Roles Data curation

    Affiliations Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China, Anhui Province Key Laboratory of Infectious Diseases, Anhui Medical University, Hefei, China

  • Jun Cheng,

    Roles Data curation

    Affiliations Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China, Anhui Province Key Laboratory of Infectious Diseases, Anhui Medical University, Hefei, China

  • Qin-Xiu Xie,

    Roles Data curation

    Affiliations Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China, Anhui Province Key Laboratory of Infectious Diseases, Anhui Medical University, Hefei, China

  • Jian-Guo Rao,

    Roles Data curation

    Affiliation Department of Infectious Diseases, Lu’an People’s Hospital, Lu’an, Anhui, China

  • Li-Yu Zhu,

    Roles Data curation

    Affiliation Department of Infectious Diseases, Chaohu Hospital of Anhui Medical University, Chaohu, Anhui, China

  • Zhen-Jun Liu,

    Roles Data curation

    Affiliation Department of Infectious Diseases, Anqing Municipal Hospital, Anqing, Anhui, China

  • Ying Ye ,

    Roles Conceptualization

    hulifen@ahmu.edu.cn (L-FH); lijiabin@ahmu.edu.cn (J-BL); yeying2@139.com (YY)

    Affiliations Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China, Anhui Province Key Laboratory of Infectious Diseases, Anhui Medical University, Hefei, China

  • Jia-Bin Li ,

    Roles Conceptualization, Funding acquisition

    hulifen@ahmu.edu.cn (L-FH); lijiabin@ahmu.edu.cn (J-BL); yeying2@139.com (YY)

    Affiliations Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China, Anhui Province Key Laboratory of Infectious Diseases, Anhui Medical University, Hefei, China, Department of Infectious Diseases, Public Health Clinical Center of Anhui Province, Hefei, China

  •  [ ... ],
  • Li-Fen Hu

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    hulifen@ahmu.edu.cn (L-FH); lijiabin@ahmu.edu.cn (J-BL); yeying2@139.com (YY)

    Affiliations Department of Infectious Diseases, the First Affiliated Hospital of Anhui Medical University, Hefei, Anhui, China, Anhui Province Key Laboratory of Infectious Diseases, Anhui Medical University, Hefei, China, Department of Infectious Diseases, Public Health Clinical Center of Anhui Province, Hefei, China, Programme in Emerging Infectious Diseases, Duke-National University of Singapore Medical School, Singapore, Singapore

  • [ view all ]
  • [ view less ]

Abstract

Background

Superinfection is a major contributor to mortality in patients with severe fever with thrombocytopenia syndrome (SFTS). However, early identification remains challenging because detection of the pathogen causing the superinfection is often delayed.

Objective

This study aims to develop a clinical scoring system for the early identification of superinfection in SFTS patients.

Methods

Among 1942 SFTS patients from 4 hospitals in China, a retrospective cohort (2014–2024) was used for model development, with 1182 patients from 2 hospitals split into training (n = 823) and internal validation (n = 359) sets, and 475 patients from 2 additional hospitals for external validation sets. Four machine learning algorithms were evaluated, with the optimal model converted into a simplified scoring scale. Finally, a prospective cohort (n = 285, 2025) evaluated the real-world performance. Model efficacy was comprehensively assessed using the area under the receiver operating characteristic curve (AUROC), calibration curves, decision curve analysis (DCA), sensitivity, and specificity.

Results

Among the 36 variables, 8 predictors (age, ALB, AST, BUN, GLU, CRP, HGB, and expectoration) for superinfection were identified by ensembling five machine learning algorithms. The RF, XGBoost, LightGBM, and LR prediction models were constructed using the 8 predictors. LR demonstrated optimal performance, with an AUROC of 0.839 (95% CI: 0.797–0.880) in the internal validation set and 0.805 (95% CI: 0.764–0.847) in the external validation set. In the real-world prospective study, the model maintained high predictive efficacy (AUROC: 0.854). Finally, the model’s nomogram was simplified into a novel 3-tiered risk scoring scale to enhance clinical applicability.

Conclusions

Our research developed a dynamic, early diagnostic tool that could improve real-time prediction of superinfection risk at the bedside and enhance antimicrobial stewardship.

Author summary

Severe fever with thrombocytopenia syndrome (SFTS) is a life-threatening tick-borne disease. It is characterized by a high incidence of superinfections, which substantially increase the risk of mortality. Unfortunately, delayed identification of superinfections often leads to worse outcomes or inappropriate antibiotic use in SFTS patients. In this multicenter study spanning 12 years, we developed a data-driven clinical prediction model designed to stratify the risk of superinfection in SFTS patients using four machine learning algorithms. The model’s performance and clinical utility were demonstrated through receiver operating characteristic curve analysis, calibration assessment, decision curve analysis, sensitivity, and specificity. Logistic regression was identified as the optimal algorithm, with strong predictive accuracy across internal and external validation. Its efficacy was further confirmed in a prospective real-world cohort, which achieved an excellent discriminatory power. Ultimately, the model was simplified into a three-tier risk scoring system, enabling rapid bedside assessment of superinfection risks without the need for complex computational tools. Overall, by identifying key clinical indicators, our model provides clinicians with an effective tool for the rapid identification of superinfection risk in SFTS patients using easily accessible predictors.

Introduction

Severe fever with thrombocytopenia syndrome (SFTS) caused by a novel Bunyavirus is a newly emerging infectious disease. The novel Bunyavirus, SFTS virus (SFTSV), is transmitted mainly through tick bites but can also be transmitted between humans [1,2]. SFTS is a severe disease with an acute onset and has been increasingly reported in China and other Asian countries [35]. The case fatality rate (CFR) of hospitalized patients with SFTS has been reported to be 10% –30% [2,68].

Superinfection contributes significantly to the high CFR of SFTS [9], with reported incidence among patients ranging from 27.4% to 42.9% [10,11]. While delayed treatment is associated with poor prognosis and increased mortality, clinicians often face uncertainty regarding the diagnosis of superinfection. Clinicians are facing a great challenge in determining which SFTS patients should receive antibiotic treatment. Therefore, early diagnosis of superinfection is crucial; however, pathogen identification is often delayed, hindering antimicrobial stewardship in SFTS patients.

Based on the inherent challenges of traditional pathogen detection including sample contamination, false negatives, and reporting delays, artificial intelligence is emerging as a critical breakthrough for achieving early and precise diagnosis [12]. Machine Learning(ML)-based tools are capable of deeply integrating and analyzing multi-source, real-time data from patient clinical symptoms, laboratory indicators, and medical images, thereby helping clinicians achieve early warning and timely diagnosis [13].

To embody this ML-driven approach in SFTS with superinfection management, we collected retrospective data from all consecutive SFTS patients who were treated at 4 hospitals in 4 cities over a period of 11 years. These data were utilized for model construction to predict superinfection of SFTS patients using machine learning algorithms. Furthermore, the model’s clinical utility was validated in a prospective, real-world cohort to evaluate its capacity for the early identification of superinfections. The validated, model-based diagnostic tool enables clinicians to conduct real-time superinfection risk assessments of SFTS patients at the bedside.

Methods

Ethical statement

This study followed the ethical guidelines of the Helsinki Declaration and was approved by the Ethics Committee of Anhui Medical University (Approval No. 20200980). Written informed consent was obtained from all participants in the prospective cohort of this study, while the requirement for informed consent was waived for the retrospective cohort.

Study design and population

This study employed an ambispective, multicenter cohort design conducted in two sequential phases to develop and validate a prediction model for superinfection in SFTS patients. During the retrospective phase (January 2014 to December 2024), data on laboratory-confirmed SFTS patients were collected over a consecutive eleven-year period from four hospitals in Anhui Province. These centres comprised the First Affiliated Hospital of Anhui Medical University in Hefei, Chaohu Affiliated Hospital of Anhui Medical University in Chaohu, Lu’an People’s Hospital in Lu’an, and Anqing Municipal Hospital in Anqing. Together, they provided a comprehensive dataset for the training, internal validation, and external validation sets. In the subsequent prospective phase (March to September 2025), SFTS patients were enrolled at the Hefei and Lu’an hospitals to constitute a prospective real-world validation set.

Patients were eligible for inclusion if they had a laboratory-confirmed SFTSV infection and complete clinical records for model development. To minimize confounding variables, we excluded patients with pre-existing chronic infections (such as tuberculosis or chronic intestinal infections), haematological diseases, or malignancies. Patients with insufficient documentation to confirm the presence or absence of superinfections were excluded.

Definition and data collection

Laboratory-confirmed SFTS was defined on the basis of the criteria used for the diagnosis and treatment of SFTS [14]. Respiratory tract infection was determined by the presentation of clinical symptoms, imaging abnormalities, and laboratory indicators, including the presence of pathogens [15]. Bloodstream infection and urinary tract infection were diagnosed by assessing clinical symptoms and pathogens in blood or urine samples [16]. Cholecystitis was defined based on clinical symptoms and imaging abnormalities [17]. Pathogens were identified through blood culture, sputum culture, next-generation sequencing (NGS), or polymerase chain reaction (PCR). All identified pathogens were consistent with the post-SFTS onset period and clinically relevant to the site of infection. In this context, the term “superinfection” refers specifically to these secondary bacterial or fungal complications arising during the course of SFTS.

The primary outcome of the study was superinfection occurring within 30 days of disease onset. We collected data for the first three days of hospitalization, including clinical manifestations, laboratory data, treatment regimens, underlying diseases, and outcomes, from electronic health records, and all data were cross-checked by trained researchers. The proportion of missing values for all variables was less than 5%. No missing data were observed in categorical variables. For continuous variables with a small number of missing values, mean imputation was performed. Superinfection was assessed only when it occurred on or after hospital day 4, thereby improving the model’s utility for early clinical decision-making.

Predictors selection and model development

As shown in Fig 1, the 1182 SFTS patients from the First Affiliated Hospital of Anhui Medical University and Anqing Municipal Hospital between 2014 and 2024 were randomly divided into a training set (n = 823) and an internal validation set (n = 359) at a ratio of 7:3. Meanwhile, stratified random sampling was conducted based on whether superinfection occurred. A total of 36 variables covering demographics, underlying diseases, clinical features, laboratory findings, and glucocorticosteroid administration, were included in the training dataset to identify independent predictors of superinfection.

thumbnail
Fig 1. Flow charts of patient recruitment and exclusion criteria.

To construct a diagnostic model for predicting superinfection in SFTS patients. Abbreviations: SFTS, severe fever with thrombocytopenia syndrome; LASSO, least absolute shrinkage and selection operator regression; LR, Logistic Regression; LightGBM, Light Gradient Boosting Machine; XGBoost, Extreme Gradient Boosting.

https://doi.org/10.1371/journal.pntd.0014696.g001

In the training set (n = 823), univariate logistic regression was first applied to all 36 candidate variables; 28 variables with p < 0.05 were retained for the Least Absolute Shrinkage and Selection Operator (LASSO) regression [18]. The 36 variables were then processed in parallel using three tree-based ML algorithms: Random Forest (RF) [19], Light Gradient Boosting Machine (LightGBM) [20], and Extreme Gradient Boosting (XGBoost) [21]. The complete hyperparameter search spaces and the values used for model fitting are provided in S4 Table. LASSO retained 14 variables, and the top 15 variables ranked by feature importance were extracted from each of the three tree-based models. The final feature set was then defined as the intersection of two groups: the variables retained by LASSO, and the union of the top-15 variables from RF, XGBoost, and LightGBM. This conservative cross-algorithmic strategy yielded 8 robust predictors, reduced algorithm-specific bias, and minimised the risk of overfitting [22].

Model validation and evaluation

Model validation was performed in three sequential stages. First, internal validation was performed on a 30% random subset of the 1,182 retrospective patients from Hefei and Anqing, allocated by stratified random sampling on the outcome variable to preserve event proportions. Second, external validation was performed on an independent cohort of 475 patients from Chaohu and Lu’an, two hospitals not represented in the training data, in order to assess geographic and institutional generalizability. Third, prospective real-world validation was performed in 285 consecutive SFTS patients enrolled between March and September 2025 at the Hefei and Lu’an hospitals, using the same data-collection protocol as the retrospective cohorts.

Model discriminative ability was evaluated using the AUROC with 95% confidence intervals. Calibration between predicted risks and observed outcomes was assessed via calibration curves, and overall predictive accuracy was quantified using the Brier score. The DCA was performed to determine the net clinical benefit and practical utility of the model across different risk thresholds. Diagnostic performance was further characterized by sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). All models were comprehensively evaluated via internal and external validation, and the optimal model was additionally validated in a real-world cohort.

Comparison of nomogram and simplified scoring scale

For the convenience of clinical application, the final predictive indicators were divided into hierarchical variables and rescored based on the nomogram. A new scoring scale ranging from 0 to 13 points was ultimately developed. The simplified scoring scale uses a binary cut-off of 6.5, corresponding to a total score of ≥ 7. This cut-off was determined by maximising Youden’s index in the training cohort and was applied unchanged to all subsequent validation cohorts. The three-tier classification combined the empirical tertile structure of the score distribution with anchoring at the Youden-optimal cut-off. Both threshold systems were derived exclusively in the training cohort and were not re-tuned in any validation cohort.

Statistical analysis

Normally distributed quantitative variables were presented as the mean (standard deviation, SD) and compared using the Student’s t-test, while non-normally distributed variables were presented as the median (interquartile range, IQR) and analyzed using the Mann–Whitney U test. Categorical variables were expressed as frequencies and proportions and compared using the Pearson chi-square test or Fisher’s exact test, as appropriate. Statistical analysis was performed using R software (version 4.4.3), and a p-value < 0.05 was considered statistically significant.

Results

Characteristics of the study population

Among the 2288 SFTS patients from 2014 to 2025, 1942 were included in the study (Fig 1). Of these, 652 (33.57%) had superinfection, including 25.18% with respiratory tract infection, 5.77% with bloodstream infection, 1.54% with urinary tract infection, and 0.42% with cholecystitis. The CFR in the superinfection group has been increased by 2.3 times compared to the non-superinfection group (31.13% vs. 13.57%, p < 0.001) (Table 1).

thumbnail
Table 1. Comparisons of clinical and laboratory characteristics between SFTS patients with superinfection and non-superinfection.

https://doi.org/10.1371/journal.pntd.0014696.t001

The superinfection group was significantly older and more likely to have glucocorticosteroid use (43.71%), diabetes mellitus (DM) (14.42%), chronic obstructive pulmonary disease (COPD) (4.75%), fever (98.47%), lymphadenopathy (29.45%), gastrointestinal symptoms (67.02%), bleeding (26.84%), cough (43.56%), expectoration (37.42%), limb tremor (22.24%), confusion (37.12%), or coma (15.18%) (p < 0.05) (Table 1). Compared to non-superinfection patients, patients with superinfection exhibited significantly lower levels of albumin (ALB: 27.90 g/L, [IQR 25.05, 31.40]), haemoglobin (HGB: 110.00g/L, [IQR 92.00, 126.00]), potassium (K: 3.44mmol/L, [IQR 3.03, 3.87]), sodium (Na: 132.70mmol/L, [IQR 129.70, 135.80]) and platelet count (PLT: 34.00 × 109/L, [IQR 24.50, 52.00]) (p < 0.05). Conversely, the levels of glucose (GLU: 8.28mmol/L, [IQR 6.38, 11.49]), C-reactive protein (CRP: 13.27mg/L, [IQR 4.07, 41.05]), globulin (GLO: 28.30g/L, [IQR 24.70, 33.00]), total bilirubin (TBIL: 15.15umol/L, [IQR 9.76, 27.53]), alanine aminotransferase (ALT: 91.00U/L, [IQR 54.00, 155.00]), aspartate aminotransferase (AST: 232.00U/L, [IQR 117.00, 470.00]), urea nitrogen (BUN: 7.73mmol/L, [IQR 5.56, 11.64]), creatinine (Cr: 81.40umol/L, [IQR 64.80, 115.43]), lactate dehydrogenase (LDH: 986.00U/L, [IQR 543.50, 1,906.00]), creatinine kinase (CK: 595.00U/L, [IQR 278.50, 1,336.50]), creatine kinase MB (CK-MB: 25.00, [IQR 14.00, 44.87]), fibrinogen (FIB: 2.83g/L, [IQR 2.33, 3.64), and D-dimer (DD: 3.42ug/mL, [IQR 1.86, 6.53]); the neutrophil count (N: 1.40 × 109/L, [IQR 0.86, 2.51]); and the activated partial thromboplastin time (APTT: 53.50s, [IQR 44.65, 68.10]) were significantly higher in the superinfection group (p < 0.05) (Table 1).

Microbiological profile associated with superinfection in SFTS patients

Among the 652 SFTS patients diagnosed with superinfection, a total of 681 bacterial and fungal isolates were identified, with some patients presenting with more than one microorganism. As shown in S1 Fig, 223 (34.20%) isolates of Gram-negative bacilli, including 67 Klebsiella pneumoniae, 36 Escherichia coli, 41 Acinetobacter, 30 Pseudomonas aeruginosa, 28 Stenotrophomonas maltophilia, 12 Enterobacter cloacae, 5 Haemophilus influenzae, and 1 isolate each of Salmonella Choleraesuis, Proteus mirabilis, Shigella, and Citrobacter freundii were detected. We also detected 137 (21.01%) isolates of Gram-positive cocci, comprising 92 Staphylococcus, 25 Streptococcus, 15 Enterococcus, 3 Bacillus cereus, and 2 Micrococcus luteus. Additionally, 312 (44.78%) isolates of fungi were identified, including 203 Aspergillus (119 A. fumigatus and 59 A. flavus, 25 other Aspergillus), 106 Candida, 1 isolate each of Mucor, Alternaria alternata, and Fusarium solani. Besides, 9 patients were diagnosed with Mycoplasma pneumoniae infection. The novel finding was that 4 patients without a history of tuberculosis were diagnosed with active Mycobacterium tuberculosis infection.

Early predictors selection for superinfection

To establish a model for predicting superinfection in a clinical setting, we applied LR, LASSO regression, RF, LightGBM, and XGBoost to identify the most effective predictors. In the training cohort, we first conducted univariate logistic regression and selected 28 indicators related to the outcome from 36 indicators (p < 0.05, S1 Table). Subsequently, we apply LASSO regression to refine the selection of predictors. Fourteen of the twenty-eight predictors (age, use of glucocorticoids, ALB, AST, LDH, BUN, GLU, CRP, HGB, DM, cough, confusion, expectoration, bleeding) were identified as potential predictors by LASSO regression analysis (Fig 2A and 2B). Given that different algorithms introduce inherent randomness, the number of trees in RF was set to 500, for XGBoost, the learning rate was adjusted to 0.1, and the maximum tree depth to 3 for optimal classification performance. In LightGBM, the learning rate and maximum tree depth were set to 0.01 and 3, respectively. The feature importance scores derived from these parameter settings were used as rankings for the respective methods (Fig 2C2E).

thumbnail
Fig 2. Selecting variables through four machine learning algorithms.

(A) LASSO coefficient profiles of the 28 variables of the clinical diagnosis prediction model in SFTS patients. (B) Cross-validation results of the clinical diagnosis prediction model for diagnosis of superinfection in SFTS patients. (C) Top 15 variables in XGBoost. (D) Top 15 variables in RF. (E) Top 15 variables in LightGBM. (F) Intersection of variables selected by four algorithms-Venn diagram. Abbreviations: SFTS, severe fever with thrombocytopenia syndrome; LASSO, least absolute shrinkage and selection operator regression; XGBoost, extreme gradient boosting; RF, random forest; LightGBM, light gradient boosting machine.

https://doi.org/10.1371/journal.pntd.0014696.g002

As shown in Fig 2C2E, the top 15 most important variables were screened out by RF, LightGBM, and XGBoost machine algorithms, respectively. Finally, we selected the top 15 variables from RF, LightGBM, and XGBoost based on their importance ranking and identified their intersection with the 14 variables selected in the previous LASSO regression. Ultimately, 8 key indicators were identified as predictors for constructing the superinfection model: age, ALB, AST, BUN, GLU, CRP, HGB, and expectoration (Fig 2F).

Prediction model construction and validation

Based on the 8 predictors, LR, RF, LightGBM, and XGBoost were employed to construct and validate predictive models, respectively. As illustrated in Fig 3A and 3B, LR achieved the highest performance both on the internal and external validation sets, with AUC values of 0.839 (95% CI: 0.797–0.880) versus 0.805 (95% CI: 0.764–0.847). RF had an internal validation set AUC of 0.829, which dropped to 0.757 on external validation. XGBoost also showed good internal validation performance, but experienced a notable decline in external validation, dropping from 0.816 to 0.763. LightGBM achieved a performance of 0.820 on the internal validation set, but its performance dropped significantly to 0.750 on the external validation set. With a minimal difference of only 0.034 between the internal and external validation set performance, LR exhibited strong generalization ability and proved to be the most stable and highest-performing method in the crucial validation stage. In terms of clinical utility, LR yielded a positive net benefit across a broad range of clinically relevant thresholds (approximately 0.1 to 0.8) (Fig 3E and 3F). Additionally, LR demonstrated excellent specificity in both internal (0.904) and external (0.930) validation, indicating a low rate of false-positive predictions. The Brier score of LR remained stable at 0.154 in internal validation and 0.151 in external validation, suggesting good calibration and minimal overfitting. Taken together, these findings support LR as the final predictive model. It offered superior discrimination, clinical practicality, consistent generalisability, and favourable performance across validation sets (S2 Table).

thumbnail
Fig 3. Receiver operating characteristic curve, calibration curve and decision curve for 4 machine learning algorithms.

(A) Receiver operating characteristic curve for the internal validation cohort. (B) Receiver operating characteristic curve for the external validation cohort. (C) Calibration curve for the internal validation cohort. (D) Calibration curve for the external validation cohort. (E) Decision curve for the internal validation cohort. (F) Decision curve for the external validation cohort. Abbreviations: SFTS, severe fever with thrombocytopenia syndrome; ROC, receiver operating characteristic curve; DCA, decision curve analysis.

https://doi.org/10.1371/journal.pntd.0014696.g003

Due to its superior performance, the LR model was selected for final deployment. This model, utilizing eight predictors (Age, ALB, AST, BUN, GLU, CRP, HGB, and expectoration), was subsequently visualized as a nomogram (Fig 4A). To enhance clinical application, the model’s predictors were subsequently segmented into hierarchical variables and rescored according to the nomogram. A novel scale scoring from 0 to 13 points was finally developed. The probability of superinfection for each score was determined through LR analysis to quantitatively stratify the superinfection risk in SFTS patients (Fig 4B). According to the scale, the risk of superinfection was categorized into three levels: low risk (≤3), medium risk (4–6), and high risk (7–13)(Fig 4B). These cutpoints were derived using a data-driven quantile-based method based on the score distribution, ensuring reproducible and non-arbitrary risk classification. The predictive performance of the simplified scoring system was subsequently compared with the nomogram, demonstrating comparable discrimination with only a slight reduction in AUC (S3 Table).

thumbnail
Fig 4. The nomogram and scoring scale for predicting superinfection in SFTS patients.

(A) The nomogram for predicting superinfection in SFTS patients. (B) The scoring scale for predicting superinfection in SFTS patients. Abbreviations: SFTS, severe fever with thrombocytopenia syndrome; ALB, albumin; AST, aspartate aminotransferase; GLU, glucose; CRP, c-reactive protein; HGB, haemoglobin; BUN, urea nitrogen.

https://doi.org/10.1371/journal.pntd.0014696.g004

Prospective validation of the model in a real-world clinical setting

The model was then prospectively validated in real-world clinical settings at two hospitals throughout 2025, where it was used to dynamically assess individual patient risk scores. The model showed strong performance in the prospective, real-world setting. As shown in Fig 5A, the model achieved excellent discrimination, with an AUC of 0.854 (95% CI: 0.810–0.898). It also exhibited strong reliability, with good calibration displayed in Fig 5B. The DCA in Fig 5C showed a greater benefit compared to either ‘no treatment’ or ‘all treatment’ in the range of 20% -100%. In brief, the model demonstrated high stability and superior predictive performance in a real-world clinical setting.

thumbnail
Fig 5. Performance of superinfection prediction model in a real-world prospective cohort.

(A) ROC for LR model in the real-world cohort. (B) Calibration curve for LR model in the real-world cohort. (C) DCA for LR model in the real-world cohort. Abbreviations: ROC, receiver operating characteristic curve; LR, logistic regression; DCA, decision curve analysis.

https://doi.org/10.1371/journal.pntd.0014696.g005

Comparison of nomogram and simplified scoring scale

As shown in S3 Table, both the nomogram and the scoring scale exhibited excellent fitting goodness and predictive performance across all datasets. Under the optimal cut-off values, the nomogram achieved a strong negative predictive value (NPV) of 78.6% in the prospective validation, indicating a robust capability for ruling out low-risk patients. While the nomogram showed a slightly higher AUROC in the training set (0.839 vs. 0.809), reaching 0.843 in the prospective validation. This confirms that simplifying the model into a scoring system does not substantially reduce predictive performance. Notably, in the prospective cohort, the scoring scale demonstrated a remarkably higher specificity (95.3% vs. 88.5%) and a significantly stronger positive likelihood ratio (9.482 vs. 4.433), indicating a superior ability to rule in high-risk patients while minimizing false positives. By simplifying complex coefficients into an intuitive integer-based system (Cut-off: 6.5), the scoring scale offers a more accessible and rapid decision-making tool for clinicians without compromising diagnostic accuracy or predictive stability.

Discussion

SFTS is an emerging tick-borne hemorrhagic fever with high mortality rates that has garnered increasing attention worldwide. Superinfections can prolong the hospitalization time and increase the mortality of SFTS patients [23,24]. In this study, we revealed that the incidence of superinfection in SFTS patients was 33.57%. We observed a notably high proportion of fungal superinfections, with Aspergillus species being particularly prevalent. Immunosuppression caused by SFTSV infection, glucocorticoid use, and ICU exposure has all been reported as risk factors for invasive aspergillosis [2527]. Besides, we report 4 cases of M. tuberculosis infection in SFTS patients. However, due to the lack of baseline pre-infection screening and the rapid progression of SFTS, we were unable to definitively differentiate between newly acquired active TB and the reactivation of latent tuberculosis (LTBI). When diagnosing superinfection in SFTS patients is uncertain, adherence to antibiotic stewardship programs often declines as clinicians prioritize life-saving interventions.

Early identification of SFTS patients with superinfection can help clinicians focus on timely management and prevent the overuse of antibiotics. In this study, we employed five machine learning algorithms with a cross-selection approach to identify the most robust and non-redundant predictors. This strategy effectively reduced the initial 36 candidate variables to 8 final predictive factors for superinfection. The eight predictors capture complementary dimensions of superinfection risk. CRP reflects systemic inflammatory activity. Age, ALB, HGB, and GLU summarise the patient’s overall physiological condition. AST and BUN reflect hepatic and renal dysfunction. Expectoration represents the dominant clinical manifestation. Together, these variables enable a multi-dimensional, bedside assessment of superinfection risk. These predictors are easily accessible factors, independent of viral parameters, making them applicable even in primary healthcare settings.

While previous studies have investigated superinfection in SFTS, most were limited by small-sample size and single-center retrospective designs [9,28]. Furthermore, these studies often prioritized internal validation, lacking assessment in external cohorts [29]. To address these gaps, our study gathered 12 years of consecutive clinical data from four hospitals. We employed four machine learning algorithms to minimise overfitting and enhance generalisability. The resulting prediction model for superinfection in SFTS patients showed high accuracy in both the external and prospective real-world validation cohorts. Building on the predictive results visualised in the nomogram, we further developed a novel 3-tier risk scoring scale. The scale enables simple, intuitive bedside stratification of superinfection risk in SFTS patients. To our knowledge, this is one of the first studies to establish a superinfection risk stratification system for SFTS patients.

However, there were several limitations. A primary limitation of this study is that all datasets and external validation sets were obtained from hospitals in Anhui Province. No independent external validation from regions outside Anhui was conducted, limiting geographic generalizability. Future research should aim to validate the model in multicenter cohorts across different geographic regions. Second, our study did not develop specific diagnostic models for bacterial or fungal superinfections, owing to the presence of dual-pathogen infections in some patients, which complicated differential diagnosis. Additionally, our primary goal was to distinguish superinfection from non-superinfection at the earliest stage to help control antimicrobial overuse in SFTS patients. Third, we did not analyze the bacterial resistance profile because some pathogens identified via NGS cannot provide a resistance phenotype.

In conclusion, this evidence-based, factor-weighted, accurate scoring scale provides clinicians with an effective tool to quickly stratify superinfection risk in SFTS patients beyond pathogen.

Supporting information

S1 Fig. Microbiological aetiologies of SFTS patients with superinfection.

(A) Distribution of Gram-negative bacteria. (B) Distribution of Gram-positive bacteria. (C) Distribution of fungi. Abbreviations: K. pneumoniae, Klebsiella pneumoniae; E. coli, Escherichia coli; P. aeruginosa, Pseudomonas aeruginosa; S. maltophilia, Stenotrophomonas maltophilia; E. cloacae, Enterobacter cloacae; H. influenzae, Haemophilus influenzae; B. cereus, Bacillus cereus; M. luteus, Micrococcus luteus; A. fumigatus, Aspergillus fumigatus; A. flavus, Aspergillus flavus.

https://doi.org/10.1371/journal.pntd.0014696.s001

(TIF)

S1 Table. Univariate logistic regression results of the training set.

Abbreviations: ALB, albumin; GLO, globulin; TBIL, total bilirubin; ALT, alanine aminotransferase; AST, aspartate aminotransferase; LDH, lactate dehydrogenase; BUN, blood urea nitrogen; Cr, creatinine; K, potassium; Na, sodium; GLU, glucose; CRP, C-reactive protein; WBC, white blood cell; N, neutrophil count; HGB, hemoglobin; PLT, platelet count; APTT, activated partial thromboplastin time; FIB, fibrinogen; DD, d-dimer; CK, creatinine kinase; CK-MB, creatine kinase MB; DM, diabetes mellitus; COPD, chronic obstructive pulmonary disease; CI, confidence interval.

https://doi.org/10.1371/journal.pntd.0014696.s002

(DOCX)

S2 Table. Comparative performance of machine learning models in validation sets.

https://doi.org/10.1371/journal.pntd.0014696.s003

(DOCX)

S3 Table. Fitting goodness and predictive performance of the nomogram and scoring scale.

https://doi.org/10.1371/journal.pntd.0014696.s004

(DOCX)

S4 Table. Hyperparameter search spaces for each model.

https://doi.org/10.1371/journal.pntd.0014696.s005

(DOCX)

References

  1. 1. Hu L, Li J, Zhang H, Bian T, Pan J, Li J, et al. Predisposing factors for person-to-person transmission of severe fever with thrombocytopenia syndrome bunyavirus. J Hosp Infect. 2022;123:174–8. pmid:34767872
  2. 2. Chen Q, Yang D, Zhang Y, Zhu M, Chen N, Yushan Z. Transmission and mortality risk assessment of severe fever with thrombocytopenia syndrome in China: results from 11-years’ study. Infect Dis Poverty. 2022;11(1):93. pmid:36058928
  3. 3. Li J-C, Zhao J, Li H, Fang L-Q, Liu W. Epidemiology, clinical characteristics, and treatment of severe fever with thrombocytopenia syndrome. Infect Med (Beijing). 2022;1(1):40–9. pmid:38074982
  4. 4. Zhan J, Wang Q, Cheng J, Hu B, Li J, Zhan F, et al. Current status of severe fever with thrombocytopenia syndrome in China. Virol Sin. 2017;32(1):51–62. pmid:28251515
  5. 5. Tran XC, Yun Y, Van An L, Kim S-H, Thao NTP, Man PKC, et al. Endemic severe fever with thrombocytopenia syndrome, Vietnam. Emerg Infect Dis. 2019;25(5):1029–31. pmid:31002059
  6. 6. Seo J-W, Kim D, Yun N, Kim D-M. Clinical update of severe fever with thrombocytopenia syndrome. Viruses. 2021;13(7):1213. pmid:34201811
  7. 7. Li J, Li S, Yang L, Cao P, Lu J. Severe fever with thrombocytopenia syndrome virus: a highly lethal bunyavirus. Crit Rev Microbiol. 2021;47(1):112–25. pmid:33245676
  8. 8. He F, Zheng X, Zhang Z. Clinical features of severe fever with thrombocytopenia syndrome and analysis of risk factors for mortality. BMC Infect Dis. 2021;21(1):1253. pmid:34906106
  9. 9. Wang H, Luo M, Fisher D, Pronyuk K, Musabaev E, Thu HNT, et al. Clinical factors associated with invasive pulmonary aspergillosis in patients with severe fever with thrombocytopenia syndrome: analysis of a 6-year clinical experience. Front Microbiol. 2024;15:1448710. pmid:39328917
  10. 10. Song H, Zou S, Huang Y, Wang Y, Wang T, Wei W, et al. The pathogenic and clinical characteristics of severe fever with thrombocytopenia syndrome patients with co-infections. Front Cell Infect Microbiol. 2023;13:1298050. pmid:38106473
  11. 11. Zuo Y, Wang H, Huang J, Zhang F, Lv D, Meng T, et al. Pulmonary infection in patients with severe fever with thrombocytopenia syndrome: a multicentre observational study. J Med Virol. 2023;95(4):e28712. pmid:36991571
  12. 12. Norvig P, Russell SJ. Artificial intelligence: a modern approach. 4th ed; 2021.
  13. 13. Odone A, Barbati C, Amadasi S, Schultz T, Resnik DB. Artificial intelligence and infectious diseases: an evidence-driven conceptual framework for research, public health, and clinical practice. Lancet Infect Dis. 2026;26(3):e152–67. pmid:40972628
  14. 14. Li J, Wang G. Consensus on the diagnosis and treatment of severe fever with thrombocytopenia syndrome. Chin J Infect Dis. 2022;40:711–21.
  15. 15. Chen Y, Fan L-C, Chai Y-H, Xu J-F. Advantages and challenges of metagenomic sequencing for the diagnosis of pulmonary infectious diseases. Clin Respir J. 2022;16(10):646–56. pmid:36068680
  16. 16. Timsit J-F, Ruppé E, Barbier F, Tabah A, Bassetti M. Bloodstream infections in critically ill patients: an expert statement. Intensive Care Med. 2020;46(2):266–84. pmid:32047941
  17. 17. Yokoe M, Hata J, Takada T, Strasberg SM, Asbun HJ, Wakabayashi G, et al. Tokyo Guidelines 2018: diagnostic criteria and severity grading of acute cholecystitis (with videos). J Hepatobiliary Pancreat Sci. 2018;25(1):41–54. pmid:29032636
  18. 18. Zhong F, Lin X, Zheng C, Tang S, Yin Y, Wang K, et al. Establishment and validation of a clinical risk scoring model to predict fatal risk in SFTS hospitalized patients. BMC Infect Dis. 2024;24(1):975. pmid:39272027
  19. 19. Hu J, Szymczak S. A review on longitudinal data analysis with random forest. Brief Bioinform. 2023;24(2):bbad002. pmid:36653905
  20. 20. Lin T-H, Chung H-Y, Jian M-J, Chang C-K, Perng C-L, Liao G-S, et al. An advanced machine learning model for a web-based artificial intelligence-based clinical decision support system application: model development and validation study. J Med Internet Res. 2024;26:e56022. pmid:39231422
  21. 21. Shi J, Chen L, Yuan X, Yang J, Xu Y, Shen L, et al. A potential XGBoost diagnostic score for Staphylococcus aureus bloodstream infection. Front Immunol. 2025;16:1574003. pmid:40330459
  22. 22. Liu Y, Fan L, Wang W, Song H, Zhang Z, Liu Q, et al. A machine learning model for mortality prediction in patients with severe fever with thrombocytopenia syndrome: a prospective, multicenter cohort study. Emerg Microbes Infect. 2025;14(1):2498572. pmid:40309990
  23. 23. Langford BJ, So M, Raybardhan S, Leung V, Westwood D, MacFadden DR, et al. Bacterial co-infection and secondary infection in patients with COVID-19: a living rapid review and meta-analysis. Clin Microbiol Infect. 2020;26(12):1622–9. pmid:32711058
  24. 24. Galli F, Bindo F, Motos A, Fernández-Barat L, Barbeta E, Gabarrús A, et al. Procalcitonin and C-reactive protein to rule out early bacterial coinfection in COVID-19 critically ill patients. Intensive Care Med. 2023;49(8):934–45. pmid:37507573
  25. 25. Bae S, Hwang HJ, Kim MY, Kim MJ, Chong YP, Lee S-O, et al. Invasive pulmonary aspergillosis in patients with severe fever with thrombocytopenia syndrome. Clin Infect Dis. 2020;70(7):1491–4. pmid:31342053
  26. 26. Kawaguchi T, Umekita K, Yamanaka A, Hara S, Yamaguchi T, Inoue E, et al. Corticosteroids may have negative effects on the management of patients with severe fever with thrombocytopenia syndrome: a case-control study. Viruses. 2021;13(5):785. pmid:33925061
  27. 27. Hu L, Kong Q, Yue C, Xu X, Xia L, Bian T, et al. Early-warning immune predictors for invasive pulmonary aspergillosis in severe patients with severe fever with thrombocytopenia syndrome. Front Immunol. 2021;12:576640. pmid:34025635
  28. 28. Sun S-H, Liu R-N, Zhang S-J, Wang Z-X. Risk factors for co-infections in patients with severe fever with thrombocytopenia syndrome. J Med Virol. 2025;97(1):e70175. pmid:39817591
  29. 29. Yao L, Shi Y, Fu J, Fang X, Zhang H, Luo D, et al. Risk factors for invasive pulmonary aspergillosis in patients with severe fever with thrombocytopenia syndrome: a multicenter retrospective study. J Med Virol. 2024;96(5):e29647. pmid:38708790