Figures
Citation: Nagarajan R, Godambe SA, Paul R, Tennant R, Anand KJS, Sandhu E, et al. (2025) Pediatric sepsis prediction: Human in the loop framework. PLOS Digit Health 4(11): e0001045. https://doi.org/10.1371/journal.pdig.0001045
Editor: Dhiya Al-Jumeily OBE, Liverpool John Moores University - City Campus: Liverpool John Moores University, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
Published: November 4, 2025
Copyright: © 2025 Nagarajan et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
“If you can look into the seeds of time and say which grain will grow and which will not, speak, then, to me” Act I, Scene 3, Macbeth, William Shakespeare, 1606–1607.
Pediatric sepsis remains one of the most significant threats to global child health, contributing to substantial mortality, long-term morbidity, and sequela that extend far beyond the initial illness with significant economic burden. Sepsis in neonates and children under 19 arises from a dysregulated host immune response to microbial burden (e.g., bacterial, viral, fungal, parasitic), contributing to approximately half of the 50 million global sepsis cases annually [1]. Diagnosis of pediatric sepsis has been acknowledged as challenging, accompanied by rapid progression to septic shock, and abrupt onset of hemodynamic collapse [2]. Pediatric Sepsis Prediction (PSP) using machine learning (ML) and artificial intelligence (AI) approaches [3–5], has emerged as an important clinical goal, Fig 1. This perspective outlines fundamental challenges and presents a compelling case for an augmented human-in-the-loop (HITL) framework for PSP. The proposed HITL framework encourages the concerted working of AI and ML models with providers at the bedside within an augmented setting, as opposed to the current practice of generating predictions by models in isolation. HITL also aligns with the broader human factors frameworks such as the Systems Engineering Initiative for Patient Safety (SEIPS) [6].
Current pediatric sepsis alert generation using structured data elements (3) is represented by the black box (Current), and the proposed augmented human-in-the-loop (HITL) framework using multimodal data and concerted working of providers with structured (3) and unstructured data elements (4), (5), (6) is shown by the blue box.
Standardized scoring criteria such as systemic inflammatory response syndrome (SIRS), sequential organ failure assessment (SOFA), and its variants (qSOFA) while used routinely for predicting pediatric sepsis [6] outcomes, rely on adverse events such as organ failure limiting their predictive potential early in the disease progression. Recent efforts have demonstrated the effectiveness of multivariate biomarkers in conjunction with AI and ML approaches such as single classifiers (e.g., logistic regression), ensemble classifiers (e.g., random forest), and deep learning for PSP [3]. However, these approaches predominantly rely on cross-sectional profiles and structured data elements. More importantly, their failure to accommodate dynamic changes in real-time (e.g., interventions, symptoms, response to treatment), and contemporary decisions at the point of care [7] including the faculty of the provider [8] at the bedside, diminish their predictive potential and generalization ability. Dynamic changes at the bedside is multimodal comprising structured as well as unstructured data elements [9]. The asynchronous nature of these changes discourages brute-force automation.
Unique challenges accompanying pediatric sepsis prediction are outlined below.
- Definition: Pediatric sepsis is associated with dysregulated immune responses to infections, hence nonspecific by very definition, making the prediction task challenging. Criteria for defining pediatric sepsis has evolved over time and continue to be debated [10–13].
- Predictive Biomarkers: Predictive biomarkers widely used for PSP are essentially structured data elements that interrogate the subjects across scales (i.e., multiscale) with varying degrees of resolution, and at different time points in the pediatric sepsis continuum, Fig 1. These multivariate biomarkers fall under molecular, clinical, and demographic biomarkers. Predictive potential of molecular biomarkers (e.g., C-reactive protein) can be attributed to the fact that disease phenotypes and clinical presentations are preceded by orchestrated changes in the underlying molecular immune signaling mechanisms. However, the molecular signaling cascade accompanying dysregulated immune responses and inflammatory profiles in pediatric sepsis can be nonspecific, impacting their predictive potential. Changes in molecular biomarkers lead to characteristic changes in clinical presentations. Therefore, clinical biomarkers (e.g., respiratory rate) can in fact be thought of as the culminating point of the underlying molecular changes. Clinical biomarkers of sepsis can also be nonspecific resembling other serious pediatric illnesses and febrile infections (e.g., SIRS: systemic inflammatory response syndrome) limiting their predictive potential. Demographic biomarkers (e.g., age), while not actionable, can act as confounders warranting their inclusion in the predictive models.
- Asynchronous Sampling: Sepsis progression is accompanied by a cascade of events such as tissue damage, organ failure, and mortality. Outcomes that have been of interest from modeling standpoint include sepsis, severe sepsis, and septic shock, with increasing decompensation from sepsis to septic shock, Fig 1. The majority of current PSP models have focused on predicting sepsis from cross-sectional profiles [3], where the data is sampled asynchronously across the subjects in a given time window. Since the patients can be at different points in the disease continuum with varying rapidity of the disease progression, cross-sectional profiling is susceptible to inflated variance impacting the model performance and generalization ability. While longitudinal profiling can ameliorate some of these challenges, the timing and frequency of administering interventions (e.g., IV fluids) can exhibit marked variations between the subjects. These aspects are especially amplified in the presence of class imbalance attributed to relatively low prevalence and sample size of pediatric sepsis subjects (0.05%, 19.38%) [3], especially accentuated in the case of severe sepsis and septic shock.
Proposed human-in-the-loop (HITL) framework
While several advanced models with varying complexity continue to be explored for PSP, these do not compensate for the failure to accommodate real-time dynamic changes and the faculty of the provider at the bedside. Unlike current models that rely predominantly on cross-sectional multivariate structured data elements, the proposed augmented HITL framework emphasizes the importance of capturing multimodal data comprising structured and unstructured data elements at the bedside in real-time. More importantly, it emphasizes the concerted working of providers and models for enhanced prediction with potential to directly impact trust and enhanced adoption of these models in clinical workflows. Asynchronous changes at the bedside can vary across subjects and may include timely intravenous fluids and antibiotic medications at the bedside reducing kidney and neurological sequelae altering the patient’s disease trajectory. Symptoms (e.g., mental status) observed by a provider in communication with the patient and family may not be readily apparent in the retrospective structured data elements used to train current PSP models, Fig 1. Since not all interventions, symptoms, and dynamic changes at the bedside may be relevant, Fig 1, brute-force automation is not an option. The HITL framework overcomes this challenge by leveraging the faculty of providers for identifying qualifying changes for inclusion as potential predictors. The proposed HITL framework addresses critical gaps in PSP and is expected to impact outcomes favorably.
References
- 1. Watson RS, Carrol ED, Carter MJ, Kissoon N, Ranjit S, Schlapbach LJ. The burden and contemporary epidemiology of sepsis in children. Lancet Child Adolesc Health. 2024;8(9):670–81. pmid:39142741
- 2. Emr BM, Alcamo AM, Carcillo JA, Aneja RK, Mollen KP. Pediatric sepsis update: how are children different?. Surg Infect (Larchmt). 2018;19(2):176–83. pmid:29394150
- 3. Tennant R, Graham J, Kern J, Mercer K, Ansermino JM, Burns CM. A scoping review on pediatric sepsis prediction technologies in healthcare. NPJ Digit Med. 2024;7(1):353. pmid:39633080
- 4. Rangan ES, Pathinarupothi RK, Anand KJS, Snyder MP. Performance effectiveness of vital parameter combinations for early warning of sepsis-an exhaustive study using machine learning. JAMIA Open. 2022;5(4):ooac080. pmid:36267121
- 5. Sepanski RJ, Godambe SA, Mangum CD, Bovat CS, Zaritsky AL, Shah SH. Designing a pediatric severe sepsis screening tool. Front Pediatr. 2014;2:56. pmid:24982852
- 6. Barbieri DF, Srinivasan D, Ulrich J, Ranganathan S, Chang C, Gerac JA, et al. Systems-based framework for clinical decision-support system integration for patient sepsis management: a theoretical application of the SEIPS model. Human Factors in Healthcare. 2025;7:100098.
- 7. McCradden MD, Mazwi ML, Oakden-Rayner L. Can an accurate model be bad?. Patterns (N Y). 2025;6(4):101205. pmid:40264964
- 8. Balamuth F, Alpern ER, Grundmeier RW, Chilutti M, Weiss SL, Fitzgerald JC, et al. Comparison of two sepsis recognition methods in a pediatric emergency department. Acad Emerg Med. 2015;22(11):1298–306. pmid:26474032
- 9. Goh KH, Wang L, Yeow AYK, Poh H, Li K, Yeow JJL, et al. Artificial intelligence in sepsis early prediction and diagnosis using unstructured data in healthcare. Nat Commun. 2021;12(1):711. pmid:33514699
- 10. Miranda M, Nadel S. Pediatric sepsis: a summary of current definitions and management recommendations. Curr Pediatr Rep. 2023;11(2):29–39. pmid:37252329
- 11. Sanchez-Pinto LN, Bennett TD, DeWitt PE, Russell S, Rebull MN, Martin B, et al. Development and validation of the phoenix criteria for pediatric sepsis and septic shock. JAMA. 2024;331(8):675–86. pmid:38245897
- 12. Paul R, Niedner M, Riggs R, Richardson T, DeSouza HG, Auletta JJ, et al. Bundled care to reduce sepsis mortality: the Improving Pediatric Sepsis Outcomes (IPSO) Collaborative. Pediatrics. 2023;152(2):e2022059938. pmid:37435672
- 13. Long E, Borland ML, George S, Jani S, Tan E, Phillips N, et al. External validation of the phoenix sepsis score in children with suspected community-acquired sepsis. JAMA Netw Open. 2025;8(3):e251412. pmid:40116825