Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

FAST and Agile–the MASLD drift: Validation of Agile 3+, Agile 4 and FAST scores in 246 biopsy-proven NAFLD patients meeting MASLD criteria of prevalent caucasian origin

  • Madalina-Gabriela Taru ,

    Roles Data curation, Formal analysis, Investigation, Methodology, Project administration, Validation, Visualization, Writing – original draft, Writing – review & editing

    ‡ MGT and CT are equally to this work as shared first authorship.

    Affiliations Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, Cluj-Napoca, Cluj, Romania, Regional Institute of Gastroenterology and Hepatology "Octavian Fodor", Cluj-Napoca, Cluj, Romania, Department of Medical and Surgical Sciences, University of Bologna, Bologna, Italy

  • Cristian Tefas ,

    Roles Conceptualization, Data curation, Formal analysis, Supervision, Writing – review & editing

    ‡ MGT and CT are equally to this work as shared first authorship.

    Affiliations Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, Cluj-Napoca, Cluj, Romania, Regional Institute of Gastroenterology and Hepatology "Octavian Fodor", Cluj-Napoca, Cluj, Romania

  • Lidia Neamti,

    Roles Data curation, Visualization, Writing – review & editing

    Affiliations Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, Cluj-Napoca, Cluj, Romania, Regional Institute of Gastroenterology and Hepatology "Octavian Fodor", Cluj-Napoca, Cluj, Romania

  • Iulia Minciuna,

    Roles Data curation, Visualization

    Affiliations Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, Cluj-Napoca, Cluj, Romania, Regional Institute of Gastroenterology and Hepatology "Octavian Fodor", Cluj-Napoca, Cluj, Romania

  • Vlad Taru,

    Roles Data curation, Visualization

    Affiliations Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, Cluj-Napoca, Cluj, Romania, Regional Institute of Gastroenterology and Hepatology "Octavian Fodor", Cluj-Napoca, Cluj, Romania, Division of Gastroenterology and Hepatology, Department of Medicine III, Medical University of Vienna, Vienna, Austria

  • Anca Maniu,

    Roles Data curation

    Affiliation Regional Institute of Gastroenterology and Hepatology "Octavian Fodor", Cluj-Napoca, Cluj, Romania

  • Ioana Rusu,

    Roles Data curation, Writing – review & editing

    Affiliation Regional Institute of Gastroenterology and Hepatology "Octavian Fodor", Cluj-Napoca, Cluj, Romania

  • Bobe Petrushev,

    Roles Visualization, Writing – review & editing

    Affiliation Regional Institute of Gastroenterology and Hepatology "Octavian Fodor", Cluj-Napoca, Cluj, Romania

  • Lucia Maria Procopciuc,

    Roles Visualization

    Affiliation Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, Cluj-Napoca, Cluj, Romania

  • Dan Corneliu Leucuta,

    Roles Formal analysis, Software, Visualization

    Affiliation Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, Cluj-Napoca, Cluj, Romania

  • Bogdan Procopet,

    Roles Data curation, Investigation, Visualization, Writing – review & editing

    Affiliations Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, Cluj-Napoca, Cluj, Romania, Regional Institute of Gastroenterology and Hepatology "Octavian Fodor", Cluj-Napoca, Cluj, Romania

  • Silvia Ferri,

    Roles Visualization, Writing – review & editing

    Affiliation Division of Internal Medicine, Hepatobiliary and Immunoallergic Diseases, IRCCS Azienda Ospedaliero—Universitaria di Bologna, Bologna, Italy

  • Monica Lupsor-Platon ,

    Roles Funding acquisition, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – review & editing

    monica.lupsor@umfcluj.ro

    Affiliations Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, Cluj-Napoca, Cluj, Romania, Regional Institute of Gastroenterology and Hepatology "Octavian Fodor", Cluj-Napoca, Cluj, Romania

  • Horia Stefanescu

    Roles Data curation, Investigation, Writing – review & editing

    Affiliation Regional Institute of Gastroenterology and Hepatology "Octavian Fodor", Cluj-Napoca, Cluj, Romania

Abstract

Background

MASLD is a prevalent chronic liver condition with substantial clinical implications. This study aimed to assess the effectiveness of three new, elastography-based, scoring systems for advanced fibrosis ≥F3 (Agile 3+), cirrhosis F4 (Agile 4), and fibrotic NASH: NASH + NAS ≥4 + F≥2 (FAST score), in a cohort of biopsy-proven NAFLD meeting MASLD criteria. Our secondary aim was to compare their diagnostic performances with those of other fibrosis prediction tools: LSM-VCTE alone, and common, easily available scores (FIB-4 or APRI).

Methods

Single-center, retrospective study, on consecutive patients with baseline laboratory tests, liver biopsy, and reliable LSM-VCTE measurements. The discrimination between tests was evaluated by analyzing the AUROCs. Dual cut-off approaches were applied to rule-out and rule-in ≥F3, F4 and fibrotic NASH. We tested previously reported cut-off values and provided our best thresholds to achieve Se ≥85%, Se ≥90%, and Sp ≥90%, Sp ≥95%.

Results

Among 246 patients, 113 (45.9%) were women, and 75 (30.5%) presented diabetes. Agile 3+ and Agile 4 demonstrated excellent performance in identifying ≥F3 and F4, achieving AUROCs of 0.909 and 0.968, while the FAST score yielded acceptable results in distinguishing fibrotic NASH. When compared to FIB-4 and LSM-VCTE, both Agile 3+ and Agile 4 performed better than FIB-4 and had a similar performance to LSM-VCTE, but with higher diagnostic accuracy, hence reducing the grey zone.

Conclusion

Agile 3+ and Agile 4 are reliable, non-invasive tests for identifying advanced fibrosis or cirrhosis in MASLD patients, while FAST score demonstrates moderate performance in identifying fibrotic NASH.

Introduction

Non-alcoholic fatty liver disease (NAFLD), also referred to by the newly defined term metabolic dysfunction-associated steatotic liver disease (MASLD) [1] is the most prevalent chronic liver condition worldwide (estimated to affect up to 38% of the entire population) [2]. Liver fibrosis is a crucial determinant of prognosis in patients with MASLD [3], leading to a significant rise in overall mortality and increased risk of developing liver-related events (LREs), especially among patients with advanced fibrosis (≥F3) or cirrhosis (F4) [4].

Liver biopsy (LB) is currently the accepted standard for evaluating liver fibrosis. However, it is hampered by its invasive nature, intra and inter-observer variability and sampling errors [57]. Given these limitations, the most straightforward approach to identify MASLD patients with suspected advanced chronic liver disease (ACLD) would involve applying non-invasive tests (NITs), while concurrently striving for cost-efficiency [8]. The utilization of NITs, which can be easily repeated over time and offer the potential to compare successive measurements, could improve the overall care of patients with chronic liver disease (CLD) in general and of those with MASLD, in particular [9].

Agile 3+ and Agile 4 are two scores comprising clinical and laboratory factors (including AST/ALT ratio, platelet count, gender, diabetes status, and age for Agile 3+) along with liver stiffness measurement (LSM) using vibration-controlled transient elastography (VCTE) [10]. These scores have been developed to predict advanced fibrosis (≥F3) and cirrhosis (F4), respectively, in patients with NAFLD [10]. As established non-invasive tests (NITs), LSM-VCTE, and FIB-4 were demonstrated to have good performance in ruling-out advanced fibrosis in people with NAFLD [11]. The newly developed Agile 3+ and Agile 4 scores were meant to provide higher positive predictive values (PPVs) for ruling-in ≥F3 and F4, and to reduce the number of indeterminate results [10]. These scores correlate well with the severity of liver fibrosis, decrease the number of patients left in the so-called “grey zone”, and increase the PPV for ruling-in ≥F3 and F4, respectively [10].

The FibroScan-AST (FAST) score has been developed in 2020 for the non-invasive identification of patients with non-alcoholic steatohepatitis (NASH), concomitant significant activity (NAS ≥4) and significant fibrosis (F≥2) as per liver biopsy [12].

In this study, we aimed to investigate the effectiveness of Agile 3+, Agile 4 and FAST scores in discriminating advanced fibrosis, cirrhosis, and fibrotic NASH, respectively, in our cohort of biopsy-proven NAFLD patients that met MASLD criteria from a tertiary medical center in Cluj-Napoca, Romania. A secondary goal was to determine if these scores outperformed commonly used NITs such as LSM-VCTE, FIB-4 and APRI (compared to FAST-score) for predicting ≥F3, F4 and fibrotic NASH, respectively.

Materials and methods

Patients

This retrospective analysis included 246 consecutive adult patients (18–80 years old), evaluated for suspected NAFLD, from our tertiary care center in Cluj-Napoca, Romania. The recruitment period started on the 1st of January 2007 and ended on the 18th of July 2023. All included patients had undergone liver biopsy (percutaneous or transjugular) for diagnostic purposes and presented baseline reliable VCTE measurements within a maximum three weeks prior to the liver biopsy. We excluded patients with missing data necessary for calculating the Agile 3+, Agile 4 and FAST scores, missing fibrosis stage on liver biopsy, history of chronic liver disease other than NAFLD (such as viral, cholestatic, immune etc.), high alcohol consumption (defined by >21 drinks, on average, per week in men and >14 drinks, on average, per week in women [13]), and ALT and AST >5 times the upper normal limit.

All patients had the following parameters collected at baseline: age, gender, body mass index (BMI), fasting glucose and history of diabetes, complete blood count, coagulation parameters, liver function profile, renal function, lipidic profile, and serum electrolytes.

This retrospective study of consecutively enrolled patients was conducted in accordance with the principles of the Helsinki Declaration and with the local and national laws. The study protocol was approved by the local institutional review boards—The Ethics Committee from “Iuliu Hatieganu” University of Medicine and Pharmacy”, Cluj-Napoca, Romania, (PN-III-P4-PCE-2021-1474 study—number of approval AVZ259/14.09.2022). The informed consent was signed by all participants at the moment of the enrollment. Data was accessed for research purposes on the 20th of September 2023. The authors did not have access to information that could identify individual participants during and after data collection.

Liver biopsy

Liver biopsies were fixed in formalin and embedded in paraffin. Histopathological staging for liver fibrosis was performed according to the NASH Clinical Research Network (CRN) scoring system and served as the reference standard [5]. Steatosis (0–3), ballooning (0–2) and inflammation (0–3) were also scored using the NASH CRN scoring system [5]. One pathologist specialized in liver diseases, blinded to the NITs results, staged fibrosis on the biopsy specimens, as: stage 0—absence of fibrosis (F0), stage 1—perisinusoidal or portal (F1), stage 2—perisinusoidal and portal/periportal (F2), stage 3—septal or bridging fibrosis (F3), stage 4—cirrhosis (F4). The NAFLD activity score (NAS) was calculated as the sum of steatosis, ballooning, and lobular inflammation grades and ranged from 0 to 8 [5]. NASH was defined on LB as the presence of steatosis, hepatocyte ballooning, and lobular inflammation with at least 1 point for each category (FLIP-NASH) [14], following the seminal study on FAST score [12]. Every biopsy specimen included in the analysis was taken from the right lobe (percutaneous or transjugular) and had a minimum of 6 portal tracts.

Fibrosis prediction formulas

The Fibrosis-4 index (FIB‐4) was calculated as follows: [15];

The AST to platelet ratio index (APRI) was calculated as follows: [16];

Liver stiffness measurement by vibration controlled transient elastography for staging fibrosis

VCTE (FibroScan, Echosens, Paris, France) was performed by two experienced operators, blinded to the biopsy results, with both M (3.5 Hz frequency), and XL (2.5 Hz frequency) probes, according to the EASL-ALEH recommendations [11, 17] and considering the integrated automatic probe selection software. Measurements were performed in a fasting state. We considered reliable results as being those representing the mean of 10 valid measurements with an IQR/M below 30%.

Controlled attenuation parameter by vibration controlled transient elastography for grading steatosis

CAP measurements (available in our clinic since 2012) were performed by FibroScan (Echosens, Paris, France) by two experienced operators, blinded to the biopsy results, simultaneously with LSM and by respecting the principles of CAP measurement [18]. CAP was computed only when the associated LSM was valid and using the same signals as the ones used to measure liver stiffness. Therefore, both stiffness and CAP were obtained during the same examination and in the same volume of liver parenchyma. We considered reliable results those representing the mean of 10 valid measurements with an IQR/M below 30%. The final CAP value was expressed in dB/m.

Agile 3+, Agile 4 and FAST scores

We calculated the Agile 3+, Agile 4 and FAST scores based on the baseline characteristics for each patient, considering diabetes status: yes = 1, no = 0 and gender: male = 1, female = 0, by using the following formulas [10, 12]:

For Agile 3+: where ;

For Agile 4: where ;

For FAST score:

Statistical analysis

Continuous variables were evaluated for their normal distribution with the Kolmogorov-Smirnov test, and then expressed as median with interquartile range (Q1-Q3) or mean with standard deviation (SD), or standard error of mean (SEM). Categorical variables were reported as frequency and percentage. Descriptive statistics were provided for the complete group (n = 246) and for the subgroup of patients for whom FAST score was calculated (n = 136). The one-way ANOVA test was used for intergroup comparison between fibrosis stages for LSM-VCTE, Agile 3+ and Agile 4. The diagnostic performance of Agile 3+, Agile 4 and FAST scores was determined using receiver operating characteristic (AUROC) curves. We calculated the AUROCs with 95% confidence intervals (CI) for the detection of histologically confirmed advanced fibrosis (≥F3), cirrhosis (F4) and fibrotic NASH (NASH + NAS ≥4 + F≥2). The DeLong test was used for comparison of diagnostic performance between Agile scores, LSM only, FIB-4, and APRI. For Agile 3+, Agile 4 and FAST scores, the number of patients remaining in the grey zone was determined. The exact McNemar’s test was used to assess the concordance between “grey zones”. The statistical significance was considered for p values < 0.05 for all tests. Statistics were performed using the IBM Statistical Package for Social Sciences (SPSS, version 29, IBM Corp., Armonk, NY, USA).

Results

246 biopsy-proven NAFLD patients were included in the final analysis. The mean number of portal tracts on biopsy was 12 ±8. Of those, 136 presented reliable CAP measurements. Out of 256 patients with reliable VCTE measurements, 4 (1.6%) of them did not meet the MASLD criteria and were not included in the analysis (were considered as lean NAFLD). Fig 1 displays a comprehensive overview of the patient selection process.

thumbnail
Fig 1. Flow diagram of patient selection.

NAFLD- nonalcoholic fatty liver disease, VCTE- vibration controlled transient elastography, CAP- controlled attenuation parameter, FAST- FibroScan-AST score.

https://doi.org/10.1371/journal.pone.0303971.g001

The median age at baseline was 52 years (IQR, 20) and median BMI was 29.0 kg/m2 (IQR, 5.1). 113 (45.9%) patients were female and 75 (30.5%) presented diabetes at baseline. Table 1 provides a comprehensive overview of the baseline characteristics for the included patients.

thumbnail
Table 1. Baseline characteristics of the patients included in the study.

https://doi.org/10.1371/journal.pone.0303971.t001

Diagnostic performance of Agile 3+ and Agile 4 scores

The mean (±SEM) values for LSM-VCTE progressively increased with the increase in fibrosis stages, from F0 (5.6 ± 0.5) kPa, to F1 (6.8 ± 0.3) kPa, F2 (9.0 ±0.5) kPa, F3 (15.5 ± 1.2) kPa and F4 (30.4 ± 3.1) kPa, respectively (Fig 2A).

thumbnail
Fig 2. LSM-VCTE, Agile 3+ and Agile 4 scores among 246 patients with biopsy-proven NAFLD.

Median values (lines inside boxes) for (a) LSM-VCTE, (b) Agile 3+, (c) Agile 4 are shown in the box graph, together with the 25th–75th percentiles, respectively. LSM–liver stiffness measurement, VCTE–vibration controlled transient elastography, kPa–kilopascals, NASH–nonalcoholic steatohepatitis, CRN–Clinical Research network, F0 –absence of fibrosis, F1 –mild fibrosis, F2 –significant fibrosis, F3 –advanced fibrosis, F4 –cirrhosis.

https://doi.org/10.1371/journal.pone.0303971.g002

The same trend was respected by Agile 3+ with values for F0 (0.073 ± 0.017), F1 (0.182 ± 0.024), F2 (0.336 ± 0.032), F3 (0.686 ± 0.042) and F4 (0.939 ± 0.016), respectively (Fig 2B).

Congruently, Agile 4 respected the same distribution, with values for F0 (0.006 ± 0.002), F1 (0.024 ± 0.005), F2 (0.100 ± 0.020), F3 (0.292 ± 0.039) and F4 (0.736 ± 0.041), respectively (Fig 2C).

For advanced fibrosis (≥F3), the predictive performance of Agile 3+ was indicated by an AUROC of 0.909 [0.866–0.942] and of Agile 4 by an AUROC of 0.911 [0.869–0.944] (Fig 3). The two scores performances tended to be lower than the AUROC for LSM alone 0.933 [0.894–0.961], although not statistically significant (DeLong test p = 0.209 and p = 0.245, respectively).

thumbnail
Fig 3. Diagnostic performance of Agile 3+, Agile 4, LSM-VCTE and FIB-4 in identifying advanced fibrosis (≥F3).

ROC—receiver operating characteristic curve, VCTE–vibration-controlled transient elastography, FIB-4 –Fibrosis 4 Index, kPa–kilopascals.

https://doi.org/10.1371/journal.pone.0303971.g003

Using the cut-off of 0.451, Agile 3+ presented a Se = 90.41%, Sp = 79.77%, PPV = 65.35%, NPV = 95.17% and Acc = 82.93% for ruling out advanced fibrosis. By applying the cut-off of 0.679 to rule in advanced fibrosis, Agile 3+ exhibited a Se = 76.71%, Sp = 91.91%, PPV = 80.00%, NPV = 90.34% and Acc = 87.40%, respectively. The performance of Agile 3+ in predicting advanced fibrosis (≥F3) using our best selected cut-offs for Se ≥85%, ≥90% and Sp ≥90% is presented in Table 2.

thumbnail
Table 2. Diagnostic accuracy of Agile 3+, Agile 4, LSM -VCTE and FIB-4 in identifying advanced fibrosis (≥F3) among 246 patients with biopsy-proven NAFLD.

https://doi.org/10.1371/journal.pone.0303971.t002

For cirrhosis (F4), the diagnostic performance of Agile 3+ was indicated by an AUROC of 0.958 [0.925–0.980], and of Agile 4 by an AUROC of 0.968 [0.937–0.986] (Fig 4). The two scores performances tended to be higher than LSM-VCTE alone (0.956 [0.922–0.978]), although not statistically significant (DeLong test p = 0.782, and p = 0.312, respectively).

thumbnail
Fig 4. Diagnostic performance of Agile 3+, Agile 4, LSM-VCTE and FIB-4 in identifying cirrhosis (F4) among 246 patients with biopsy-proven NAFLD.

ROC—receiver operating characteristic curve, VCTE–vibration-controlled transient elastography, FIB-4 –Fibrosis 4 Index, kPa–kilopascals.

https://doi.org/10.1371/journal.pone.0303971.g004

Using the cut-off of 0.251, Agile 4 presented a Se = 96.55%, Sp = 84.79%, PPV = 45.90%, NPV = 99.46% and Acc = 86.18% in ruling-out cirrhosis. By applying the cut-off of 0.565 to rule-in cirrhosis, Agile 4 exhibited a Se = 72.41%, Sp = 94.47%, PPV = 63.64%, NPV = 96.24% and Acc = 91.87%, respectively. The performance of Agile 4 in predicting cirrhosis (F4) using our best selected cut-offs for Se ≥90%, Se ≥85%, respectively Sp ≥90%, Sp ≥95% is presented in Table 3.

thumbnail
Table 3. Diagnostic accuracy of Agile 3+, Agile 4, LSM-VCTE and FIB-4 in identifying cirrhosis (F4) among 246 patients with biopsy-proven NAFLD.

https://doi.org/10.1371/journal.pone.0303971.t003

Comparison with other fibrosis prediction scores

A detailed comparison using DeLong protocol among different fibrosis prediction scores is presented in Table 4.

thumbnail
Table 4. Comparison between Agile 3+, Agile 4, and standard NITs in staging liver fibrosis using DeLong protocol.

https://doi.org/10.1371/journal.pone.0303971.t004

In terms of identifying advanced fibrosis (≥F3), the AUROCs for LSM-VCTE alone and for FIB-4 index were 0.933 [0.894–0.961] and 0.854 [0.803–0.895], respectively (Table 2). Agile 3+ had significantly better diagnostic performance compared to FIB-4 (p = 0.012), but not compared to LSM-VCTE (p = 0.209).

In terms of identifying cirrhosis (F4), the AUROCs for LSM-VCTE alone and for FIB-4 index were 0.956 [0.922–0.978] and 0.921 [0.880–0.951], respectively (Table 3). Agile 4 had a significantly better diagnostic performance compared to FIB-4 (p = 0.001), and a slightly better diagnostic performance compared to LSM-VCTE alone, but not statistically significant (p = 0.312).

Proportion of patients with indeterminate results when applying Agile 3+, Agile 4 and LSM—VCTE

We next looked at the proportion of patients that remained unclassified (in the so-called “grey zone”). In our cohort of patients, by using Agile 3+ standard cut-offs for ≥F3, 0.451 and 0.679 [10], and LSM-VCTE standard cut-offs for ≥F3, 8 kPa and 12 kPa, [11], the proportion of patients that were left unclassified were 12.6% and 21.9%, respectively (McNemar’s exact test p = 0.003). By using Agile 4 standard-cutoffs for F4, namely 0.251 and 0.565 [10], and the LSM-VCTE cut-offs of 8 kPa and 20 kPa, then 10 kPa and 20 kPa [19], the proportion of patients that were left unclassified were 11.4%, 39.4% and 26.8%, respectively (McNemar’s exact test p<0.0001 for both scenarios), as depicted in Table 5.

thumbnail
Table 5. Distribution of patients with biopsy-proven NAFLD according to the individual risk.

https://doi.org/10.1371/journal.pone.0303971.t005

Diagnostic performance of FAST score in identifying fibrotic NASH

The AUROCs for FAST Score, LSM-VCTE alone, FIB-4 index and APRI score for identifying fibrotic NASH (NASH + NAS ≥4 + F ≥2) were 0.679 [0.594–0.757], 0.591 [0.503–0.674], 0.519 [0.432–0.606], and 0.578 [0.490–0.662], respectively (Fig 5). In the subgroup analysis for FAST Score, the AUROCs were 0.70 [0.59–0.80] for ALT ≥35 UI/L and 0.60 [0.42–0.77] for ALT <35 UI/L, respectively.

thumbnail
Fig 5. Diagnostic performance of FAST score and other NITs in predicting fibrotic NASH.

ROC—receiver operating characteristic curve, FAST- FibroScan-AST score, VCTE–vibration-controlled transient elastography, FIB-4 –Fibrosis 4 Index, APRI—aspartate aminotransferase to platelet ratio index.

https://doi.org/10.1371/journal.pone.0303971.g005

The AUROC for FAST score was significantly higher than the AUROCs for LSM-VCTE alone (p = 0.02), FIB-4 (p = 0.001) and APRI (p = 0.002) scores.

The Se, Sp, PPV, NPV, and Acc for FAST score using the cut-off of 0.35 to rule-out fibrotic NASH and the cut-off of 0.67 to rule in the condition [12], along with our best selected cut-off values for Se ≥90% and Sp ≥90% are depicted in Table 6.

thumbnail
Table 6. Diagnostic accuracy of FAST score in predicting fibrotic NASH (NASH + NAS≥4 + F≥2).

https://doi.org/10.1371/journal.pone.0303971.t006

In our cohort of patients, when applying the FAST score with its standard cut-off values [12], 44 (32.4%) patients remained below the inferior cut-off, 44 (32.4%) in the grey zone and 48 (35.2%) patients were above the superior cut-off.

Discussion

The purpose of this study was to validate three new non-invasive scoring systems (Agile 3+, Agile 4, and FAST score) in a cohort of 246 patients with biopsy-confirmed NAFLD meeting MASLD criteria. We sought to assess their effectiveness in discriminating advanced fibrosis, cirrhosis, and fibrotic NASH and successfully confirmed their utility. During the validation process, we evaluated the performance of previously published cut-offs, and provided our best selected cut-off values, aiming for sensitivities of ≥85% and ≥90% to rule-out the conditions, and specificities of ≥90% and ≥95% to rule-in the conditions [10].

Agile 3+ and Agile 4 scores were specifically developed for individuals with NAFLD in 2023 [10]. These scoring systems serve three primary objectives: the identification of advanced fibrosis and cirrhosis; the optimization of the positive predictive value to confirm these conditions; and the reduction of cases with indeterminate results, often referred to as the "grey zone" [10].

Agile 3+

Upon assessing its diagnostic performance, the AUROC for Agile 3+ in discriminating ≥F3 was excellent, but slightly inferior to those for LSM-VCTE alone (0.909 vs. 0.933), even though not statistically significant (p = 0.209). Nonetheless, when comparing the patients with indeterminate results that resulted after applying dual cut-off approaches for Agile 3+ and LSM-VCTE, Agile 3+ significantly reduced the number of patients that remained in the grey zone (p = 0.003), while maintaining very good accuracy (Table 5).

Agile 4

Upon assessing its diagnostic performance, the AUROC for Agile 4 in discriminating F4 exhibited excellent performance, that was slightly superior to LSM-VCTE alone (0.968 vs. 0.956), although not statistically significant. When applying the dual cut-off approach for Agile 4, only 11.4% of patients remained in the grey zone, while maintaining excellent accuracy. When comparing the patients with indeterminate results that resulted after applying dual cut-off approaches for both Agile 4 and LSM-VCTE, Agile 4 significantly reduced the number of patients that remained in the grey zone (p<0.0001).

Both scores significantly outperformed FIB-4 in discriminating ≥F3 and F4 (Table 4).

These data suggest that Agile 3+ and Agile 4 scores are well optimized to discriminate NAFLD patients with advanced fibrosis and cirrhosis, and our results are consistent with findings from previous reported studies [10, 2022]. The seminal study by Sanyal et. all. [10], that developed the Agile scores, reported significantly greater AUROCs when compared to LSM-VCTE alone (0.86–0.90 for Agile 3+ and 0.83–0.85 for LSM-VCTE in depicting ≥F3, and 0.89–0.93 for Agile 4 and 0.85–0.88 for LSM-VCTE in discriminating F4). In our cohort of patients, even though we did not obtain significantly greater AUROCs, the Agile 3+ score significantly reduced the number of patients with indeterminant results and Agile 4 exhibited an excellent accuracy of 92%. In our population, by using the superior cut-off of 0.600 for Agile 4, NAFLD-cirrhosis could be ruled-in with an accuracy of 93.5%.

Nevertheless, a possible explanation for the lack of superiority of Agile scores in our cohort of patients in terms of AUROCs (compared to the seminal study) could be attributed to the slightly diverse prevalence of F3 and F4 and disparities in clinical and laboratory data required for score computation. However, our cohort consisted in consecutive patients with clinical suspicion of having NASH, and therefore the prevalence of F3 and F4 stages is more likely to reflect the distribution in the general population. More than that, our cohort consisted in patients with Caucasian descent, which have a different risk of developing severe fibrosis than Latin-Americans or Hispanics [2]. With these in mind, our results are of highest importance for Central and Eastern Europe, where Caucasian population is prevalent.

In our cohort, the prevalence of advanced fibrosis (≥F3) and cirrhosis (F4) were 29.7% and 11.8% respectively. In the study by Sanyal et al. [10], the prevalence of both conditions was slightly higher, with 54% and 23% of patients presenting ≥F3 and F4, respectively in both training and validation sets, and a similar prevalence in the external validation cohort of 37% and 13%, respectively. The mean age in the Sanyal et al. cohort was 55 ± 16 years for both training and validation cohorts, and a significant proportion of patients presented diabetes, 50.4% in the training and 51% in the validation cohort respectively, with similar proportion for the external validation cohorts. In our study, the median age was 52 years (41–61), and a lower proportion of patients presented diabetes, namely 30.5%.

For Agile 3+, our thresholds—0.480 for ruling out (Se ≥90%) and 0.680 for ruling in (Sp ≥90%) advanced fibrosis—closely mirrored the standard thresholds of 0.451 and 0.679, respectively. Similarly, for Agile 4, our thresholds—0.380 for ruling out (Se ≥90%) and 0.520 for ruling in (Sp ≥90%) cirrhosis—were in line with the literature’s proposed thresholds of 0.251 and 0.565, respectively. Given the excellent diagnostic performance demonstrated by the standard cut-offs in our cohort, they can be reliably applied within the Caucasian population.

One notably significant element emphasized in our article is the outstanding capability of Agile 4 in distinguishing cirrhosis (accuracy of 92%), in a population with a median BMI of 29.0 (IQR, 5.1). It was previously established that LSM-VCTE alone ≥25 kPa is adequate for confirming CSPH in non-obese individuals with NASH, but it falls short in the case of obese patients with NASH [23]. In this regard, composite scores with remarkable accuracy, such as Agile 4, could offer significant improvements in depicting CSPH and improve the management of these patients.

As part of the clinical evaluation, especially for risk stratification, the patients that are left in the “grey zone” should undergo, in our opinion, additional monitoring to determine their real fibrosis status. In this scenario, the causes for false positives should be considered, and another non-invasive test could be applied (ELFTM, FibroMeterTM, FibroTest®) or the patient could undergo liver biopsy in case of discordant NITs [3, 11].

Another notable accomplishment of using Agile scores in clinical practice lies in their ability to predict liver-related events, as recently reported [21, 24, 25]. Since these scores incorporate factors like diabetes [26], which predisposes to hepatic decompensation, and other variables related to prediction of liver-related events (including hepatocellular carcinoma) [27], we anticipate that this field will remain highly dynamic and lively, with continued validation and exploration of the Agile scores.

FAST-score

When developed, the FAST score exhibited satisfactory performance in both deviation (C-statistic 0.80, 95% CI 0.76–0.85) and validation (C-statistic range 0.85; 95% CI 0.83–0.87) cohorts and was further validated in some populations [12]. For depicting fibrotic NASH, the FAST score presented a satisfactory performance in a recently published meta-analysis that included 12 studies, with an AUROC of 0.79 [28]. By applying the rule-out (≤0.35) and rule-in (≥0.67) cut-offs, 33% remained in the grey zone [28]. In our cohort of patients, the score presented a moderate performance in discriminating fibrotic NASH with an AUROC of 0.679. The score outperformed FIB-4 (0.679 vs. 0.519), APRI (0.679 vs. 0.578) and LSM-VCTE alone (0.679 vs. 0.591), nevertheless, LSM-VCTE was designed for fibrosis and steatosis assessment only, and the presence of inflammation can significantly impact the results [3].

Given that Agile 3+, Agile 4, and FAST scores identify populations with varied fibrotic and inflammatory statuses, they hold promise for inclusion in algorithms as a screening tool for fibrosis and fibrotic NASH (MASH) [29]. We believe that they could serve as pivotal components within a clinical pathway, perhaps in a “secondary step”, as part of evaluations conducted within specialized medical centers. However, it is essential to recognize that these scores include laboratory tests such as platelets, AST, and ALT, commonly encompassed in the scores that are usually applied in a “first step” like FIB-4 or NAFLD fibrosis score. In this respect, we believe that the performance of a multistep algorithm including Agile 3+, Agile 4, or FAST scores should be carefully evaluated and validated in future studies.

The limitations of our study are inherent in its retrospective nature. Because this study was a cross-sectional one, we did not explore the association between the scores and the clinical outcome. Nevertheless, the strengths rely in the fact that we enrolled a relatively large number of patients, and to our knowledge, this is the first report on the use of the Agile scores that originates from East Europe, incorporating mainly Caucasian descents. Furthermore, a single expert pathologist assessed all liver biopsy samples to minimize disagreements among observers in pathological staging. From our cohort of biopsy-proven NAFLD patients, out of 256 patients with reliable VCTE measurements, 252 (98.4%) met the criteria for MASLD definition, illustrating the significance of our results in light of the recent change in definition. Another limitation of the study could be the extended duration over which the analysis was conducted (2007–2023) and the fact that during this period we utilized 2 different Fibroscan devices (FibroScan X1115305, respectively FibroScan® Expert 630 starting with 2016). As the number of biopsies for NAFLD patients from our tertiary center was not very large, we aimed to include as many probes as possible in our analysis. Nevertheless, the protocol has been rigorously followed since its introduction until the present.

Conclusions

In conclusion, this study successfully validated the utility of three non-invasive scoring systems (Agile 3+, Agile 4, and FAST score) in a cohort of patients with biopsy-confirmed NAFLD, meeting the criteria for MASLD, and of Caucasian origin. The Agile 3+ and Agile 4 scores demonstrated their effectiveness in discriminating advanced fibrosis and cirrhosis, while reducing the number of cases with indeterminate results, and outperforming the FIB-4 score. Although the AUROCs did not significantly exceed those of LSM-VCTE alone, the Agile scores optimized accuracy and decreased the number of indeterminate results. Considering its excellent accuracy in discriminating cirrhosis, the use of Agile 4 score could improve the noninvasive assessment of CSPH in patients with obese NASH (MASH). The FAST score exhibited moderate performance in detecting fibrotic NASH (MASH). Our findings suggest that these scoring systems bring a significant contribution to the assessment and management of patients with MASLD and warrant further exploration in clinical practice.

Acknowledgments

Figs 1 and 2 were created with BioRender.com.

References

  1. 1. Rinella ME, Lazarus JV, Ratziu V, Francque SM, Sanyal AJ, Kanwal F, et al. A multi-society Delphi consensus statement on new fatty liver disease nomenclature. Hepatology. 2023.
  2. 2. Younossi ZM, Golabi P, Paik JM, Henry A, Van Dongen C, Henry L. The global epidemiology of nonalcoholic fatty liver disease (NAFLD) and nonalcoholic steatohepatitis (NASH): a systematic review. Hepatology. 2023;77(4):1335–47. pmid:36626630
  3. 3. Taru MG, Neamti L, Taru V, Procopciuc LM, Procopet B, Lupsor-Platon M. How to Identify Advanced Fibrosis in Adult Patients with Non-Alcoholic Fatty Liver Disease (NAFLD) and Non-Alcoholic Steatohepatitis (NASH) Using Ultrasound Elastography-A Review of the Literature and Proposed Multistep Approach. Diagnostics (Basel). 2023;13(4). pmid:36832276
  4. 4. Sanyal AJ, Van Natta ML, Clark J, Neuschwander-Tetri BA, Diehl A, Dasarathy S, et al. Prospective Study of Outcomes in Adults with Nonalcoholic Fatty Liver Disease. N Engl J Med. 2021;385(17):1559–69. pmid:34670043
  5. 5. Kleiner DE, Brunt EM, Van Natta M, Behling C, Contos MJ, Cummings OW, et al. Design and validation of a histological scoring system for nonalcoholic fatty liver disease. Hepatology. 2005;41(6):1313–21. pmid:15915461
  6. 6. Brunt EM, Clouston AD, Goodman Z, Guy C, Kleiner DE, Lackner C, et al. Complexity of ballooned hepatocyte feature recognition: Defining a training atlas for artificial intelligence-based imaging in NAFLD. J Hepatol. 2022;76(5):1030–41. pmid:35090960
  7. 7. Ratziu V, Charlotte F, Heurtier A, Gombert S, Giral P, Bruckert E, et al. Sampling variability of liver biopsy in nonalcoholic fatty liver disease. Gastroenterology. 2005;128(7):1898–906. pmid:15940625
  8. 8. Selvaraj EA, Mózes FE, Jayaswal ANA, Zafarmand MH, Vali Y, Lee JA, et al. Diagnostic accuracy of elastography and magnetic resonance imaging in patients with NAFLD: A systematic review and meta-analysis. J Hepatol. 2021;75(4):770–85. pmid:33991635
  9. 9. Sanyal AJ, Castera L, Wong VW-S. Noninvasive Assessment of Liver Fibrosis in NAFLD. Clinical Gastroenterology and Hepatology. 2023;21(8):2026–39. pmid:37062495
  10. 10. Sanyal AJ, Foucquier J, Younossi ZM, Harrison SA, Newsome PN, Chan WK, et al. Enhanced diagnosis of advanced fibrosis and cirrhosis in individuals with NAFLD using FibroScan-based Agile scores. J Hepatol. 2023;78(2):247–59. pmid:36375686
  11. 11. EASL Clinical Practice Guidelines on non-invasive tests for evaluation of liver disease severity and prognosis—2021 update. J Hepatol. 2021;75(3):659–89. pmid:34166721
  12. 12. Newsome PN, Sasso M, Deeks JJ, Paredes A, Boursier J, Chan WK, et al. FibroScan-AST (FAST) score for the non-invasive identification of patients with non-alcoholic steatohepatitis with significant activity and fibrosis: a prospective derivation and global validation study. Lancet Gastroenterol Hepatol. 2020;5(4):362–73. pmid:32027858
  13. 13. Chalasani N, Younossi Z, Lavine JE, Diehl AM, Brunt EM, Cusi K, et al. The diagnosis and management of non-alcoholic fatty liver disease: practice Guideline by the American Association for the Study of Liver Diseases, American College of Gastroenterology, and the American Gastroenterological Association. Hepatology. 2012;55(6):2005–23. pmid:22488764
  14. 14. Bedossa P. Utility and appropriateness of the fatty liver inhibition of progression (FLIP) algorithm and steatosis, activity, and fibrosis (SAF) score in the evaluation of biopsies of nonalcoholic fatty liver disease. Hepatology. 2014;60(2):565–75. pmid:24753132
  15. 15. Sterling RK, Lissen E, Clumeck N, Sola R, Correa MC, Montaner J, et al. Development of a simple noninvasive index to predict significant fibrosis in patients with HIV/HCV coinfection. Hepatology. 2006;43(6):1317–25. pmid:16729309
  16. 16. Wai CT, Greenson JK, Fontana RJ, Kalbfleisch JD, Marrero JA, Conjeevaram HS, et al. A simple noninvasive index can predict both significant fibrosis and cirrhosis in patients with chronic hepatitis C. Hepatology. 2003;38(2):518–26. pmid:12883497
  17. 17. Liver EAftSot. EASL-ALEH Clinical Practice Guidelines: Non-invasive tests for evaluation of liver disease severity and prognosis. Journal of hepatology. 2015;63(1):237–64. pmid:25911335
  18. 18. Sasso M, Beaugrand M, de Ledinghen V, Douvin C, Marcellin P, Poupon R, et al. Controlled attenuation parameter (CAP): a novel VCTE™ guided ultrasonic attenuation measurement for the evaluation of hepatic steatosis: preliminary study and validation in a cohort of patients with chronic liver disease from various causes. Ultrasound Med Biol. 2010;36(11):1825–35.
  19. 19. Mózes FE, Lee JA, Selvaraj EA, Jayaswal ANA, Trauner M, Boursier J, et al. Diagnostic accuracy of non-invasive tests for advanced fibrosis in patients with NAFLD: an individual patient data meta-analysis. Gut. 2022;71(5):1006–19. pmid:34001645
  20. 20. Dalbeni A, Lombardi R, Henrique M, Zoncapè M, Pennisi G, Petta S, et al. Diagnostic accuracy of AGILE3+ score for advanced fibrosis in patients with non-alcoholic fatty liver disease: A systematic review and meta-analysis. Hepatology. 2023.
  21. 21. Pennisi G, Enea M, Pandolfo A, Celsa C, Antonucci M, Ciccioli C, et al. AGILE 3+ Score for the Diagnosis of Advanced Fibrosis and for Predicting Liver-related Events in NAFLD. Clin Gastroenterol Hepatol. 2023;21(5):1293–302.e5. pmid:35842119
  22. 22. Oeda S, Seko Y, Hayashi H, Arai T, Iwaki M, Yoneda M, et al. Validation of the utility of Agile scores to identify advanced fibrosis and cirrhosis in Japanese patients with nonalcoholic fatty liver disease. Hepatol Res. 2023;53(6):489–96. pmid:36807720
  23. 23. Pons M, Augustin S, Scheiner B, Guillaume M, Rosselli M, Rodrigues SG, et al. Noninvasive Diagnosis of Portal Hypertension in Patients With Compensated Advanced Chronic Liver Disease. Am J Gastroenterol. 2021;116(4):723–32. pmid:33982942
  24. 24. Miura K, Hayashi H, Kamada Y, Fujii H, Takahashi H, Oeda S, et al. Agile 3+ and Agile 4, noninvasive tests for liver fibrosis, are excellent formulae to predict liver-related events in nonalcoholic fatty liver disease. Hepatol Res. 2023;53(10):978–88. pmid:37353881
  25. 25. Boursier J, Roux M, Sanyal AJ. Reply to: "Agile scores are a good predictor of liver-related events in patients with NAFLD". J Hepatol. 2023;79(3):e128–e9. pmid:37302579
  26. 26. Paternostro R, Jachs M, Hartl L, Simbrunner B, Scheiner B, Bauer D, et al. Diabetes impairs the haemodynamic response to non-selective betablockers in compensated cirrhosis and predisposes to hepatic decompensation. Aliment Pharmacol Ther. 2023;58(8):805–13. pmid:37519146
  27. 27. Taru MG, Lupsor-Platon M. Exploring Opportunities to Enhance the Screening and Surveillance of Hepatocellular Carcinoma in Non-Alcoholic Fatty Liver Disease (NAFLD) through Risk Stratification Algorithms Incorporating Ultrasound Elastography. Cancers (Basel). 2023;15(16). pmid:37627125
  28. 28. Ravaioli F, Dajti E, Mantovani A, Newsome PN, Targher G, Colecchia A. Diagnostic accuracy of FibroScan-AST (FAST) score for the non-invasive identification of patients with fibrotic non-alcoholic steatohepatitis: a systematic review and meta-analysis. Gut. 2023;72(7):1399–409. pmid:36599683
  29. 29. Kanwal F, Shubrook JH, Adams LA, Pfotenhauer K, Wai-Sun Wong V, Wright E, et al. Clinical Care Pathway for the Risk Stratification and Management of Patients With Nonalcoholic Fatty Liver Disease. Gastroenterology. 2021;161(5):1657–69. pmid:34602251