Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Validation of the accuracy of the FAST score for detecting patients with at-risk nonalcoholic steatohepatitis (NASH) in a North American cohort and comparison to other non-invasive algorithms

  • Tinsay A. Woreta ,

    Roles Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    tworeta1@jhmi.edu

    Affiliation Johns Hopkins University School of Medicine, Baltimore, Maryland, United States of America

  • Mark L. Van Natta,

    Roles Data curation, Formal analysis, Visualization, Writing – review & editing

    Affiliation Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland, United States of America

  • Mariana Lazo,

    Roles Conceptualization, Methodology, Visualization, Writing – review & editing

    Affiliation Drexel University Dornsife School of Public Health, Philadelphia, Pennsylvania, United States of America

  • Arunkumar Krishnan,

    Roles Visualization, Writing – review & editing

    Affiliation Johns Hopkins University School of Medicine, Baltimore, Maryland, United States of America

  • Brent A. Neuschwander-Tetri,

    Roles Visualization, Writing – review & editing

    Affiliation Saint Louis University, St. Louis, Missouri, United States of America

  • Rohit Loomba,

    Roles Visualization, Writing – review & editing

    Affiliation University of California San Diego School of Medicine, San Diego, California, United States of America

  • Anna Mae Diehl,

    Roles Visualization, Writing – review & editing

    Affiliation Duke University, Durham, North Carolina, United States of America

  • Manal F. Abdelmalek,

    Roles Visualization, Writing – review & editing

    Affiliation Duke University, Durham, North Carolina, United States of America

  • Naga Chalasani,

    Roles Visualization, Writing – review & editing

    Affiliation Indiana University School of Medicine, Indianapolis, Indiana, United States of America

  • Samer Gawrieh,

    Roles Visualization, Writing – review & editing

    Affiliation Indiana University School of Medicine, Indianapolis, Indiana, United States of America

  • Srinivasan Dasarathy,

    Roles Visualization, Writing – review & editing

    Affiliation Cleveland Clinic, Cleveland, Ohio, United States of America

  • Raj Vuppalanchi,

    Roles Visualization, Writing – review & editing

    Affiliation Indiana University School of Medicine, Indianapolis, Indiana, United States of America

  • Mohammad S. Siddiqui,

    Roles Visualization, Writing – review & editing

    Affiliation Virginia Commonwealth University School of Medicine, Richmond, Virginia, United States of America

  • Kris V. Kowdley,

    Roles Validation, Writing – review & editing

    Affiliation Liver Institute Northwest, Seattle, Washington, United States of America

  • Arthur McCullough,

    Roles Visualization, Writing – review & editing

    Affiliation Cleveland Clinic, Cleveland, Ohio, United States of America

  • Norah A. Terrault,

    Roles Visualization, Writing – review & editing

    Affiliation University of Southern California, Los Angeles, California, United States of America

  • Cynthia Behling,

    Roles Visualization, Writing – review & editing

    Affiliation University of California San Diego School of Medicine, San Diego, California, United States of America

  • David E. Kleiner,

    Roles Visualization, Writing – review & editing

    Affiliation Laboratory of Pathology, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, United States of America

  • Mark Fishbein,

    Roles Visualization, Writing – review & editing

    Affiliation Department of Pediatrics, Feinberg Medical School of Northwestern University, Chicago, Illinois, United States of America

  • Paula Hertel,

    Roles Visualization, Writing – review & editing

    Affiliation Division of Gastroenterology, Hepatology and Nutrition, Texas Children’s Hospital, Baylor College of Medicine, Houston, Texas, United States of America

  • Laura A. Wilson,

    Roles Visualization, Writing – review & editing

    Affiliation Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland, United States of America

  • Emily P. Mitchell,

    Roles Visualization, Writing – review & editing

    Affiliation Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland, United States of America

  • Laura A. Miriel,

    Roles Visualization, Writing – review & editing

    Affiliation Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland, United States of America

  • Jeanne M. Clark,

    Roles Visualization, Writing – review & editing

    Affiliation Johns Hopkins University School of Medicine, Baltimore, Maryland, United States of America

  • James Tonascia,

    Roles Data curation, Formal analysis, Validation, Visualization, Writing – review & editing

    Affiliation Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland, United States of America

  • Arun J. Sanyal,

    Roles Conceptualization, Methodology, Supervision, Validation, Visualization, Writing – review & editing

    Affiliation Virginia Commonwealth University School of Medicine, Richmond, Virginia, United States of America

  •  [ ... ],
  • for the NASH Clinical Research Network

    Membership of the NASH Clinical Research Network is provided in the Acknowledgments.

  • [ view all ]
  • [ view less ]

Abstract

Background and aims

Management of patients with NASH who are at elevated risk of progressing to complications of cirrhosis (at-risk NASH) would be enhanced by an accurate, noninvasive diagnostic test. The new FAST score, a combination of FibroScan® parameters liver stiffness measurement (LSM) and controlled attenuation parameter (CAP) and aspartate aminotransferase (AST), has shown good diagnostic accuracy for at-risk NASH (area-under-the-Receiver-Operating-Characteristic [AUROC] = 0.80) in European cohorts. We aimed to validate the FAST score in a North American cohort and show how its diagnostic accuracy might vary by patient mix. We also compared the diagnostic performance of FAST to other non-invasive algorithms for the diagnosis of at-risk NASH.

Methods

We studied adults with biopsy-proven non-alcoholic fatty liver disease (NAFLD) from the multicenter NASH Clinical Research Network (CRN) Adult Database 2 (DB2) cohort study. At-risk-NASH was histologically defined as definite NASH with a NAFLD Activity Score (NAS) ≥ 4 with at least 1 point in each category and a fibrosis stage ≥ 2. We used the Echosens® formula for FAST from LSM (kPa), CAP (dB/m), and AST (U/L), and the FAST-based Rule-Out (FAST ≤ 0.35, sensitivity = 90%) and Rule-In (FAST ≥ 0.67, specificity = 90%) zones. We determined the following diagnostic performance measures: AUROC, sensitivity (Se), specificity (Sp), positive predictive value (PPV), and negative predictive value (NPV); these were calculated for the total sample and by subgroups of patients and by FibroScan® exam features. We also compared the at-risk NASH diagnostic performance of FAST to other non-invasive algorithms: NAFLD fibrosis score (NFS), Fibrosis-4 (FIB-4) index, and AST to platelet ratio index (APRI).

Results

The NASH CRN population of 585 patients was 62% female, 79% white, 14% Hispanic, and 73% obese; the mean age was 51 years. The mean (SD) AST and ALT were 50 (37) U/L and 66 (45) U/L, respectively. 214 (37%) had at-risk NASH. The AUROC of FAST for at-risk NASH in the NASH CRN study population was 0.81 (95% CI: 0.77, 0.84. Using FAST-based cut-offs, 35% of patients were ruled-out with corresponding NPV = 0.90 and 27% of patients were ruled-in with corresponding PPV = 0.69. The diagnostic accuracy of FAST was higher in non-whites vs. whites (AUROC: 0.91 vs 0.78; p = 0.001), and in patients with a normal BMI vs. BMI > 35 kg/m2 (AUROC: 0.94 vs 0.78, p = 0.008). No differences were observed by other patient characteristics or FibroScan® exam features. The FAST score had higher diagnostic accuracy than other non-invasive algorithms for the diagnosis of at-risk NASH (AUROC for NFS, FIB-4, and APRI 0.67, 0.73, 0.74, respectively).

Conclusion

We validated the FAST score for the diagnosis of at-risk NASH in a large, multi-racial population in North America, with a prevalence of at-risk NASH of 37%. Diagnostic performance varies by subgroups of NASH patients defined by race and obesity. FAST performed better than other non-invasive algorithms for the diagnosis of at-risk NASH.

Introduction

Nonalcoholic fatty liver disease (NAFLD) is the most common cause of liver disease worldwide and affects more than 25% of the global population [1]. It is strongly linked with obesity and the metabolic syndrome, a cluster of conditions that increases the risk of cardiovascular disease and includes abdominal obesity, insulin resistance, dyslipidemia, and hypertension. A subset of patients with NAFLD have nonalcoholic steatohepatitis (NASH) and are at higher risk of developing liver-related morbidity and mortality from progression to cirrhosis, hepatocellular carcinoma, or need for liver transplantation.

Due to the growing pandemic of obesity, the prevalence of NASH is increasing, and NASH is projected to become the leading cause of end-stage liver disease and liver transplantation in the upcoming decades [2]. Studies have shown that compared with the general population, patients with NAFLD have higher overall and liver-related mortality [3]. NASH related mortality is 1.7 times higher than in NAFLD (26 vs. 15 events per 1000 person-years), and liver-specific mortality is 15 times higher than in NAFLD (12 vs. 0.8 events per 1000 person-years) [1]. Currently, there are no FDA approved pharmacologic therapies for NASH. There are multiple ongoing Phase 3 clinical trials investigating the efficacy of promising novel agents with anti-inflammatory or anti-fibrotic properties for the treatment of NASH [4].

An accurate assessment of fibrosis stage is critical in the evaluation of patients with NASH, as studies have shown that the risk of liver-related mortality is directly related to fibrosis stage [5]. The presence and severity of fibrosis is an independent predictor for long-term prognosis in patients with NAFLD, including overall mortality [6].

Liver biopsy remains the gold standard for the detection of steatohepatitis and staging of fibrosis for patients with NASH [7]. However, it is an imperfect standard due to its invasive nature, the potential for rare but life-threatening complications, high cost, sampling error, and inter-/intra-observer variability. Furthermore, in clinical practice, patients are often reluctant to undergo a liver biopsy due to a fear of an invasive procedure and the risk of complications. These limitations have fueled researchers to develop alternative noninvasive strategies for fibrosis assessment, and in recent years it has become an area of intense research [8].

Currently, there are a number of commonly used noninvasive tools for the detection of advanced fibrosis which have been validated in patients with NASH. These include scoring algorithms that can be easily calculated using readily available clinical and laboratory data, serum biomarkers, and imaging modalities [9]. The most widely used scoring systems are the NAFLD fibrosis score (NFS) (based on age, BMI, presence of impaired fasting glucose or diabetes, AST/ALT ratio, platelet count, and albumin), FIB-4 index (based on age, AST, ALT, and platelet count), and AST to platelet ratio index (APRI) [7]. Vibration controlled transient elastography (FibroScan®), which measures liver stiffness using an ultrasound-based technology, was approved by the U.S. FDA in 2013 for use as an aid to the clinical management of patients with liver disease [10,11]. It is an inexpensive, easy to perform test that has been shown to have high diagnostic accuracy for the detection of advanced fibrosis in patients with NASH [12]. FibroScan® can also provide a quantitative assessment of steatosis using the controlled attenuation parameter (CAP) [13]. FibroScan® is equipped with two probes for adults: the standard M probe and the extra-large (XL) probe for obese patients.

The main limitations of these currently used noninvasive tools are: (1) although they have high diagnostic accuracy in the detection of advanced fibrosis (i.e., bridging fibrosis or cirrhosis) [12,14], they are less accurate for identifying fibrosis stage 2 or above [7], and (2) they do not detect the presence or degree of steatohepatitis and other markers of liver cell injury such as hepatocellular ballooning. There is thus a great need to identify noninvasive diagnostic tools that can predict the presence of inflammation in addition to fibrosis and identify individuals who are at the highest risk of disease progression. In particular, it would be very beneficial to have a highly accurate, noninvasive diagnostic test to identify patients with NASH with stage 2 fibrosis or higher and more advanced grades of steatohepatitis and hepatocellular injury (NAS ≥ 4), as such patients are at elevated risk of fibrosis progression and the development of cirrhosis.

Recently, the FibroScan-AST (FAST) score was reported as a new and promising noninvasive tool to identify patients with progressive NASH [15]. It is derived from a model combining liver stiffness measurement (LSM), CAP, and AST according to the following equation:

It was found to be the most predictive model for the identification of patients with NASH with significant activity (NAFLD activity score (NAS) ≥ 4) and fibrosis (stage 2 or higher) in a cohort of 350 adult patients with suspected NAFLD attending liver clinics in England [15]. The diagnostic accuracy in this derivation cohort was good, with an area-under-the-Receiver-Operating-Characteristic (AUROC) of 0.80. Two thresholds for the FAST score were established using this derivation cohort, a rule-out cutoff of ≤ 0.35 to yield a sensitivity of 90% and a rule-in cutoff of ≥ 0.67 to yield a specificity of 90% [15]. The investigators assessed the accuracy of FAST using external validation cohorts comprised of seven independent international cohorts of patients with histologically confirmed NAFLD from France, China, Malaysia, Turkey, and the U.S. and found good performance with AUROC values ranging from 0.74 to 0.95 [15].

In this study, we sought to validate the FAST score in a large, diverse cohort of U.S. patients enrolled in the NASH Clinical Research Network (NASH CRN) Adult Database (D2) cohort study. Patients enrolled in this observational study had the full spectrum of NAFLD, a common context of use of FAST in patients found to have NAFLD by imaging. We also aimed to determine how the diagnostic accuracy of FAST varies across subgroups defined by various patient characteristics and FibroScan® exam features. Finally, we compared the diagnostic performance of FAST to its individuals components as well as other non-invasive algorithms and prediction models based on combinations of liver biochemistries.

Methods

Study design and participants

The validation study cohort was comprised of individuals 18 years or older with biopsy-proven NAFLD enrolled in the NAFLD Adult DB2 study conducted by the NASH CRN, a multicenter network sponsored by the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK).

The NAFLD Adult DB2 study is a prospective observational study of patients with biopsy-proven NAFLD which was started in December 2009 at 8 U.S. medical centers: Case Western Reserve University and Cleveland Clinic Foundation (Cleveland, OH); Duke University (Durham, NC); Indiana University (Indianapolis, IN); Saint Louis University (St. Louis, MO); University of California, San Diego (San Diego, CA); University of California, San Francisco (San Francisco, CA); Virginia Mason Medical Center and Swedish Medical Center (Seattle, WA); and Virginia Commonwealth University (Richmond, VA) [16]. The inclusion and exclusion criteria for the DB2 study were similar to that of the earlier Adult Database 1 study described in an earlier publication [17], with the exception that all new participants required histological evidence of NAFLD to be eligible for enrollment [16]. FibroScan® exam was performed for all partipants enrolled in the Adult DB2 database if they provided signed informed consent to participate. Individuals enrolled in the DB2 study were included in this analysis if they met the following criteria (i) had FibroScan® performed with simultaneous assessment of LSM and CAP and aminotransferase level measurements within 6 months of liver biopsy and (ii) had liver biopsy reviewed centrally by the NASH CRN Pathology Committee. The study was approved by the institutional review boards of participating institutions. All participants provided written informed consent prior to enrollment. Data were stored, monitored, and analyzed at the Data Coordinating Center at the Johns Hopkins Bloomberg School of Public Health.

Characterization of study participants and procedures

Detailed demographic, anthropometric, clinical, and laboratory data were systematically collected on all participants as part of the individual study protocol. Routine laboratory tests were performed on fresh blood samples in Clinical Laboratory Improvement Amendments-certified laboratories at each participating clinical site according to standard clinical protocols [17]. Liver biopsies were evaluated and scored centrally by the NASH CRN Pathology Committee using the NASH CRN validated histologic scoring system, which specifies the NAS and fibrosis stage [18]. A diagnosis of definite NASH was made by the Pathology Committee based on pattern recognition independent of NAS score [18]. LSM and CAP were simultaneously assessed using the FibroScan® 502 Touch device equipped with both M and XL probes (Echosens, Paris, France). The FibroScan® 502 Touch device was available at each participating clinical site. Probe selection was performed using the automatic probe selection tool embedded within the FibroScan® 502 Touch operating software, which is based on the probe to liver capsule distance.

All FibroScan® procedures were performed by study personnel who were trained and certified by Echosens. Individuals were asked to fast for at least 3 hours prior to the FibroScan® procedure. Participants were placed in the supine position with their right arm fully abducted. Ten valid measurements were obtained [16]. The final CAP and LSM measurements were recorded as the median values of 10 consecutive valid measurements, and they were expressed in dB/m and kPa, respectively. Unreliable LSM values were defined as medians with the interquartile range (IQR)/median > 30% [16].

At-risk NASH was defined as definite NASH on biopsy with a NAS 4 or higher with at least 1 point in each category and a fibrosis stage 2 or higher. The FAST score was calculated from liver stiffness (E, kPa), steatosis (controlled attenuation parameter [CAP], dB/m), and AST (U/L) according to the equation detailed above.

Statistical analysis

Descriptive statistics including means, medians, standard deviations and inter-quartile ranges were used to determine the characteristics of the study cohort. Comparisons between patients with at-risk NASH and those without at-risk NASH were performed using chi-square tests for categorical variables and the unequal variance t-test for continuous data.

Specifying the rule-out cutoff of 0.35 and a rule-in cutoff of 0.67, diagnostic performance measures of the FAST score for the identification of at-risk NASH were computed using our validation study cohort. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated. PPV and NPV were calculated at varying prevalences using observed sensitivity and specificity. Discrimination (the ability of the FAST score to correctly classify those with and without at-risk NASH) was assessed using area under receiver operating characteristic (AUROC) curves. The Delong test was used to compare ROC curves [19]. The diagnostic performance measures of the FAST score for at-risk NASH were determined for subgroups of patients based on variables including demographics, anthropometrics, clinical characteristics, and FibroScan® exam features.

Various diagnostic models for the identification of at-risk NASH were compared to the FAST score [19]. In particular, the diagnostic performance of FAST was compared to the NAFLD fibrosis score (NFS), Fibrosis-4 (FIB-4) index, and AST to platelet ratio index (APRI).

Statistical analyses were performed using SAS 9.4 (2017 SAS Institute Inc., Cary, NC) and Stata 15.1 (StataCorp. 2017. Stata Statistical Software: Release 15. College Station, TX: StataCorp LLC.). P-values were two-sided, nominal and 0.05 was the threshold for statistical significance.

Results

Characteristics of the study population

A total of 585 adults with biopsy-confirmed NAFLD from the Adult DB2 study were included in the analysis. The baseline characteristics of our study cohort are depicted in Table 1. Overall, the mean age was 51 years. The majority of participants were white (79%), female (62%), and obese (73%). 41% had a body mass index (BMI) ≥ 40 kg/m2. 4% were black, 9% were Asian, and 1% were American Indian/Pacific Islander. 14% were Hispanic. Type 2 diabetes mellitus (43%) and hyperlipidemia (49%) were common underlying comorbidities. The mean (SD) AST and ALT were 50 (37) U/L and 66 (45) U/L, respectively. The mean (SD) LSM was 11.4 (11.1) kPa, and CAP was 321 (52) dB/m. The XL probe was used for 324 patients (55%).

thumbnail
Table 1. Characteristics of the population by NASH activity and fibrosis status.

https://doi.org/10.1371/journal.pone.0266859.t001

214 participants (37%) had at-risk NASH. Participants with at-risk NASH were more likely to be white (83% vs. 76%), female (71% vs. 57%), and obese (82% vs. 68%) when compared to those without at-risk NASH (Table 1). They were also more likely to be older (mean age 54 vs. 51 years) and have Type 2 diabetes mellitus (55% vs. 36%). At-risk NASH patients had higher mean AST (65 vs. 40 U/L), ALT (78 vs. 58 U/L), LSM (15.2 vs. 9.3 kPa), and CAP scores (327 vs. 317 dB/m) and lower platelet counts (227K vs. 243K cells/μL).

There were 61 patients (10%) with cirrhosis in the cohort, of whom 35 (57%) met criteria for at-risk NASH. 121 (21%) patients had stage 3 fibrosis, 83% of whom had at-risk NASH; 120 (21%) had Stage 2 fibrosis, 65% of whom had at-risk NASH (S1 Table).

Diagnostic performance of FAST score

The AUROC of FAST for at-risk NASH in the study population was 0.81 (95% CI: 0.77, 0.84) (Fig 1).

thumbnail
Fig 1. Diagnostic performance of FAST score for detection of at-risk NASH in 585 NAFLD patients.

On the left, histogram showing frequency distribution of FAST scores by at-risk NASH status is depicted. Green color depicts scores for patients with at-risk NASH, and orange color shows scores for patients without at-risk NASH. The dotted lines show rule-out cut-off of 0.35 and rule-in cutoff of 0.67. On the right, AUROC of FAST for the diagnosis of at-risk NASH is shown.

https://doi.org/10.1371/journal.pone.0266859.g001

35% of patients in the NASH CRN cohort had a FAST score below the rule-out cutoff of 0.35, and 27% had a score above the rule-in cutoff of 0.67. 38% of patients had scores in the interderminate range. Fig 1 shows a graphical display of the frequency distribution of FAST scores according to the presence or absence of at-risk NASH. FAST scores ranged from 0.01 to 0.96.

The diagnostic performance of the FAST score, i.e., the sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) using a rule-out cutoff of ≤ 0.35 and a rule-in cutoff of ≥ 0.67, is depicted in Table 2. The rule-out zone cutoff of 0.35 yielded a sensitivity of 0.91, specificity of 0.50, PPV of 0.51, and NPV of 0.90. The rule-in zone cutoff of 0.67 led to a sensitivity of 0.51, specificity of 0.87, PPV of 0.69, and NPV of 0.76.

thumbnail
Table 2. Diagnostic statistics of FAST* for at-risk NASH.

https://doi.org/10.1371/journal.pone.0266859.t002

Table 3 displays the diagnostic accuracy of the FAST score at varying prevalences of at-risk NASH, which highlights that PPV decreases with decreasing prevalence of at-risk NASH, while NPV increases.

thumbnail
Table 3. Diagnostic accuracy of FAST at varying prevalences of at-risk NASH.

https://doi.org/10.1371/journal.pone.0266859.t003

Subgroup analysis.

The diagnostic accuracy of the FAST score for at-risk NASH among various subgroups characterized by important patient characteristics including age, gender, race/ethnicity, and BMI and FibroScan® probe type is displayed in Table 4. The performance of FAST was better in non-whites vs. whites (AUROC: 0.91 vs 0.78; p = 0.001). When dividing the population into three BMI categories, the diagnostic accuracy of FAST did not differ significantly (Table 4). As a sensitivity analysis, when BMI was categorized into four groups, defining an additional group as BMI <25 kg/m2, the AUROC for the 23 participants in the lowest BMI category was 0.94 (95% CI = 0.84, 1.00), and the p-value for difference in AUROCs between the lowest and highest BMI categories was 0.008. No differences were observed by other patient characteristics. There was no difference found by FibroScan® probe type (XL vs. M probe).

thumbnail
Table 4. Comparison of diagnostic accuracy of FAST for at-risk NASH by subgroups.

https://doi.org/10.1371/journal.pone.0266859.t004

There were 20 patients with unreliable LSMs. Although the mean BMI in the 20 patients with unreliable LSMs was significantly higher (mean 37.4 kg/m2) than the 565 patients with reliable LSMs (mean 34.4 kg/m2), the p-value for the comparison of ROC curves by the 4 BMI categories was similar when these 20 patients were excluded (p-value of 0.043 with all patients vs p-value of 0.035 when excluding patients with unreliable LSMs).

Comparison of diagnostic accuracy of FAST vs. other non-invasive diagnostic models for at-risk NASH.

A comparison of the diagnostic accuracy of various non-invasive diagnostic models for at-risk NASH vs. the FAST score is shown in Table 5. Analysis of the individual components of the FAST score showed that the diagnostic accuracy of each individual component was significantly lower to that of the FAST score. The addition of ALT to FAST did not result in increase in diagnostic accuracy. AUROC for NFS, FIB-4 index, and APRI were also significantly lower than that of the FAST score, with values of 0.67, 0.73, and 0.74, respectively.

thumbnail
Table 5. Comparison of various diagnostic models for at-risk NASH vs. FAST.

https://doi.org/10.1371/journal.pone.0266859.t005

Discussion

In this study, we validated the accuracy of the FAST score for identifying patients with at-risk NASH using a large, diverse cohort of U.S. patients with the full spectrum of biopsy-proven NAFLD from the NASH CRN network, a cohort with a prevalence of at-risk NASH of 37%. We found that the FAST score has good diagnostic performance characteristics with an AUROC of 0.80. Using a cutoff for sensitivity = 90% of 0.35 and for specificity = 90% of 0.67, the PPV and NPV in our cohort was 0.69 and 0.90, respectively. The performance of FAST was better in non-whites compared to whites. Additional analysis showed that the diagnostic performance was also better in patients with a normal BMI (< 25 kg/m2) compared to those with a a BMI > 35 kg/m2.

Our study results are consistent with the findings by Newsome et al., who performed the original study deriving the FAST score and found an AUROC of 0.80 in the derivation cohort from England and 0.85 in the pooled validation cohort [15]. Using the dual cutoff approach, the PPV in the derivation cohort, where the prevalence of at-risk NASH was 50%, was 0.83, and the NPV was 0.85. In the seven international external validation cohorts, the NPV was consistently high, ranging from 0.73 to 1.0. The NPV in the pooled external validation cohort, which was comprised of 1026 patients, was 0.94, which was similar to the high NPV of 0.90 that we found in our cohort. There was a greater range in the PPV in the seven external validation cohorts, which ranged from 0.33 to 0.81. The PPV in the pooled cohort was 0.69, which was the same as the PPV in our cohort. The modest PPV found in our cohort where 41% of individuals had a BMI ≥ 40 kg/m2 reflects that the accuracy of most ultrasound based modalities are restricted in those with severe obesity.

In a study conducted by Oeda et al. in Japan, the AUROC of the FAST score for the diagnosis of at-risk NASH was comparable but lower than that reported in our study and the Newsome et al. study, with a value of 0.76 for both the M and XL probes [20]. As in our study, there was no significant differences in the diagnostic accuracy by probe type. The NPV in the study was high at approximately 0.89. The prevalence of obesity in the overall study population was substantially lower than that of our population at about 25%, which is consistent with the lower prevalence of obesity reported in patients with NAFLD in Asian countries compared to Western countries, even using the definition of obesity in this population of > 25 kg/m2 [21]. The prevalence of at-risk NASH was also lower at about 25%.

These results illustrate that the PPV and NPV of the FAST score, like for any other tests, are determined by the population to which it is applied [15]. The prevalence of at-risk NASH in the target population will affect the PPV and NPV, and the diagnostic performance will also be determined by the patient mix. The modest PPV, which was found across clinical studies, highlights the utility of the FAST score in secondary care settings, where the prevalence of at-risk NASH will be higher than primary care settings, and the PPV will thus increase. The high NPV, which has been found across all existing studies, illustrates the important role that the FAST score can serve in identifying patients that are likely to be eligible for enrollment in clinical trials of newer pharmacotherapies for the treatment of NASH. Currently, the majority of NASH clinical trials for non-cirrhotic patients require histological evidence of NASH with Stage 2 or 3 fibrosis as an inclusion criteria [22,23]. The use of the FAST score in such settings can thus decrease the number of unnecessary liver biopsies performed and the rate of screening failure for clinical trials, which is currently high.

In clinical practice, a combination of noninvasive tests is often used to estimate the stage of fibrosis in patients with NASH, given the limited diagnostic accuracy of individual tests compared to the gold standard of liver biopsy. There have been several other prediction models developed for patients with NAFLD based on FibroScan® measurements combined with laboratory tests associated with liver inflammation or fibrosis, such as serum ALT or platelet count. Lee et al. developed the CLA model to discriminate between NASH and simple steatosis, which is based on three independent predictors: CAP > 250 dB/m, LSM > 7 kPa, and ALT > 60 IU/mL [24]. The discriminatory capability was found to be good with an AUROC of 0.812. Okajima et al. devised the LSM/platelet ratio index and found the AUROCs for detecting fibrosis stages ≥ 1, ≥ 2, and ≥ 3 were 0.835, 0.913, and 0.936, respectively, which was greater than that of LSM alone or established scoring symptoms as the NFS, FIB-4 index, and APRI [25]. Jung et al. showed that a magnetic resonance elastography (MRE) score ≥ 3.3 KPa combined with FIB-4 ≥ 1.6 can be used to identify patients with stage 2 fibrosis or higher with a PPV ≥ 90% [26]. Newsome et al. considered five predictor variables in the creation of their model (LSM, CAP, AST, ALT, and AST: ALT ratio) and determined that AST was the best parameter to combine with LSM and CAP [15]. This model had significantly better predictive properties than models with only one or two of these predictors and resulted in the equation for the FAST score.

In our study, we similarly found that the diagnostic accuracy of the FAST score was significantly greater than that of individuals components of FAST as well as the commonly used fibrosis scoring systems NFS, Fibrosis-4 (FIB-4) index, and APRI for the diagnosis of at-risk NASH.

The use of a predictive model based on FibroScan® measurements is valuable as FibroScan® is increasingly used in clinical settings in the U.S. since it received FDA approval in 2013 and has been shown to have good performance characteristics for the detection of advanced fibrosis stage and steatosis grade and low failure rates [12,16,2730]. A prior study from the NASH CRN showed that, in NAFLD patients from North America, the failure rate of FibroScan® with automatic probe selection for the estimation of LSM and CAP was very low at 3.2% [16]. In addition, the reliability rate was > 95%, and the reproducibility of LSM and CAP measurement was high. Furthermore, FibroScan® is easy to perform, relatively inexpensive compared to liver biopsy or magnetic resonance imaging, and can be performed as a point of care test in clinical practice settings where a FibroScan® device is available. The FAST score can be easily calculated using the LSM and CAP measurements along with a serum AST value using a free app from Echosens, myFibroScan, which makes it a convenient tool to use in clinical practice.

The major strengths of this study are the large sample size and multi-center nature of this U.S. based study. Although the original validation study by Newsome et al. included an external U.S. cohort, this was limited to 242 patients at a single center [15]. The original derivation cohort had 350 patients from 7 centers in England, with a mean age of 54 yrs, 43% female, mean BMI 34.2 kg/m2 and 50% with at-risk NASH [15]. Our study population included 585 patients from 8 centers in the U.S., with a mean age of 51 yrs, 62% female, mean BMI 34.5 kg/m2, and 37% with at-risk NASH. We thus studied a patient population with different baseline characteristics including a higher proportion of females and lower proportion with at-risk NASH.

An additional strength of our analysis is that we examined ROC curves by subgroups defined by patient characteristics such as race/ethnicity and BMI which was not perfomed in the original paper. We found that the performance of FAST was better in non-whites compared to whites. Our analysis also suggests that FAST has better diagnostic performance in patients with a normal BMI compared to morbid obese patients. Race/ethnicity and BMI were also found to be important in a prior NASH CRN study evaluating the performance characteristics of VCTE, as Hispanic ethnicity and BMI category were associated with a higher odds of unreliable LSM [16]. However, only 20 patients (3.4%) in our cohort had unreliable LSM, which makes it unlikely that this accounted for the differences observed by race and BMI category. Given the high prevalence of obesity in our cohort (73%), the majority of patients (55%) had the XL probe chosen for FibroScan® measurement. We did not find any significant difference between the diagnostic accuracy of FAST by probe type, which makes this unlikely to have accounted for differences in diagnostic accuracy according to BMI category. Further studies are needed to confirm differences in the diagnostic accuracy of FAST by race/ethnicity and BMI category with detailed information on abdominal fat distribution to explore possible mechanisms to account for such differences.

Of the 61 patients with cirrhosis in our study, only 35 (57%) met the definition of at-risk NASH. Thus, there is a need to develop a non-invasive score to predict the outcome of at-risk NASH or cirrhosis, as cirrhotic patients are at the highest risk of developing complications such as decompensated liver disease and hepatocellular cancer. In addition, there are several ongoing NASH clinical trials which are enrolling cirrhotic patients [31]. Additional models which have high diagnostic accuracy in the identification of patients with NASH who may be eligible for enrollment in clinical trials, including cirrhotic patients, are thus needed.

There are several other strengths of our study. Our study population consisted of a large number of patients seen across 8 U.S. medical centers as part of the NASH CRN Adult DB2 study. All new participants in the Adult Database 2 study required a liver biopsy to be eligible for enrollment. Thus, the decision to proceed with liver biopsy was not based on the results of FibroScan® or laboratory tests, and hence patients with the full spectrum of disease severity were included in the analysis, minimizing selection bias and making the results broadly applicable to patients with imaging evidence of steatosis or having other risk factors for NAFLD. The large sample size increased our ability to detect differences among subgroups in the overall cohort. The study population was relatively diverse, with 14% of patients being of Hispanic ethnicity and 9% being Asian. We examined prediction models for a very important clinical outcome of Stage 2 fibrosis or higher rather than focusing only on more advanced stages of fibrosis. The need for a noninvasive test to identify such patients is critical as the majority of current clinical trials aim to recruit patients with Stage 2 or 3 fibrosis.

The limitations of the study include the absence of longitudinal data on changes in FAST score over time in patients with NASH. The requirement of liver biopsy is currently a major barrier to enrollment in NASH clinical trials, and the development of a noninvasive score which can supplant liver biopsy can only take place if longitudinal data confirming the accuracy of a noninvasive score in assessing changes in liver inflammation and fibrosis is available. In addition, the average time between FibroScan® measurement and liver biopsy in the study was 77 days, compared to the shorter time interval of 2 weeks in Newsome et al. study, which may have impacted diagnostic accuracy. The small size of certain subgroups may have also limited diagnostic accuracy in our subgroup analysis. Finally, 38% of patients in the NASH CRN cohort had a FAST score that fell into the indeterminate range using the rule-out cutoff of 0.35 and rule-in cutoff of 0.67 for the identification of at-risk NASH. This is similar to the results from the derivation cohort reported by Newsome et al., where 39% of individuals had a FAST score in the grey zone between the rule-out and rule-in cutoffs [15]. A recent study found that the combination of MRE and FIB-4 (MEFIB) had a higher diagnostic accuracy and resulted in a smaller percentage of patients in the indeterminate range compared to FAST for the detection of stage 2 fibrosis or higher in patients with NAFLD. Further studies are needed to compare such strategies to FAST for the detection of at-risk NASH [32].

In summary, this study validated the use of the FAST score for the diagnosis of at-risk NASH in a large, diverse cohort of U.S. patients with biopsy-proven NAFLD.

Supporting information

S1 Table. % at-risk NASH and FAST by fibrosis stage.

https://doi.org/10.1371/journal.pone.0266859.s001

(DOC)

Acknowledgments

Members of the Nonalcoholic Steatohepatitis Clinical Research Network Adult Clinical Centers

Cleveland Clinic Foundation, Cleveland, OH: Daniela Allende, MD; Annette Bellar, MSLA; Jaividhya Dasarathy, MD; Srinivasan Dasarathy, MD; Julie Martridonna; Nicole Welch, MD; Rahul Yerrapothu Arthur J. McCullough, MD (2002–2021)

Duke University Medical Center, Durham, NC: Manal F. Abdelmalek, MD, MPH; Mustafa Bashir, MD; Anna Mae Diehl, MD; Cynthia Guy, MD; Christopher Kigongo, MB, CHB; Mariko Kopping, MS, RD; Dawn Piercy, MS, FNP; Naglaa Tawadrous

Indiana University School of Medicine, Indianapolis, IN: Timeka Bates, RN; Naga Chalasani, MD; Mandy Cruz, RN; Oscar W. Cummings, MD; Lisa Garrison, RN; Samer Gawrieh, MD; Niharika Samala, MD; Jessie Vaughn, RN; Raj Vuppalanchi, MD

Saint Louis University, St Louis, MO: Danielle Carpenter, MD; Theresa Cattoor, RN; Janet Freebersyser, RN; Brent A. Neuschwander-Tetri, MD; Susan Torretta; Elizabeth M. Brunt, MD (2002–2008); Debra King, RN (2004–2015); Jinping Lai, MD (2015–2016); Joan Siegner, RN (2004–2015); Susan Stewart, RN (2004–2015); Kristina Wriston, RN (2015)

Liver Institute Northwest, Seattle, WA: Kris V. Kowdley, MD; Luiza Deftu; Tarika Sivakumar; Theresa Dorrian; Heather Harris; My Nguyen

University of California San Diego, San Diego, CA: Veeral Ajmera, MD; Cynthia Behling, MD, PhD; Lori Edge; Rohit Loomba, MD, MHSc; Egbert Madamba; Michael S. Middleton, MD, PhD; Lisa Richards, NP; Suzanne Sharpton, MD; Seema Singh; Claude Sirlin, MD

University of California San Francisco, San Francisco, CA: Danielle Brandman, MD, MAS; Ryan Gill, MD, PhD; Bilal Hameed, MD; Remilekun Awe; Nathan M. Bass, MD, PhD (2002–2011)

University of Southern California, Los Angeles, CA: Daisy Olvera, BA; Norah Terrault, MD, MPH; Liyun Yuan, MD, PhD

University of Washington Medical Center, Seattle, WA: Matthew Yeh, MD, PhD

Virginia Commonwealth University, Richmond, VA: Amon Asgharpour, MD; Sherry Boyett, RN, BSN; Melissa J. Contos, MD; Velimir AC Luketic, MD; Arun J. Sanyal, MD; Jolene Schlosser, RN, BSN; Mohammad S. Siddiqui, MD

Washington University, St. Louis, MO: Elizabeth M. Brunt, MD (2008–2015); Kathryn Fowler, MD (2012–2015)

Resource Centers

National Cancer Institute, Bethesda, MD: David E. Kleiner, MD, PhD

National Institute of Diabetes and Digestive and Kidney Diseases, Bethesda, MD: Edward C. Doo, MD; Sherry Hall, MS; Jay H. Hoofnagle, MD; Averell H. Sherker, MD; Rebecca Torrance, RN, MS; Patricia R. Robuck, PhD, MPH (2002–2011)

Data Coordinating Center, Johns Hopkins University, Bloomberg School of Public Health, Baltimore, MD: Peggy Adamo, BS; Patricia Belt, BS; Jeanne M. Clark, MD, MPH; Jennifer M. DeSanto, RN, BSN, MS; Jill Meinert; Laura Miriel, BS; Emily P. Mitchell, MPH, MBA; Carrie Shade; Jacqueline Smith, AA; Michael Smith, BS; Alice Sternberg, ScM; James Tonascia, PhD; Mark L. Van Natta, MHS; Annette Wagoner; Laura A. Wilson, ScM; Tinsay Woreta, MD, MPH; Katherine P. Yates, ScM; John Dodge (2002–2018); Michele Donithan, MHS (2002–2017); Milana Isaacson, BS (2002–2018)

References

  1. 1. Younossi ZM, Koenig AB, Abdelatif D, Fazel Y, Henry L, Wymer M. Global epidemiology of nonalcoholic fatty liver disease-Meta-analytic assessment of prevalence, incidence, and outcomes. Hepatology. 2016;64:73–84. pmid:26707365.
  2. 2. Estes C, Anstee QM, Arias-Loste MT, Bantel H, Bellentani S, Caballeria J, et al. Modeling NAFLD disease burden in China, France, Germany, Italy, Japan, Spain, United Kingdom, and United States for the period 2016–2030. J Hepatol. 2018;69:896–904. pmid:29886156.
  3. 3. Ong JP, Pitts A, Younossi ZM. Increased overall mortality and liver-related mortality in non-alcoholic fatty liver disease. J Hepatol. 2008;49:608–12. pmid:18682312.
  4. 4. Konerman MA, Jones JC, Harrison SA. Pharmacotherapy for NASH: Current and emerging. J Hepatol. 2018;68:362–75. pmid:29122694.
  5. 5. Dulai PS, Singh S, Patel J, Soni M, Prokop LJ, Younossi Z, et al. Increased risk of mortality by fibrosis stage in nonalcoholic fatty liver disease: Systematic review and meta-analysis. Hepatology. 2017;65:1557–65. pmid:28130788.
  6. 6. Angulo P, Kleiner DE, Dam-Larsen S, Adams LA, Bjornsson ES, Charatcharoenwitthaya P, et al. Liver Fibrosis, but No Other Histologic Features, Is Associated With Long-term Outcomes of Patients With Nonalcoholic Fatty Liver Disease. Gastroenterology. 2015;149:389–97.e10. pmid:25935633.
  7. 7. Chalasani N, Younossi Z, Lavine JE, Charlton M, Cusi K, Rinella M, et al. The diagnosis and management of nonalcoholic fatty liver disease: Practice guidance from the American Association for the Study of Liver Diseases. Hepatology. 2018;67:328–57. pmid:28714183.
  8. 8. Castera L, Friedrich-Rust M, Loomba R. Noninvasive Assessment of Liver Disease in Patients With Nonalcoholic Fatty Liver Disease. Gastroenterology. 2019;156:1264–81.e4. pmid:30660725.
  9. 9. Kaswala DH, Lai M, Afdhal NH. Fibrosis Assessment in Nonalcoholic Fatty Liver Disease (NAFLD) in 2016. Dig Dis Sci. 2016;61:1356–64. pmid:27017224.
  10. 10. Bonder A, Afdhal N. Utilization of FibroScan in clinical practice. Curr Gastroenterol Rep. 2014;16:372. pmid:24452634.
  11. 11. Hannah WN Jr, Harrison SA. Noninvasive imaging methods to determine severity of nonalcoholic fatty liver disease and nonalcoholic steatohepatitis. Hepatology. 2016;64:2234–43. pmid:27338123.
  12. 12. Tapper EB, Challies T, Nasser I, Afdhal NH, Lai M. The Performance of Vibration Controlled Transient Elastography in a US Cohort of Patients With Nonalcoholic Fatty Liver Disease. Am J Gastroenterol. 2016;111:677–84. pmid:26977758.
  13. 13. Mikolasevic I, Orlic L, Franjic N, Hauser G, Stimac D, Milic S. Transient elastography (FibroScan(®)) with controlled attenuation parameter in the assessment of liver steatosis and fibrosis in patients with nonalcoholic fatty liver disease—Where do we stand? World J Gastroenterol. 2016 28;22:7236–51. pmid:27621571.
  14. 14. Musso G, Gambino R, Cassader M, Pagano G. Meta-analysis: natural history of non-alcoholic fatty liver disease (NAFLD) and diagnostic accuracy of non-invasive tests for liver disease severity. Ann Med. 2011;43:617–49. pmid:21039302.
  15. 15. Newsome PN, Sasso M, Deeks JJ, Paredes A, Boursier J, Chan WK, et al. FibroScan-AST (FAST) score for the non-invasive identification of patients with non-alcoholic steatohepatitis with significant activity and fibrosis: a prospective derivation and global validation study. Lancet Gastroenterol Hepatol. 2020;5:362–73. pmid:32027858.
  16. 16. Vuppalanchi R, Siddiqui MS, Van Natta ML, Hallinan E, Brandman D, Kowdley K, et al. Performance characteristics of vibration-controlled transient elastography for evaluation of nonalcoholic fatty liver disease. Hepatology. 2018;67:134–44. pmid:28859228.
  17. 17. Neuschwander-Tetri BA, Clark JM, Bass NM, Van Natta ML, Unalp-Arida A, Tonascia J, et al. Clinical, laboratory and histological associations in adults with nonalcoholic fatty liver disease. Hepatology. 2010;52:913–24. pmid:20648476.
  18. 18. Kleiner DE, Brunt EM, Van Natta M, Behling C, Contos MJ, Cummings OW, et al. Design and validation of a histological scoring system for nonalcoholic fatty liver disease. Hepatology. 2005;41:1313–21. pmid:15915461.
  19. 19. DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44:837–45. pmid:3203132.
  20. 20. Oeda S, Takahashi H, Imajo K, Seko Y, Kobayashi T, Ogawa Y, et al. Diagnostic accuracy of FibroScan-AST score to identify non-alcoholic steatohepatitis with significant activity and fibrosis in Japanese patients with non-alcoholic fatty liver disease: Comparison between M and XL probes. Hepatol Res. 2020;50:831–9. pmid:32337818.
  21. 21. Wong VW, Wong GL, Yeung DK, Lau TK, Chan CK, Chim AM, et al. Incidence of non-alcoholic fatty liver disease in Hong Kong: a population study with paired proton-magnetic resonance spectroscopy. J Hepatol. 2015;62:182–9. pmid:25195550.
  22. 22. Younossi ZM, Ratziu V, Loomba R, Rinella M, Anstee QM, Goodman Z, et al. Obeticholic acid for the treatment of non-alcoholic steatohepatitis: interim analysis from a multicentre, randomised, placebo-controlled phase 3 trial. Lancet. 2019 14;394:2184–96. pmid:31813633.
  23. 23. Anstee QM, Neuschwander-Tetri BA, Wong VW, Abdelmalek MF, Younossi ZM, Yuan J, et al. Cenicriviroc for the treatment of liver fibrosis in adults with nonalcoholic steatohepatitis: AURORA Phase 3 study design. Contemp Clin Trials. 2020;89:105922. pmid:31881392.
  24. 24. Lee HW, Park SY, Kim SU, Jang JY, Park H, Kim JK, et al. Discrimination of Nonalcoholic Steatohepatitis Using Transient Elastography in Patients with Nonalcoholic Fatty Liver Disease. PLoS One. 2016;11:e0157358. pmid:27284700.
  25. 25. Okajima A, Sumida Y, Taketani H, Hara T, Seko Y, Ishiba H, et al. Liver stiffness measurement to platelet ratio index predicts the stage of liver fibrosis in non-alcoholic fatty liver disease. Hepatol Res. 2017;47:721–30. pmid:27539017.
  26. 26. Jung J, Loomba RR, Imajo K, Madamba E, Gandhi S, Bettencourt R, et al. MRE combined with FIB-4 (MEFIB) index in detection of candidates for pharmacological treatment of NASH-related fibrosis. Gut. 2021;70:1946–53. pmid:33214165.
  27. 27. Eddowes PJ, Sasso M, Allison M, Tsochatzis E, Anstee QM, Sheridan D, et al. Accuracy of FibroScan Controlled Attenuation Parameter and Liver Stiffness Measurement in Assessing Steatosis and Fibrosis in Patients With Nonalcoholic Fatty Liver Disease. Gastroenterology. 2019;156:1717–30. pmid:30689971.
  28. 28. Yoneda M, Yoneda M, Mawatari H, Fujita K, Endo H, Iida H,et al. Noninvasive assessment of liver fibrosis by measurement of stiffness in patients with nonalcoholic fatty liver disease (NAFLD). Dig Liver Dis. 2008;40:371–8. pmid:18083083.
  29. 29. Siddiqui MS, Vuppalanchi R, Van Natta ML, Hallinan E, Kowdley KV, Abdelmalek M, et al. Vibration-Controlled Transient Elastography to Assess Fibrosis and Steatosis in Patients With Nonalcoholic Fatty Liver Disease. Clin Gastroenterol Hepatol. 2019;17:156–63. pmid:29705261.
  30. 30. Sasso M, Beaugrand M, de Ledinghen V, Douvin C, Marcellin P, Poupon R, et al. Controlled attenuation parameter (CAP): a novel VCTE guided ultrasonic attenuation measurement for the evaluation of hepatic steatosis: preliminary study and validation in a cohort of patients with chronic liver disease from various causes. Ultrasound Med Biol. 2010;36:1825–35. pmid:20870345.
  31. 31. Harrison SA, Wong VW, Okanoue T, Bzowej N, Vuppalanchi R, Younes Z, et al. Selonsertib for patients with bridging fibrosis or compensated cirrhosis due to NASH: Results from randomized phase III STELLAR trials. J Hepatol. 2020;73:26–39. pmid:32147362.
  32. 32. Tamaki N, Imajo K, Sharpton S, Jung J, Kawamura N, Yoneda M,et al. Magnetic resonance elastography plus Fibrosis-4 versus FibroScan-aspartate aminotransferase in detection of candidates for pharmacological treatment of NASH-related fibrosis. Hepatology. 2022;75:661–72. pmid:34496054.