https://orcid.org/0000-0002-4591-3757
Correction
9 Nov 2023: Rounis K, Makrakis D, Papadaki C, Monastirioti A, Vamvakas L, et al. (2023) Correction: Prediction of outcome in patients with non-small cell lung cancer treated with second line PD-1/PDL-1 inhibitors based on clinical parameters: Results from a prospective, single institution study. PLOS ONE 18(11): e0294382. https://doi.org/10.1371/journal.pone.0294382 View correction
Figures
Abstract
Objective
We prospectively recorded clinical and laboratory parameters from patients with metastatic non-small cell lung cancer (NSCLC) treated with 2nd line PD-1/PD-L1 inhibitors in order to address their effect on treatment outcomes.
Materials and methods
Clinicopathological information (age, performance status, smoking, body mass index, histology, organs with metastases), use and duration of proton pump inhibitors, steroids and antibiotics (ATB) and laboratory values [neutrophil/lymphocyte ratio, LDH, albumin] were prospectively collected. Steroid administration was defined as the use of > 10 mg prednisone equivalent for ≥ 10 days. Prolonged ATB administration was defined as ATB ≥ 14 days 30 days before or within the first 3 months of treatment. JADBio, a machine learning pipeline was applied for further multivariate analysis.
Results
Data from 66 pts with non-oncogenic driven metastatic NSCLC were analyzed; 15.2% experienced partial response (PR), 34.8% stable disease (SD) and 50% progressive disease (PD). Median overall survival (OS) was 6.77 months. ATB administration did not affect patient OS [HR = 1.35 (CI: 0.761–2.406, p = 0.304)], however, prolonged ATBs [HR = 2.95 (CI: 1.62–5.36, p = 0.0001)] and the presence of bone metastases [HR = 1.89 (CI: 1.02–3.51, p = 0.049)] independently predicted for shorter survival. Prolonged ATB administration, bone metastases, liver metastases and BMI < 25 kg/m2 were selected by JADbio as the important features that were associated with increased probability of developing disease progression as response to treatment. The resulting algorithm that was created was able to predict the probability of disease stabilization (PR or SD) in a single individual with an AUC = 0.806 [95% CI:0.714–0.889].
Citation: Rounis K, Makrakis D, Papadaki C, Monastirioti A, Vamvakas L, Kalbakis K, et al. (2021) Prediction of outcome in patients with non-small cell lung cancer treated with second line PD-1/PDL-1 inhibitors based on clinical parameters: Results from a prospective, single institution study. PLoS ONE 16(6): e0252537. https://doi.org/10.1371/journal.pone.0252537
Editor: Ramon Andrade De Mello, Nine of July University (UNINOVE): Discipline of Medical Oncology - Post Graduation Program in Medicine, BRAZIL
Received: November 2, 2020; Accepted: May 17, 2021; Published: June 1, 2021
Copyright: © 2021 Rounis et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting information files.
Funding: This work was partly supported by Anticancer Research Support Association (ARSA). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. One of the co-authors, Dimitrios Makrakis, at the time of data collection, was receiving a scholarship for cancer research from ARSA (ID: 2440338).
Competing interests: The authors have declared that no competing interests exist.
Introduction
Immune checkpoint inhibitors (ICIs) targeting the PD-1/PD-L1 axis have demonstrated substantial clinical activity in metastatic NSCLC and received regulatory approval for use as first or subsequent lines of therapy [1–5]. However, only a small proportion of individuals will experience durable clinical remissions and subsequent significant clinical benefit. In addition, beyond PD-L1 levels in tumor cells or the immune cells of the tumor microenvironment, there is currently a lack of biomarkers for the prediction of treatment outcomes. From the financial perspective, the large scale use of these inhibitors is associated with substantial expenditures for the healthcare system, thus rendering their cost-effectiveness debatable [6, 7].
Pretreatment weight loss and low body mass index values have been well-recognized adverse prognostic features in cancer patients [8]. Furthermore, several clinical studies have reported the prognostic value of systemic inflammation in malignancy and the role of routine blood parameters as potential inflammatory biomarkers [9]. Neutrophil/lymphocyte ratio (NLR) and low albumin levels have been associated with treatment outcomes in patients with advanced cancer, including lung cancer [10, 11]. Evidence is being progressively gathered on the application of the aforementioned parameters for the creation of predictive models in a wide spectrum of malignancies [12–14].
Intestinal microbiome composition exerts a pivotal impact in the shaping of an effective immune response [15]. Preclinical data have highlighted the importance of gut microbiota on immunotherapy efficacy in experimental mouse melanoma models [16]. More importantly, antibiotic (ATB) administration may significantly alter the microbiome composition leading to gut dysbiosis and immune dysfunction [17]. Beyond ATBs, proton pump inhibitors (PPis) are among the most common prescribed drugs worldwide and their administration has been linked with a significant decrease in Shannon’s diversity accompanied with alterations at the range of 20% of the bacterial taxa of the intestinal flora [18].
Daily steroid requirements > 10 mg of prednisone equivalent consisted an exclusion criterion for the registrational trials of ICIs [1–5]. In retrospective studies steroid administration has been associated with poor outcomes in patients with NSCLC treated with ICIs [19]. However, besides per os or intravenous steroids, NSCLC patients commonly use inhalational steroids due to the high prevalence of chronic obstructive pulmonary disease (COPD) in these individuals. Inhalational steroids exert a plethora of immunomodulatory effects on bronchial mucosa [20] however their effect on ICI efficacy has not been investigated so far.
Based on the above data we assumed that routinely available clinical and laboratory parameters may have prognostic and predictive relevance in patients with advanced NSCLC treated with ICIs. To test our hypothesis we conducted a prospective observational study in order to evaluate their role in the determination of clinical outcome in patients with metastatic NSCLC treated with ICIs in the second line treatment setting. In addition, we introduced these parameters in the Just Add Data Bio (JADBio) (www.jadbio.com) machine learning pipeline [21, 22] for further multivariate analysis in order to estimate their integrative predictive value in NSCLC.
Materials and methods
Study design
This is a prospective observational study enrolling patients with metastatic NSCLC, without EGFR mutations or ALK translocations, treated with ICIs following progression on previous platinum-based chemotherapy. Patients were recruited at the Department of Medical Oncology, University General Hospital of Heraklion, from November 15, 2017 until November 21, 2019. Patients were eligible if they received ICIs as second-line treatment as per standard treatment guidelines, according to the decision of the treating physician. Written informed consent was obtained from all patients before enrollment. The study was reviewed and approved by the institutional review board of the University Hospital of Heraklion and was conducted in accordance with the principles of the Declaration of Helsinki (ID 2644).
Data collection and outcome assessment
Patients with EGFR mutations or ALK translocations were excluded from the analysis. Radiological assessment was prospectively performed using CT scans (or MRI if clinically indicated) from the start of immunotherapy and every 8–9 weeks thereafter. Partial response (PR), stable disease (SD) and progressive disease (PD) were assessed according to RECIST 1.1 criteria [23]. Disease stabilization (DS) was defined as the achievement of PR or SD after ICI administration. Disease progression was defined as radiological progression or death during the course of treatment. Progression free survival (PFS) was defined as the time duration between the initiation of immunotherapy and disease progression or death. Overall survival (OS) was defined as the time duration between the initiation of immunotherapy and death. Individuals that had not progressed or were alive at the time of data analysis were censored for PFS and OS respectively at the date of last follow up.
Data on patient [age, gender, smoking status, performance status (PS), body mass index (BMI)], disease characteristics (histology, organs affected with metastatic disease) and context and duration of co-medications [per os (pos), intravenous (iv) or inhalational steroids, ATB and PPis] were prospectively collected. Disease burden was classified as high and low (> 2 and ≤ 2 organs with metastases) at the beginning of immunotherapy. Patients were classified based on their BMI at the start of immunotherapy in a binary fashion with the value of 25 kg/m2 used as the cut-off to define BMI high vs BMI low. Common laboratory parameters such as baseline lactate dehydrogenase (LDH) levels, albumin and absolute white blood cell counts were collected at the time of treatment initiation. Elevated LDH levels were defined according to the upper limit of normal value range (UNL) (247 units/liter) and the cut-off for neutrophil/lymphocyte ratio (NLR) was set at > 3. The cut-off for albumin levels was set at 3.5 g/dl that represents the lower normal limit. PD-L1 assessment, when available, further categorized the patients as PD-L1 positive or negative. PD-L1 expression was scored as % of tumor cells showing membranous and/or cytoplasmic staining; the cut-off for positivity was set at ≥ 1%.
Patients were categorized as having received steroids per os or iv in case of steroid use at a dosage of > 10 mg prednisone equivalent for ≥ 10 days within the first 12 weeks of treatment or within 15 days before its initiation. Patients were further sub-classified into two different subgroups, those who had received steroids due to immune related adverse effects (irAEs) and those who had received steroids for supportive reasons (e.g. brain edema due to brain metastases, anorexia, dyspnea, COPD exacerbations). We categorized patients as having been administered ATB if they had received ATBs within 30 days before the initiation of immunotherapy and/or within the first 12 weeks of treatment; prolonged ATB administration was defined as ATBs use for ≥ 14 days. In case of multiple courses of shorter periods, the total duration was calculated. Long-term PPis usage was defined as the use of PPis for a time duration ≥ 3 months before the initiation of immunotherapy. Chronic administration of inhalational steroids was defined as use for ≥ 3 months prior to the start of immunotherapy. The cut-offs of 10 days, 14 days and 3 months for steroids, ATBs and PPIs use, respectively, were set arbitrarily before the initiation of data collection.
Statistical analysis
Statistical analysis was performed using SPSS 25.00. Descriptive statistics were performed to define categorical and continuous nominal variables. Statistical significance was set at p < 0.05 (two-sided test). Chi square test was used to access any potential associations between each variable with PR and DS rates. In addition, chi-square test was applied to investigate any potential associations of various clinical characteristics with prolonged ATB administration. Mann-Whitney U test was applied to test the effect of duration of ATB administration in days as a continuous variable on DS rates. In addition, we performed binary logistic regression analysis in order to examine the odds ratios (OR) of the studied covariates on the probability of achieving DS as response to ICI administration.
The Kaplan Meier method was used to access any effect of the studied parameters on PFS and OS. Curves were compared with the log-rank test. We initially applied Cox Regression Method to examine the effect of the duration of ATB administration as a continuous nominal variable in days on PFS and OS. Finally, we conducted a univariate analysis for each studied categorical variable and afterwards a multivariate analysis including the parameters that had reached statistical significance in the univariate analysis using Cox Regression Method to investigate their effect on survival outcomes.
We did not perform a sample size and power calculation because at the time of the initiation of data collection there was a scarcity of published reports on the effect of the studied parameters on the outcome of immunotherapy treated cancer patients. Thus, it would have been of no value in this exploratory study due to the lack of available data on which to base the required calculations.
Multivariate analysis by JADBio tool
For the purpose of conducting a multivariate analysis on our data, we applied JADBio, a fully automated machine learning (AutoML) system (www.jadbio.com). JADBio selects the algorithms and methods corresponding to the particular problem, according to the type of data used and possible preferences set by the user. To do this, it employs an artificial intelligence (AI) system responsible for selecting methods and performing tasks, such as data transformation, data pre-processing, feature selection, model selection and results visualization. Furthermore, the system is in charge of selecting which of their hyper-parameters to optimize. The combination of methods used and their corresponding hyper-parameters is defined as a configuration and these methods are applied using the 10-fold cross validation protocol. Thus, JADBio produces thousands of different models, ranking them based on a scoring metric, in our case, area under the receiver operating characteristic (ROC) curve (AUC), and outputs the best performing one. To eliminate the possibility of overestimating the final predictive performance, JADBio uses a bootstrap-based method to correct it [24]. Using the same method, it calculates the confidence intervals of the resulted performance.
In our analysis, we used JADBio for binary classification modelling for the prediction of the probability of a single individual to achieve DS (PR or SD vs PD) with ICIs as second line treatment. The feature classification of the parameters used as input in JADBio is demonstrated in S1 Table. The tool applied the following modelling algorithms: support vector machines (SVM) with full polynomial and Gaussian kernels [25], random forests [26], ridge logistic regression [27], and decision trees [28]. The performance metric we chose over the several ones available at JADBio, is the AUC. In most cases, the result of an analysis will be a complex model, incomprehensible to the human user. To aid in that regard, JADBio additionally outputs the best interpretable model. In our work, we report the performance estimation of the best performing model.
Results
Patient characteristics
Patients’ characteristics are shown in detail in Table 1. All the individuals included in this study were Caucausian. All patients had received prior platinum-based chemotherapy. Median age was 69 years (range: 39–81 years), 24 patients (36.3%) had received steroids, 34 (51.5%) had received ATBs and 22 (33.3% of the total population) had been administered a prolonged course of ATBs. None of the studied clinical and laboratory parameters were associated at a statistical significant level with prolonged ATB administration (S2 Table).
Effect of the studied variables on response outcomes
Ten (15.2%) patients experienced PR, 23 (34.8%) SD and 33 (50%) had PD at the time of their first disease evaluation. Median duration of response was 7.97 months (range, 2.8–26.9 months).
Only low BMI (p = 0.030, CI 95%) was significantly associated with inferior response rates (S3 Table). Low BMI (p = 0.003, CI 95%), the presence of bone metastases (p = 0.007, CI 95%), liver metastases (p = 0.014, CI 95%) and high disease burden (p = 0.017, CI 95%) were significantly associated with inferior DS rates. ATB administration (p = 0.014, CI 95%), prolonged ATB administration (p = 0.002, CI 95%) and the use of pos or iv steroids for supportive reasons (p = 0.040, CI 95%), exhibited a statistically significant correlation with reduced DS rates (Fig 1A–1C). The duration of ATB administration in days as a continuous nominal variable was also negatively correlated with DS rates (p = 0.004, CI 95%) (S1 Fig). None of the other studied parameters affected DS rates at a significant level (S4 Table).
The odds ratio (OR) of each studied covariate on the probability of achieving DS as result of ICIs administration along with its statistical significance are depicted in Fig 2A and S5 Table. In the multivariate logistic regression analysis, bone metastases [OR: 0.153 (CI: 0.032–0.734, p = 0.019)] and prolonged ATB administration [OR: 0.085 (CI: 0.017–0.411, p = 0.002)], independently predicted for lower probability of DS with ICIs (Fig 2B and S5 Table).
(LB: Lower border, UB: Upper border).
Effect of the studied variables on survival outcomes
Median duration of follow up was 6.37 months (range: 0.6–26.9 months). After data censoring, median PFS and OS for the whole patient population were 3.50 (95% CI: 1.49–5.50) and 6.77 (95% CI: 2.29–11.24) months, respectively.
The results on the effect of the studied variables on PFS and OS are depicted in S6 Table. BMI <25 kg/m2 (2.33 vs 4.93 months, p = 0.009), high disease burden (1.77 vs 4.67 months, p = 0.008) and the presence of liver (1.73 vs 4.80 months, p = 0.002) or bone metastases (2.10 vs 4.80 months, p = 0.024) were significantly associated with reduced PFS. In addition, baseline albumin levels < 3.5 g/dl (1.70 vs 4.40 months, p = 0.005) and baseline NLR >3 (2.53 vs 4.93, p = 0.024) were also correlated with reduced PFS. Although ATB administration was not associated with lower PFS, (p = 0.062) (S2A Fig), prolonged ATB course (Fig 3A) and steroid administration > 10 mg for supportive reasons (S3A Fig) were significantly correlated with inferior PFS (1.57 vs 4.93 months, p<0.001 and 1.27 vs 4.70 months, p = 0.013). None of the other analyzed covariates exhibited statistically significant correlations with PFS (S4A and S5A Figs and S6 Table).
(A) Effect of prolonged ATB administration on PFS (B) Effect prolonged ATB administration on OS (C) Scatter plot depicting the effect of the duration of ATB administration in days as a continuous variable on PFS (D) Scatter plot depicting the effect of the duration of ATB administration in days as a continuous variable.
Regarding their effect on patients’ survival, PS 2 (3.17 vs 9.60 months, p = 0.027), baseline albumin levels < 3.5 g/dl (1.70 vs 9.57 months, p = 0.003), baseline LDH levels > UNL (3.70 vs 9.90 months, p = 0.040) and the presence of bone metastases (3.77 vs 10.33 months, p = 0.011) exhibited a negative correlation with OS (S6A and S6B Fig). Prolonged ATB administration was associated with reduced OS (2.50 vs 9.93 months, p = 0.001) (Fig 3B), however, the use of steroids (2.53 vs 9.60 months, p = 0.051) or of ATB (4.00 vs 9.67 months, p = 0.301) (S2B and S3B Figs) were not correlated with reduced OS. No other associations with inferior OS were observed (S4B and S5B Figs and S6 Table).
Univariate and multivariate survival analysis
Cox Regression analysis revealed that the duration of ATB administration evaluated as a continuous nominal variable was negatively correlated with PFS (p = 0.007, CI 95%) and OS (p = 0.027, 95% CI) (Fig 3C and 3D).
In the univariate analysis for PFS, baseline albumin levels were not included in the analysis due to insufficient number of events; results are shown in Table 2. Multivariate analysis demonstrated that steroids used for supportive reasons [HR = 2.556 (CI: 1.347–4.887, p = 0.004)], prolonged administration of ATBs [HR = 3.403 (CI: 1.817–6.375, p = 0.0001)] and the presence of liver [HR = 3.266 (CI: 1.653–6.375, p = 0.001)] or bone metastases [HR = 2.244 (CI: 1.155–4.360, p = 0.017)] were independent predictors for inferior PFS (Table 2).
In the multivariate analysis for OS, prolonged use of ATBs [HR = 2.945 (CI: 1.619–5.358, p = 0.0001)] and bone metastases [HR = 1.890 (CI: 1.017–3.512, p = 0.049)] were independently associated with reduced survival (Table 2).
Multivariate analysis using the JADBio tool
For the classification task (response to ICIs), patients were divided into two groups; responders were characterized as those experiencing PR or SD and non-responders were those experiencing PD as best response to treatment. For the classification analysis, JADbio tried 3017 configurations and trained 211190 models (Fig 4A). JADbio performed LASSO feature selection (penalty = 0.5, lambda = 0.027) and selected 4 features: prolonged ATB administration, bone metastases, liver metastases and BMI < 25 kg/m2 for the original signature. In total there was only one signature. The predictive algorithm of the best performing model was SVM of type C-SVC with Polynomial Kernel and hyper-parameters: cost = 0.01, gamma = 1.0, degree = 4 with an AUC = 0.806 [0.714–0.889] (Fig 4B). The ROC curve of the best performing model is demonstrated in Fig 4C. In addition, the classification analysis was able to calculate the feature importance of the selected features on the probability of achieving PR or SD which was defined as the percentage drop in predictive performance when each particular feature was removed from the model (Fig 5A). The box plots that visualize the contrast of the cross-validated predicted probability of belonging to a specific class against the actual class of the samples are depicted in Fig 5B.
A. Visualization of the learning process of JADbio for the classification analysis of our data. JADbio tried 3017 configurations and trained 211190 models in total. B. Distribution of the performance metric (AUC) of our model. The distribution is computed on out of sample predictions of the current model. C. Receiver Operating Characteristic (ROC) Curve for the best performing model (Support Vector Machines (SVM) of type C-SVC with Polynomial Kernel and hyper-parameters: cost = 0.01, gamma = 1.0, degree = 4). The classification threshold for the 95% confidence intervals has been set at the average F1/accuracy/Balance accuracy.
A. Feature importance plot: This chart reports feature importance defined as the percentage drop in predictive performance when the feature is removed from the model. Grey lines indicate 95% confidence intervals. B. The Box-Plot contrasts the cross-validated predicted probability of belonging to a specific class against the actual class of the samples. Well-performing models are expected to provide predictions that are close to 1 for the actual class and close to 0 for all other class. Class 1 is the probability of achieving PR or SD as response to immunotherapy and class 2 is the probability of developing disease progression.
Discussion
The primary aim of our study was to prospectively evaluate the effect of common clinical and laboratory parameters on the outcome of patients with metastatic NSCLC receiving immunotherapy. We herein demonstrate that routinely available patient and disease characteristics are correlated with treatment outcomes and can be integrated into a multifactorial model predicting individual clinical benefit from ICIs using a machine learning approach.
In our cohort, bone metastases constituted an adverse prognostic factor in NSCLC patients treated with second line ICIs. In accordance, previous retrospective studies highlight that ICI efficacy may vary according to the presence of specific disease sites [29, 30]. Furthermore, we observed that patients with low BMI had shorter PFS compared to patients with high ΒΜΙ. Low albumin levels were also significantly associated with both shorter PFS and OS in our cohort. However, it should be noted that BMI and/or albumin levels cannot be used alone for the evaluation of patients’ nutritional status. More detailed analysis is required to further elucidate the impact of body composition in the outcome of cancer patients treated with immunotherapy [31, 32]. Performance status 2 did not emerge as an independent negative prognostic factor, however this could be attributed to the small sample size of our cohort and the fact that only 15 patients had performance status 2, leading to increased probability for a statistical type I error.
The administration of commonly used co-medications exerted a significant impact on patients’ outcome in our analysis. The time frame of 12 weeks from the start of ICIs initiation employed for the classification of patients according to the use of steroids and ATBs was set to avoid a bias for those achieving long term clinical remissions, who thus, would have a higher possibility for steroid and ATB use during the course of their illness. ATB administration as a categorical variable did not affect PFS or OS, however when we examined the effect of their administration in days as a continuous nominal variable, a statistically significant negative correlation with PFS and OS was revealed. Importantly, prolonged ATBs administration emerged as an independent predictor for reduced probability of disease stabilization and for inferior PFS and OS. Our results are in accordance with previously published prospective and retrospective studies [33, 34] and further reinforce the data published by Tinsley et al [35] reporting worst outcomes with cumulative ATB administration in patients with metastatic malignancies receiving ICIs indicating a dose dependent effect between ATB exposure and reduced ICI efficacy. Our findings along with the results from previously published reports suggest that ATB administration, especially for longer time periods should be avoided in patients receiving immunotherapy.
In our analysis we classified patients who received steroids into two different subgroups, those who were administered steroids for supportive reasons and those who received high dose steroids due to immune related adverse effects (irAEs). In our cohort, the use of steroids for supportive reasons was independently associated with shorter PFS, however no associations with OS were revealed. Regrettably, due to the small number of patients we were not able to perform more detailed subgroup analysis regarding the specific reasons for the supportive administration of steroids, however, our findings reinforce previous reports raising concerns regarding the use of > 10 mg prednisone equivalent in patients receiving ICIs [36]. On the contrary, the administration of inhalational steroids or of PPis did not impair treatment outcomes in our analysis and their administration seems safe. Our results regarding the effects of PPis are in contrast with a recent published retrospective analysis by Hopkins et al [37] demonstrating that PPis negatively affected survival outcomes in individuals with metastatic urothelial cancer treated with atezolizumab. Therefore, further research is needed in order to clarify their effects on the efficacy of ICIs.
We further incorporated all the recorded parameters into JADbio, an artificial intelligence (AI) system, with to evaluate how these different features interact with one another and to examine the feature importance of each particular parameter on individual treatment outcomes in an integrative manner. JADbio selected four clinical features and created a signature that was able to predict the possibility for disease stabilization as result of treatment with ICIs with an accuracy of 81%. These four features consisted of prolonged ATB administration, bone metastases, liver metastases and BMI < 25 kg/m2. The higher feature importance obtained for prolonged ATB administration further underscores the importance of the microbiome composition for an effective antitumor immune response [16]. Interestingly, they indicate that factors likely inherent to the biology of the primary tumour are related to both the specific patterns of metastatic spread and the response to ICIs.
Previous studies have employed AI for the prediction of outcome of patients with metastatic melanoma and NSCLC receiving treatment with ICIs [38, 39]. Despite the significant smaller sample of the cohort studied herein, our analysis provides the advantage of including a wider range of routinely available, easily obtainable clinical parameters and more importantly it allows the calculation of each parameter’s feature importance on the determination of an individual’s outcome. Using JADbio, we constructed a novel multivariate model predicting the individual possibility of achieving disease stabilization in patients with metastatic NSCLC treated with ICIs in the second line setting with accuracy at the level of 81%. Using other AutoML services, an overestimation of the final predictive performance might have resulted, as they mainly use cross-validation, which overfits in sample-sample scenarios [40]. JADBio is built for such scenarios and uses a technique [24] to remove this cross-validation bias, rendering the final performance estimation conservative and reliable.
Our results indicate that routinely available variables could be used to identify individuals who will achieve disease control with ICIs and to spot those who will likely progress on treatment for whom closer monitoring, alternative treatment regimens or participation in clinical trials should be advised. However, it should be also noted that immunotherapy has now moved into the first line treatment setting either as a monotherapy or in combination with chemotherapy and that only a minority of patients now receive ICIs in the second line or beyond.
Strengths of our study include the prospective evaluation and analysis of a wide range of common and easily accessible clinical and laboratory parameters and of common co-medications in a cohort of lung cancer patients treated with immunotherapy to determine their prognostic role. A significant novelty of our report represents the additional multivariate analysis using an AutoML interface to further determine the integrated feature importance of each of these parameters on individual patient outcomes. Limitations of our study are the small statistical sample and the fact that PD-L1 levels were not included in our model due to high rates of missing data. In addition, our results were not validated in another patient cohort.
Conclusion
Our results corroborate previous evidence regarding the negative predictive role of liver and bone metastases in NSCLC patients treated with ICIs. Furthermore, they emphasize the negative effect of ATBs on patient outcomes and suggest that long-term ATBs use should be avoided in these patients. By incorporating our data into the JADbio machine learning system, we were able to distinguish the clinical variables that are most relevant for achieving disease control with immunotherapy. Importantly, we estimated the feature importance of these variables on individual patient outcomes in an integrative manner. Since immunotherapy is currently mostly used either as first line treatement, either as a single agent or in combination with chemotherapy, our findings merit further evaluation in these settings.
Supporting information
S1 Table. Binary classification of patients’ feature input in JADBio.
https://doi.org/10.1371/journal.pone.0252537.s001
(DOC)
S2 Table. Chi square test demonstrating the association of the analyzed clinical parameters with a prolonged ATB course.
https://doi.org/10.1371/journal.pone.0252537.s002
(DOC)
S3 Table. Effect of the studied variables on response rates.
https://doi.org/10.1371/journal.pone.0252537.s003
(DOC)
S4 Table. Effect of the studied variables on disease stabilization rates.
https://doi.org/10.1371/journal.pone.0252537.s004
(DOC)
S5 Table. Univariate and multivariate logistic regression on the Odds Ratio (OR) of the analyzed covariates on the probability of achieving disease stabilization (PR or SD) as response to treatment with ICIs.
https://doi.org/10.1371/journal.pone.0252537.s005
(DOC)
S6 Table. Kaplan Meier method (log-rank test) on the effect of the studied parameters on PFS and OS.
https://doi.org/10.1371/journal.pone.0252537.s006
(DOC)
S1 Fig. Mann-Whitney U test examining the effect of the duration of ATB administration in days on DS rates.
On the left side are the days on ATB of the patients that experienced PD and on the right side the days on ATB of those who had DS (PR or SD) as response to ICI administration.
https://doi.org/10.1371/journal.pone.0252537.s007
(DOC)
S2 Fig. Kaplan-Meier curves on the effect of ATB administration on PFS (A) and OS (B).
https://doi.org/10.1371/journal.pone.0252537.s008
(DOC)
S3 Fig. Kaplan-Meier curves on the effect of steroid administration > 10 mg on PFS (A) and OS (B).
https://doi.org/10.1371/journal.pone.0252537.s009
(DOC)
S4 Fig. Kaplan-Meier curves on the effect of chronic PPis administration on (A) PFS and (B) OS.
https://doi.org/10.1371/journal.pone.0252537.s010
(DOC)
S5 Fig. Kaplan-Meier curves on the effect of inhalational steroids administration on (A) PFS and (B).
https://doi.org/10.1371/journal.pone.0252537.s011
(DOC)
S6 Fig. Kaplan Meier curves depicting the effect of the following parameters on OS (A) Baseline albumin levels <3.5 g/dl (B) Presence of bone metastases.
https://doi.org/10.1371/journal.pone.0252537.s012
(DOC)
Acknowledgments
We would like to thank Pavlos Charonyktakis (CTO and co-founder of JADBio) for his insights on the JADBio application methodology and the interpretation of results. We would also like to thank all the patients and their families who participated in this study.
References
- 1. Brahmer J, Reckamp KL, Baas P, Crinò L, Eberhardt WEE, Poddubskaya E, et al. Nivolumab versus Docetaxel in Advanced Squamous-Cell Non–Small-Cell Lung Cancer. New England Journal of Medicine [Internet]. 2015 Jul 9 [cited 2020 May 15];373(2):123–35. pmid:26028407
- 2. Borghaei H, Paz-Ares L, Horn L, Spigel DR, Steins M, Ready NE, et al. Nivolumab versus Docetaxel in Advanced Nonsquamous Non-Small-Cell Lung Cancer. N Engl J Med. 2015 Oct 22;373(17):1627–39. pmid:26412456
- 3. Rittmeyer A, Barlesi F, Waterkamp D, Park K, Ciardiello F, von Pawel J, et al. Atezolizumab versus docetaxel in patients with previously treated non-small-cell lung cancer (OAK): a phase 3, open-label, multicentre randomised controlled trial. Lancet. 2017 21;389(10066):255–65. pmid:27979383
- 4. Socinski MA, Jotte RM, Cappuzzo F, Orlandi F, Stroyakovskiy D, Nogami N, et al. Atezolizumab for First-Line Treatment of Metastatic Nonsquamous NSCLC. N Engl J Med. 2018 Jun 14;378(24):2288–301. pmid:29863955
- 5. Gandhi L, Rodríguez-Abreu D, Gadgeel S, Esteban E, Felip E, De Angelis F, et al. Pembrolizumab plus Chemotherapy in Metastatic Non-Small-Cell Lung Cancer. N Engl J Med. 2018 May 31;378(22):2078–92. pmid:29658856
- 6. Georgieva M, da Silveira Nogueira Lima JP, Aguiar P, de Lima Lopes G, Haaland B. Cost-effectiveness of pembrolizumab as first-line therapy for advanced non-small cell lung cancer. Lung Cancer. 2018;124:248–54. pmid:30268469
- 7. Verma V, Sprave T, Haque W, Simone CB, Chang JY, Welsh JW, et al. A systematic review of the cost and cost-effectiveness studies of immune checkpoint inhibitors. J Immunother Cancer. 2018 23;6(1):128. pmid:30470252
- 8. Martin L, Senesse P, Gioulbasanis I, Antoun S, Bozzetti F, Deans C, et al. Diagnostic Criteria for the Classification of Cancer-Associated Weight Loss. JCO [Internet]. 2014 Nov 24 [cited 2020 May 16];33(1):90–9. Available from: https://ascopubs.org/doi/full/10.1200/JCO.2014.56.1894 pmid:25422490
- 9. Laird BJ, Kaasa S, McMillan DC, Fallon MT, Hjermstad MJ, Fayers P, et al. Prognostic factors in patients with advanced cancer: a comparison of clinicopathological factors and the development of an inflammation-based prognostic system. Clin Cancer Res. 2013 Oct 1;19(19):5456–64. pmid:23938289
- 10. Kazandjian D, Gong Y, Keegan P, Pazdur R, Blumenthal GM. Prognostic Value of the Lung Immune Prognostic Index for Patients Treated for Metastatic Non-Small Cell Lung Cancer. JAMA Oncol. 2019 Jul 25; pmid:31343662
- 11. Sun H, Hu P, Shen H, Dong W, Zhang T, Liu Q, et al. Albumin and Neutrophil Combined Prognostic Grade as a New Prognostic Factor in Non-Small Cell Lung Cancer: Results from a Large Consecutive Cohort. PLOS ONE. 2015 Dec 14;10(12):e0144663. pmid:26656866
- 12. Hopkins AM, Rowland A, Kichenadasse G, Wiese MD, Gurney H, McKinnon RA, et al. Predicting response and toxicity to immune checkpoint inhibitors using routinely available blood and clinical markers. Br J Cancer [Internet]. 2017 Sep 26 [cited 2020 May 15];117(7):913–20. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5625676/ pmid:28950287
- 13. Ren F, Zhao T, Liu B, Pan L. Neutrophil-lymphocyte ratio (NLR) predicted prognosis for advanced non-small-cell lung cancer (NSCLC) patients who received immune checkpoint blockade (ICB). Onco Targets Ther. 2019;12:4235–44. pmid:31239702
- 14. Weide B, Martens A, Hassel JC, Berking C, Postow MA, Bisschop K, et al. Baseline Biomarkers for Outcome of Melanoma Patients Treated with Pembrolizumab. Clin Cancer Res. 2016 Nov 15;22(22):5487–96. pmid:27185375
- 15. Belkaid Y, Hand T. Role of the Microbiota in Immunity and inflammation. Cell [Internet]. 2014 Mar 27 [cited 2020 May 15];157(1):121–41. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4056765/ pmid:24679531
- 16. Vétizou M, Pitt JM, Daillère R, Lepage P, Waldschmitt N, Flament C, et al. Anticancer immunotherapy by CTLA-4 blockade relies on the gut microbiota. Science. 2015 Nov 27;350(6264):1079–84. pmid:26541610
- 17. Palleja A, Mikkelsen KH, Forslund SK, Kashani A, Allin KH, Nielsen T, et al. Recovery of gut microbiota of healthy adults following antibiotic exposure. Nature Microbiology [Internet]. 2018 Nov [cited 2020 May 15];3(11):1255–65. Available from: https://www.nature.com/articles/s41564-018-0257-9 pmid:30349083
- 18. Imhann F, Bonder MJ, Vich Vila A, Fu J, Mujagic Z, Vork L, et al. Proton pump inhibitors affect the gut microbiome. Gut. 2016 May;65(5):740–8. pmid:26657899
- 19. Arbour KC, Mezquita L, Long N, Rizvi H, Auclin E, Ni A, et al. Impact of Baseline Steroids on Efficacy of Programmed Cell Death-1 and Programmed Death-Ligand 1 Blockade in Patients With Non-Small-Cell Lung Cancer. J Clin Oncol. 2018 1;36(28):2872–8. pmid:30125216
- 20. Brusselle G, Bracke K. Targeting immune pathways for therapy in asthma and chronic obstructive pulmonary disease. Ann Am Thorac Soc. 2014 Dec;11 Suppl 5:S322–328. pmid:25525740
- 21. Orfanoudaki G, Markaki M, Chatzi K, Tsamardinos I, Economou A. MatureP: prediction of secreted proteins with exclusive information from their mature regions. Sci Rep. 2017 12;7(1):3263. pmid:28607462
- 22. Panagopoulou M, Karaglani M, Balgkouranidou I, Biziota E, Koukaki T, Karamitrousis E, et al. Circulating cell-free DNA in breast cancer: size profiling, levels, and methylation patterns lead to prognostic and predictive classifiers. Oncogene. 2019;38(18):3387–401. pmid:30643192
- 23. Eisenhauer EA, Therasse P, Bogaerts J, Schwartz LH, Sargent D, Ford R, et al. New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1). Eur J Cancer. 2009 Jan;45(2):228–47. pmid:19097774
- 24. Tsamardinos I, Greasidou E, Tsagris M, Borboudakis G. Bootstrapping the Out-of-sample Predictions for Efficient and Accurate Cross-Validation. Machine Learning. 2017 Aug 23;107.
- 25.
Boser BE, Guyon IM, Vapnik VN. A training algorithm for optimal margin classifiers. In: Proceedings of the fifth annual workshop on Computational learning theory [Internet]. Pittsburgh, Pennsylvania, USA: Association for Computing Machinery; 1992 [cited 2020 May 15]. p. 144–152. (COLT ‘92).
- 26. Breiman L. Random Forests. Machine Learning [Internet]. 2001 Oct 1 [cited 2020 May 16];45(1):5–32.
- 27. Ridge Regression: Biased Estimation for Nonorthogonal Problems: Technometrics: Vol 12, No 1 [Internet]. [cited 2020 May 15]. https://www.tandfonline.com/doi/abs/10.1080/00401706.1970.10488634
- 28.
Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and Regression Trees [Internet]. 1983 [cited 2020 May 15]. https://www.semanticscholar.org/paper/Classification-and-Regression-Trees-Breiman-Friedman/8017699564136f93af21575810d557dba1ee6fc6
- 29. Prelaj A, Ferrara R, Rebuzzi SE, Proto C, Signorelli D, Galli G, et al. EPSILoN: A Prognostic Score for Immunotherapy in Advanced Non-Small-Cell Lung Cancer: A Validation Cohort. Cancers [Internet]. 2019 Dec [cited 2020 May 15];11(12):1954. Available from: https://www.mdpi.com/2072-6694/11/12/1954 pmid:31817541
- 30. Landi L, D’Incà F, Gelibter A, Chiari R, Grossi F, Delmonte A, et al. Bone metastases and immunotherapy in patients with advanced non-small-cell lung cancer. Journal for ImmunoTherapy of Cancer [Internet]. 2019 Nov 21 [cited 2020 May 15];7(1):316. pmid:31752994
- 31. Kichenadasse G, Miners JO, Mangoni AA, Rowland A, Hopkins AM, Sorich MJ. Association Between Body Mass Index and Overall Survival With Immune Checkpoint Inhibitor Therapy for Advanced Non-Small Cell Lung Cancer. JAMA Oncol. 2019 Dec 26;
- 32. Fearon K, Strasser F, Anker SD, Bosaeus I, Bruera E, Fainsinger RL, et al. Definition and classification of cancer cachexia: an international consensus. Lancet Oncol. 2011 May;12(5):489–95. pmid:21296615
- 33. Derosa L, Hellmann MD, Spaziano M, Halpenny D, Fidelle M, Rizvi H, et al. Negative association of antibiotics on clinical activity of immune checkpoint inhibitors in patients with advanced renal cell and non-small-cell lung cancer. Ann Oncol. 2018 1;29(6):1437–44. pmid:29617710
- 34. Pinato DJ, Howlett S, Ottaviani D, Urus H, Patel A, Mineo T, et al. Association of Prior Antibiotic Treatment With Survival and Response to Immune Checkpoint Inhibitor Therapy in Patients With Cancer. JAMA Oncol. 2019 Sep 12; pmid:31513236
- 35. Tinsley N, Zhou C, Tan G, Rack S, Lorigan P, Blackhall F, et al. Cumulative Antibiotic Use Significantly Decreases Efficacy of Checkpoint Inhibitors in Patients with Advanced Cancer. Oncologist. 2020;25(1):55–63. pmid:31292268
- 36. Ricciuti B, Dahlberg SE, Adeni A, Sholl LM, Nishino M, Awad MM. Immune Checkpoint Inhibitor Outcomes for Patients With Non-Small-Cell Lung Cancer Receiving Baseline Corticosteroids for Palliative Versus Nonpalliative Indications. J Clin Oncol. 2019 1;37(22):1927–34. pmid:31206316
- 37. Hopkins AM, Kichenadasse G, Karapetis CS, Rowland A, Sorich MJ. Concomitant Proton Pump Inhibitor Use and Survival in Urothelial Carcinoma Treated with Atezolizumab. Clin Cancer Res [Internet]. 2020 Sep 15 [cited 2020 Sep 21]; https://clincancerres.aacrjournals.org/content/early/2020/09/11/1078-0432.CCR-20-1876 pmid:32933995
- 38. Park W, Mezquita L, Okabe N, Chae YK, Kwon D, Saravia D, et al. Association of the prognostic model iSEND with PD-1/L1 monotherapy outcome in non-small-cell lung cancer. Br J Cancer. 2020 Feb;122(3):340–7. pmid:31761899
- 39. Trebeschi S, Drago SG, Birkbak NJ, Kurilova I, Cǎlin AM, Delli Pizzi A, et al. Predicting response to cancer immunotherapy using noninvasive radiomic biomarkers. Ann Oncol [Internet]. 2019 Jun [cited 2020 May 15];30(6):998–1004. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6594459/ pmid:30895304
- 40. Cawley GC, Talbot NLC. On Over-fitting in Model Selection and Subsequent Selection Bias in Performance Evaluation. Journal of Machine Learning Research [Internet]. 2010 [cited 2020 May 15];11(70):2079–107. Available from: http://jmlr.org/papers/v11/cawley10a.html