http://orcid.org/0000-0001-9473-546X
Figures
Abstract
Background
Most recently, an emerging theme in the field of tumor immunology predominates: chimeric antigen receptor (CAR) therapy in treating solid tumors. The number of related preclinical trials was surging. However, an evaluation of the effects of preclinical studies remained absent. Hence, a meta-analysis was conducted on the efficacy of CAR in animal models for solid tumors.
Methods
The authors searched PubMed/Medline, Embase, and Google scholar up to April 2017. HR for survival was extracted based on the survival curve. The authors used fixed effect models to combine the results of all the trials. Heterogeneity was assessed by I-square statistic. Quality assessment was conducted following the Stroke Therapy Academic Industry Roundtable standard. Publication bias was assessed using Egger's test.
Results
Eleven trials were included, including 54 experiments with a total of 362 animals involved. CAR immunotherapy significantly improved the survival of animals (HR: 0.25, 95% CI: 0.13–0.37, P < 0.001). The quality assessment revealed that no study reported whether allocation concealment and blinded outcome assessment were conducted, and only five studies implemented randomization.
Citation: Wu Y, Xu R, Jia K, Shi H (2017) The efficacy of chimeric antigen receptor (CAR) immunotherapy in animal models for solid tumors: A systematic review and meta-analysis. PLoS ONE 12(11): e0187902. https://doi.org/10.1371/journal.pone.0187902
Editor: Salvatore V. Pizzo, Duke University School of Medicine, UNITED STATES
Received: May 8, 2017; Accepted: October 28, 2017; Published: November 15, 2017
Copyright: © 2017 Wu et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Cancer is one of the leading causes of death around the world[1]. However, the leaps and bounds of chimeric antigen receptor (CAR) immunotherapy is changing such a situation. CARs can target specific antigen of tumor cells, therefore activating T cells and inducing robust antitumor effects. In the field of hematologic malignancies, the surging of CAR immunotherapy has demonstrated remarkable success[2].
Compared with hematologic malignancies, solid tumors remained a significant challenge to CAR-T immunotherapy. So far, an increasing number of preclinical trials have focused on solid tumors, targeting at carcinoembryonic antigen (CEA), interleukin 13 receptor (IL-13R), human epidermal growth factor receptor 2 (HER2), fibroblast activation protein (FAP) and so on. At present, more and more scientists are devoted to searching for potential targets.
Most recently, publications on preclinical trials of solid tumors have abounded, and relevant phase I or phase I/II clinical trials have just been initiated[3]. However, an evaluation of the effects of preclinical studies remains absent. Which target of CARs will induce better or worse outcomes? What is the role of CARs in treating different types of cancer? Are the outcomes reliable in preclinical studies? These questions still remain unknown.
Here, we conducted a meta-analysis of animal models in order to evaluate the potential value of CAR-T therapy for solid tumors based on the preclinical trials. Also, we attempted to explore the experimental design features of current studies in order to point out the possible shortcomings of the preclinical experimental designs and the future clinical trials.
Materials and methods
Literature search
We search trials among PubMed/Medline, Embase, and Google scholar up to April 2017. Key words included "chimeric antigen receptor", "CAR", "solid tumor", "GBM", "lung cancer", "colorectal cancer", "pancreatic cancer", "prostate cancer", "ovarian cancer", "breast cancer", "preclinical". All additional studies of potential interest were retrieved for further analysis. All publications were written in English.
All the related publications were screened independently by two reviewers (YW and RX) to identify studies that met the inclusion criteria (below).
Inclusion and exclusion criteria
Eligible studies should meet these standards. (1) Participant: the trials be conducted in animal models. (2) Intervention: CAR immunotherapy. (3) Control: the researchers should make at least one comparison between CAR T cell group and NT T cell group or untreated group. (4) Outcome: the survival curve should be reported. For trials that compared CAR and control group in more than one tumor model, the survival curve of each tumor model was included. If there was a disagreement between the two reviews, another reviewer (HS) reviewed it and a final consensus was reached.
Data extraction
Three reviewers (YW, RX, and KJ) independently extracted data with a extraction form, and we checked all the data very carefully. We identified all the studies with the first author and the year of publication. We extracted the following information from the reports: first-author; year of publication; animal species; age; experimental group; control group; animal number; type of model; target; the generation of CAR; the type of cancer; the Kaplan-Meier survival curve. When the data was reported merely in image format, we attempted to contact the correspondence author of the publication to ask for the original data. If there was no reply or no useful information, Engauge Digitizer software V9.7 for macOS 10.12.3 was used to measure graphically the data as presented. When different CAR T cells were evaluated in multiple groups in one publication, the data in each group were extracted as an individual experiment for analysis. If the efficacy of different doses of CAR T cells were evaluated, all the valid hazard ratios for survival would be extracted.
Quality assessment
A latest 2009 version of the initial Stroke Therapy Academic Industry Roundtable (STAIR) standard was applied to assess the quality of the studies[4]. It includes: (1) sample-size calculation; (2) inclusion and exclusion criteria; (3) randomization; (4) allocation concealment; (5) reporting of animals excluded from analysis; (6) blinded assessment of outcome; (7) reporting potential conflicts of interest and study funding. Three reviews (YW, RX, and KJ) assessed the qualities in all included studies and presented as a "yes" or "no". The "unclear" means the quality was not clear. The image was made with Numbers V4.1 software.
Data analysis
Statistical analysis, forest plots and detection of publication bias were carried out with Stata SE 14.1 for macOS 10.12.3 (StataCorp, College Station, TX, USA). The data of survival was extracted by Engauge Digitizer software V9.7 for macOS 10.12.3. The ln(HR) value and se(ln(HR)) value were calculated based on an Excel spreadsheet developed by Matthew Sydes and Jayne Tierney of the MRC Clinical Trials Unit, London, the United Kingdom[5, 6]. P≤0.05 was used to indicate a statistical significance. Heterogeneity was considered low, moderate or high for I- squared values <25%, 25–50% and >50%[7]. A fixed effect model would be used if the heterogeneity was low or moderate. If the heterogeneity was high, the analysis would be performed with a random effects model. Publication bias was assessed by Egger's test. If the p value is more than 0.1 in the Egger's test, it was considered insignificant for publication bias[8].
Results
Literature selection and study characteristics
The preliminary literature search included 3,199 relevant publications (S1 Fig). Of these, 3,157 studies contained commentaries, editorials, study protocols, and irrelevant themes. And they were excluded afterwards based on their titles or abstracts. The remaining 32 studies were reviewed in full text. After removing duplicated literatures, literatures without usable data and some ineligible literatures, we identified articles eligible for further review by screening texts. We identified fifteen trials including 54 experiments with a total of 362 animals involved[9–23]. The whole research process can be seen in the S1 Fig. All the studies reported the survival curve. The characteristics among these studies varied considerably. Main characteristics of those trials are available in the Table 1.
Meta-analyses
The meta-analysis on survival time indicated that CAR immunotherapy was associated with a significantly prolonged survival (HR: 0.25, 95% CI: 0.13–0.37, P < 0.001) (Fig 1). And the heterogeneity was low (I-squared = 0.0%). We then conducted a subgroup analyses of year of publication, generation of CAR, type of cancer, type of animal model, and target (Table 2). The subgroup analysis manifested that, among all types of cancers, CAR immunotherapy was most efficient in ovarian cancer animals (HR: 0.170, 95% CI: -0.147–0.488). The subgroup analysis by target showed that HER2-CAR-T therapy is most efficient (HR: 0.203, 95% CI: -0.148–0.554). Also, a comparison between immunocompromised and immunocompetent animal models was also performed. Notably, no significant difference was observed between immunocompromised and immunocompetent animals (P = 0.712). This finding could be due to the lack of statistical power.
Quality assessments and risk of bias
The quality of the seventeen studies was assessed by the STAIR tool (Fig 2 and Table 3). According to the Egger's test, the P value was 0.013, which manifests that the publication bias did not exist.
This meta-analysis revealed that many common practices including randomization were not implemented in most of the trials. None of the published studies reported whether blinded assessment of outcome was carried out. Whether there existed any expectations or personal preferences was unclear. This made it difficult to find out that some outcome of experiments was in fact invalid.
Discussion
To the best of our knowledge, this is the first meta-analysis which assessed efficacy of chimeric antigen receptor (CAR) immunotherapy in animal models for solid tumors. Publications on preclinical trials of solid tumors have abounded recently. Also, phase I and phase I/II clinical trials of CAR on solid tumors have just been initiated. The aim of this study is to assess the potential value of CAR-T therapy for solid tumors based on the preclinical trials.
Main findings
Based on our analyses, CAR-T immunotherapy proved to generate a robust antitumor efficacy in animal models. The quality assessment manifested that there were some defects in the field of CAR preclinical research. No trials reported whether blinded outcome assessment or allocation concealment was performed. Only five studies implemented randomization, which may have induced uncertainties.
Our subgroup analysis illustrated that CAR immunotherapy was most efficient in ovarian cancer animals, and HER2-CAR-T cell therapy was demonstrated to be more effective. Inserestingly, between immunocompromised and immunocompetent animals models, no significant difference of efficacy was observed. This finding could be due to a lack of statistical power.
Agreement/disagreement with previous study
To date, there is no meta-analysis evaluating CAR immunotherapy in animal models. A meta-analysis tended to evaluate the efficiency of CD19 CAR T cells for treatment of B cell malignancies [24]. Base on results of that meta-analysis, the number of CD19-CAR T cells have positive correlations with the clinical efficiency. Also, a systematic review had a discussion about the the increasing number of CAR trials[25].
Limitations
This study does have some limitations. Firstly, all the preclinical trials evaluating CARs have comparatively small group sizes, leading to some uncertainties of outcomes. Secondly, doses of CAR-T cells varies in different experiments, ranging from 5×10^3 to 1×10^7. Therefore, some of the comparisons between CARs and control groups may be invalid, although we have excluded the invalid comparisons according to our criteria. Thirdly, we used Engauge Digitizer software in order to extract data from the survival curve. Minor distortion of effect sizes were likely to occurred. Fourth, the meta-analysis didn't directly address some elements, including duration of trial or selection of model.
Conclusions
CAR immunotherapy appeared to inhibit the growth of solid tumors in animal models. CAR therapy may be a potential clinical strategy in treating solid tumors.
Acknowledgments
We thanks the data provided by the authors of included trials. We acknowledged Bei Qian, Keren Jia, Defu He, and Xiangyu Cao who helped us in methodology.
References
- 1. Siegel RL, Miller KD, Jemal A. Cancer statistics, 2016. CA Cancer J Clin. 2016;66(1):7–30. pmid:26742998.
- 2. Johnson LA, June CH. Driving gene-engineered T cell immunotherapy of cancer. Cell Res. 2017;27(1):38–58. pmid:28025979
- 3. Wu Y, Jiang M. The revolution of lung cancer treatment: from vaccines, to immune checkpoint inhibitors, to chimeric antigen receptor T therapy. Biotarget. 2017;1:7.
- 4. Fisher M, Feuerstein G, Howells DW, Hurn PD, Kent TA, Savitz SI, et al. Update of the stroke therapy academic industry roundtable preclinical recommendations. Stroke. 2009;40(6):2244–50. pmid:19246690
- 5. Parmar MKB, Torri V, Stewart LA. Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. Statistics in Medicine. 1998;17(24):2815–34. pmid:9921604
- 6. Williamson PR, Smith CT, Hutton JL, Marson AG. Aggregate data meta-analysis with time-to-event outcomes. Statistics in Medicine. 2002;21(22):3337–51. pmid:12407676
- 7. Dersimonian R, Laird N. Meta-analysis in clinical trials. Controlled Clinical Trials. 1986;7(3):177–88. pmid:3802833
- 8. Vandenbroucke JP. Bias in meta-analysis detected by a simple, graphical test. Experts' views are still needed. BMJ (Clinical research ed). 1997;315(7109):629.
- 9. Ahmed N, Salsman VS, Yvon E, Louis CU, Perlaky L, Wels WS, et al. Immunotherapy for Osteosarcoma: Genetic Modification of T cells Overcomes Low Levels of Tumor Antigen Expression. Molecular Therapy. 2009;17(10):1779. pmid:19532139
- 10. Choi BD, Suryadevara CM, Gedeon PC, Nd HJ, Sanchezperez L, Bigner DD, et al. Intracerebral delivery of a third generation EGFRvIII-specific chimeric antigen receptor is efficacious against human glioma. Journal of Clinical Neuroscience. 2014;21(1):189–90. pmid:24054399
- 11. Chow KK, Naik S, Kakarla S, Brawley VS, Shaffer DR, Yi Z, et al. T cells redirected to EphA2 for the immunotherapy of glioblastoma. Molecular Therapy. 2013;21(3):629–37. pmid:23070117
- 12. Kakarla S, Chow KK, Mata M, Shaffer DR, Song XT, Wu MF, et al. Antitumor effects of chimeric receptor engineered human T cells directed to tumor stroma. Molecular Therapy. 2013;21(8):1611. pmid:23732988
- 13. Kong S, Sengupta S, Tyler B, Bais AJ, Ma Q, Doucette S, et al. Suppression of human glioma xenografts with second-generation IL13R-specific chimeric antigen receptor-modified T cells. Clinical Cancer Research An Official Journal of the American Association for Cancer Research. 2012;18(21):5949. pmid:22966020
- 14. Krebs S, Chow KK, Yi Z, Rodriguez-Cruz T, Hegde M, Gerken C, et al. T cells redirected to interleukin-13Ralpha2 with interleukin-13 mutein—chimeric antigen receptors have anti-glioma activity but also recognize interleukin-13Ralpha1. Cytotherapy. 2014;16(8):1121–31. pmid:24841514
- 15. Maliar A, Servais C, Waks T, Chmielewski M, Lavy R, Altevogt P, et al. Redirected T Cells That Target Pancreatic Adenocarcinoma Antigens Eliminate Tumors and Metastases in Mice. Gastroenterology. 2012;143(5):1375–84. pmid:22819865
- 16. Ohno M, Ohkuri T, Kosaka A, Tanahashi K, June CH, Natsume A, et al. Expression of miR-17-92 enhances anti-tumor activity of T-cells transduced with the anti-EGFRvIII chimeric antigen receptor in mice bearing human GBM xenografts. Journal for ImmunoTherapy of Cancer. 2013;1(1):21.
- 17. Hong H, Brown CE, Ostberg JR, Priceman SJ, Chang WC, Weng L, et al. L1 Cell Adhesion Molecule-Specific Chimeric Antigen Receptor-Redirected Human T Cells Exhibit Specific and Efficient Antitumor Activity against Human Ovarian Cancer in Mice. Plos One. 2016;11(1):e0146885. pmid:26761817
- 18. Zhou X, Li J, Wang Z, Chen Z, Qiu J, Zhang Y, et al. Cellular Immunotherapy for Carcinoma Using Genetically Modified EGFR-Specific T Lymphocytes. Neoplasia. 2013;15(5):544. pmid:23633926
- 19. Mohammed S, Sukumaran S, Bajgain P, Watanabe N, Heslop HE, Rooney CM, et al. Improving Chimeric Antigen Receptor-Modified T Cell Function by Reversing the Immunosuppressive Tumor Microenvironment of Pancreatic Cancer. Molecular Therapy the Journal of the American Society of Gene Therapy. 2017;25(1):249. pmid:28129119
- 20. Shiina S, Ohno M, Ohka F, Kuramitsu S, Yamamichi A, Kato A, et al. CAR T cells targeting podoplanin reduce orthotopic glioblastomas in mouse brains. Cancer Immunol Res. 2016.
- 21. Slaney CY, Von SB, Davenport AJ, Beavis PA, Westwood JA, Mardiana S, et al. Dual-specific Chimeric Antigen Receptor T Cells and an Indirect Vaccine Eradicate a Variety of Large Solid Tumors in an Immunocompetent, Self-antigen Setting. Clinical Cancer Research An Official Journal of the American Association for Cancer Research. 2016.
- 22. Wu MR, Zhang T, Demars LR, Sentman CL. B7H6-specific chimeric antigen receptors lead to tumor elimination and host antitumor immunity. Gene Therapy. 2015;22(8):675–84. pmid:25830550
- 23. Zhu X, Prasad S, Gaedicke S, Hettich M, Firat E, Niedermann G. Patient-derived glioblastoma stem cells are killed by CD133-specific CAR T cells but induce the T cell aging marker CD57. Oncotarget. 2015;6(1):171–84. pmid:25426558
- 24. Zhang T, Cao L, Xie J, Shi N, Zhang Z, Luo Z, et al. Efficiency of CD19 chimeric antigen receptor-modified T cells for treatment of B cell malignancies in phase I clinical trials: a meta-analysis. Oncotarget. 2015;6(32):33961–71. pmid:26376680
- 25. Holzinger A, Barden M, Abken H. The growing world of CAR T cell trials: a systematic review. Cancer Immunol Immunother. 2016;65(12):1433–50. pmid:27613725.