Figures
Abstract
Cytoapheresis (CAP) therapy is widely used in ulcerative colitis (UC) patients with moderate to severe activity in Japan. The aim of this study is to predict the need of operation after CAP therapy of UC patients on an individual level using an artificial neural network system (ANN). Ninety UC patients with moderate to severe activity were treated with CAP. Data on the patients’ demographics, medication, clinical activity index (CAI) and efficacy of CAP were collected. Clinical data were divided into training data group and validation data group and analyzed using ANN to predict individual outcomes. The sensitivity and specificity of predictive expression by ANN were 0.96 and 0.97, respectively. Events of admission, operation, and use of immunomodulator, and efficacy of CAP were significantly correlated to the outcome. Requirement of operation after CAP therapy was successfully predicted by using ANN. This newly established ANN strategy would be used as powerful support of physicians in the clinical practice.
Citation: Takayama T, Okamoto S, Hisamatsu T, Naganuma M, Matsuoka K, Mizuno S, et al. (2015) Computer-Aided Prediction of Long-Term Prognosis of Patients with Ulcerative Colitis after Cytoapheresis Therapy. PLoS ONE 10(6): e0131197. https://doi.org/10.1371/journal.pone.0131197
Editor: Emiko Mizoguchi, Massachusetts General Hospital, UNITED STATES
Received: February 19, 2015; Accepted: May 29, 2015; Published: June 25, 2015
Copyright: © 2015 Takayama et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported all by a KORP project grant from Otsuka Pharmaceutical, Inc. (to TK). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors received funding from Otsuka Pharmaceutical, Inc., though this does not alter their adherence to PLOS ONE policies on sharing data and materials.
Introduction
Ulcerative colitis (UC) is a chronic and recurrent inflammatory disease of the colon. Most these patients are controlled with medication, but some are required total colectomy and frequent admissions. These remarkably disturb the quality of life (QOL) remarkably in many cases.
It is well known that UC is often associated with the increase of peripheral blood granulocytes and monocytes [1]. Accordingly, cytoapheresis therapy is widely used in UC patients with moderate to severe activity in Japan [2]. In this regard, several studies have shown the effect and safety of CAP [2–12]. Most of those studies showed that approximately 60% of patients have clinical response to CAP therapy [2–12].
Our previous study revealed that 1) long-term prognosis of UC patients who achieved remission by CAP therapy is favourable, 2) recurrent patients who previously showed efficacy with the first course of CAP successfully respond to the second course of CAP, and 3) the combination use of immunomodulators (IM) was effective to avoid operation and/or re-admission [13]. As the limitation of the study, we still could not have any suggestion which patients should be treated with IM.
According to the improvement of computer technology, computer-aided therapy is ready to be used in several areas of clinical practice [14–18]. If available computer-aided tool, which predict the outcome and/or prognosis of UC patients after CAP therapy with high accuracy from accumulating data, it is possible to prospectively simulate the patients by editing the each parameters before CAP therapy.
As for the system, we chose artificial neural network (ANN) system, which is a learning system based on a computational technique and has been previously used to simulate the neurological processing ability of the human brain [19]. ANN systems are widely used in various fields, such as the control of operation of the motor at constant speed, and air-conditioners’ controls. ANNs recognise complex patterns between inputs and outputs via the learning process. Once the hidden relationship between input and output has been learned, an ANN can correctly predict output from a given input [14, 15]. Notably, ANN systems use a non-linear expression in formulating the predictive value, therefore they do not suffer from the assessment of a non-linear relation [18]. Since recent study demonstrated that the kinetics of most phenomena in living organisms are non-linear [18], and ANNs can solve those relations, we chose ANNs for the generating the predictive expression. Recent reports showed the superiority of ANN to classical linear methods to solve several clinical problems such as in the prediction of effect of IFN-alpha and ribavirin combination therapy in patients with chronic hepatitis C infection [16, 17, 20–25], survival after percutaneous gastrostomy [26], incidence of metabolic syndrome [27], selection of lung cancer biomarkers [28], mortality risk in burn injury [29], diabetes complications [30] and post-operative bleeding risk [31]. The aims of this study are to develop a new tool that can support daily clinic by predicting the operation after CAP therapy by using clinical data and ANNs.
Results
Response rate and patient backgrounds
Ninety UC patients with moderate to severe activity (55 men and 35 women; mean age, 38·5 years; range of age, 14–77 years) received CAP therapy (Table 1). Of the 90 patients, 44 patients (48.8%) achieved remission, 14 patients (15.6%) had effect, and 32 patients (35.6%) had no effect. According to this result, we decided input and outcomes (Table 2). We divided the entire data in to training data set for generating predictive expressions and validation data set as detailed in method, generated the predictive expressions to predict the requirement of operation after CAP therapy from 13 input factors.
Sensitivity and specificity
To validate the predictive expressions, we analyzed the sensitivity and specificity. The sensitivity was 0.96 and the specificity was 0.97 (Table 3). Both sensitivity and specificity were considered high enough, suggesting that it can be used as support of physicians’ decision in daily clinic.
Past history of admission and operation non-linearly correlated to the outcome
We next attempted to identify factors that critically correlate to the outcome in ANN by using the relative weights of input factors analysis (Fig 1 and S1 Table). This analysis involves determining how the result changes when the test factor (Xtest) is excluded. An Xtest value greater than 1 indicates that it improves the expression, and a value less than 1 indicates that it does not improve the expression. We analysed all expressions and determined the corresponding means and standard deviations. As shown in Fig 1, X13 (history of operation) and X11 (history of admission) were defined as significant predictive factors in every trial.
Data are expressed as the mean±SD for member networks.
Independent four factors were the key factors to predict prospective operation
Given the evidence that events of operation and admission are significant as predictive factors, we deleted those two factors and generated the networks. As shown in Table 4, both sensitivity and specificity were decreased into 0.87 and 0.75 respectively by deleting those factors. Since we have previously reported the importance of use of IM and the effect of CAP to the requirement of operation after CAP therapy [13], we also assessed the predictive value without those 4 factors. Both sensitivity and specificity were dramatically decreased into 0.60 and 0.71, respectively, by deleting 4 factors, suggesting those 4 factors were critically related to the outcome.
Discussion
In this study we successfully predicted the requirement of operation after CAP with high sensitivity and specificity (0.96 and 0.97 respectively). Since we use the non-linear analysis, we could not know the factor which correlate to outcome in linear way. However, using relative weights of input factors analysis, history of operation and history of admission were defined as important factors that influence to the prediction (Fig 1 and S1 Table). Moreover, gathering to our previous report, we defined two more factors which dramatically influence the outcome; use of IM and the effect of CAP.
In this study we set the simple factors as input. Moreover, use of IM were defined as important factor for the outcome, we can easily simulate and know the necessity of use of IM in individual patients from the simulated result.
Patients with UC suffer from repeated remissions and recurrences in refractory course. Especially, surgeon severely impairs the QOL. Accumulating reveal their pathology, new treatments and the effects, though, there are few reports, which show the prediction about prognosis. One of the difficulties in prediction of effect of treatment and/or prognosis is possibly existence of non-linear relation in several factors and the outcome. Most reports in clinical fields use classical linear approach, which could not solve non-linear relations. In contrast, ANNs can identify relationships within a patient’s clinical data that may be overlooked when classical linear approaches are used [18]. Because ANNs are trained using existing data, they are more capable of providing correct answers for individual patients. ANN can predict both linear and non-linear phenomena and can analyse relationships between many variables at different levels [23].
To avoid the bias as much as possible, in this study we randomly divided the all data into training data and validation data for 4 more times and evaluated the accuracy with same way. In all trials, both sensitivity and specificity were similar (S2 Table). We note that, although the ANN is a useful model, there is several limitations. First, the network logic of prediction cannot be broken down into simple elements because ANNs process data in a non-linear way [14, 18, 23, 32]. We used relative weights of input factors analysis to address this issue. Second, ANNs have over-fitting problems that occurs by convergence of expressions. The automatic ANN designer of the software we used avoid this issue by checking on progress of the algorithm using the independent selection set which randomly selected from entire data set.
Both physicians and patients express concern about the risks associated with treatment because it is difficult to predict the outcome at the time decisions are made. Since the increased demand for individualised treatment necessitates new statistics that can be applied in conjunction with ethical and clinical evidence at the individual level, ANNs may have potential economic benefits in that they reduce unnecessary medical treatment. Although our predictive expression does not predict responses completely, our results show that ANN is a valid method for devising individual treatment regimens in the clinical situation. It is well known that 100% prediction accuracy is impossible to achieve because of random error and multiple biases. Also we believe that it is very important to use various methods (including MLR, ANN and/or newly developed techniques [30]) to uncover the relation between multiple factors and multiple outcomes of diseases to realize the tailor-made medicine. As the outcome of CAP treatment and rate of operation may be affected by multiple unknown factors, it is important not only to update data continuously and to acquire clinical data such as the patient’s demographics, medical history, result of endoscopic examination, and laboratory test results, but also to demonstrate that the use of trained ANNs in routine medical practice increases the quality of medical care and reduces costs.
Methods
Patients
One hundred fourteen active UC patients who treated with CAP (granulocytapheresis; GCAP and/or leucocytaphereis; LCAP), and who could be followed-up more than 3 years were historically collected and data from 90 out of the patients were used for further analysis including background, medication and long-term prognosis. For long-term prognosis, we evaluated the rates of operation, re-admission, and use or dose-up of steroid. Clinical efficacy was evaluated by Clinical Activity Index (CAI).
This historical cohort study was conducted at the Keio university hospital. All patients’ data who underwent leukocyte apheresis for active UC from 2001 to 2006 were enrolled. 114 patients with clinically active ulcerative colitis treated with GCAP and/or LCAP once or twice a week. 90 patients’ data which could be followed the long time prognosis with full clinical data (55 men, 35 women; mean age, 36.4 years) were used for analysis. Average observation time was 4.59 years. Clinical efficacy was evaluated by Clinical Activity Index (CAI) according to the Rachmilewitz’s criteria with questionnaire to the patients [33]. We defined CAI less than 4 as remission, and more than 4 points decrease of CAI as effective according to previous reports [34]. This historical cohort study was conducted at Keio University Hospital and the study was approved by the Keio University School of Medicine review board and the permission was obtained. All patients who underwent CAP for UC with moderate to severe activity between 2001 and 2006 were enrolled. Written or oral informed consent was obtained from all patients and/or the parents of patients younger than 20 years of age.
A questionnaire was designed to review the demographic data, including age, gender, weight, height, either GCAP or LCAP, frequency of CAP therapy (once or twice per week), disease extent, duration, clinical type, CAI of pre 1st course of CAP, and medication (use of PSL and/or IM). Outcomes (rates of operation, re-admission, and use or dose-up of steroid) were obtained from the hospital medical records.
Inclusion criteria
Patients inclusion criteria: age between 14 and 77; had endoscopic and histologic diagnosis of UC, not indeterminate colitis; with colonic involvement, had a CAI score more than 5;
Exclusion criteria
Exclusion criteria were patients with evidence of toxic megacolon; with malignancy, with serious concomitant cerebral, pulmonary, cardiac, hepatic or renal disease, and with a history of hypersensitivity reaction during an apheresis.
Cyteapheresis therapy
Patients with moderately active disease were treated in our outpatient clinic, while those with severe disease were treated as in patients. Each patient received five or ten GCAP or LCAP once or twice per week. One GCAP session was 60min at 30ml/min and one LCAP session was 60min at 30–50ml/min. In patients who were receiving corticosteroids at entry, the dose of steroids was to be tapered or discontinued in line with clinical improvement during the CAP.
ANN
To develop the ANN, we used three types of network according to manufacturer’s instruction: multilayer perceptrons (MLPs), radial-basis function networks (RBFs), and linear networks (LINs). Details of the ANN and MLP are provided elsewhere [35]. In brief, a hierarchical ANN consisting of three layers (one input, one hidden, and one output layer) was used to classify the effect as a node in the output layer. MLPs were constructed from three layers (one input, one hidden, and one output layer) to classify effects as a node in the output layer. RBF units respond to the distance of points from the centre. The RBF has a hidden layer of radial units, each of which models a Gaussian response surface. We analyzed the results of 90 patients from multiple centres and formed 100 000 networks.
Training data set and validation data set
We randomly divided the entire dataset into a training dataset (n = 54, for generation of predictive expressions) and validation data set (n = 36). Validation data set was divided into selection set for internal validation and test set for external validation according to manufacturer’s instruction. We used same training data set for generating the predictive expression by using MLR and ANN, and used validation data set to evaluate the accuracy of the expression generated using training data set.
Input factors and outcome
We used the clinical data to determine input factors X1–X13, which were used to predict the outcomes of individual patients using ANN analysis (Table 2). X1 and X2 represented the patient’s age and gender, respectively. X3 represented the type of CAP and X4–X6 represented the disease extent, duration and clinical type, respectively. X7 and X8 represented the CAI before and after CAP respectively. X9 and X10 represented medication (PSL and 6-MP/AZA, respectively). X11–X13 represented the history of admission, PSL, operation, respectively. The outcome was requirement of operation after CAP therapy.
Relative weights of input factors analysis
The detail of relative weights of input factors analysis were described elsewhere [25, 36]. In brief, we analysed relative weights of input factors using a leave-one-input-factor-out (LOFO) in turn with a missing values substitution procedure, which enables predictions to be made in the absence of values for each causal factor, and then assessed effects upon ANN response error. Root mean square error (RMSE) is an estimate of the typical difference between the predicted and actual values of outcomes. The smaller RMSE is the better prediction accuracy of the models. The network original error was accumulated as RMSEoriginal and the network was again used with LOFO data and the error RMSELOFO was estimated. Then, the relative weights of input factors was calculated as RMSELOFO/RMSEoriginal.
Supporting Information
S1 Table. Values of relative weight of input factors analysis.
https://doi.org/10.1371/journal.pone.0131197.s001
(DOCX)
S2 Table. Sensitivity and specificity of 4 other trials.
https://doi.org/10.1371/journal.pone.0131197.s002
(DOCX)
Acknowledgments
We thank Drs. Ogata, Miyoshi, Sujino, Mikami, Inoue, Yajima, and Iwao for critical comments.
Author Contributions
Conceived and designed the experiments: TT SO TK. Performed the experiments: TT. Analyzed the data: TT. Contributed reagents/materials/analysis tools: TT SO T. Hisamatsu MN KM SM RB T. Hibi. Wrote the paper: TT TK.
References
- 1. Saniabadi AR, Hanai H, Fukunaga K, Sawada K, Shima C, Bjarnason I, et al. Therapeutic leukocytapheresis for inflammatory bowel disease. Transfus Apher Sci. 2007;37: 191–200. pmid:17974479
- 2. Hanai H, Watanabe F, Yamada M, Sato Y, Takeuchi K, Iida T, et al. Adsorptive granulocyte and monocyte apheresis versus prednisolone in patients with corticosteroid-dependent moderately severe ulcerative colitis. Digestion. 2004;70: 36–44. pmid:15297776
- 3. Hanai H, Watanabe F, Takeuchi K, Iida T, Yamada M, Iwaoka Y, et al. Leukocyte adsorptive apheresis for the treatment of active ulcerative colitis: a prospective, uncontrolled, pilot study. Clin Gastroenterol Hepatol. 2003;1: 28–35. pmid:15017514
- 4. Suzuki Y, Yoshimura N, Saniabadi AR, Saito Y. Selective granulocyte and monocyte adsorptive apheresis as a first-line treatment for steroid naïve patients with active ulcerative colitis: a prospective uncontrolled study. Dig Dis Sci. 2004;49: 565–571. pmid:15185858
- 5. Naganuma M, Funakoshi S, Sakuraba A, Takagi H, Inoue N, Ogata H, et al. Granulocytapheresis is useful as an alternative therapy in patients with steroid-refractory or-dependent ulcerative colitis. Inflamm Bowel Dis. 2004; 10: 251–257. pmid:15290920
- 6. Yamamoto T, Umegae S, Kitagawa T, Yasuda Y, Yamada Y, Takahashi D, et al. Granulocyte and monocyte adsorptive apheresis in the treatment of active distal ulcerative colitis: a prospective, pilot study. Aliment Pharmacol Ther. 2004;20: 783–792. pmid:15379839
- 7. Kanke K, Nakano M, Hiraishi H, Terano A. Clinical evaluation of granulocyte/monocyte apheresis therapy for active ulcerative colitis. Dig Liver Dis. 2004;36: 811–817. pmid:15646427
- 8. Yamamoto T, Saniabadi AR, Umegae S, Matsumoto K. Impact of selective leukocytapheresis on mucosal inflammation and ulcerative colitis: cytokine profiles and endoscopic findings. Inflamm Bowel Dis. 2006;12: 719–726. pmid:16917227
- 9. Yamamoto T, Saniabadi AR, Maruyama Y, Umegae S, Matsumoto K. Factors affecting clinical and endoscopic efficacies of selective leucocytapheresis for ulcerative colitis. Dig Liver Dis. 2007;39: 626–633. pmid:17532273
- 10. Sakuraba A, Motoya S, Watanabe K, Nishishita M, Kanke K, Matsui T, et al. An open-label prospective randomized multicenter study shows very rapid remission of ulcerative colitis by intensive granulocyte and monocyte adsorptive apheresis as compared with routine weekly treatment. Am J Gastroenterol. 2009;104: 2990–2995. pmid:19724269
- 11. Sands BE, Sandborn WJ, Feagan B, Lofberg R, Hibi T, Wang T, et al. A randomized, double-blind, sham-controlled study of granulocyte/monocyte apheresis for active ulcerative colitis. Gastroenterology. 2008;135: 400–409. pmid:18602921
- 12. Hibi T, Sameshima Y, Sekiguchi Y, Hisatome Y, Maruyama F, Moriwaki K, et al. Treating ulcerative colitis by Adacolumn therapeutic leucocytapheresis: clinical efficacy and safety based on surveillance of 656 patients in 53 centres in Japan. Dig Liver Dis. 2009;41: 570–577. pmid:19211314
- 13. Takayama T, Kanai T, Matsuoka K, Okamoto S, Sujino T, Mikami Y, et al. Long-term prognosis of patients with ulcerative colitis treated with cytapheresis therapy. J Crohns Colitis. 2013;7: e49–54. pmid:22633997
- 14. Baxt WG. Application of artificial neural networks to clinical medicine. Lancet. 1995;346: 1135–1138. pmid:7475607
- 15. Cross SS, Harrison RF, Kennedy RL. Introduction to neural networks. Lancet. 1995;346: 1075–1079. pmid:7564791
- 16. Grossi E, Mancini A, Buscema M. International experience on the use of artificial neural networks in gastroenterology. Dig Liver Dis. 2007;39: 278–285. pmid:17275425
- 17. Pace F, Savarino V. The use of artificial neural network in gastroenterology: the experience of the first 10 years. Eur J Gastroenterol Hepatol. 2007;19: 1043–1045. pmid:17998826
- 18. Grossi E, Buscema M. Introduction to artificial neural networks. Eur J Gastroenterol Hepatol. 2007;19: 1046–1054. pmid:17998827
- 19. Takayama K, Fujikawa M, Obata Y, Morishita M. Neural network based optimization of drug formulations. Adv Drug Deliv Rev. 2003;55: 1217–1231. pmid:12954200
- 20. Haydon GH, Flegg PJ, Blair CS, Brettle RP, Burns SM, Hayes PC. The impact of chronic hepatitis C virus infection on HIV disease and progression in intravenous drug users. Eur J Gastroenterol Hepatol. 1998;10: 485–489. pmid:9855064
- 21. Maiellaro PA, Cozzolongo R, Marino P. Artificial neural networks for the prediction of response to interferon plus ribavirin treatment in patients with chronic hepatitis C. Curr Pharm Des. 2004;10: 2101–2109. pmid:15279549
- 22. Das A, Wong RC. Prediction of outcome in acute lower gastrointestinal hemorrhage: role of artificial neural network. Eur J Gastroenterol Hepatol. 2007;19: 1064–1069. pmid:17998830
- 23. Das A, Ben-Menachem T, Cooper GS, Chak A, Sivak MV Jr., Gonet JA, et al. Prediction of outcome in acute lower-gastrointestinal haemorrhage based on an artificial neural network: internal and external validation of a predictive model. Lancet. 2003;362: 1261–1266. pmid:14575969
- 24. Haydon GH, Jalan R, Ala-Korpela M, Hiltunen Y, Hanley J, Jarvis LM, et al. Prediction of cirrhosis in patients with chronic hepatitis C infection by artificial neural network analysis of virus and clinical factors. J Viral Hepat. 1998;5: 255–264. pmid:9751012
- 25. Takayama T, Ebinuma H, Tada S, Yamagishi Y, Wakabayashi K, Ojiro K, et al. (2011) Prediction of effect of pegylated interferon alpha-2b plus ribavirin combination therapy in patients with chronic hepatitis C infection. PLoS One. 2011 Dec 2. 6(12): e27223. pmid:22164207
- 26. Takayama T, Takayama K, Inoue N, Funakoshi S, Serizawa H, Watanabe N, et al. Prediction of survival and complications after percutaneous endoscopic gastrostomy in an individual by using clinical factors with an artificial neural network system. Eur J Gastroenterol Hepatol. 2009;21: 1279–1285. pmid:19478677
- 27. Hirose H, Takayama T, Hozawa S, Hibi T, Saito I. Prediction of metabolic syndrome by using artificial neural network system based on clinical data including insulin resistance index and serum adiponectin level. Comp Biol Med. 2011;41: 1051–1056.
- 28. Ligor T, Pater Ł, Buszewski B. Application of an artificial neural network model for selection of potential lung cancer biomarkers. J Breath Res. 2015;9: 027106. pmid:25944812
- 29. Stylianou N, Akbarov A, Kontopantelis E, Buchan I, Dunn KW. Mortality risk prediction in burn injury: Comparison of logistic regression with machine learning approaches. Burns. 2015 Apr 27. pii: S0305-4179(15)00095-9.
- 30. Sangi M, Win KT, Shirvani F, Namazi-Rad MR, Shukla N. Applying a novel combination of techniques to develop a predictive model for diabetes complications. PLoS One. 2015 Apr 22;10(4):e0121569. pmid:25902317
- 31. Huang RS, Nedelcu E, Bai Y, Wahed A, Klein K, Tint H, et al. Post-operative bleeding risk stratification in cardiac pulmonary bypass patients using artificial neural network. Ann Clin Lab Sci. 2015;45: 181–186. pmid:25887872
- 32. Baxt WG. Use of an artificial neural network for the diagnosis of myocardial infarction. Ann Intern Med. 1991;115: 843–848. pmid:1952470
- 33. Rachmilewitz D. Coated mesalazine (5-aminosalicylic acid) versus sulphasalazine in the treatment of active ulcerative colitis: a randomised trial. BMJ. 1989;298: 82–86. pmid:2563951
- 34. Ogata H, Matsui T, Nakamura M, Iida M, Takazoe M, Suzuki Y, et al. A randomised dose finding study of oral tacrolimus (FK506) therapy in refractory ulcerative colitis. Gut. 2006;55: 1255–1262. pmid:16484504
- 35. Takayama K, Morva A, Fujikawa M, Hattori Y, Obata Y, Nagai T. Formula optimization of theophylline controlled-release tablet based on artificial neural networks. J Control Release. 2000;68: 175–186. pmid:10925126
- 36. Takagaki K, Arai H, Takayama K. Creation of a tablet database containing several active ingredients and prediction of their pharmaceutical characteristics based on ensemble artificial neural networks. J Pharm Sci. 2010;99: 4201–4214. pmid:20310024