Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Machine learning model to predict the adherence of tuberculosis patients experiencing increased levels of liver enzymes in Indonesia

  • Dyah Aryani Perwitasari ,

    Roles Conceptualization, Funding acquisition, Validation, Writing – original draft, Writing – review & editing

    dyah.perwitasari@pharm.uad.ac.id

    Affiliations Faculty of Pharmacy, Universitas Ahmad Dahlan, Yogyakarta, Indonesia, Mahadata, Bioinformatics and Precision Medicine in Pharmaceutical Care (MABIF Centre), Universitas Ahmad Dahlan, Yogyakarta, Indonesia

  • Imaniar Noor Faridah,

    Roles Investigation, Project administration, Writing – review & editing

    Affiliations Faculty of Pharmacy, Universitas Ahmad Dahlan, Yogyakarta, Indonesia, Mahadata, Bioinformatics and Precision Medicine in Pharmaceutical Care (MABIF Centre), Universitas Ahmad Dahlan, Yogyakarta, Indonesia

  • Haafizah Dania,

    Roles Data curation, Formal analysis, Methodology

    Affiliations Faculty of Pharmacy, Universitas Ahmad Dahlan, Yogyakarta, Indonesia, Mahadata, Bioinformatics and Precision Medicine in Pharmaceutical Care (MABIF Centre), Universitas Ahmad Dahlan, Yogyakarta, Indonesia

  • Didik Setiawan,

    Roles Resources, Software, Visualization

    Affiliation Faculty of Pharmacy, Universitas Muhammadiyah Purwokerto, Purwokerto, Indonesia

  • Triantoro Safaria

    Roles Data curation, Methodology, Validation, Writing – review & editing

    Affiliation Faculty of Psychology, Universitas Ahmad Dahlan, Yogyakarta, Indonesia

Abstract

Indonesia is still the second-highest tuberculosis burden country in the world. The antituberculosis adverse drug reaction and adherence may influence the success of treatment. The objective of this study is to define the model for predicting the adherence in tuberculosis patients, based on the increased level of liver enzymes. The longitudinal study using adult tuberculosis patients treated with the first line of antituberculosis was conducted prospectively. The pregnant women and patients with complications such as gout, diabetes mellitus, liver disorder and HIV were excluded. We measured the total bilirubin, aspartate aminotransferase (AST), and alanine aminotransferase (ALT) and adherence over the 2nd, 4th, and 6th months of the treatment. We used the ORANGE Data mining as the machine learning to predict the adherence. We recruited 201 patients, whereas the male participants and less than 61 years old as the dominant participants. Around 33%, 35% and 35% tuberculosis patients experienced the increase level of bilirubine, ALT and AST, respectively. There were significant differences in ALT and AST between good and poor adherence groups, especially in the female patients. The Neural Network and Random Forests were the most suitable models to predict tuberculosis patients’ adherence with good Area Under The Curve (AUC).

Introduction

Based on the Global Tuberculosis Report (2023), Indonesia was in the two-thirds of the world’s tuberculosis (TB) cases in 2022 with other countries, such as: India, China, Philippine, Pakistan, Nigeria, Bangladesh and Democratic Republic of the Congo [1]. The estimation of TB cases reached 1.060.000 cases per year, and the number of deaths due to TB reached 134.000 per year in 2023 [2]. Adherence to the treatment of TB still became a challenge in adults, mostly due to the loss of follow-up. Some social factors may influence the adherence of TB patients, such as stigma, discrimination, health system factors and caregiver factors [3]. However, for the adults and late adolescences, the adverse drug reaction might became the barrier of adherence [4].

Most of the adverse drug reactions experienced by TB patients are related to the metabolism of Isoniazid (INH). INH has many polymorphisms of gene encoding the protein involved in the INH absorption, distribution, metabolism and elimination [5]. Because the complexity of adverse drug reaction mechanism in TB patients, so that education and information to the TB patients, became the important health care in primary health care [6]. The previous review found that the prevalence of adverse drug reactions elated to the first line drugs varied from 8.0% to 85%. The adverse drug reactions were gastrointestinal disturbances, serious hepatotoxicity, ototoxicity, nephrotoxicity, peripheral neuropathy and cutaneous adverse drug reaction. These adverse drug reactions may cause discontinuation of treatment or modification of the regimen [7]. The previous study defined that the incidence of liver injury reached 71.2%. However, the close monitoring and early surveillance should be conducted because the asymptomatic of liver injury reached 32.6% [7,8]. Some factors were related to the incidence of hepatotoxicity due to the antituberculosis, such as age, pregnancy, malnutrition, gender, alcoholism and comorbidities [9].

Adherence is one of the important attributes which is important to reach the effectivity of treatment. The previous study, which was explored the barrier of adherence in tuberculosis patients, found that failure to complete the treatment might results in some adverse outcome. One of the factors related to the failure of complete treatment was adverse drug reactions of antituberculosis [10]. The adverse drug reaction experienced by tuberculosis patients might be worsening their condition, and led the patients’ refusal to their treatment [11]. The importance of education abut TB and TB treatment to the patients is part of the health promotion conducted in the primary health care. The TB patients’ knowledge, mainly about hepatotoxicity effect of TB treatment has significant association with the patients’ adherence [12].

Predicting adherence is important to give intervention to non-adherence group. Machine learning can be used accurately to predict patients; adherence involving many variables [13]. A previous study conducted on Diabetes melitus type 2 patients presented the acceptable area under the curve (AUC) for the machine learning implementation to predict the patients adherence [14].

Our study is aimed to define the model for predicting the adherence barrier in TB patients, based on the hepatotoxicity adverse drug reaction.

Methods

We recruited TB patients in primary health care, hospital and lung hospital in a longitudinal study conducted in Yogyakarta. The inclusion criteria were: adults TB patients and receiving first line tuberculosis (Fixed Dose-Combination) treatments for 6 months. The pregnant women and patients with complications such as gout, diabetes mellitus, liver disorder and HIV were excluded. We measured participants’ adherence using Medication Adherence Rating Scale (MARS). MARS questionnaire has 5 questions related to the TB medications use. It has Likert scale with 5 choices, while the non-adherence options were defined by 1 and the adherence options was defined by 5. The gradual options were defined by 2 to 4, in orderly [12]. The participants were categorized into adherence and non-adherence, using the total score of MARS questionnaire. The adherence group had total score of MARS was 25, and the non-adherence group had total score of MARS was <25. The tuberculosis patients’ knowledge about tuberculosis treatment, adverse drug reaction and treatment for adverse drug reaction was assessed using short questionnaire. The questionnaire was scored based on the correct and wrong answers. The higher score of correct answer, the better knowledge [12].

We collected laboratory results, such as haemoglobin (Hb), total bilirubin, aspartate aminotransferase (AST) and alanine aminotransferase (ALT) over the 2nd, 4th and 6th months of the treatment. We also collected other symptoms which were related to the adverse drug reaction of TB treatment, such as pruritus, nausea and vomiting. We did not use the grading criteria for the adverse drug reaction, because for the laboratory data we used the continuous data. For the patients’ symptoms, it was collected based on the patients’ experienced. Our study has been approved by Ethical Committee of Universitas Ahmad Dahlan, number: 012002010. We conducted the written inform consent procedures to the participant before participating in the study. We started to collect the data on 8 of March 2021 and the last data was collected on 19 January 2022. We analysed the data descriptively, and used the “ORANGE Data Mining” platform to get the model to predict tuberculosis patients’ adherence based on the hepatotoxicity adverse drug reaction. We used MARS score as the dependent variable, and demographic characteristics, patients’ knowledge, levels of Hb, bilirubin, AST, ALT as the independent variables. We implemented kNN, Logistic Regression, Random Forest, Naïve Bayes and Neural Network. We used leave-one out cross-validation techniques to test the performance of the models. The performance of each model is reported based on the area under the curve (AUC), accuracy (Accuration of Clarification: CA), sensitivity (Recall) and specifity (F1). AUC was used to select the best model.

The detailed structure for each model includes kNN (Number of neighbours: 5, Metric: Euclidean, Weight: Uniform), Logistic Regression (Regularization type: Lasso L1, Strength C = 0.001). Random forest (Number of trees: 10, Replicable training, No split subsets smaller than 5), Neural Network (Neurons in the hidden layers: 100,50,20, activation: ReLu, solver: Adam, Regularization α: 0.0001 and Maximum number of iterations: 200).

Separately, we also used SPSS (Version 27.0, IBM Corp) as the software with Student-T test to assess the associations between variables and adherence (significant value < 0.05). The methods in this study were carried out in accordance with relevant guidelines and regulations.

Results

We recruited 201 tuberculosis patients in this study. Table 1 presents the demographic characteristics of the participants. The dominant proportion of characteristics in this study were male (58.7%), patients with age ≤ 60 years old (85.6%), patients with normal BMI (55.7%), patients with a job (54.7%), patients with monthly income between 63.33–190.012 US Dollar (69.2%), patients with last education was up to senior high school (86.1%), and patients without comorbidity (88.1%). As much as 5% of tuberculosis patients got other medications, rather than antituberculosis. The increase of bilirubine, AST and ALT were experienced by 16.4%, 17.4% and 17.4%, respectively. There are three different regimens for antituberculosis treatment. Beside the Fixed Dose Combination (Rifampicin, Isoniazid, Pyrazinamide and Ethambutol), there were two other regiments. The two other regiments showed the 4th month treatment after the two months of initial treatment [15].

thumbnail
Table 1. Socio-demographic and economic characteristics of study participants (n = 201).

https://doi.org/10.1371/journal.pone.0315912.t001

Table 2 presents the association of female tuberculosis patients and increased of liver enzymes both in adherence and non-adherence groups.

thumbnail
Table 2. The results of the association test between laboratory data and TB patients’ adherence in the 2nd, 4th and 6th months.

https://doi.org/10.1371/journal.pone.0315912.t002

Fig 1 describes the adherence and knowledge during the 6 months of antituberculosis treatment. The tuberculosis adherences were not significantly different per month. However, the tuberculosis knowledge was getting better during the treatment.

Fig 2 presents the mean of antituberculosis adverse drug reaction experienced by participants, the average of Hb, bilirubine, ALT and AST during the 6 months of treatment. Similar pattern can be seen in the variables in Fig 2. At the end of the treatment, the means of the parameters increased.

Fig 3 presents the flowchart of ORANGE Data Mining.

Table 3 presents the results of machine learning analysis using some models, such as kNN, Random Forest, Neural Network, Naïve Bayes, and Logistic Regression. The good model can be seen in Random Forest, Neural Network and Naïve Bayes with area under the curve (AUC) value more than 80%. However, the accuration of clarification (CA), F score (Ft) and Recall values of Naïve Bayes were not good.

thumbnail
Table 3. Models of adherence prediction in tuberculosis patients using ORANGE data mining.

https://doi.org/10.1371/journal.pone.0315912.t003

Fig 4 presents the results of ROC analysis among the models. The good AUC can be seen in the Neural Network and Random Forest models.

thumbnail
Fig 4. ROC of Naïve Bayes, Random Forest, Neural Network, kNN and logistic regression.

https://doi.org/10.1371/journal.pone.0315912.g004

Discussion

Our study finds that tuberculosis patients had a good adherence and knowledge, during the 6 months of treatment. Some of them, experienced the increased of liver enzymes at the end of the treatment. Adherence prediction is very important to reach the treatment effectiveness. Many factors may influence the adherence of tuberculosis patients in taking the medicine. Our study also finds that adherence can be predicted by a model including the characteristics demographic and also the level of liver enzymes. The most appropriate model for this prediction is Random Forest and Neural Network.

The good adherence of tuberculosis patients can be influenced by some factors. A systematic review in Indian subcontinent presents that tuberculosis patients adherence can be influenced by various factors which were correlated with the treatment. However, the role of the health providers, including the tuberculosis programmers [16]. The Ministry of Health in Indonesia, also decided that Direct Observed Treatment (DOT) for tuberculosis patients included in the strategy of tuberculosis elimination program in Indonesia [17]. DOTs can support the tuberculosis patients, especially in avoiding the taking of antituberculosis. The role of DOTs in increasing tuberculosis patients’ adherence is significant [18]. In the National Strategy for tuberculosis elimination in Indonesia, the government support the DOT’s role, such as the salary for nurse who can be the DOTs of tuberculosis patients, the rule that DOTs for tuberculosis patients must be from the family or closest neighbor [17]. All of the tuberculosis patients in this study were supported by DOTs. Thus, the tuberculosis patients’ adherence and knowledge about hepatotoxicity adverse drug reaction are good. The previous study, also conducted in Indonesia, described the significant association between tuberculosis patients’ adherence and the hepatotoxicity due to the antituberculosis treatment [12]. Female tuberculosis patients have a significant association with increased of liver enzymes, in both of adherence and non-adherence groups. Our study is similar to a previous study in Taiwan [19]. The female factor predicts the hepatotoxicity adverse drug reaction with other factors, such as old age, immunocompromised disease and duration of treatment.

Using the machine learning to predict adherence in tuberculosis is still rare. However, in other diseases, the use of machine learning in medication adherence prediction can be found in many studies. The previous scoping review about the use of machine learning in predicting medication adherence mentioned that machine learning could be used to predict medication adherence with a good level of accuracy [20]. Some predictors was found during the machine learning analysis, duration level, marital status, income, gender, geographic location, emergency care interventions, age, race, ethnicity, disease severity, comorbidities, medication cost, insurance coverage, substance abuse, medication beliefs, medication knowledge, medication dose, medication frequency, initial medication adherence, and current medications [2123].

Our study finding is online with previous study in adherence prediction. The Neural Networks model is appropriate for adherence prediction [23]. The Neural Network and Random Forest can be used as the model to predict medication adherence, which involving many variables. Our study has limitation that the sample size, because the research conducted during the pandemic era. The baseline parameters of the tuberculosis patients were not collected in this study because we implemented particular inclusion and exclusion criteria and we did the prospective monitoring in this study. However, the strength of this study, was related to the use of machine learning to predict the medication adherence in Indonesia. Also, we followed the patients’ treatment until 6 months, thus we can do the monitoring of adverse drug reaction and liver functions during the treatment. One of the attributes implemented in machine learning are level of liver enzymes and the elevation of the liver enzymes. There are some patients experiencing the elevation of liver enzymes at the end of the treatment. The tuberculosis patients’ knowledge also defined in this study.

The implementation of this study in the clinical practice is to involve the education about hepatotoxicity after antituberculosis treatment, laboratory parameters and characteristic demography as the variables to increase the tuberculosis patients’ adherence. Future studies are suggested to include more attributes related to the psycho-behaviour factors.

Conclusion

This study developed the model for predicting the tuberculosis patients adherence. The Neural Network model was the most suitable model to predict the adherence of tuberculosis patients based on some variables related to the increased of liver enzymes during the treatment.

Acknowledgments

The authors thank to the local government for the study permition.

References

  1. 1. Anonymous. Global Tuberculosis Report [Internet]. WHO. 2023 [cited 2024 Jul 27]. Available from: https://iris.who.int/bitstream/handle/10665/373828/9789240083851-eng.pdf?sequence=1
  2. 2. Anonymous. Press Briefing: Tuberculosis World Day 2023 [Internet]. Ministry of Health, Indonesia. 2023 [cited 2024 Jul 27]. Available from: https://www.youtube.com/watch?v=B3X6A9K0AZk
  3. 3. Leddy AM, Jaganath D, Triasih R, Wobudeya E, Bellotti de Oliveira MC, Sheremeta Y, et al. Social Determinants of Adherence to Treatment for Tuberculosis Infection and Disease Among Children, Adolescents, and Young Adults: A Narrative Review. J Pediatric Infect Dis Soc. 2022 Oct;11(Supplement_3):S79–84. pmid:36314549
  4. 4. Kay AW, Thivalapill N, Skinner D, Dube GS, Dlamini N, Mzileni B, et al. Predictors of suboptimal adherence to isoniazid preventive therapy among adolescents and children living with HIV. PLoS One. 2020;15(12):e0243713. pmid:33332462
  5. 5. Perwitasari DA, Irham LM, Darmawan E, Mulyani UA, Atthobari J. CYP2E1 polymorphism, acetylator profiles and drug-induced liver injury incidence of Indonesian tuberculosis patients. Indian J Tuberc. 2016 Jul;63(3):139–43. pmid:27865233
  6. 6. Perwitasari DA, Atthobari J, Wilffert B. Pharmacogenetics of isoniazid-induced hepatotoxicity. Drug Metab Rev. 2015 May;47(2):222–8. pmid:26095714
  7. 7. Prasad R, Singh A, Gupta N. Adverse drug reactions in tuberculosis and management. Indian J Tuberc. 2019 Oct;66(4):520–32. pmid:31813444
  8. 8. Abbaspour F, Hasannezhad M, Khalili H, SeyedAlinaghi S, Jafari S. Managing Hepatotoxicity Caused by Antituberculosis Drugs: A Comparative Study of Approaches. Arch Iran Med. 2024 Mar;27(3):122–6. pmid:38685836
  9. 9. Golemba AS, Ferreyra FGE, Martearena RE, Achinelli FR, Rovai GB. Drug-induced hepatotoxicity and tuberculosis in a hospital from the Argentinian northeast: cross-sectional study. Medwave. 2015 May;15(4):e6135. pmid:26035138
  10. 10. Appiah MA, Arthur JA, Gborgblorvor D, Asampong E, Kye-Duodu G, Kamau EM, et al. Barriers to tuberculosis treatment adherence in high-burden tuberculosis settings in Ashanti region, Ghana: a qualitative study from patient’s perspective. BMC Public Health. 2023 Jul;23(1):1317. pmid:37430295
  11. 11. Gebreweld FH, Kifle MM, Gebremicheal FE, Simel LL, Gezae MM, Ghebreyesus SS, et al. Factors influencing adherence to tuberculosis treatment in Asmara, Eritrea: a qualitative study. J Health Popul Nutr. 2018 Jan;37(1):1. pmid:29304840
  12. 12. Perwitasari DA, Setiawan D, Nguyen T, Pratiwi A, Rahma Fauziah L, Saebrinah E, et al. Investigating the Relationship between Knowledge and Hepatotoxic Effects with Medication Adherence of TB Patients in Banyumas Regency, Indonesia. Int J Clin Pract. 2022;2022:4044530. pmid:36110263
  13. 13. Koesmahargyo V, Abbas A, Zhang L, Guan L, Feng S, Yadav V, et al. Accuracy of machine learning-based prediction of medication adherence in clinical research. Psychiatry Res. 2020 Dec;294:113558. pmid:33242836
  14. 14. Wu X-W, Yang H-B, Yuan R, Long E-W, Tong R-S. Predictive models of medication non-adherence risks of patients with T2D based on multiple machine learning algorithms. BMJ open diabetes Res care. 2020 Mar;8(1). pmid:32156739
  15. 15. Anonymous. Tuberkulosis, Pedoman Diagnosis dan Penatalaksanaan di Indonesia (Tuberculosis, Diagnosis and Management in Indonesia). Perhimpunan Dokter Paru Indonesia (PDPI); 2021.
  16. 16. Shringarpure K, Gurumurthy M, Sagili KD, Taylor M, Garner P, Tonsing J, et al. Patient adherence to tuberculosis treatment in the Indian subcontinent: systematic review and meta-synthesis of qualitative research. BMJ Open. 2023 May;13(5):e063926. pmid:37142319
  17. 17. Anonymous. National Strategy for Tuberculosis ELimination [Internet]. Jakarta; 2020. Available from: https://tbindonesia.or.id/wp-content/uploads/2021/06/NSP-TB-2020-2024-Ind_Final_-BAHASA.pdf
  18. 18. Bojorquez I, Salazar I, Garfein RS, Cerecer P, Rodwell TC. Surveillance or support: The experience of direct observation during tuberculosis treatment. Glob Public Health. 2018 Jul;13(7):804–18. pmid:27748157
  19. 19. Shu C-C, Lee C-H, Lee M-C, Wang J-Y, Yu C-J, Lee L-N. Hepatotoxicity due to first-line antituberculosis drugs: a five-year experience in a Taiwan medical centre. Int J Tuberc lung Dis Off J Int Union against Tuberc Lung Dis. 2013 Jul;17(7):934–9.
  20. 20. Bohlmann A, Mostafa J, Kumar M. Machine Learning and Medication Adherence: Scoping Review. JMIRx med. 2021 Nov;2(4):e26993. pmid:37725549
  21. 21. Karanasiou GS, Tripoliti EE, Papadopoulos TG, Kalatzis FG, Goletsis Y, Naka KK, et al. Predicting adherence of patients with HF through machine learning techniques. Healthc Technol Lett. 2016 Sep;3(3):165–70. pmid:27733922
  22. 22. Bourdès V, Ferrières J, Amar J, Amelineau E, Bonnevay S, Berlion M, et al. Prediction of persistence of combined evidence-based cardiovascular medications in patients with acute coronary syndrome after hospital discharge using neural networks. Med Biol Eng Comput. 2011 Aug;49(8):947–55. pmid:21598000
  23. 23. Kim N, McCarthy DE, Loh W-Y, Cook JW, Piper ME, Schlam TR, et al. Predictors of adherence to nicotine replacement therapy: Machine learning evidence that perceived need predicts medication use. Drug Alcohol Depend. 2019 Dec;205:107668. pmid:31707266