Comparison of MLP, AdaBoost, and CatBoost with SMOTE–ENN for Liver Disease Prediction

Muhammad Satrio Kurniawan, Muhamad Akrom

Abstract


Liver disease is a major global health concern, characterized by high prevalence and mortality rates. Therefore, early and accurate diagnosis is essential for improving clinical outcomes and reducing mortality. This study proposes a machine learning-based framework for liver disease prediction using clinical data from the Indian Liver Patient Dataset (ILPD), which exhibits class imbalance. To address this issue, a hybrid resampling technique combining the Synthetic Minority Over-sampling Technique and Edited Nearest Neighbors (SMOTE–ENN) was applied to the training data. This study evaluates and compares the performance of three machine learning models: Multilayer Perceptron (MLP), AdaBoost, and CatBoost. Hyperparameter optimization was performed using GridSearchCV with a stratified cross-validation strategy. Model performance was evaluated using several metrics, including accuracy, precision, recall, F1-score, and the area under the receiver operating characteristic curve (ROC–AUC). ROC–AUC was used as the primary criterion for selecting the best-performing model. The experimental results demonstrate that MLP achieved the best overall performance, with an accuracy of 75% and the highest ROC–AUC value of 0.848, indicating better class discrimination than AdaBoost and CatBoost. These findings suggest that the proposed approach has the potential to improve liver disease prediction performance on imbalanced clinical datasets and highlight the importance of using ROC–AUC as an evaluation metric in medical decision support systems.

Keywords


liver disease prediction; machine learning; SMOTE–ENN; ILPD; ROC–AUC

Full Text:

PDF

References


C. Gan et al., “Liver Diseases: Epidemiology, Causes, Trends and Predictions,” Signal Transduct. Target. Ther., Vol. 10, No. 1, p. 33, Feb. 2025, DOI: 10.1038/s41392-024-02072-z.

R.-H. Lin, “An Intelligent Model for Liver Disease Diagnosis,” Artif. Intell. Med., Vol. 47, No. 1, pp. 53–62, Sep. 2009, DOI: 10.1016/j.artmed.2009.05.005.

S. G. Sepanlou et al., “The Global, Regional, and National Burden of Cirrhosis by Cause in 195 Countries and Territories, 1990–2017: A Systematic Analysis for the Global Burden of Disease Study 2017,” Lancet Gastroenterol. Hepatol., Vol. 5, No. 3, pp. 245–266, Mar. 2020, DOI: 10.1016/S2468-1253(19)30349-8.

E. B. Tapper and N. D. Parikh, “Mortality Due to Cirrhosis and Liver Cancer in the United States, 1999-2016: Observational Study,” BMJ, p. k2817, Jul. 2018, DOI: 10.1136/bmj.k2817.

K. R. Islam et al., “Machine Learning-based Early Prediction of Sepsis using Electronic Health Records: A Systematic Review,” J. Clin. Med., Vol. 12, No. 17, p. 5658, Aug. 2023, DOI: 10.3390/jcm12175658.

H. Sadr et al., “Unveiling the Potential of Artificial Intelligence in Revolutionizing Disease Diagnosis and Prediction: A Comprehensive Review of Machine Learning and Deep Learning Approaches,” Eur. J. Med. Res., Vol. 30, No. 1, p. 418, May 2025, DOI: 10.1186/s40001-025-02680-7.

H. Abualruz et al., “The Role of Artificial Intelligence in Enhancing Triage Decisions in Healthcare Settings: A Systematic revIew,” Applied Nursing Research, Vol. 86, p. 152024, Dec. 2025, DOI: 10.1016/j.apnr.2025.152024.

S. Shen et al., “Mapping the Landscape of Machine Learning in Chronic Disease Management: A Comprehensive Bibliometric Study,” Digit. Health, Vol. 11, May 2025, DOI: 10.1177/20552076251361614.

A. P. Susanto, D. Lyell, B. Widyantoro, S. Berkovsky, and F. Magrabi, “Effects of Machine Learning-based Clinical Decision Support Systems on Decision-Making, Care Delivery, and Patient Outcomes: A Scoping Review,” Journal of the American Medical Informatics Association, Vol. 30, No. 12, pp. 2050–2063, Nov. 2023, DOI: 10.1093/jamia/ocad180.

K. Gupta, N. Jiwani, N. Afreen, and D. D, “Liver Disease Prediction using Machine Learning Classification Techniques,” in 2022 IEEE 11th International Conference on Communication Systems and Network Technologies (CSNT), IEEE, Apr. 2022, pp. 221–226. DOI: 10.1109/CSNT54456.2022.9787574.

I. Altaf, M. A. Butt, and M. Zaman, “Hard Voting Meta Classifier for Disease Diagnosis using Mean Decrease in Impurity for Tree Models,” Review of Computer Engineering Research, Vol. 9, No. 2, pp. 71–82, Jun. 2022, DOI: 10.18488/76.v9i2.3037.

I. R. Hikmah and R. N. Yasa, “Perbandingan Hasil Prediksi Diagnosis pada Indian Liver Patient Dataset (ILPD) dengan Teknik Supervised Learning menggunakan Software Orange,” Jurnal Telematika, Vol. 16, No. 2, pp. 69–76, Jan. 2022, DOI: 10.61769/telematika.v16i2.402.

A. Agung Gde Wahyu Sukma Erlangga, P. Putu Ode Juliantara, and Adnan, “Perbandingan Performa Smote dan Smote-Enn pada Data Tidak Seimbang,” J. RAMATEKNO, Vol. 5, No. 2, pp. 150–158, 2025.

R. Rani et al., “Enhancing Liver Disease Diagnosis with Hybrid SMOTE-ENN Balanced Machine Learning Models—an Empirical Analysis of Indian Patient Liver Disease Datasets,” Front. Med. (Lausanne)., Vol. 12, May 2025, DOI: 10.3389/fmed.2025.1502749.

B. Venkata Ramana, M. Surendra Prasad Babu, N. B. Venkateswarlu, and A. Professor, “A Critical Comparative Study of Liver Patients from USA and INDIA: An Exploratory Analysis,” 2012. [Online]. Available: www.IJCSI.org

J. M. Kernbach and V. E. Staartjes, “Foundations of Machine Learning-based Clinical Prediction Modeling: Part II—Generalization and Overfitting,” 2022, pp. 15–21. DOI: 10.1007/978-3-030-85292-4_3.

E. Yalçın, T. K. Koç, S. Aslan, S. C. Demir, S. Aykut, and M. Sucu, “Hyperparameter Optimization based Machine Learning Approach for Early Diagnosis of Fetal Genetic Disorders,” Discover Computing, Vol. 28, No. 1, p. 274, Nov. 2025, DOI: 10.1007/s10791-025-09815-8.

X. Chen and J. C. Jeong, “Enhanced Recursive Feature Elimination,” in Sixth International Conference on Machine Learning and Applications (ICMLA 2007), IEEE, Dec. 2007, pp. 429–435. DOI: 10.1109/ICMLA.2007.35.

X. Zhou, H. Wen, Y. Zhang, J. Xu, and W. Zhang, “Landslide Susceptibility Mapping using Hybrid Random Forest with GeoDetector and RFE for Factor Optimization,” Geoscience Frontiers, Vol. 12, No. 5, p. 101211, Sep. 2021, DOI: 10.1016/j.gsf.2021.101211.

F. Dashti, A. Ghaffari, A. Seyfollahi, and B. Arasteh, “A Self-Predictive Diagnosis System of Liver Failure based on Multilayer Neural Networks,” Multimed. Tools Appl., Vol. 83, No. 36, pp. 83769–83788, Mar. 2024, DOI: 10.1007/s11042-024-18945-y.

A. Singh, S. Kushwaha, M. Alarfaj, and M. Singh, “Comprehensive Overview of Backpropagation Algorithm for Digital Image Denoising,” Electronics (Basel)., Vol. 11, No. 10, p. 1590, May 2022, DOI: 10.3390/electronics11101590.

R. Amin, R. Yasmin, S. Ruhi, M. H. Rahman, and M. S. Reza, “Prediction of Chronic Liver Disease Patients using Integrated Projection based Statistical Feature Extraction with Machine Learning Algorithms,” Inform. Med. Unlocked, Vol. 36, p. 101155, 2023, DOI: 10.1016/j.imu.2022.101155.

Y. Wang and L. Feng, “An Adaptive Boosting Algorithm based on Weighted Feature Selection and Category Classification Confidence,” Applied Intelligence, Vol. 51, No. 10, pp. 6837–6858, Oct. 2021, DOI: 10.1007/s10489-020-02184-3.

Q. Sui and S. K. Ghosh, “Active Learning for Stacking and AdaBoost-Related Models,” Stats (Basel)., Vol. 7, No. 1, pp. 110–137, Jan. 2024, DOI: 10.3390/stats7010008.

M. Bereta, “Regularization of Boosted Decision Stumps using Tabu Search,” Appl. Soft Comput., Vol. 79, pp. 424–438, Jun. 2019, DOI: 10.1016/j.asoc.2019.04.003.

J. Hatwell, M. M. Gaber, and R. M. Atif Azad, “Ada-WHIPS: Explaining AdaBoost Classification with Applications in the Health Sciences,” BMC Med. Inform. Decis. Mak., Vol. 20, No. 1, p. 250, Dec. 2020, DOI: 10.1186/s12911-020-01201-2.

L. Prokhorenkova, G. Gusev, A. Vorobev, A. V. Dorogush, and A. Gulin, “CatBoost: Unbiased Boosting with Categorical Features,” Jan. 2019.

S. Ben Jabeur, C. Gharib, S. Mefteh-Wali, and W. Ben Arfi, “CatBoost Model and Artificial Intelligence Techniques for Corporate Failure Prediction,” Technol. Forecast. Soc. Change, Vol. 166, p. 120658, May 2021, DOI: 10.1016/j.techfore.2021.120658.

S. M. Ganie, P. K. Dutta Pramanik, and Z. Zhao, “Improved Liver Disease Prediction from Clinical Data through an Evaluation of Ensemble Learning Approaches,” BMC Med. Inform. Decis. Mak., Vol. 24, No. 1, p. 160, Jun. 2024, DOI: 10.1186/s12911-024-02550-y.

D. El-Shahat, A. Tolba, M. Abouhawwash, and M. Abdel-Basset, “Machine Learning and Deep Learning Models based Grid Search Cross Validation for Short-Term Solar Irradiance Forecasting,” J. Big Data, Vol. 11, No. 1, p. 134, Sep. 2024, DOI: 10.1186/s40537-024-00991-w.

S. Bates, T. Hastie, and R. Tibshirani, “Cross-Validation: What Does it Estimate and How Well Does It do It?,” Jul. 2022, DOI: 10.1080/01621459.2023.2197686.

E. Richardson, R. Trevizani, J. A. Greenbaum, H. Carter, M. Nielsen, and B. Peters, “The Receiver Operating Characteristic Curve Accurately Assesses Imbalanced Datasets,” Patterns, Vol. 5, No. 6, p. 100994, Jun. 2024, DOI: 10.1016/j.patter.2024.100994.

K. M. Sujon, R. Hassan, K. Choi, and M. A. Samad, “Accuracy, Precision, Recall, f1-Score, or MCC? Empirical Evidence from Advanced Statistics, ML, and XAI for Evaluating Business Predictive Models,” J. Big Data, Vol. 12, No. 1, p. 268, Dec. 2025, DOI: 10.1186/s40537-025-01313-4.

O. Rainio, J. Teuho, and R. Klén, “Evaluation Metrics and Statistical Tests for Machine Learning,” SCI. Rep., Vol. 14, No. 1, p. 6086, Mar. 2024, Doi: 10.1038/s41598-024-56706-x.

D. M. W. Powers, “Evaluation: from Precision, Recall and F-Measure to ROC, Informedness, Markedness and Correlation,” Oct. 2020.

A. P. Bradley, “The use of the Area under the ROC Curve in the Evaluation of Machine Learning Algorithms,” Pattern Recognit., Vol. 30, No. 7, pp. 1145–1159, Jul. 1997, DOI: 10.1016/S0031-3203(96)00142-2.




DOI: https://doi.org/10.32520/stmsi.v15i11.7034

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.