Prediksi Persetujuan Pinjaman Bank Ritel Menggunakan CatBoost dengan Optimasi Hyperparameter Berbasis Optuna dan Analisis Interpretabilitas SHAP
DOI:
https://doi.org/10.30865/jurikom.v13i3.9790Keywords:
CatBoost, Optuna, Bayesian Optimization, Loan Approval, SHAP, LightGBMAbstract
The banking sector faces significant challenges in accurately classifying loan applications, particularly for datasets dominated by categorical features with imbalanced class distribution (71%:29%). This study proposes the application of CatBoost (Categorical Boosting) with Optuna-based hyperparameter optimization a Bayesian optimization framework using Tree-structured Parzen Estimator (TPE) for bank loan approval prediction. Two class imbalance handling scenarios are comparatively evaluated: SMOTE and CatBoost built-in class_weight. Experiments are conducted on a dataset of 381 samples with 15 active features (12 original features and 3 engineered features) using 5-fold stratified cross-validation. Results show LightGBM achieves the best overall performance with Accuracy 93.42%, Precision 94.83%, Recall 96.49%, F1-Score 95.65%, ROC-AUC 0.9215, and MCC 0.8220. CatBoost (SMOTE) achieves competitive performance with AUC-CV 0.9030 and F1 94.02%. SHAP (SHapley Additive exPlanations) analysis identifies Credit_History as the dominant feature (mean|SHAP|=3.2225), followed by ApplicantIncome (0.6896) and Property_Area_Semiurban (0.5222). This study contributes as the first investigation integrating CatBoost+Optuna+XAI-SHAP in retail bank loan approval prediction with dominant categorical features, while providing systematic comparison against LightGBM, XGBoost, and Random Forest.
References
[1] X. Zhang and L. Yu, “Consumer credit risk assessment: A review from the state-of-the-art classification algorithms, data traits, and learning methods,” Expert Syst. Appl., vol. 237, no. PA, Mar. 2024, doi: 10.1016/j.eswa.2023.121484.
[2] S. Xie and T. Shingadia, “Explainable Machine Learning Framework for Predicting Auto Loan Defaults,” Risks, vol. 13, no. 9, Sep. 2025, doi: 10.3390/risks13090172.
[3] H. Ayari, P. R. Guetari, and P. N. Kraïem, “Machine learning powered financial credit scoring: a systematic literature review,” Artif. Intell. Rev., vol. 59, no. 1, Jan. 2026, doi: 10.1007/s10462-025-11416-2.
[4] N. Nguyen and D. Ngo, “Comparative analysis of boosting algorithms for predicting personal default,” Cogent Economics and Finance, vol. 13, no. 1, 2025, doi: 10.1080/23322039.2025.2465971.
[5] X. Cai, W. Dai, and J. Lu, “Loan Default Prediction Based on Machine Learning Approaches,” in Proceedings of the 2025 2nd International Conference on Generative Artificial Intelligence and Information Security, GAIIS 2025, Association for Computing Machinery, Inc, Jun. 2025, pp. 557–564. doi: 10.1145/3728725.3728813.
[6] L. Prokhorenkova, G. Gusev, A. Vorobev, A. V. Dorogush, and A. Gulin, “CatBoost: unbiased boosting with categorical features,” 2018. [Online]. Available: https://github.com/catboost/catboost
[7] A. V. Dorogush, V. Ershov, and A. Gulin, “CatBoost: gradient boosting with categorical features support,” Oct. 2018, [Online]. Available: http://arxiv.org/abs/1810.11363
[8] J. T. Hancock and T. M. Khoshgoftaar, “CatBoost for big data: an interdisciplinary review,” J. Big Data, vol. 7, no. 1, Dec. 2020, doi: 10.1186/s40537-020-00369-8.
[9] T. Anande, S. Alsaadi, and M. Leeson, “Enhanced Modelling Performance with Boosting Ensemble Meta-Learning and Optuna Optimization,” SN Comput. Sci., vol. 6, no. 1, Jan. 2025, doi: 10.1007/s42979-024-03544-3.
[10] K. Hema and M. Arathi, “Optimizing Credit Card Approval Decisions Through Advanced Gradient Boosting Techniques,” 2026.
[11] X. Zhu, Q. Chu, X. Song, P. Hu, and L. Peng, “Explainable prediction of loan default based on machine learning models,” Data Science and Management, vol. 6, no. 3, pp. 123–133, Sep. 2023, doi: 10.1016/j.dsm.2023.04.003.
[12] L. Monje, R. A. Carrasco, and M. Sánchez-Montañés, “Machine Learning XAI for Early Loan Default Prediction,” Comput. Econ., 2025, doi: 10.1007/s10614-025-10962-9.
[13] R. Yang, P. Wang, L. Li, and S. Yong, “An explainable SSA-CatBoost machine learning model and application in corporate credit rating: evidence from China,” Ann. Oper. Res., vol. 354, no. 1, pp. 273–307, 2025, doi: 10.1007/s10479-025-06513-y.
[14] I. Ivanov, B. Toleva, and V. J. Hooper, “A Fast and Effective Approach for Classification Medical Data Sets,” International Journal of Innovative Research and Scientific Studies, vol. 6, no. 3, pp. 545–552, 2023, doi: 10.53894/ijirss.v6i3.1580.
[15] D. N. Mamo et al., “Performance Evaluation and Comparative Analysis of Different Machine Learning Algorithms in Predicting Postnatal Care Utilization: Evidence From the Ethiopian Demographic and Health Survey 2016,” Plos Digital Health, vol. 4, no. 1, p. e0000707, 2025, doi: 10.1371/journal.pdig.0000707.
[16] C. Esposito, G. A. Landrum, N. Schneider, N. Stiefl, and S. Riniker, “GHOST: Adjusting the Decision Threshold to Handle Imbalanced Data in Machine Learning,” J. Chem. Inf. Model., vol. 61, no. 6, pp. 2623–2640, 2021, doi: 10.1021/acs.jcim.1c00160.
[17] Y. Zhao and H. Zhao, “A hybrid machine learning framework by incorporating categorical boosting and manifold learning for financial analysis,” Intelligent Systems with Applications, vol. 25, Mar. 2025, doi: 10.1016/j.iswa.2024.200473.
[18] P. D. Nguyen, N. Tuyen, L. H. Vu, N. N. Nguyen, and T. Q. Nguyen, “Machine Learning Techniques in Chronic Kidney Diseases: A Comparative Study of Classification Model Performance,” Bioinform. Biol. Insights, vol. 19, 2025, doi: 10.1177/11779322251356563.
[19] M. M. Hossain, M. Mamun, A. Munir, M. M. Rahman, and S. H. Chowdhury, “A Secure Bank Loan Prediction System by Bridging Differential Privacy and Explainable Machine Learning,” Electronics (Switzerland), vol. 14, no. 8, Apr. 2025, doi: 10.3390/electronics14081691.
[20] F. Sovrano and F. Vitali, “Perlocution vs Illocution: How Different Interpretations Of the Act Of Explaining Impact On the Evaluation Of Explanations and XAI,” pp. 25–47, 2023, doi: 10.1007/978-3-031-44064-9_2.
[21] F. Ren, X. Zhao, Q. Yang, H. Liao, Y. Zhang, and X. Liu, “A Machine Learning Framework for Predicting Cognitive Impairment in Aging Populations Using Urinary Metal and Demographic Data,” Front. Genet., vol. 16, 2025, doi: 10.3389/fgene.2025.1631228.
[22] Q. Tang, Y. C. Wang, and Y. Luo, “An Interpretable Machine Learning Model With Demographic Variables and Dietary Patterns for ASCVD Identification: From U.S. NHANES 1999–2018,” BMC Med. Inform. Decis. Mak., vol. 25, no. 1, 2025, doi: 10.1186/s12911-025-02937-5.
