Credit Card Fraud Detection Using Ensemble Variation: Logistic Regression, Support Vector Classifier and Random Forest

Chlyfen Richard Salibana; Ema Utami

doi:10.30865/jurikom.v12i6.9343

Authors

Chlyfen Richard Salibana Universitas Amikom Yogyakarta, Yogyakarta
Ema Utami Universitas Amikom Yogyakarta, Yogyakarta

DOI:

https://doi.org/10.30865/jurikom.v12i6.9343

Keywords:

Credit Card Fraud Detection, Machine dan Ensemble learning, Random Forest, SMOTE, Imbalanced Data

Abstract

Credit card fraud is a significant threat in the financial industry, causing significant financial losses annually, posing a challenge to both businesses and the financial sector. This requires research and development to identify fraud models that significantly improve over time. The purpose of this research is to develop a machine learning (ML)-based credit card fraud detection system with an ensemble approach to address the challenges of imbalanced data in digital financial transactions. The method used includes four main stages: data collection; SMOTE; Hyperparameter Tuning; and model evaluation. The dataset used is from Kaggle Credit Card Fraud Detection, which has a very low fraud proportion (0.17%). The increase in data volume was carried out using SMOTE on the training data. Three main models (Logistic Regression, Support Vector Classifier, Random Forest) and ensembles (hard and soft voting) were tested with hyperparameter tuning for optimal results. Random Forest performed best with an F1-Score of 0.8482 and an ROC-AUC of 0.9684. This model was able to detect 84% of fraudulent transactions with high precision, surpassing other models in handling imbalanced data. The combined advantages of RF and SMOTE are effective for fraud detection which is relevant for real-time systems in the financial sector.

References

[1] Y. Wang, “A Data Balancing and Ensemble Learning Approach for Credit Card Fraud Detection,” 2025 4th Int. Symp. Comput. Appl. Inf. Technol. ISCAIT 2025, pp. 386–390, 2025, doi: 10.1109/ISCAIT64916.2025.11010591.

[2] E. Ileberi, Y. Sun, and Z. Wang, “Performance Evaluation of Machine Learning Methods for Credit Card Fraud Detection Using SMOTE and AdaBoost,” IEEE Access, vol. 9, pp. 165286–165294, 2021, doi: 10.1109/ACCESS.2021.3134330.

[3] J. Z. Jiang Ping, Jinliang Zhang, “Credit Card Fraud Detection Using Autoencoder Neural Network,” Cornell Univ., vol. 2, no. 1, pp. 35–41, 2019, doi: 10.1016/j.gltp.2021.01.006.

[4] Y. Wang, “Fraud detection based on FS-SMOTE model for credit card,” Highlights Sci. Eng. Technol., vol. 70, pp. 316–323, 2023, doi: 10.54097/hset.v70i.12479.

[5] M. Zhu, Y. Zhang, Y. Gong, C. Xu, and Y. Xiang, “Enhancing Credit Card Fraud Detection: A Neural Network and SMOTE Integrated Approach,” J. Theory Pract. Eng. Sci., vol. 4, no. 02, pp. 23–30, 2024, doi: 10.53469/jtpes.2024.04(02).04.

[6] P. Sundaravadivel, R. A. Isaac, D. Elangovan, D. KrishnaRaj, V. V. L. Rahul, and R. Raja, “Optimizing credit card fraud detection with random forests and SMOTE,” Sci. Rep., vol. 15, no. 1, 2025, doi: 10.1038/s41598-025-00873-y.

[7] R. Marco, N. Aini, and I. M. A. Agastya, “A Hybrid Approach CNN-LSTM Based on Attention Mechanism for Credit Card Fraud Detection,” Int. J. Intell. Eng. Syst., vol. 18, no. 3, pp. 653–664, 2025, doi: 10.22266/ijies2025.0430.45.