Comparative Study of Naive Bayes and SVM for E-Commerce Sentiment Classification on Shopee
DOI:
https://doi.org/10.30865/ijics.v10i2.9740Keywords:
Data Mining, Sentiment Analysis, Naive Bayes, Support Vector Machine, Text Mining, ShopeeAbstract
This study compares the performance of Naive Bayes and Support Vector Machine (SVM) for sentiment classification of men’s shirt product reviews on Shopee. A dataset of 500 reviews was collected via web scraping and processed through case folding, tokenizing, stopword removal, and stemming, followed by TF-IDF feature extraction. The data was split at an 80:20 ratio and evaluated using accuracy, precision, recall, and F1-score. The main contribution of this study is demonstrating that despite both algorithms achieving equal overall accuracy of 93%, SVM outperforms Naive Bayes in detecting negative sentiment on a class-imbalanced dataset, with SVM attaining a negative class recall of 0.87 and F1-score of 0.88 compared to 0.80 and 0.87 for Naive Bayes. These findings provide practical guidance for selecting an appropriate classifier in imbalanced e-commerce review classification tasks.
References
[1] Puteri, G. A., Trisnawarman, D., & Budiyantara, A, "Comparison of Shopee and Tokopedia user sentiment using Naive," Jurnal Ilmu Komputer dan Sistem Informasi, vol. 13, no. 1, 2025.
[2] Wibisono, A. C., Nadira, T. S., & Sutabri, T, "Customer sentiment analysis on the Shopee platform using the Naive Bayes method," Nusantara Journal of Multidisciplinary Science, 2024.
[3] Andriani, N., Ma'arif, M. S., Amalia, I. N., & Rozikin, C, "Sentiment analysis of Shopee application users using Naive Bayes Classifier," Jurnal Informatika dan Teknik Elektro Terapan, vol. 12, no. 1, 2023. https://journal.eng.unila.ac.id/index.php/jitet/article/view/3631
[4] Fauzi, M. A., & Arifin, A. Z, "Text mining for sentiment analysis of marketplace application reviews using machine learning," Jurnal RESTI, vol. 5, no. 3, pp. 512-519, 2021.
[5] Halim, F., & Wicaksono, S. A, "Implementation of TF-IDF and SVM for sentiment classification of e-commerce product reviews," Jurnal Teknologi dan Sistem Komputer, vol. 11, no. 2, pp. 89-97, 2023.
[6] Pratama, D. A., & Nugroho, A, "Sentiment analysis of marketplace users using the Naive Bayes algorithm based on text mining," Jurnal Ilmiah Informatika Komputer, vol. 26, no. 3, pp. 203-212, 2021.
[7] Rahman, A., & Prasetyo, E, "Comparison of SVM and Naive Bayes methods in sentiment analysis of marketplace reviews," Jurnal Teknologi Informasi dan Ilmu Komputer (JTIIK), vol. 9, no. 4, pp. 811-818, 2022.
[8] Sanjaya, T. P. R., Fauzi, A., & Masruriyah, A. F. N, "Sentiment analysis of reviews on Shopee e-commerce using Naive Bayes and SVM algorithms," INFOTECH Journal, vol. 4, no. 1, 2023.
[9] Riki, A., Dameria, E., Hermawan, A., Junaedi, J., & Kurnia, Y, "Optimizing sentiment classification of e-commerce product reviews: A comparative study of Naive Bayes and SVM with SMO," JUITA: Jurnal Informatika, vol. 13, no. 3, pp. 287-295, 2025.
[10] Jannah, N. Z. B., & Kusnawi, K, "Comparison of Naive Bayes and SVM in sentiment analysis of product reviews on marketplaces," Sinkron: Jurnal dan Penelitian Teknik Informatika, vol. 8, no. 2, pp. 727-733, 2024.
[11] Nabiilah, N., Rohimah, S., & Loka, S. K. P, "Analyzing customer sentiment towards marketplace reviews using machine learning algorithms," IJATIS: Indonesian Journal of Applied Technology and Innovation Science, vol. 3, no. 1, 2024.
[12] R. Rismansyah, "Sentiment analysis of Shopee reviews on the Google Play Store using the Naive Bayes algorithm," JEIS: Jurnal Elektro dan Informatika Swadharma, vol. 5, no. 1, 2025.
[13] Angreyani, J., & Pernando, Y, "Sentiment analysis of Shopee e-commerce reviews using the Naive Bayes algorithm," J-Com: Jurnal Informatika, vol. 5, no. 1, 2024. https://jurnal.stmikroyal.ac.id/index.php/j-com/article/view/3570
[14] Bahtiar, S. A. H., Dewa, C. K., & Luthfi, A, "Comparison of Naive Bayes and Logistic Regression in sentiment analysis," Journal of Information Systems and Informatics, vol. 5, no. 2, 2023. https://journal-isi.org/index.php/isi/article/view/539
[15] Yulianeu, A., & Setiawan, R, "Sentiment analysis on product reviews from Shopee marketplace using the Naive Bayes classifier," Lontar Komputer, vol. 13, no. 2, 2022.
[16] Al Fachrozi, M., & Tania, K. D, "Comparison of Naive Bayes, SVM, K-NN, Decision Tree, and Random Forest in Sentiment Analysis Based on SeaBank Application Aspects," JURTEKSI, vol. XII, no. 1, pp. 69-80, 2025.
[17] Fatihaturrahmah, A., & Tania, K. D, "Review: A Hybrid Approach of Aspect-Based Sentiment Analysis and Knowledge Extraction for Evaluating Security Perceptions in Digital Payment Applications," Scientific Journal of Informatics, vol. 12, no. 4, 2025.
[18] Ardhani, D. A., & Tania, K. D, "Knowledge discovery on e-commerce customer churn using interpretable machine learning: A comparative study of SHAP-based classifiers," Journal of Applied Informatics and Computing, vol. 9, no. 5, pp. 2695-2702, 2025.
[19] Ayuningtiyas, P., Tania, K. D, "Sentiment-Based Knowledge Discovery on the iPusnas Application Using Machine Learning and Deep Learning Methods," Journal of Applied Informatics and Computing, vol. 9, no. 5, 2025.
[20] Depari, A. D. S., Tania, K. D., & Sevtiyuni, P. E, "Application of Machine Learning Methods and SMOTE Technique for Diabetes Prediction," Jurnal Sistem Komputer dan Informatika, vol. 7, no. 2, 2025.
