Implementation of Adam Optimizer using Recurrent Neural Network (RNN) Architecture for Diabetes Classification

 (*)Nur Cahyo Tio Nugroho Mail (Universitas Dian Nuswantoro, Semarang, Indonesia)
 Erwin Yudi Hidayat (Universitas Dian Nuswantoro, Semarang, Indonesia)

(*) Corresponding Author

Submitted: December 28, 2023; Published: January 24, 2024

Abstract

Non-communicable diseases (NCDs) present a considerable worldwide health dilemma, resulting in considerable expenses for treatment and heightened rates of mortality. Conditions like diabetes mellitus, cardiovascular diseases, cancer, and chronic respiratory diseases are primary causes of global mortality, making up 71% of total global deaths in 2016, as reported by the World Health Organization (WHO). Diabetes Mellitus (DM), marked by prolonged elevated blood glucose levels, stands out as a significant metabolic disorder. This research delves into the implementation of Recurrent Neural Networks (RNNs) utilizing the Adaptive Moment Estimation (Adam) optimizer for classifying Diabetes Mellitus (DM). RNNs, a subset of artificial neural networks tailored for sequential data processing, are employed to make predictions by incorporating recurrent connections. Situated within the dynamic landscape of Artificial Intelligence and Machine Learning, the research exhibits promising outcomes via k-fold cross-validation, confusion matrix analysis, loss graph examination, and classification report. The RNN-Adam model showcases commendable overall performance, achieving an average accuracy of 80.20% through k-fold cross-validation and 81.60% accuracy as revealed by the confusion matrix. This research offers valuable insights into the effectiveness of the RNN-Adam model for diabetes classification.

Keywords


Recurrent Neural Network; Optimizer; Adam; Diabetes; Classification System

Full Text:

PDF


Article Metrics

Abstract view : 188 times
PDF - 34 times

References

D. N. Purqoti, Baiq Rulli Fatmawati, Zaenal arifin, Ilham, Zuliardi, and Harlina putri Rusiana, “Peningkatan Pengetahuan Penyakit Tidak Menular (PTM) Pada Masyarakat Resiko Tinggi Melalui Pendidikan Kesehatan,” LOSARI: Jurnal Pengabdian Kepada Masyarakat, vol. 4, no. 2, pp. 99–104, Dec. 2022, doi: 10.53860/losari.v4i2.108.

Yash Sahebrao Chaudhari, Yash Sahebrao Chaudhari, Srushti Sunil Bhujbal, Vidya Ashok Walunj, Neha Satish Bhor, and Rutuja Dattatraya Vyavhare, “Diabetes Mellitus: A Review,” International Journal of Advanced Research in Science, Communication and Technology, pp. 16–22, Mar. 2023, doi: 10.48175/IJARSCT-8551.

L. M. Quinn, S. L. Thrower, and P. Narendran, “What is type 1 diabetes?,” Medicine, vol. 50, no. 10, pp. 619–624, Oct. 2022, doi: 10.1016/j.mpmed.2022.07.002.

D. Kerr, F. King, and D. C. Klonoff, “Digital Health Interventions for Diabetes: Everything to Gain and Nothing to Lose,” Diabetes Spectrum, vol. 32, no. 3, pp. 226–230, Aug. 2019, doi: 10.2337/ds18-0085.

R. Chandra, A. Shukla, S. Tiwari, S. Agarwal, M. Svafrullah, and K. Adiyarta, “Natural language Processing and Ontology based Decision Support System for Diabetic Patients,” in 2022 9th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI), IEEE, Oct. 2022, pp. 13–18. doi: 10.23919/EECSI56542.2022.9946601.

S. Raschka, J. Patterson, and C. Nolet, “Machine Learning in Python: Main Developments and Technology Trends in Data Science, Machine Learning, and Artificial Intelligence,” Information, vol. 11, no. 4, p. 193, Apr. 2020, doi: 10.3390/info11040193.

P. Yilmaz, Ş. Akçakaya, Ş. D. Özkaya, and A. Çetin, “Machine Learning Based Music Genre Classification and Recommendation System,” El-Cezeri Journal of Science and Engineering, vol. 9, no. 4, pp. 1560–1571, Dec. 2022, doi: 10.31202/ecjse.1209025.

S. Yoo, “Comparison of Artificial Intelligence and Human Motivation,” Technium Social Sciences Journal, vol. 25, pp. 345–351, Nov. 2021, doi: 10.47577/tssj.v25i1.4736.

Dr. A. Bashar, “Survey on Evolving Deep Learning Neural Network Architectures,” Journal of Artificial Intelligence and Capsule Networks, vol. 2019, no. 2, pp. 73–82, Dec. 2019, doi: 10.36548/jaicn.2019.2.003.

R. Yauri and R. Espino, “Edge device for movement pattern classification using neural network algorithms,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 30, no. 1, p. 229, Apr. 2023, doi: 10.11591/ijeecs.v30.i1.pp229-236.

E. Prisciandaro, G. Sedda, A. Cara, C. Diotti, L. Spaggiari, and L. Bertolaccini, “Artificial Neural Networks in Lung Cancer Research: A Narrative Review,” J Clin Med, vol. 12, no. 3, p. 880, Jan. 2023, doi: 10.3390/jcm12030880.

J. Wang, L. Zhang, Q. Guo, and Z. Yi, “Recurrent Neural Networks With Auxiliary Memory Units,” IEEE Trans Neural Netw Learn Syst, vol. 29, no. 5, pp. 1652–1661, May 2018, doi: 10.1109/TNNLS.2017.2677968.

C. Gambella, B. Ghaddar, and J. Naoum-Sawaya, “Optimization problems for machine learning: A survey,” Eur J Oper Res, vol. 290, no. 3, pp. 807–828, May 2021, doi: 10.1016/j.ejor.2020.08.045.

M. Reyad, A. M. Sarhan, and M. Arafa, “A modified Adam algorithm for deep neural network optimization,” Neural Comput Appl, vol. 35, no. 23, pp. 17095–17112, Aug. 2023, doi: 10.1007/s00521-023-08568-z.

U. M. Butt, S. Letchmunan, M. Ali, F. H. Hassan, A. Baqir, and H. H. R. Sherazi, “Machine Learning Based Diabetes Classification and Prediction for Healthcare Applications,” J Healthc Eng, vol. 2021, pp. 1–17, Sep. 2021, doi: 10.1155/2021/9930985.

B. Pranto, Sk. M. Mehnaz, E. B. Mahid, I. M. Sadman, A. Rahman, and S. Momen, “Evaluating Machine Learning Methods for Predicting Diabetes among Female Patients in Bangladesh,” Information, vol. 11, no. 8, p. 374, Jul. 2020, doi: 10.3390/info11080374.

P. Chen and C. Pan, “Diabetes classification model based on boosting algorithms,” BMC Bioinformatics, vol. 19, no. 1, Mar. 2018, doi: 10.1186/s12859-018-2090-9.

F. F. Alkhalid, “The effect of optimizers in fingerprint classification model utilizing deep learning,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 20, no. 2, pp. 1098–1102, Nov. 2020, doi: 10.11591/ijeecs.v20.i2.pp1098-1102.

I. Amelia Dewi and M. A. Negara Ekha Salawangi, “High performance of optimizers in deep learning for cloth patterns detection,” IAES International Journal of Artificial Intelligence (IJ-AI), vol. 12, no. 3, p. 1407, Sep. 2023, doi: 10.11591/ijai.v12.i3.pp1407-1418.

D. Varma, A. Nehansh, and P. Swathy, “Data Preprocessing Toolkit : An Approach to Automate Data Preprocessing,” International Journal of Scientific Research in Engineering and Management, vol. 07, no. 03, Mar. 2023, doi: 10.55041/ijsrem18270.

R. R. Achmad and M. Haris, “Hyperparameter Tuning Deep Learning for Imbalanced Data,” TEPIAN, vol. 4, no. 2, Jun. 2023, doi: 10.51967/tepian.v4i2.2216.

J. Feng, L. T. Yang, B. Ren, D. Zou, M. Dong, and S. Zhang, “Tensor Recurrent Neural Network With Differential Privacy,” IEEE Transactions on Computers, pp. 1–11, 2023, doi: 10.1109/TC.2023.3236868.

W. Wardianto, F. Farikhin, and D. M. Kusumo Nugraheni, “Analisis Sentimen Berbasis Aspek Ulasan Pelanggan Restoran Menggunakan LSTM Dengan Adam Optimizer,” JOINTECS (Journal of Information Technology and Computer Science), vol. 8, no. 2, p. 67, Jul. 2023, doi: 10.31328/jointecs.v8i2.4737.

Q. Tong, G. Liang, and J. Bi, “Calibrating the adaptive learning rate to improve convergence of ADAM,” Neurocomputing, vol. 481, pp. 333–356, Apr. 2022, doi: 10.1016/j.neucom.2022.01.014.

E. Kee, J. J. Chong, Z. J. Choong, and M. Lau, “A Comparative Analysis of Cross-Validation Techniques for a Smart and Lean Pick-and-Place Solution with Deep Learning,” Electronics (Basel), vol. 12, no. 11, p. 2371, May 2023, doi: 10.3390/electronics12112371.

Bila bermanfaat silahkan share artikel ini

Berikan Komentar Anda terhadap artikel Implementation of Adam Optimizer using Recurrent Neural Network (RNN) Architecture for Diabetes Classification

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 JURNAL MEDIA INFORMATIKA BUDIDARMA

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.



JURNAL MEDIA INFORMATIKA BUDIDARMA
STMIK Budi Darma
Secretariat: Sisingamangaraja No. 338 Telp 061-7875998
Email: mib.stmikbd@gmail.com

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.