Klasifikasi Pengenalan Wajah Siswa Pada Sistem Kehadiran dengan Menggunakan Metode Convolutional Neural Network

Authors

  • Henri Kurniawan Universitas Amikom, Yogyakarta
  • Kusrini Kusrini Universitas Amikom, Yogyakarta
  • Kusnawi Kusnawi Universitas Amikom, Yogyakarta

DOI:

https://doi.org/10.30865/mib.v7i2.5958

Keywords:

Student Face Recognition, Attendance System, Modified Convolutional Neural Network, Data Augmentation, Confusion Matrix

Abstract

The student attendance system is useful for monitoring student attendance. The current technology is technology capable of detecting an object, such as fingerprints, voice, eye retinas, and faces. The author will create a model that can be used to detect student faces. In this study the authors used a modified Convolutional Neural Network (CNN) algorithm. The complexity of the CNN designed is in accordance with the specifications of the hardware and software used. Face data is taken directly from students in class (private dataset). Recording of students' faces using a standard quality webcam camera. The images produced by each student are 126 images with a total of 20 classes (labels). Taking pictures with various angles of the face, namely from above, below, front, left side and right side. The augmentation techniques used are flip, random rotation and affine techniques to enrich the data. Regularization techniques, such as dropout are also used. This is in order to increase accuracy, speed of model training and avoid overfitting of the built model. The evaluation results with the confusion matrix on the modified Convolutional Neural Network (CNN) algorithm produce a faster model training process with 5.31 hours and accuracy reaching 97.78%, the loss value is stable at 0.1177, loss validation with the number 0.0192, with as many iterations (epochs) as 60. The resulting model will be developed on a prototype of the student attendance system.

References

I. M. Kusrini Kusrini, Suputa Suputa, Arief Setyanto, K. Artha Agastya, Herlambang Priantoro, and E. I. Chandramouli, “Data augmentation for automated pest classification in Mango farms,†Comput. Electron. Agric., vol. 179, 2020, doi: 10.1016/j.compag.2020.105842.

A. Majumder, A. Rajbongshi, M. M. Rahman, and A. A. Biswas, “Local Freshwater Fish Recognition Using Different CNN Architectures with Transfer Learning,†Int. J. Adv. Sci. Eng. Inf. Technol., vol. 11, no. 3, pp. 1078–1083, 2021, doi: 10.18517/ijaseit.11.3.14134.

D. Husen, K. Kusrini, and K. Kusnawi, “Deteksi Hama Pada Daun Apel Menggunakan Algoritma Convolutional Neural Network,†J. Media Inform. Budidarma, vol. 6, no. 4, p. 2103, 2022, doi: 10.30865/mib.v6i4.4667.

R. Z. Fadillah, A. Irawan, M. Susanty, and I. Artikel, “Data Augmentasi untuk Mengatasi Keterbatasan Data pada Model Penerjemah Bahasa Isyarat Indonesia (BISINDO),†J. Inform., vol. 8, no. 2, pp. 208–214, 2021, [Online]. Available: https://ejournal.bsi.ac.id/ejurnal/index.php/ji/article/view/10768

H. Zhang, A. Jolfaei, and M. Alazab, “A Face Emotion Recognition Method Using Convolutional Neural Network and Image Edge Computing,†IEEE Access, vol. 7, no. November, pp. 159081–159089, 2019, doi: 10.1109/ACCESS.2019.2949741.

H. Yang and X. Han, “Face recognition attendance system based on real-time video processing,†IEEE Access, vol. 8, pp. 159143–159150, 2020, doi: 10.1109/ACCESS.2020.3007205.

J. Kong, M. Chen, M. Jiang, J. Sun, and J. Hou, “Face Recognition Based on CSGF(2D)2PCANet,†IEEE Access, vol. 6, pp. 45153–45165, 2018, doi: 10.1109/ACCESS.2018.2865425.

B. Jabber, J. Lingampalli, C. Z. Basha, and A. Krishna, “Detection of covid-19 patients using chest x-ray images with convolution neural network and mobile net,†Proc. 3rd Int. Conf. Intell. Sustain. Syst. ICISS 2020, pp. 1032–1035, 2020, doi: 10.1109/ICISS49785.2020.9316100.

X. Li, Z. Yang, and H. Wu, “Face detection based on receptive field enhanced multi-task cascaded convolutional neural networks,†IEEE Access, vol. 8, pp. 174922–174930, 2020, doi: 10.1109/ACCESS.2020.3023782.

B. Mocanu, R. Tapu, and T. Zaharia, “DEEP-SEE FACE: A Mobile Face Recognition System Dedicated to Visually Impaired People,†IEEE Access, vol. 6, pp. 51975–51985, 2018, doi: 10.1109/ACCESS.2018.2870334.

Y. H. Liu, “Feature Extraction and Image Recognition with Convolutional Neural Networks,†J. Phys. Conf. Ser., vol. 1087, no. 6, 2018, doi: 10.1088/1742-6596/1087/6/062032.

R. M. Rawat, S. Garg, N. Jain, and G. Gupta, “COVID-19 detection using convolutional neural network architectures based upon chest X-rays images,†Proc. - 5th Int. Conf. Intell. Comput. Control Syst. ICICCS 2021, no. Iciccs, pp. 1070–1074, 2021, doi: 10.1109/ICICCS51141.2021.9432134.

D. Arsal, Muhammad and Wardijono, Bheta and Anggraini, “Face Recognition Untuk Akses Pegawai Bank Menggunakan Deep Learning Dengan Metode CNN,†Nas. Teknol. dan Sist. Inf., vol. 06, pp. 55–63, 2020, doi: 10.1109/UBMK52708.2021.9559031.

J. Sanjaya and M. Ayub, “Augmentasi Data Pengenalan Citra Mobil Menggunakan Pendekatan Random Crop, Rotate, dan Mixup,†J. Tek. Inform. dan Sist. Inf., vol. 6, no. 2, pp. 311–323, 2020, doi: 10.28932/jutisi.v6i2.2688.

M. Z. Alom et al., “The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches,†2018, [Online]. Available: http://arxiv.org/abs/1803.01164

Suyanto, Machine Learning Tingkat Dasar dan Lanjut, Ed. I. Bandung, Indonesia: Informatika, 2018.

K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,†3rd Int. Conf. Learn. Represent. ICLR 2015 - Conf. Track Proc., pp. 1–14, 2015.

L. Perez and J. Wang, “The Effectiveness of Data Augmentation in Image Classification using Deep Learning,†2017, [Online]. Available: http://arxiv.org/abs/1712.04621

A. Negi, K. Kumar, P. Chauhan, and R. S. Rajput, “Deep neural architecture for face mask detection on simulated masked face dataset against covid-19 pandemic,†Proc. - IEEE 2021 Int. Conf. Comput. Commun. Intell. Syst. ICCCIS 2021, pp. 595–600, 2021, doi: 10.1109/ICCCIS51004.2021.9397196.

M. S. Majib, M. M. Rahman, T. M. Shahriar Sazzad, N. I. Khan, and S. K. Dey, “VGG-SCNet: A VGG Net based Deep Learning framework for Brain Tumor Detection on MRI Images,†IEEE Access, vol. 9, pp. 116942–116952, 2021, doi: 10.1109/ACCESS.2021.3105874.

Downloads

Published

2023-04-27

Issue

Vol. 7 No. 2 (2023): April 2023

Section

Articles

License

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License

Authors who publish with this journal agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).