Audit And Evaluation Of  CBT Examination System At SMK Muhammadiyah-10 Kisaran Using Cobit 2019 Framework

Zulfan; Khairul; Andysah Putera Utama Siahaan

Authors

Zulfan University Pembangunan Panca Budi
Khairul University Pembangunan Panca Budi
Andysah Putera Utama Siahaan University Pembangunan Panca Budi

Keywords:

Information Technology Audit, Computer Based Test, COBIT 2019, Capability Level, Vocational High School

Abstract

This study aims to audit and evaluate the Computer Based Test (CBT) system for Academic Ability Tests (TKA) at SMK Muhammadiyah 10 Kisaran using the COBIT 2019 framework through a mixed-methods descriptive approach with data collection techniques including observation, semi-structured interviews, questionnaires based on COBIT 2019 capability indicators, and documentation studies, focusing on five COBIT 2019 domains: EDM03 (Ensure Risk Optimization), APO12 (Manage Risk), APO13 (Manage Security), DSS01 (Manage Operations), and DSS05 (Manage Security Services), with 8 respondents consisting of the principal, curriculum vice principal, IT team, proctors, technicians, and teachers determined through purposive sampling based on RACI chart analysis. The results show that the overall capability level of CBT system governance is at Level 2 (Managed Process) with an average score of 2.22, while DSS01 reaches Level 3 (Established Process) with a score of 3.01, and the gap analysis reveals significant discrepancies between actual conditions and the expected Level 4 (Predictable Process), with EDM03 having the largest gap (2.08) and only 48% achievement, identifying EDM03, APO12, APO13, and DSS05 as priority domains requiring immediate improvement due to their high impact on TKA implementation reliability and security. This research contributes a comprehensive evaluation model integrating risk analysis, IT-Related Goals, and COBIT 2019 capability levels for CBT systems in vocational high schools, which is still rarely studied in the Indonesian educational context, providing both theoretical contributions to the development of information system audit studies in education and practical benefits as evaluation material and a basis for CBT system improvement for school management.

References

[1] ISACA, COBIT 2019 Framework: Governance and Management Objectives. Schaumburg, IL, USA: ISACA, 2018.

[2] R. E. Bennett, “The changing nature of educational assessment,” Review of Research in Education, vol. 39, no. 1, pp. 370–407, 2015, doi: 10.3102/0091732X14554179.

[3] A. Kadir, Pengenalan Sistem Informasi, 2nd ed. Yogyakarta, Indonesia: Andi, 2014.

[4] Amri, F. Y. Rudi F., F. A. Gani, A. Fauziah, and Y. Yunus, “Implentasi ujian on-line CBT berbasis client-server pada Sekolah SMK Negeri 2 Lhokseumawe,” Prosiding Seminar Nasional Politeknik Negeri Lhokseumawe, vol. 7, no. 1, pp. C-44–C-48, 2024.

[5] R. Efendi, L. S. Lesmana, F. Putra, E. Yandani, and R. A. Wulandari, “Design and implementation of Computer Based Test (CBT) in vocational education,” Journal of Physics: Conference Series, vol. 1764, no. 1, p. 012068, 2021, doi: 10.1088/1742-6596/1764/1/012068.

[6] E. Hartati and T. Mardiana, “Evaluasi penerapan Computer Based Test (CBT) sebagai upaya perbaikan sistem pada ujian nasional untuk sekolah terpencil di Sumatera Selatan,” Jurnal TAM (Technology Acceptance Model), vol. 9, no. 1, pp. 58–64, 2018.

[7] T. M. Siregar, D. Armanto, S. Frisnoiry, and D. Ruslan, “Effective solutions for implementing Android-based Computer-Based Testing (CBT) in vocational high schools as a digital assessment innovation,” Jurnal Penelitian Pendidikan IPA, vol. 11, no. 1, pp. 623–633, 2025, doi: 10.29303/jppipa.v11i1.10155.

[8] R. Syaifuddin, Faza, Diah, and N. Hamidah, “Analisis pemanfaatan aplikasi CBT sebagai sarana tes di MI Badrussalam Surabaya,” Jurnal PTK dan Pendidikan, vol. 8, no. 2, pp. 79–84, 2022, doi: 10.18592/ptk.v8i2.7569.

[9] R. C. S. Hariyono, S. Hartati, A. Nursetyo, and R. Arifiani, “Audit sistem informasi e-payment dengan framework COBIT 2019 (Studi kasus: Sekolah Menengah Kejuruan XYZ),” REMIK: Riset dan E-Jurnal Manajemen Informatika Komputer, vol. 9, no. 1, pp. 266–275, 2025, doi: 10.33395/remik.v9i1.14429.

[10] A. Sukamto, Bahrani, and N. Nurvayanti, “Tes Kemampuan Akademik (TKA) sebagai inovasi evaluasi pendidikan: Sebuah tinjauan naratif,” Journal of Instructional and Development Researches, vol. 6, no. 1, pp. 54–69, 2026, doi: 10.53621/jider.v6i1.695.

[11] H. Syutri and Julhadi, “Evaluasi berbasis teknologi e-asesmen, CBT, aplikasi digital,” Ensiklopedia of Journal, vol. 8, no. 2, pp. 66–76, 2026, doi: 10.33559/eoj.v8i2.3626.

[12] N. Y. L. Gaol, A. H. Nasyuha, and H. Jaya, “Pelatihan pelayanan Computer Based Test (CBT) dalam meningkatkan kompetensi tenaga pendidik di Sumatera Utara,” Jurnal Abdimas TGD, vol. 2, no. 1, pp. 14–18, 2022.

[13] A. P. Imanda, D. Apriliyani, and D. A. S. P. Anjani, “Challenges and solutions for the implementation of computer-based test learning evaluation at SMKN 2 Bandung,” Curricula: Journal of Curriculum Development, vol. 3, no. 1, pp. 17–28, 2024, doi: 10.17509/curricula.v3i1.63533.

[14] Y. D. Cahyono and L. W. Widianti, “Implementasi tata kelola dan manajemen risiko teknologi informasi menggunakan framework COBIT 2019: Studi kasus Politeknik Angkatan Darat,” JATI (Jurnal Mahasiswa Teknik Informatika), vol. 9, no. 1, pp. 250–256, 2025.

[15] A. Q. A’yuni, A. H. Muhammad, and A. Nasiri, “Literature review audit tata kelola teknologi informasi menggunakan kerangka kerja COBIT 2019,” Jurnal Informa: Jurnal Penelitian dan Pengabdian Masyarakat, vol. 9, no. 1, pp. 47–52, 2023, doi: 10.46808/informa.v9i1.247.

[16] M. K. Siddik, Novriyanto, Y. Vitriani, and T. Darmizal, “Audit tata kelola teknologi informasi pada Universitas Hang Tuah menggunakan domain COBIT,” 2024.

[17] A. Tafdhilla, J. H. Iftinan, A. Rahmadani, and A. Wulansari, “Penilaian penggunaan framework COBIT 2019 dalam pengelolaan teknologi informasi pada institusi perguruan tinggi,” Bulletin of Computer Science Research, vol. 4, no. 1, pp. 91–100, 2023, doi: 10.47065/bulletincsr.v4i1.314.

[18] E. S. Anggraini, M. Aprilsyah, I. N. Hasibuan, L. Asisura, and C. Rizal, “Audit sistem informasi Portalsia menggunakan framework COBIT 5 pada EDM05, APO04 dan BAI10,” Jurnal Komputer Teknologi Informasi Sistem Komputer (JUKTISI), vol. 3, no. 2, pp. 754–762, 2024, doi: 10.62712/juktisi.v3i2.172.

[19] A. F. Gamaliel, G. Firmansyah, and A. M. Widodo, “Risk management analysis on the School Activity Plan and Budget Application Information System (ARKAS) using COBIT 2019,” Asian Journal of Social and Humanities, vol. 2, no. 12, pp. 3007–3024, 2024, doi: 10.59888/ajosh.v2i12.396.

[20] ISACA, COBIT 2019 Design Guide: Designing an Information and Technology Governance Solution. Schaumburg, IL, USA: ISACA, 2018.

[21] B. R. W. Prasetya and A. H. Muhammad, “Quality management of information technology governance COBIT 2019 framework education factors in Indonesia: A review,” JIKO (Jurnal Informatika dan Komputer), vol. 8, no. 1, pp. 48–55, 2025, doi: 10.33387/jiko.v8i1.9498.

[22] C. Anwar and A. Harits, “Perancangan sistem kuisioner penilaian kapabilitas framework COBIT 2019,” Jurnal Informatika Utama, vol. 3, no. 1, pp. 42–51, 2025, doi: 10.55903/jitu.v3i1.271.

[23] A. Viamianni, R. Mulyana, and F. Dewi, “COBIT 2019 information security focus area implementation for ReinsurCo digital transformation,” JIKO (Jurnal Informatika dan Komputer), vol. 6, no. 2, pp. 106–115, 2023, doi: 10.33387/jiko.v6i2.6366.

[24] A. J. Wulandari, R. Aliya, and Megawati, “Audit sistem informasi Computer Based Test menggunakan COBIT 2019 di SMK IT Al Izhar Pekanbaru,” Jurnal Rekayasa Sistem Informasi dan Teknologi, vol. 2, no. 4, pp. 1268–1278, 2025, doi: 10.70248/jrsit.v2i4.2299.

[25] ISACA, COBIT 2019 Framework: Introduction and Methodology. Schaumburg, IL, USA: ISACA, 2018.

[26] S. C. I. Simatupang and M. I. Fianty, “Assessment of capability levels and improvement recommendations using COBIT 2019 for the IT consulting industry,” G-Tech: Jurnal Teknologi Terapan, vol. 7, no. 4, pp. 1391–1400, 2023, doi: 10.33379/gtech.v7i4.3141.

[27] J. Felicia, J. F. Andry, F. Adikara, D. Y. Bernanda, and K. Christianto, “Leveraging COBIT 2019 to measure the accounting software implementation in high schools for better transparency,” Journal of Computer Science, vol. 20, no. 2, pp. 218–228, 2024, doi: 10.3844/jcssp.2024.218.228.

[28] L. Gorgona, “Building a maturity model for COBIT 2019 based on CMMI,” ISACA Journal, vol. 6, 2021.

[29] I. M. Artana, N. P. Sastra, and D. M. Wiharta, “Domain analysis and audit of IT governance based on COBIT 5 at Denpasar Industrial Training Center,” Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI), vol. 12, no. 1, pp. 87–98, 2023, doi: 10.23887/janapati.v12i1.55989.

[30] U. F. Vista and Rapina, “Perancangan tata kelola teknologi informasi pada MA Darussalam Pangkalpinang menggunakan framework COBIT 2019,” Jurnal Inovasi Pendidikan dan Teknologi Informasi (JIPTI), vol. 5, no. 2, pp. 255–266, 2024, doi: 10.52060/jipti.v5i2.2079.

[31] R. S. Hardinata, W. Fitriani, C. Pramono, M. Muttaqin, H. M. Ritonga, L. Marlina, and A. Khaliq, “Audit tata kelola teknologi informasi menggunakan COBIT 5: Studi kasus Universitas Pembangunan Panca Budi Medan,” Jurnal Teknik dan Informatika, vol. 6, no. 1, pp. 42–45, 2019.

[32] N. Azahra and R. Setyadi, “Pemetaan core-process menggunakan design factor untuk tata kelola teknologi informasi di SMK Telkom Purwokerto,” JATI (Jurnal Mahasiswa Teknik Informatika), vol. 8, no. 4, pp. 7443–7452, 2024, doi: 10.36040/jati.v8i4.9994.