Evaluasi Situs Web dengan Metode Cognitive Walkthrough, Heuristic Evaluation, dan User Experience Questionnaire
DOI:
https://doi.org/10.30865/jurikom.v13i2.9120Keywords:
Cognitive Walkthrough, Usability, Prosecutor's Office, Evaluation, User Satisfaction, Heuristic Evaluation, Website, UEQAbstract
The Bali High Prosecutor’s Office website, a legal service channel in Bali, has not been evaluated since 2018. A preliminary study revealed several user complaints regarding malfunctioning crucial features, such as confusing workflows and unclear guidance. This can be hindering public access to the legal process in seeking justice. To this purpose, the website’s features were evaluated through research using cognitive walkthrough, heuristic evaluation, and User Experience Questionnaire (UEQ). The evaluation process involved 10 general users to measure task scenario performance, 3 experts to identify qualitative issues, and 23 questionnaire respondents to measure user experience perceptions. The evaluation was conducted in three stages: initial design evaluation, prototype development, and final design evaluation. The initial design usability test revealed significant issues. There were numerous failures in executing task scenarios in the public complaints feature, with an average severity rating of 3,27, which is in the critical category. Furthermore, clarity and accuracy were rated below average, with 50% of the products in the dataset performing worse than the Bali High Prosecutor’s Office website. This research aims to produce evidence-based interface design recommendations capable of improving the digital service quality of the Bali High Prosecutor’s Office. The contribution of this research lies in the development and validation of a high-fidelity prototype, which was evaluated using UEQ and demonstrated significant improvement across all aspects of user experience: attractiveness, clarity, efficiency, accuracy, stimulation, and novelty. This research provides a comprehensive evaluation framework adoptable by other government agencies seeking to enhance their digital public services
References
[1] A. A. Fatah, “Analisa Usability Sistem Informasi Manajemen Tugas Akhir (SIM-TA) Universitas Muhammadiyah Malang Menggunakan Metode System Usability Scale (SUS),” Undergraduate thesis, Univ. Muhammadiyah Malang, Malang, 2024.
[2] D. Aspandi, S. Doosdal, V. Ülger, L. Gillich, and S. Staab, “User interaction analysis through contrasting websites experience,” arXiv preprint arXiv:2201.03638, 2022. [Online]. Available: https://arxiv.org/abs/2201.03638
[3] F. M. C. Harahap, D. Manongga, and A. Hendrowati, “Evaluasi Usability pada Situs Web UNRIYO Menggunakan Metode Heuristic Evaluation,” J. Teknol. Inf. dan Ilmu Komput., vol. 8, no. 1, p. 29, 2021, doi: 10.25126/jtiik.202184025.
[4] I. K. T. Juliana, I. M. Candiasa, and L. J. E. Dewi, “Evaluasi Usability Pada Aplikasi PLN Mobile Menggunakan Metode Heuristic Evaluation Dan Usability Testing,” J. Ilm. Teknol. Inf. Terap., vol. 8, no. 2, pp. 89–98, 2022. [Online]. Available: https://doi.org/10.25078/jit.v8i2.958
[5] I. M. Candiasa, Modul Analisis Data Penelitian. Singaraja, 2020.
[6] I. M. Candiasa and L. J. E. Dewi, Modul Evaluasi Usability. Singaraja, 2021.
[7] I. P. A. Sanjaya, K. Agustini, and I. M. Candiasa, “Evaluasi Usability pada Ruang Guru Menggunakan Metode Cognitive Walkthrough dan Heuristik Nielsen,” JITTER J. Ilm. Teknol. dan Komput., vol. 3, no. 2, pp. 672–683, 2022.
[8] J. A. Bargas-Avila and K. Hornbæk, “Old wine in new bottles or novel challenges? A critical analysis of empirical studies of user experience,” Proc. ACM Hum.-Comput. Interact., vol. 5, no. CSCW1, Art. no. 1, pp. 1–32, 2021.
[9] J. Brooke and P. Jordan, “SUS: A retrospective,” Int. J. Hum.-Comput. Interact., vol. 37, no. 4, pp. 281–293, 2021.
[10] J. Nielsen, “Usability 101: Introduction to usability,” Nielsen Norman Group, 2012. [Online]. Available: https://www.nngroup.com/articles/usability-101-introduction-to-usability/. [Accessed: May 10, 2022].
[11] J. R. Lewis and S. Utesch, “Investigating the Correspondence Between Heuristic Evaluation and Usability Testing: A Multi-Year, Multi-Evaluator Case Study,” in Proc. Hum. Factors Ergon. Soc. Annu. Meet., 2020, pp. 241–245.
[12] L. J. E. Dewi, Modul User Experience. Singaraja, 2021.
[13] M. I. Harahap, M. K. Nizam, and D. Darmawan, “Evaluasi Usability Pada Aplikasi Kitabisa Menggunakan Metode Cognitive Walkthrough Dan System Usability Scale (SUS),” J. Sist. Komput. dan Inform., vol. 2, no. 2, p. 223, 2021, doi: 10.30865/json.v2i2.2725.
[14] M. R. A. Faisya, P. I. Santosa, and R. Ferdiana, “Pengujian Usability dengan Cognitive Walkthrough dan User Experience Questionnaire (UEQ) (Studi kasus: Situs Web Jogja Lowker),” J. Inform. dan Sist. Inf., vol. 2, no. 2, pp. 337–348, 2021.
[15] M. Schrepp, “Interactions of the UEQ Scales,” UEQ-Online, 2020. [Online]. Available: https://ueq-online.org/archive/UEQ_Interactions_of_Scales_2020.pdf
[16] P. B. K. Putrawan, G. S. Santyadiputra, and I. M. A. Wirawan, “Evaluasi Usability Sistem Informasi Geografis Pariwisata Kota Denpasar dengan Metode Evaluasi Heuristik,” J. Nas. Pendidik. Tek. Inform., vol. 10, no. 2, p. 162, 2021, doi: 10.23887/janapati.v10i2.32619.
[17] R. Andika and D. Renaldi, “Heuristic Evaluation of UI/UX to enhance experience and sales in e-commerce,” Jurnal Bit-Tech, vol. 7, no. 2, pp. 245–258, 2024.
[18] R. Fitria, “Integrating Heuristic Evaluation and Cognitive Walkthrough in usability evaluation of mobile application,” J. Artif. Intell. Eng. Appl., vol. 3, no. 3, pp. 1–10, 2024.
[19] S. M. Prasetiyo, R. Gustiawan, Farhat, and F. R. Albani, “Analisis Pertumbuhan Pengguna Internet Di Indonesia,” BIIKMA Buletin Ilmiah Ilmu Komputer dan Multimedia, vol. 2, no. 1, pp. 65–71, Jun. 2024. [Online]. Available: https://jurnalmahasiswa.com/index.php/biikma/article/view/1032
[20] T. S. Jayne and I. G. P. S. Wijaya, “Penerapan Metode Cognitive Walkthrough Dan Heuristic Evaluation Pada Evaluasi Usability Aplikasi Manajemen Tugas,” J. Teknol. Inf. dan Ilmu Komput., vol. 8, no. 4, pp. 661–670, 2021, doi: 10.25126/jtiik.202184456.
[21] W. P. Haryono and Letthari, “The usability evaluation of KAI Access application using the User Experience Questionnaire,” in Proc. 2019 4th Int. Conf. Inf. Technol. Inf. Syst. Electr. Eng. (ICITISEE), 2019, pp. 27–32.
