Pengukuran Kepuasan Pengguna E-Learning Menggunakan Metode Evaluasi Heuristik dan System Usability Scale

Penulis

Emi Iryanti, La Ode Mohamad Zulfiqar, Sri Suning Kusumawardani, Indriana Hidayah

Abstrak

Pandemik COVID-19 yang terjadi saat ini mempengaruhi banyak aspek kehidupan termasuk pendidikan, dimana pembelajaran dilakukan dari rumah untuk mengurangi resiko penularan virus corona dengan menerapkan e-learning. Hal ini yang membuat implementasi e-learning harus baik, oleh karenanya harus dilakukan evaluasi agar e-learning mudah digunakan. Salah satu aspek penting yang harus dievaluasi yakni dari sisi usability-nya dimana dapat diketahui kepuasan pengguna dari sisi “kebergunaan”nya. Penelitian ini menggunakan dua metode evaluasi usability yaitu System Usability Scale (SUS) dan evaluasi heuristik (HE) digunakan untuk hal ini. Penggunaan kedua metode ini dilakukan untuk mendapatkan hasil evaluasi yang lebih mendalam agar dapat dilakukan perbaikan oleh pihak terkait. Dalam evaluasi usability menggunakan HE, evaluator yang dipilih adalah lima user expert yang ahli dalam bidang usability (tiga orang) ahli dalam bidang IT dan pengembangan pembelajaran (dua orang), sedangkan lingkup evaluasi pada penelitian ini yaitu proses login, edit profile, organisasi perkuliahan, dan aktivitas perkuliahan. Sedangkan pada evaluasi menggunakan kuesioner SUS diperoleh skor 63,3 (grade C-) dengan 162 responden, dengan hasil uji realibitas sebesar 0,818 dan uji validitas semua item pertanyaan di atas 0,129 yang berarti bersifat realible dan valid. Hasil evaluasi usability menggunakan HE, didapatkan bahwa terdapat satu prinsip yang dianggap sebagai permasalahan mayor oleh user expert yaitu prinsip user control and freedom, dimana sistem (e-learning) tidak memfasilitasi fungsi undo dan redo yang menyebabkan pengguna kebingungan apabila dengan sengaja/tidak memilih menu yang tidak dikehendaki.

 

Abstract

The COVID-19 pandemic affects many aspects including education, where learning is carried out from home to reduce the risk of coronavirus transmission by implementing e-learning. One important aspect that must be evaluated is from the usability side, where we can find out the user satisfaction from the "usability" side. This study uses two usability evaluation methods, namely the System Usability Scale (SUS) and the heuristic evaluation (HE). The use of these two methods is carried out to obtain more in-depth evaluation results so that related parties can improve them. In the usability evaluation using HE, the selected evaluators are five user experts who are experts in the field of usability (three people) who are experts in the field of IT and learning development (two people), while the scope of evaluation in this study is the login process, edit profile, lecture organization, and lecture activities. While the evaluation using the SUS questionnaire obtained a score of 63.3 (grade C-) with 162 respondents. The results of the usability evaluation using HE, it was found that there is one principle that is considered a major problem by user experts, namely the principle of user control and freedom, where the system (e-learning) does not facilitate the undo and redo functions which causes confusion if the user click unwanted menu.

Teks Lengkap:

PDF

Referensi


ABIDAH, A., HIDAYATULLAH, H.N., SIMAMORA, R.M., FEHABUTAR, D. dan MUTAKINATI, L., 2020. The Impact of Covid-19 to Indonesian Education and Its Relation to the Philosophy of ‘Merdeka Belajar’. Studies in Philosophy of Science and Education, 1(1), pp. 38-49.

AL-SHAGRAN, A. dan, SAHRAOUI, A., 2018. Assessment of E-learning Systems: A Systems Engineering Approach System. International Journal of Computer Science and Software Engineering, 6(8), pp. 173-179.

ALVES, J.M. et al, 2016. Software Quality Evaluation of the Laboratory Information System Used in the Santa Catarina State Integrated Telemedicine and Telehealth System. In: 2016 IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS). City: Dublin, pp. 76-81.

BROOKE, J., 2013. SUS: A Retrospective. Journal of Usability Studies, 8(2), pp. 29-40.

BUDIU, R., 2019. Usability Heuristic #6: Recognition vs. Recall in User Interfaces. [Video] Tersedia di : [Diakses 14 Jan. 2020].

BUTARBUTAR, F.T.S. dan HARYANTO, Y., 2017. Kajian Signifikansi Faktor yang Mempengaruhi Penggunaan E-learning pada Siswa SMK Global Informatika Tangerang. Jurnal Rekayasa Sistem dan Teknologi Informasi (RESTI), 1(1), p. 9.

CHEN, X. XIA, E. dan JIA, W., 2020. Utilisation Status and User Satisfaction of Online Education Platforms Overview of Literature Concerning Online Education. International Journal of Emerging Technologies in Learning (iJET), 15(19), pp. 154-170.

DARAMOLA, O., OLADIPUPO, O., AFOLABI, I. dan OLOPADE, A., 2017. Heuristic Evaluation of An Institutional E-learning System: A Nigerian Case. International Journal of Emerging Technologies in Learning (iJET), 12(3), pp. 26-42.

DEVINE, E.B. et al, 2014. Usability Evaluation of Pharmacogenomics Clinical Decision Support Aids and Clinical Knowledge Resources in Computerized Provider Order Entry System: A Mixed Methods Approach. International Journal Media Information, 83(7), pp. 473-483.

FERNANDEZ, A., INSFRAN, E. dan ABRAHẢO, S., 2011. Usability Evaluation Method for The Web: A Systematic Mapping Study. Information and Software Technology, 53(8), pp. 789-817.

GÔMES, R.Y., CABALLERO, D.C. dan SEVILLANO, J.-L., 2018. Heuristic evaluation on Mobile Interface: A New Checklist. The Scientific World Journal, 2014, p. 19.

HARLEY, A., 2018. Visibility of System Status (Usability Heuristic #1). [Blog] Nielsen Norman Group. Tersedia di : [Diakses 14 Jan. 2020].

HARRATI, N., BOUCHRIKA, A TARI. Dan OLOPADE, A., 2017. Exploring User Satisfaction for E-learning Systems via Usage-Based Metrics and System Usability Scale Analysis. Computers in Human Behavior, 12(3), pp. 463-471.

KALEY, A., 2018. Match Between The System and The Real World: The 2nd Usability Heuristic Explained. [Blog] Nielsen Norman Group. Tersedia di : [Diakses 14 Jan. 2020].

LIMBONG, T. dan SIMARMATA, J, 2020. Menentukan Matakuliah yang Efektif Belajar Daring (Belajar dan Ujian) dengan Metode Multi-Attribute Utility Theory (MAUT). Jurnal Rekayasa Sistem dan Teknologi Informasi (RESTI), 4(2), pp. 370-376.

MORAN, K., 2019. Usability Heuristic 4: Consistency and Standards. [Video] Tersedia di : [Diakses 14 Jan. 2020].

NIELSEN, J., 1994. Jakob Nielsen’s Ten Usability Heuristics. [Blog] Nielsen Norman Group. Tersedia di : [Diakses 14 Jan. 2020].

NIELSEN, J., 2001. Error Message Guidelines. [Blog] Nielsen Norman Group. Tersedia di : [Diakses 14 Jan. 2020].

NIELSEN, J., 2017. A 100-Year View of User Experience (by Jakob Nielsen). [Blog] Nielsen Norman Group. Tersedia di : [Diakses 14 Jan. 2020].

PRIATNA, T., ADILLAH MAYLAWATI, D.S., SUGILAR, H. dan RAMDHANI, M.A., 2020. Key success factors of E-learning Implementation in Higher Education. International Journal of Emerging Technologies in Learning (iJET), 15(17), pp. 101-114.

QUINONES, D., RUSU, C., 2017. How to Develop Usability Heuristics: Asystematic Literature Review. Computer Standards & Interfaces. 53, pp. 89-122.

ROGERS, Y., SHARP, H. dan PREECE, J., 2015. Interaction Design: Beyond Human-Computer Interaction.USA:Wiley.

SALMAN, H.M., WAN AHMAD, W.F. dan SULAIMAN, S., 2018. Usability Evaluation of The Smartphone User Interface in Supporting Elderly Users from Experts’ Perspective. IEEE Access, 6, pp. 22578-22591.

SUDARWATI, N, dan RUKMININGSIH., 2018. Evaluating E-learning as A Learning Media A Case of Entrepreneurship E-learning Using Schoology as Media. International Journal of Emerging Technologies in Learning (iJET), 13(9), pp. 269-279.

SUTCLIFFE, A., 2002. Assessing The Reliability of Heuristic Evaluation for Website Attractiveness and Usability. In : 2014 47th Hawaii International Conference on System Sciences, pp. 1838-1847.

WAHYUNINGRUM, T., KARTIKO, C. dan WARDHANA, A.C., 2020. Exploring e-Commerce Usability by Heuristic Evaluation as a Compelement of System Usability Scale. In: 2020 International Conference on Advancement in Data Science, E-learning and Information Systems (ICADEIS). City: Lombok, pp. 1-5.

WULANDARI, I.R. dan FARIDA, L.D., 2018. Pengukuran User Experience pada E-learning di Lingkungan Universitas Menggunakan User Experience Questionnaire (UEQ). Jurnal Mantik Penusa, 2(2), pp. 146-151.




DOI: http://dx.doi.org/10.25126/jtiik.2022924631