Video conferencing as a face-to-face online meeting app: user preference based on usability testing

Authors

  • Astrid Wahyu Adventri Wibowo Universitas Pembangunan Nasional Veteran Yogyakarta
  • Berty Dwi Rahmawati Universitas Pembangunan Nasional Veteran Yogyakarta
  • Hasan Mastrisiswadi Universitas Pembangunan Nasional Veteran Yogyakarta

DOI:

https://doi.org/10.30656/jsmi.v5i2.3432

Keywords:

System usability scale, Usability testing, USE questionnaire, User preference, Video conferencing

Abstract

The global pandemic of Corona Virus Disease (Covid-19) that hit Indonesia since March 2020 has changed the face-to-face system from offline to online. Video Conference (VC) becomes an alternative choice for delivering material, both learning and working. VC is a technology that allows users to hold face-to-face meetings at their respective places simultaneously. Various VC apps are becoming increasingly popular these days, such as Google Meet, Zoom, Youtube, Webex, Skype, GoTo Meeting, and Big Blue Button (BBB). This study is intended to provide a usability test of VC applications (such as Zoom, Google Meet, and BBB) and provide recommendations for VC as an online conference media based on user preferences. The usability measurement technique used is the System Usability Scale (SUS) and the USE questionnaire. The results of this study show that Zoom has the highest usability value compared to Google Meet and BBB, Google Meet is ranked second and BBB is ranked third.

References

J. M. Denstadli, T. E. Julsrud, and R. J. Hjorthol, “Videoconferencing as a Mode of Communication,†J. Bus. Tech. Commun., vol. 26, no. 1, pp. 65–91, Jan. 2012, doi: https://doi.org/10.1177/1050651911421125.

International Organization for Standardization, “9241-11. Ergonomic requirements for office work with visual display terminals (VDTs),†Int. Organ. Stand., vol. 45, no. 9, 1998. Available: https://www.iso.org/standard/16883.html.

J. Brooke, “SUS: a retrospective,†J. usability Stud., vol. 8, no. 2, pp. 29–40, 2013. Available: https://uxpajournal.org/wp-content/uploads/sites/7/pdf/JUS_Brooke_February_2013.pdf.

J. R. Lewis and J. Sauro, “Item benchmarks for the system usability scale.,†J. Usability Stud., vol. 13, no. 3, pp. 158–167, 2018. Available: https://uxpajournal.org/wp-content/uploads/sites/7/pdf/JUS_Lewis_May2018.pdf.

P. T. Kortum and A. Bangor, “Usability Ratings for Everyday Products Measured With the System Usability Scale,†Int. J. Human–Computer Interact., vol. 29, no. 2, pp. 67–76, Jan. 2013, doi: https://doi.org/10.1080/10447318.2012.681221.

P. Kortum and M. Sorber, “Measuring the Usability of Mobile Applications for Phones and Tablets,†Int. J. Human–Computer Interact., vol. 31, no. 8, pp. 518–529, Aug. 2015, doi: https://doi.org/10.1080/10447318.2015.1064658.

P. Kortum and S. C. Peres, “The Relationship Between System Effectiveness and Subjective Usability Scores Using the System Usability Scale,†Int. J. Human–Computer Interact., vol. 30, no. 7, pp. 575–584, Jul. 2014, doi: https://doi.org/10.1080/10447318.2014.904177.

J. R. Lewis, J. Brown, and D. K. Mayes, “Psychometric Evaluation of the EMO and the SUS in the Context of a Large-Sample Unmoderated Usability Study,†Int. J. Human–Computer Interact., vol. 31, no. 8, pp. 545–553, Aug. 2015, doi: https://doi.org/10.1080/10447318.2015.1064665.

S. C. Peres, T. Pham, and R. Phillips, “Validation of the System Usability Scale (SUS): SUS in the Wild,†Proc. Hum. Factors Ergon. Soc. Annu. Meet., vol. 57, no. 1, pp. 192–196, Sep. 2013, doi: https://doi.org/10.1177/1541931213571043.

A. Bangor, K. Joseph, M. Sweeney-Dillon, G. Stettler, and J. Pratt, “Using the SUS to Help Demonstrate Usability’s Value to Business Goals,†Proc. Hum. Factors Ergon. Soc. Annu. Meet., vol. 57, no. 1, pp. 202–205, Sep. 2013, doi: https://doi.org/10.1177/1541931213571045.

A. Bangor, P. T. Kortum, and J. T. Miller, “An Empirical Evaluation of the System Usability Scale,†Int. J. Human–Computer Interact., vol. 24, no. 6, pp. 574–594, Jul. 2008, doi: https://doi.org/10.1080/10447310802205776.

J. R. Lewis, B. S. Utesch, and D. E. Maher, “Measuring Perceived Usability: The SUS, UMUX-LITE, and AltUsability,†Int. J. Human–Computer Interact., vol. 31, no. 8, pp. 496–505, Aug. 2015, doi: https://doi.org/10.1080/10447318.2015.1064654.

J. C. Nunnally and J. C. Nunnaly, Psychometric Theory. McGraw-Hill, 1978. Available: https://books.google.co.id/books?id=arJqAAAAMAAJ

A. Hodrien and T. P. Fernando, “A review of post-study and post-task subjective questionnaires to guide assessment of system usability,†J. Usability Stud., vol. 16, no. 3, pp. 203–232, 2021. Available: http://usir.salford.ac.uk/id/eprint/60928/.

A. M. Lund, “Measuring usability with the use questionnaire12,†Usability interface, vol. 8, no. 2, pp. 3–6, 2001. Available: https://www.researchgate.net/publication/230786746.

E. Mathe and E. Spyrou, “User Evaluation of Low-Cost, Non-Invasive Methods for Heart-Rate Measurement,†J. Usability Stud., vol. 15, no. 3, pp. 145–165, 2020. Available: https://uxpajournal.org/wp-content/uploads/sites/7/pdf/JUS_Mathe_May2020.pdf.

Y. M. Choi, “Applying Tangible Augmented Reality for Product Usability Assessment.,†J. Usability Stud., vol. 14, no. 4, pp. 187–200, 2019. Available: https://uxpajournal.org/wp-content/uploads/sites/7/pdf/JUS_Choi_August2019.pdf.

B. Jerman-Blazic and T. Arh, “Usability Evaluation and Study of a Video-Conferencing Service Provided via the Virtual Conference Centre,†2011. Available: http://www.thinkmind.org/download.php?articleid=icn_2011_20_20_10118.

M. S. Khalid and M. I. Hossan, “Usability evaluation of a video conferencing system in a university’s classroom,†in 2016 19th International Conference on Computer and Information Technology (ICCIT), 2016, pp. 184–190, doi: https://doi.org/10.1109/ICCITECHN.2016.7860192.

J. Brooke, “SUS: A ‘Quick and Dirty’ Usability Scale,†in Usability Evaluation In Industry, vol. 189, no. 194, CRC Press, 1996, pp. 207–212, doi: https://doi.org/10.1201/9781498710411-35

A. Sidik, “Penggunaan System Usability Scale (SUS) Sebagai Evaluasi Website Berita Mobile,†Technol. J. Ilm., vol. 9, no. 2, pp. 83–88, Apr. 2018, doi: https://doi.org/10.31602/tji.v9i2.1371.

M. Gao, P. Kortum, and F. Oswald, “Psychometric Evaluation of the USE (Usefulness, Satisfaction, and Ease of use) Questionnaire for Reliability and Validity,†Proc. Hum. Factors Ergon. Soc. Annu. Meet., vol. 62, no. 1, pp. 1414–1418, Sep. 2018, doi: https://doi.org/10.1177/1541931218621322.

A. Sasongko, W. E. Jayanti, and D. Risdiansyah, “USE Questionnaire Untuk Mengukur Daya Guna Sistem Informasi e-Tadkzirah,†J. Khatulistiwa Inform., vol. 8, no. 2, pp. 80–87, 2020. Available: https://ejournal.bsi.ac.id/ejurnal/index.php/khatulistiwa/article/view/9135.

K. Finstad, “The system usability scale and non-native English speakers,†J. usability Stud., vol. 1, no. 4, pp. 185–188, 2006. Available: https://uxpajournal.org/wp-content/uploads/sites/7/pdf/JUS_Finstad_Aug2006.pdf.

A. Bangor, P. Kortum, and J. Miller, “Determining what individual SUS scores mean: Adding an adjective rating scale,†J. usability Stud., vol. 4, no. 3, pp. 114–123, 2009. Available: https://uxpajournal.org/wp-content/uploads/sites/7/pdf/JUS_Bangor_May2009.pdf.

J. R. Lewis and J. Sauro, “The Factor Structure of the System Usability Scale,†in International conference on human centered design, Springer, 2009, pp. 94–103, doi: https://doi.org/10.1007/978-3-642-02806-9_12.

H. Mastrisiswadi, I. Lestari, A. Istiani, R. Husaini, and R. P. Agusdin, Panduan Spada Wimaya UPN “Veteran†Yogyakarta. UPN’’Veteran’’Yogyakarta, 2020. Available: https://spada.upnyk.ac.id/

M. Fan, J. Lin, C. Chung, and K. N. Truong, “Concurrent Think-Aloud Verbalizations and Usability Problems,†ACM Trans. Comput. Interact., vol. 26, no. 5, pp. 1–35, Sep. 2019, doi: https://doi.org/10.1145/3325281.

P. Chynał and J. M. Szymański, “Remote usability testing using eyetracking,†in IFIP Conference on Human-Computer Interaction, 2011, pp. 356–361, doi: https://doi.org/10.1007/978-3-642-23774-4_29.

Downloads

Published

2021-12-31

Issue

Vol. 5 No. 2 (2021)

Section

Research Article

License

All articles in Jurnal Sistem dan Manajemen Industri can be disseminated provided they include the identity of the article and the source of the article Jurnal Sistem dan Manajemen Industri. The publisher is not responsible for the contents of the article. The content of the article is the sole responsibility of the author

Creative Commons License

Jurnal Sistem dan Manajemen Industri is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

How to Cite

[1]
“Video conferencing as a face-to-face online meeting app: user preference based on usability testing”, j. sist. manaj. ind., vol. 5, no. 2, pp. 98–104, Dec. 2021, doi: 10.30656/jsmi.v5i2.3432.
Crossref
Scopus
Google Scholar
Europe PMC