Implementation and Comparative Analysis of Test Automation Framework Performance for Functional Testing of Web-Based Applications using the Distance to the Ideal Alternative (DIA) Method

Shidqi Adiatma, Astie Darmayantie

Abstract


The importance of functional testing is to ensure the quality of web-based applications so as to improve user experience (user experience) to make it more secure and reliable in ever-increasing market pressure. Can encourage many companies to build high-quality applications and he can release in a short time. Because of this, the testing process must be automated to ensure applications run quickly and effectively. There are several test automation frameworks, specifically for web-based applications that offer effective features and performance to test applications more effectively, such as Katalon Studio, Cypress and WebDriverIO. The purpose of this research is to find the best test automation framework based on performance with certain parameters and sub-parameters. The author runs functional testing on each test automation framework with several test cases and provisions from each framework in a web-based application, and generates reports from each framework with automation testing progress parameters and tool usability parameters using The Distance To The Ideal Alternative method (DIA), and determine the weight for each parameter and sub-parameters. The results of a comparative analysis of test automation frameworks for web-based applications show that WebDriverIO has the best performance compared to other test automation frameworks with a value of 0 in the DIA Method, indicating that WebDriverIO has zero distance from the ideal alternative.


Keywords


cypress;katalon studio;test automation framework; webdriverio

Full Text:

PDF

References


D. Wahyono, Automation Regression Testing Pada Aplikasi iFocus Mobile Menggunakan Katalon Studio Studi Kasus PT GUE, UNIVERSITAS ATMA JAYA YOGYAKARTA, vol. 186, p. 17, 2020.

L. C. &. J. Gregory, Agile Testing: A Practical Guide for Testers and Agile Teams, Boston: Pearson Education, 2009.

Meiliana, Siklus Pengujian Perangkat Lunak, 12 Desember 2018. [Online]. Available: https://socs.binus.ac.id/2018/12/06/siklus-pengujian-perangkat-lunak/.

I. N. Laily, Pengertian Website Menurut Para Ahli, Beserta Jenis dan Fungsinya, 7 Februari 2022. [Online]. Available: https://katadata.co.id/safrezi/berita/6200a2a9697ec/pengertian-website-menurut-para-ahli-beserta-jenis-dan-fungsinya. [Diakses 9 Mei 2023].

C. Merina, A Comparative analysis of test automation frameworks performance for functional testing in android-based applications using the distance to the ideal alternative method, Third International Conference on Informatics and Computing (ICIC), pp. 1-6, 2018.

S. K. a. P. Upadhyay, Performance Evaluation and Comparison of Software Testing Tools, VSRD Int. J. Comput. Sci. Inf. Technol, vol. 2, no. 10, p. 801808, 2012.

R. R. a. Shallu, Performance Evaluation and Comparison of Software Testing Tool, Int. J. Inf. Comput. Technol, vol. 3, no. 7, p. 711716, 2013.

W. Saputra, Apa itu Automation Testing ?, 1 Mei 2022. [Online]. Available: https://dosenit.com/tekno/apa-itu-automation-testing. [Diakses 10 Mei 2023].

J. S. Alla Shtokal, Comparative analysis of frameworks used in automated testing on example of TestNG and WebdriverIO, Journal of Computer Sciences Institute, no. 19, pp. 100-106, 2021.

H. Nguyen, Single-Page Application And Front-End Testing Methods-Built with React and React Router, Tested with Jest and Cypress, TURKU UNIVERSITY OF APPLIED SCIENCES, 2022.




DOI: https://doi.org/10.33508/wt.v22i1.5027

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Creative Commons License
Widya Teknik is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License