Enhancing Testing Efficiency through the Implementation of an Optimal Test Automation Framework Selection Model
Keywords:
Quality Assurance, Test Automation Framework, Automation Tools, Test Cases, Test SuiteAbstract
Selecting the best automation testing framework from a diverse range of approaches poses a significant challenge, as the available selection schemes fail to produce substantial results when multiple testing scenarios with varying functional requirements are present. In this paper, the authors present the Quality Assurance (QA) aware algorithm and an Optimal Test Automation Framework Selection (OTAFS) model, which consider QA parameters for selecting the optimal automation testing framework. The reliability, throughput and execution time of the selected framework are identified as the most efficient parameters. The study discusses the results of QA parameter values for the selected automation frameworks, which are implemented using Python and Selenium platform is used to create test cases. The proposed model and algorithm is experimentally evaluated on an e-commerce website, and a comparative analysis of the results is provided with QA parameter values of different automation testing frameworks.
Downloads
References
Tripathy, P., & Naik, K. (2011). Software testing and quality assurance: theory and practice. John Wiley & Sons.
Amaricai, S., & Constantinescu, R. (2014). Designing a software test automation framework, Informatica Economica, 18(1), 152.
Lin, Y. D., Rojas, J. F., Chu, E. T. H., & Lai, Y. C. (2014). On the accuracy, efficiency, and reusability of automated test oracles for android devices. IEEE Transactions on Software Engineering, 40(10), 957-970.
Umar, M. A., &Zhanfang, C. (2019). A study of automated software testing: Automation tools and frameworks. International Journal of Computer Science Engineering (IJCSE), 6, 217-225.
Anjum, H., Babar, M. I., Jehanzeb, M., Khan, M., Chaudhry, S., Sultana, S., ... & Bhatti, S. N. (2017). A comparative analysis of quality assurance of mobile applications using automated testing tools. International Journal of Advanced Computer Science and Applications, 8(7).
Xu, D., Xu, W., Kent, M., Thomas, L., & Wang, L. (2014). An automated test generation technique for software quality assurance. IEEE transactions on reliability, 64(1), 247-268.
Brohi, A. B., Butt, P. K., & Zhang, S. (2019). Software Quality Assurance: Tools and Techniques. In Security, Privacy, and Anonymity in Computation, Communication, and Storage: SpaCCS 2019 International Workshops, Atlanta, GA, USA, July 14–17, 2019, Proceedings 12 (pp. 283-291). Springer International Publishing.
Huang, A. F., Lan, C. W., & Yang, S. J. (2009). An optimal QoS-based Web service selection scheme, Information Sciences, 179(19), 3309-3322.
Dobslaw, F., Feldt, R., Michaëlsson, D., Haar, P., de Oliveira Neto, F. G., &Torkar, R. (2019, October). Estimating return on investment for gui test automation frameworks. In 2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE) (pp. 271-282). IEEE.
Miranda, B., Cruciani, E., Verdecchia, R., &Bertolino, A. (2018, May). FAST approaches to scalable similarity-based test case prioritization. In Proceedings of the 40th International Conference on Software Engineering (pp. 222-232).
Winkler, D., Meixner, K., & Novak, P. (2019). Efficient and flexible test automation in production systems engineering. Security and Quality in Cyber-Physical Systems Engineering: With Forewords by Robert M. Lee and Tom Gilb, 227-265.
Elberzhager, F., Rosbach, A., Münch, J., & Eschbach, R. (2012). Reducing test effort: A systematic mapping study on existing approaches. Information and Software Technology, 54(10), 1092-1106.
Borg, M., Bengtsson, J., Österling, H., Hagelborn, A., Gagner, I., & Tomaszewski, P. (2022, May). Quality assurance of generative dialog models in an evolving conversational agent used for Swedish language practice. In Proceedings of the 1st International Conference on AI Engineering: Software Engineering for AI (pp. 22-32).
Yu, T., Srisa-an, W., &Rothermel, G. (2014, May). SimRT: An automated framework to support regression testing for data races. In Proceedings of the 36th International Conference on Software Engineering (pp. 48-59).
Shahamiri, S. R., Kadir, W. M. N. W., Ibrahim, S., & Hashim, S. Z. M. (2011). An automated framework for software test oracle. Information and Software Technology, 53(7), 774-788.
Salari, M. E., Enoiu, E. P., Afzal, W., &Seceleanu, C. (2022, April). Choosing a Test Automation Framework for Programmable Logic Controllers in CODESYS Development Environment. In 2022 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) (pp. 277-284). IEEE.
Lukasczyk, S., & Fraser, G. (2022, May). Pynguin: Automated unit test generation for python. In Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings (pp. 168-172).
Lukasczyk, S., Kroiß, F., & Fraser, G. (2023). An empirical study of automated unit test generation for Python. Empirical Software Engineering, 28(2), 36.
Thörn, J., Strandberg, P. E., Sundmark, D., & Afzal, W. (2022). Quality assuring the quality assurance tool: applying safety-critical concepts to test framework development. PeerJ Computer Science, 8, e1131.
Shirzadehhajimahmood, S., Prasetya, I. S. W. B., Dignum, F., Dastani, M., & Keller, G. (2021, August). Using an agent-based approach for robust automated testing of computer games. In Proceedings of the 12th International Workshop on Automating TEST Case Design, Selection, and Evaluation (pp. 1-8).
Graham, D. (2010). ROI of test automation: benefit and cost. Professionaltester. com, November, 2010.
Shahin, M., Babar, M. A., & Zhu, L. (2017). Continuous integration, delivery and deployment: a systematic review on approaches, tools, challenges and practices. IEEE access, 5, 3909-3943.
Singh, G., Choudhary, J., Laddhani, L. (2023) : An Optimal Selection Scheme for Automation Testing Framework with Quality Assurance. Grenze International Journal of Engineering and Technology, Volume 9, No. 1,p. 2935-2940 https://thegrenze.com ISSN(Online): 2395-5295, ISSN(Print): 2395-5287.
Singh, G., Choudhary, J., Laddhani, L. (2022): Taxonomic Analysis of DevOps Tools. JOURNAL OF ALGEBRAIC STATISTICS Volume 13, No. 3, p. 2725-2731 https://publishoa.com ISSN: 1309-3452.
Paigude, S. ., Pangarkar, S. C. ., Hundekari, S. ., Mali, M. ., Wanjale, K. ., & Dongre, Y. . (2023). Potential of Artificial Intelligence in Boosting Employee Retention in the Human Resource Industry. International Journal on Recent and Innovation Trends in Computing and Communication, 11(3s), 01–10. https://doi.org/10.17762/ijritcc.v11i3s.6149
Mr. Rahul Sharma. (2013). Modified Golomb-Rice Algorithm for Color Image Compression. International Journal of New Practices in Management and Engineering, 2(01), 17 - 21. Retrieved from http://ijnpme.org/index.php/IJNPME/article/view/13
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.