Parallel Automation for Cross-Browser and Cross-Device Validation in OTT Systems
Keywords:
OTT, Parallel Automation, Validation, BrowserAbstract
The over-the-top solutions need a smooth distribution of high-quality content on the wide variety of devices and browsers. As devices are becoming more and more diverse, it has become an urgent problem to guarantee affective and performance continuity. The paper gives an account of a parallel automation framework capable of extensive scalability and robustness through the combination of Selenium Grid, Appium, and cloud-based device farms that can be effectively used to perform cross-browser and cross-device validation. Our system has the potential to save a lot of execution time through dynamic test orchestration and parallel execution of tests, retaining preservation of accuracy and play back integrity of the visual elements. Experimental results of more than 300 test cases in multiple platforms, including Android and iOS, Smart TVs, and the latest versions of various web browsers, show improvement in the average time of feedback by more than 70 percent, 90 percent improvement in throughput, and an improvement in defect coverage detection. Other measurable key performance indicators include, pixel drift and adaptive bitrate (ABR) switching delays. We designed our framework to facilitate continuous integration processes, and it has been useful especially with regards to testing of the consistency of user interface and video streaming quality. The results present parallel automation as a cost efficient and scalable option of validating OTT platforms that will support quicker releases at the same time as maintaining a high level of ensured quality. The provided architecture is modular and extendable, so it can be flexibly applied to OTT-ecosystems and test technology development in the future.
Downloads
References
Xie, M., Ye, J., Xing, Z., & Ma, L. (2023). NICRO: Purely vision-based, non-intrusive Cross-Device and Cross-Platform GUI testing. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2305.14611
Mariani, L., Pezzè, M., Terragni, V., & Zuddas, D. (2021). An evolutionary approach to adapt tests across mobile apps. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2104.05233
Menegassi, A. A., & Endo, A. T. (2019). Automated tests for cross‐platform mobile apps in multiple configurations. IET Software, 14(1), 27–38. https://doi.org/10.1049/iet-sen.2018.5445
Vasquez, M. L., Moran, K., & Poshyvanyk, D. (2018). Continuous, Evolutionary and Large-Scale: A new perspective for Automated mobile app testing. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1801.06267
Fallahzadeh, E., Bavand, A. H., & Rigby, P. C. (2023). Accelerating Continuous Integration with Parallel Batch Testing. Accelerating Continuous Integration With Parallel Batch Testing, 55–67. https://doi.org/10.1145/3611643.3616255
Mathew, S. (2024). An Overview on Testing using Selanium. An Overview on Testing Using Selanium. https://doi.org/10.20944/preprints202404.0911.v1
Yu, S., Fang, C., Du, M., Ling, Y., Chen, Z., & Su, Z. (2023). Practical Non-Intrusive GUI Exploration Testing with Visual-based Robotic Arms. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2312.10655
García, B., Kloos, C. D., Alario-Hoyos, C., & Munoz-Organero, M. (2022). Selenium-Jupiter: A JUnit 5 extension for Selenium WebDriver. Journal of Systems and Software, 189, 111298. https://doi.org/10.1016/j.jss.2022.111298
García, B., Gallego, M., Gortázar, F., & Munoz-Organero, M. (2020). A survey of the Selenium ecosystem. Electronics, 9(7), 1067. https://doi.org/10.3390/electronics9071067
Kuutila, M., Mäntylä, M., & Raulamo-Jurvanen, P. (2016). Benchmarking Web-testing - Selenium versus Watir and the Choice of Programming Language and Browser. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1611.00578
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
