Scheduling Scientific Workflow to Improve Service Quality Parameters in the Cloud Computing
Keywords:
Scientific workflow, Cloud computing, Amazon Web Services, SchedulingAbstract
Cloud computing has emerged as a crucial platform for managing and executing time-constrained scientific applications, typically represented by workflow models and their scheduling. The scheduling of workflow applications in cloud computing poses a significant challenge, as they consist of numerous tasks with complex structures involving processing, data entry, storage access, and software functions. To address this challenge, users are provided with a convenient and cost-effective approach to run workflows on rented on-cloud Virtual Machines (VMs) at any time and from anywhere. With the growing dominance of pay-as-you-go pricing models in cloud services, extensive research has been conducted to minimize the cost of workflow execution by developing customized VM allocation mechanisms. However, most existing approaches assume static task execution times in the cloud, which can be estimated in advance. Unfortunately, this assumption is highly impractical in real-world scenarios due to performance variations among VMs. In this study, we propose a custom workflow scheduling algorithm designed to handle deadline-constrained workflows with random arrivals and uncertain task execution times, while ensuring higher CPU utilization. Our algorithm supports the use of containers to manage targets and optimize resource utilization, thereby reducing the overall cost of infrastructure resources and meeting individual workflow deadline constraints. Simulation results demonstrate that the proposed algorithm outperforms existing approaches in terms of rental costs and resource utilization efficiency.
Downloads
References
Felter, W.; Ferreira, A.; Rajamony, R.; Rubio, J. An updated performance comparison of virtual machines and Linux containers. In Proceedings of the 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), Philadelphia, PA, USA, 29–31 March 2015.
Jennings, B.; Stadler, R. Resource Management in Clouds: Survey and Research Challenges. J. Netw. Syst. Manag. 2015, 23, 567–619. [CrossRef]
Liu, P.; Hu, L.; Xu, H.; Shi, Z.; Tang, Y. A Toolset for Detecting Containerized Application’s Dependencies in CaaS Clouds. In Proceedings of the 2018 IEEE 11th International Conference on Cloud Computing (CLOUD), San Francisco, CA, USA, 2–7 July 2018.
Dragoni, N.; Giallorenzo, S.; Lluch-Lafuente, A.; Mazzara, M.; Montesi, F.; Mustafin, R.; Safina, L. Microservices: Yesterday, today, and tomorrow. In Present and Ulterior Software Engineering; Springer: Cham, Switzerland, 2017.
Singh, V.; Peddoju, S.K. Container-based microservice architecture for Cloud applications. In Proceedings of the 2017 International Conference on Computing, Communication and Automation (ICCCA), Greater Noida, India, 5–6 May 2017; pp. 847–852. [CrossRef]
A Survey on Scheduling Strategies for Workflow in Cloud Environment and Emerging Trends,Mainak Adhikari, Tarachand Amgoth and Satish Narayana Srirama,ACM, 2019.
A GSA based hybrid algorithm for bi objective workflow scheduling in Cloud computing, Anubhav Choudhary, Indrajeet Gupta, Vishakha Singh and Prasanta K. Jana, FGCS, 2018.
Minimizing cost and Makespan for workflow scheduling in Cloud using fuzzy dominance sort based HEFT, Xiumin Zhou, Gongxuan Zhang, Jin Sun, Junlong Zhou, Tongquan Wei and Shiyan Hu, Future Generation Computer System, 2018.
GRP-HEFT :A Budget Constrained Resource Provisioning Scheme for Workflow Scheduling in IaaS Clouds, Hamid Reza Faragardi, Mohammad Reza Saleh Sedghpour, Saber Fazliahmadi, Thomas Fahringer and Nayereh Rasouli, IEEE, 2019.
A Workflow Scheduling Deadline based Heuristic for Energy optimization in Cloud, Emile Cadorel, HeieneCoullon and Jean Marc Manaud, IEEE, 2019.
Cost-Efficient and Latency-Aware Workflow Scheduling Policy for Container-based Systems, Weiwen Zhang, Yong Liu, Long Wang, Zengxiang Li and Rick Siow Mong Goh, IEEE, 2018.
Concurrent Workflow Budget- and Deadline-constrained Scheduling in Heterogeneous Distributed Environments, N. Zhou, F. Li, K. Xu, and D. Qi, IEEE 2018.
Understanding the performance and potential of Cloud computing for scientific application,ISadooghi ae al, IEEE, 2017.
Makespan Driven Workflow Scheduling in Clouds Using Immune Based PSO Algorithm, Pengwei Wang, Yinghui Lei, Promise Ricardo Agbedanu, and Zhaohui Zhang, IEEE, 2020.
Cost and Makespan aware workflow scheduling in hybrid Clouds, Junlong Zhou, Tian Wang, Peijin Cong, Pingping Lu, Tongquan Wei and Mingsong Chen, JSA 2019.
Resource Provisioning for Task-batch based Workflows with Deadlines in Public Clouds, Z. Cai, X. Li, and R. Ruiz, ,IEEE 2019.
“Uncertainty-Aware Online Scheduling for Real- Time Workflows in Cloud Service Environment, H. Chen, X. Zhu, G. Liu, andW. Pedrycz , IEEE 2018.
“Cloud Pricing Models: Taxonomy, Survey, and Interdisciplinary Challenges, C. Wu, R. Buyya, and K. Ramamohanarao ACM, 2019.
Cost and Makespan aware workflow scheduling in hybrid Clouds, Junlong Zhou, Tian Wang, Peijin Cong, Pingping Lu, Tongquan Wei and Mingsong Chen, JSA 2019.
Multi Objective Cloud workflow scheduling: A Multiple Population Ant Colony System Approach, Zong-Gan Chen,Zhi Hui zhan, Yue Jiao Gong, Tian Long Gu, Feng Zhao, Hua Qiang Yuan, Xiaofeng Chen, Qing Li and Jun Zhang, IEEE 2018.
Decomposition Based Multi Objective Workflow Scheduling for Cloud Environments,EmmanuelBugingo, Wei Zheng, Dongzhan Zhang, Yingsheng Qin and Defu Zhang, Easychair, 2019.
Workflow Scheduling in Cloud computing environment with classification on ordinal optimization on using SVM, VahebSamandi, Debajyoti Mukhopadhyay and Nikhil Raut, IEEE 2019.
Budget and Deadline Aware E Science Workflow Scheduling in Clouds, Vahid Arabnejad, Kris Bubendorfer and Bryan Ng, IEEE 2018.
Dynamic Fault Tolerant Workflow Scheduling with Hybrid Spatial Temporal Re execution in Cloud, Na Wu, Decheng Zuo and Zhan Zhang, Information, 2019.
A new Optimization Method for Security Constrained Workflow Scheduling,Ali Abdali and SafaMeasoomyNia, IJCSE, 2019.
Fault Tolerant Scheduling for Scientific Workflow with Task Replication Method in Cloud, Zhongjin Li, Jiacheng Yu, Haiyang Hu, Jie Chen, Hua Hu, Jidong Ge and Victor Chang, Scipress,2018.
Workflow Scheduling Using Hybrid GA-PSO Algorithm in Cloud Computing,Ahmad M. Manasrah and Hanan Ba Ali, Wiley, 2018.
A Cuckoo based Workflow Scheduling Algorithm to Reduce Cost and Increase Load Balance in the Cloud Environment, Shahin Ghasemi and Ali Hanani, IJIV,2019.
Workflow Scheduling in Cloud Computing Using Memetic Algorithm, Abdulsalam Alsmady,Tareq Al Khraishi, Wail Mardidni ,Hadeel Alazzam and Yaser Khamayseh, IEEE 2019.
Performance Modeling and Workflow Scheduling of Microservice Based Application in Clouds, Liang Bao, Xiaoxuan Bu, Nana Ren and Mengqing Shen, IEEE, 2019.
Workflow Scheduling Algorithm in Cloud Cmoputing,SavioVaz,Alisha Crystal D’Almeda and Santhosh B,IJERT 2019.
User Priority Aware and Cost Constrained Workflow Scheduling in Clouds, Yuehing Chen, Yaunqing Xia, Ce Yan and Runze Gao, Chinese Control Conference, 2019.
A QoS aware Workflow Scheduling Method for Cloudlet based Mobile Cloud Computing,Wei Tian, Renhao Gu, Feng Ruan, Xihua Liu and Shucun Fu, IEEE, 2019.
Patil, S. D. ., & Deore, P. J. . (2023). Machine Learning Approach for Comparative Analysis of De-Noising Techniques in Ultrasound Images of Ovarian Tumors. International Journal on Recent and Innovation Trends in Computing and Communication, 11(2s), 230–236. https://doi.org/10.17762/ijritcc.v11i2s.6087
Martinez, M., Davies, C., Garcia, J., Castro, J., & Martinez, J. Machine Learning-Enabled Quality Control in Engineering Manufacturing. Kuwait Journal of Machine Learning, 1(2). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/122
Timande, S., & Dhabliya, D. (2019). Designing multi-cloud server for scalable and secure sharing over web. International Journal of Psychosocial Rehabilitation, 23(5), 835-841. doi:10.37200/IJPR/V23I5/PR190698
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
