Container Scheduling: A Taxonomy, Open Issues and Future Directions for Scheduling of Containerized Microservices in Cloud Environments

Authors

  • Anil Prajapati, Manish M Patel

Keywords:

Cloud Computing, Containerization, Container scheduling, Microservice, Machine learning

Abstract

Containerization offers lightweight virtualization and modern applications are adopting containers because of their scalability, portability, and flexible deployment, particularly with microservices. In contrast to monolithic architecture, microservice design is a new paradigm that delivers granular and loosely coupled services. With containerization, it is feasible to create a scalable application architecture made up of several microservices. For their production environment, companies like Netflix, Google, Microsoft, and others have been using cloud environments based on containers. We have presented an extensive review of containerization, and microservice architecture in this paper. The study also discusses container orchestration, classification of container scheduling techniques, optimization objectives for scheduling of container-based microservices, and a comparison of different container orchestration platforms. Container scheduling strategies are widely developed using heuristic and meta-heuristic techniques. Designing a resource efficient scheduling technique for containerized microservice is a key challenge due to various factors such as dynamic workload and diverse resource requirements. Machine learning has great potential and machine learning-based techniques have been employed for the optimized scheduling of containerized microservices in recent years. It is possible to implement an intelligent container scheduling approach to forecast performance. Machine learning-based multi-objective container scheduling solutions can be proposed to obtain effective resource usage of cloud environment. We mention areas that still need investigation in the field of container scheduling for containerized microservices.

Downloads

Download data is not yet available.

References

XiliWana , XinjieGuana,∗ , TianjingWanga , GuangweiBaia , Baek-Yong Choi, “Application deployment using Microservice and Docker containers: Framework and optimization”, Journal of Network and Computer Applications 119 (2018) 97–109

M. SRIRAGHAVENDRA1 & PRATEEK JAIN2,” VIRTUAL MACHINE VS CONTAINER: AN APPLICATION PERFOMANCE” ,International Journal of General Engineering and Technology (IJGET) ,ISSN(P): 2278-9928; ISSN(E): 2278-9936 Vol. 6, Issue4, Jun – Jul 2017; 29-40

Imtiaz Ahmad, Mohammad Gh. AlFailakawi , AsayelAlMutawa, LatifaAlsalman,” Container scheduling techniques: A Survey and assessment”, Journal of King Saud University – Computer and Information Sciences

Y. Hu, H. Zhou, C.d. Laat et al.,” Concurrent container scheduling on heterogeneous clusters with multi-resource constraints” ,Future Generation Computer Systems 102 (2020) 562–573

MIAO LIN 1 , JIANQING XI1 , WEIHUA BAI 2 , AND JIAYIN WU ,“Ant Colony Algorithm for Multi-Objective Optimization of Container-Based Microservice Scheduling in Cloud”IEEE Access VOLUME 7, 2019

Qian Qu, Ronghua Xu, SeyedYahyaNikouei, Yu Chen “An Experimental Study on Microservices based Edge Computing Platforms”, IEEE Xplore 2017

VindeepSingh,Sateesh K Peddoju,”Container-based Microservice Architecture for Cloud Applications”, IEEE International Conference on Computing, Communication and Automation (ICCCA2017), ISBN: 978-1-5090-6471-7/17/$31.00 ©2017 IEEE

OMOGBAI OLEGHE, “Container Placement and Migration in Edge Computing: Concept and Scheduling Models”,IEEE Access 2021

Guisheng Fan1,2 , Liang Chen1 , Huiqun Yu1 , and Wei Qi1,”Multi-Objective Optimization of Container-Based Microservice Scheduling in Edge Computin”, Computer Science and Information Systems 2020

Ouafa Bentaleb1,2,3 · Adam S. Z. Belloum3 · Abderrazak Sebaa4,5 Aouaouche El-Maouhab,”Containerization technologies: taxonomies, applications and challenges”, The Journal of Supercomputing 2021

Salah, M. Jamal Zemerly, Chan YeobYeun, Mahmoud Al-Qutayri, Yousof Al-Hammadi,” Performance Comparison between Container-based and VM-based Services”, 978-1-5090-3672-1/17/$31.00 ©2017 IEEE

Sheng Wang, Zhijun Ding, Senior Member, IEEE, ChangjunJiang,”Elastic Scheduling for Microservice Applications in Clouds”, IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS:1045-92(19)-2020

JunmiBo An, Donggang Cao, Xiangqun Chen,” Comparing Container-based Microservices and Workspace as a Service:Which One to Choose?”, 2018 IEEE Symposium on Service-Oriented System Engineering”, 0-7695-6394-5/18/$31.00 ©2018 IEEE

Docker Containers and VMs.https://www.weave.works/blog/a-practical-guide-to-choosing-between-docker-containers-and-vms.Accessed January 2022

Microservice vs Monolithic. https://www.suse.com/c/rancher_blog/microservices-vs-monolithic-architectures/. Accessed June 2023

Chris Richardson of Eventuate,Building Microservices, https://www.nginx.com/blog/building-microservices-using-an-api-gateway/. Accessed: December 2023

Tarek Menouer,PatriceDarmon ,“New Scheduling Strategy based on Multi-CriteriaDecision Algorithm” 2019 27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), 2377-5750/19/$31.00 ©2019 IEEE

Rajkumar Buyya1, Maria A. Rodriguez1, Adel NadjaranToosi, Jaeman Park,” Cost-Efficient Orchestration of Containers in Clouds: A Vision, Architectural Elements, and Future Directions”, Cloud Computing and Distributed Systems (CLOUDS) Lab

Claus Pahl∗ and Antonio Brogi‡ and Jacopo Soldani‡ and PooyanJamshidi† “Cloud Container Technologies: a State-of-the-Art Review”, IEEE Transactions on Cloud computing 2017

Maria A. Rodriguez RajkumarBuyya,” Container-based cluster orchestration systems: A taxonomy and future directions”, © 2018 John Wiley & Sons, Ltd

Abdul Saboor 1,* ,MohdFadzil Hassan 2, Containerized Microservices Orchestration and Provisioning in Cloud Computing: A Conceptual Framework and Future Perspectives”, Appl. Sci. 2022, 12, 5793

Maria Fazio,AntonioCelest,RajivRanjan,LydiaChen,Chang Liu,” Open Issues in Scheduling Microservices in the Cloud” ,IEEE cloud computing , 2325-6095/16/$33.00 © 2016 IEEE September/October 2016

Kaewkasi , KornrathakChuenmuneewong,” Improvement of Container Scheduling for Docker using Ant Colony Optimization” ,IEEE cloud computing , 978-1-4673-9077/4/17/ © 2017 IEEE October 2017

Hamid MohammadiFard ,“Dynamic Multi-objective Scheduling of Microservices in the Cloud” 2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC)

XUEHUA ZHAO,” Microservice Based Computational Offloading Framework and Cost Efficient Task Scheduling Algorithm in Heterogeneous Fog Cloud Network”,IEEE Access VOLUME 8, 2020

Tarek Menouer Patrice Darmon,” New Scheduling Strategy based on Multi-Criteria Decision Algorithm” , 2019 27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing ,2377-5750/19/$31.00 ©2019 IEEE DOI 10.1109/PDP.2019.00022

Mehmet Söylemez1 ,BedirTekinerdogan 2,* and AyçaKolukısaTarhan 1,” Challenges and Solution Directions of Microservice Architectures: A Systematic Literature Review”, Appl. Sci. 2022, 12, 5507. https://doi.org/10.3390/app12115507

Z. Zhong, “Machine Learning-based Orchestration of Containers: A Taxonomy and Future Directions” ACM Computing Surveys, Vol. 54, No. 10s, Article 217. Publication date: September 2022

NandanJha,Saurabh Garg, Prem Prakash Jayaraman,RajkumarBuyya,RajivRanjanCelest, ” A Holistic Evaluation of Docker Containers for Interfering Microservices” , 2018 IEEE International Conference on Services Computing,2474-2473/18/$31.00 ©2018 IEEEDOI 10.1109/SCC.2018.00012

MingchangWei,Yang Yu,,” A Container Scheduling Strategy Based on Machine Learning in Microservice Architecture”, 2019 IEEE International Conference on Services Computing (SCC), 2474-2473/19/$31.00 ©2019 IEEEDOI 10.1109/SCC.2019.00023

Ye Wu ,HaopengChen,”ABP Scheduler :Speeding up service spread in Docker swarm” , 2017 IEEE International journal on Parallel and distributed Processing with Applications”, 0-7695-6329-5/17 2017 IEEE

Junming Ma, Bo An, Donggang Cao, Xiangqun Chen,” Comparing Container-based Microservices and Workspace as a Service:Which One to Choose?”, 2018 IEEE Symposium on Service-Oriented System Engineering”, 0-7695-6394-5/18/$31.00 ©2018 IEEE

Christophe C´ erin, Tarek Menouer, WalidSaad and Wiem Ben AbdallahChris,” A New Docker Swarm Scheduling Strategy”, 2017 IEEE 7th International Symposium on Cloud and Service Computing, 978-0-7695-6328-2/17 $31.00 © 2017 IEEE

Ayman Noor∗†, DevkiNandanJha∗, Karan Mitra‡, Prem Prakash Jayaraman§, Arthur Souza¶, Rajiv Ranjan∗andSchahramDustdar, “A framework for monitoring microservice-oriented cloud applications in heterogeneous virtualization environments”, 2019 IEEE 12th International Conference on Cloud Computing (CLOUD), 2159-6190/19/$31.00 ©2019 IEEE

Michel Gokan Khan, Member, IEEE, Javid Taheri, Senior Member, IEEE,”PerfSim: A Performance Simulator for Cloud Native Microservice Chains:, arXiv:2103.08983v2 [2017]

Guo ,“A Container Scheduling Strategy Based on Neighborhood Division in Micro Service” 978-1-5386-3416-5/18/$31.00 ©2018 IEEE

Raj Gunasekaran,”Characterizing Bottlenecks in Scheduling Microservices on Serverless Platforms”, 2020 IEEE 40th International Conference on Distributed Computing Systems (ICDCS)

Rohan Mahapatra,Exploring Efficient ML-based Scheduler for Microservices in Heterogeneous Clusters

1st Guozhi Li,” Microservices: architecture, container, and challenges”, 2020 IEEE 20th International Conference on Software Quality, Reliability and Security Companion (QRS-C)

Qilong Li, “Multi-Algorithm Collaboration Scheduling Strategy for Docker Container”, 2017 International Conference on Computer Systems, Electronics and Control (ICCSEC)

Christina Terese Joseph K. Chandrasekaran,” Straddling the crevasse: A review of microservice software architecture foundations and recent advancements”, DOI: 10.1002/spe.2729

Yanjun Shi *, YijiaGuo, LinglingLv and Keshuai Zhang,” An Efficient Resource Scheduling Strategy for V2X Microservice Deployment in Edge Servers”, Future Internet 2020, 12, 172; doi:10.3390/fi12100172

1Pratham Jangra, 2Anuttam Anand, 3Dr. Amit Kumar Tyagi, “Survey on Container Systems and Their Efficient Orchestration Algorithms”, International Journal of Creative Research Thoughts (IJCRT)

Ebook for .Net microservice for containerized applications, Microsoft book

Yiren Li1,2, Tieke Li1 , Pei Shen2 , Liang Hao2,” Sim-DRS: a similarity-based dynamic resource scheduling algorithm for microservice-based web systems”, PeerJComput. Sci. 7:e824 DOI 10.7717/peerj-cs.824

Vishal Rao1 , Vishnu Singh1 “Scheduling Microservice Containers on Large Core Machines through Placement and Coalescing”

Downloads

Published

09.07.2024

How to Cite

Anil Prajapati. (2024). Container Scheduling: A Taxonomy, Open Issues and Future Directions for Scheduling of Containerized Microservices in Cloud Environments. International Journal of Intelligent Systems and Applications in Engineering, 12(22s), 1108–1122. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/6639

Issue

Section

Research Article