A Survey on Various Load Balancing Approaches in Distributed and Parallel Computing Environment
Keywords:
Distributed Computing, Load Balancing, Heterogeneous System, Task allocation, HeuristicsAbstract
One of the important issues in distributed and parallel computing is to allocate computational load across different processors or nodes by making better utilization of all the available resources and increasing system performance or throughput. Since this survey mainly reviews and categorize the study on load balancing and task allocation as per the characteristics of distributed systems to make comprehensive taxonomy and to correlate studies on various types of load balancing techniques. Various load balancing techniques helps to meet the QoS requirements and simultaneously maximize throughput by optimum use of the resources. Firstly, this survey briefs the general characteristics of load balancing and distributed systems. On the basis of these characteristics, the survey reviews the study on load balancing and task allocation with respect to resource optimization, various techniques to achieve reliability, load balancing in heterogeneous environment. The resources and workloads must be scheduled in an efficient manner to balance the load. Through the survey, different load balancing techniques are summarized that resolve the issue of task scheduling and load balancing, also in this area the related studies can be understood well on how the general characteristics of distributed systems are satisfied.
Downloads
References
Mrs. Minal Shahakar, Dr. Surenda Mahajan, Dr. Lalit Patil, “Load Balancing in Distributed Cloud Computing: A Reinforcement Learning Algorithms in Heterogeneous Environment”, International Journal on Recent and Innovation Trends in Computing and Communication, Vol. 11, Issue 2, 2023.
YuAng Chen and Yeh-Ching Chung, “Workload Balancing via Graph Reordering on Multicore Systems”, IEEE Transactions on Parallel and Distributed Systems, Vol. 33, No. 5, May 2022.
Andrea Giordano, Alessio De Rango, Rocco Rongo, Donato D’Ambrosio, and William Spataro, “Dynamic Load Balancing in Parallel Execution of Cellular Automata”, IEEE Transactions on Parallel and Distributed Systems, Vol. 32, No. 2, February 2021.
Alberto Cabrera, Alejandro Acosta, Francisco Almeida, and Vicente Blanco, “A Dynamic Multi–Objective Approach for Dynamic Load Balancing in Heterogeneous Systems”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, No. 10, October 2020.
Yinghao Yu , Wei Wang , Renfei Huang , Jun Zhang , and Khaled Ben Letaief, “Achieving Load-Balanced, Redundancy-Free Cluster Caching with Selective Partition”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, No. 2, February 2020.
Mahdi Jafari Siavoshani , Farzad Parvaresh , Ali Pourmiri , and Seyed Pooya Shariatpanahi, “Coded Load Balancing in Cache Networks”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, No. 2, February 2020.
Guoxin Liu, Haiying Shen, and Haoyu Wang, “Towards Long-View Computing Load Balancing in Cluster Storage Systems”, IEEE Transactions On Parallel And Distributed Systems, Vol. 28, No. 6, June 2017.
Jonatha Anselmi and Josu Doncel, “Asymptotically Optimal Size-Interval Task Assignments”, IEEE Transactions On Parallel And Distributed Systems, Vol. 30, No. 11, November 2019.
Juan Luis Jimenez Laredo, Frederic Guinand, Damien Olivier, and Pascal Bouvry, “Load Balancing at the Edge of Chaos: How Self-Organized Criticality Can Lead to Energy-Efficient Computing”, IEEE Transactions On Parallel And Distributed Systems, Vol. 28, No. 2, February 2017.
Qiong Chen, Zimu Zheng, Chuang Hu, Dan Wang, and Fangming Liu, “On-Edge Multi-Task Transfer Learning: Model and Practice With Data-Driven Task Allocation”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, No. 6, June 2020.
Wenzhong Guo, Jie Li, Guolong Chen, Yuzhen Niu, and Chengyu Chen, “A PSO-Optimized Real-Time Fault-Tolerant Task Allocation Algorithm in Wireless Sensor Networks”, IEEE Transactions On Parallel And Distributed Systems, Vol. 26, No. 12, December 2015.
Ashraf Suyyagh and Zeljko Zilic, “Energy and Task-Aware Partitioning on Single-ISA Clustered Heterogeneous Processors”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, No. 2, February 2020.
Pingpeng Yuan, Changfeng Xie, Ling Liu, and Hai Jin, “PathGraph: A Path Centric Graph Processing System”, IEEE Transactions On Parallel And Distributed Systems, Vol. 27, No. 10, October 2016. Design And Development of An Efficient Approach for Task Allocation in Distributed Systems Using Heuristics Environment 26 | SKNCOE, Research Centre - Computer Engineering 2022
Lazaros Papadopoulos, Dimitrios Soudris, Christoph Kessler, August Ernstsson, Johan Ahlqvist, Nikos Vasilas, Athanasios I. Papadopoulos, Panos Seferlis, Charles Prouveur, Matthieu Haefele, Samuel Thibault, Athanasios Salamanis, Theodoros Ioakimidis, and Dionysios Kehagias, “EXA2PRO: A Framework for High Development Productivity on Heterogeneous Computing Systems”, IEEE Transactions On Parallel And Distributed Systems, Vol. 33, No. 4, April 2022.
Li Shi, Zhemin Zhang, and Thomas Robertazzi, “Energy-Aware Scheduling of Embarrassingly Parallel Jobs and Resource Allocation in Cloud”, IEEE Transactions On Parallel And Distributed Systems, Vol. 28, No. 6, June 2017.
Dazhao Cheng, Jia Rao, Yanfei Guo, Changjun Jiang, and Xiaobo Zhou, “Improving Performance of Heterogeneous MapReduce Clusters with Adaptive Task Tuning”, IEEE Transactions On Parallel And Distributed Systems, Vol. 28, No. 3, March 2017.
Zhiyao Hu , Dongsheng Li, Dongxiang Zhang , Yiming Zhang , and Baoyun Peng “Optimizing Resource Allocation for Data-Parallel Jobs Via GCN-Based Prediction”, IEEE Transactions On Parallel And Distributed Systems, Vol. 32, No. 9, September 2021.
Anandarup Mukherjee, Pallav Kumar Deb, and Sudip Misra, “Timed Loops for Distributed Storage in Wireless Networks”, IEEE Transactions On Parallel And Distributed Systems, Vol. 33, No. 3, March 2022.
Renyu Yang, Chunming Hu, Xiaoyang Sun, Peter Garraghan , Tianyu Wo, Zhenyu Wen, Hao Peng , Jie Xu, “Performance-Aware Speculative Resource Oversubscription for Large-Scale Clusters”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, No. 7, July 2020.
Dazhao Cheng, Xiaobo Zhou, Yu Wang and Changjun Jiang, “Adaptive Scheduling Parallel Jobs with Dynamic Batching in Spark Streaming”, IEEE Transactions On Parallel And Distributed Systems, Vol. 29, No. 12, December 2018.
Laiping Zhao, Yanan Yang, Ali Munir, Alex X. Liu, Yue Li, and Wenyu Qu, “Optimizing Geo-Distributed Data Analytics with Coordinated Task Scheduling and Routing”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, No. 2, February 2020.
Jiuchuan Jiang, Bo An, Yichuan Jiang, Senior Member, IEEE, Peng Shi, Zhan Bu, and Jie Cao, “Batch Allocation for Tasks with Overlapping Skill Requirements in Crowdsourcing”, IEEE Transactions On Parallel And Distributed Systems, Vol. 30, No. 8, August 2019.
Weng Chon Ao and Konstantinos Psounis, “Resource-Constrained Replication Strategies for Hierarchical and Heterogeneous Tasks”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, No. 4, April 2020.
Umar Ibrahim Minhas, Roger Woods, Dimitrios S. Nikolopoulos, and Georgios Karakonstantis, “Efficient Dynamic Multi-Task Execution on FPGA-Based Computing Systems”, IEEE Transactions on Parallel and Distributed Systems, Vol. 33, No. 3, March 2022. Design And Development of An Efficient Approach for Task Allocation in Distributed Systems Using Heuristics Environment 27 | SKNCOE, Research Centre - Computer Engineering 2022
Eunji Hwang, Suntae Kim, Tae-kyungYoo, Jik-Soo Kim, Soonwook Hwang, and Young-ri Choi, “Resource Allocation Policies for Loosely Coupled Applications in Heterogeneous Computing Systems”, IEEE Transactions on Parallel and Distributed Systems, Vol. 27, No. 8, August 2016.
Niraj Kumar, Jaishree Mayank, and Arijit Mondal, “Reliability Aware Energy Optimized Scheduling of Non-Preemptive Periodic Real-Time Tasks on Heterogeneous Multiprocessor System”, IEEE Transactions on Parallel and Distributed Systems, Vol. 31, No. 4, April 2020.
Myeonggyun Han , Jinsu Park , and Woongki Baek, “Design and Implementation of a Criticality and Heterogeneity-Aware Runtime System for Task-Parallel Applications”, IEEE Transactions on Parallel and Distributed Systems, Vol. 32, No. 5, May 2021.
Jiaying Meng, Haisheng Tan, Xiang-Yang Li, Zhenhua Han, and Bojie Li, “Online Deadline-Aware Task Dispatching and Scheduling in Edge Computing”, IEEE Transactions on Parallel and Distributed Systems, Vol. 31, No. 6, June 2020.
Hafiz Fahad Sheikh, Ishfaq Ahmad, and Dongrui Fan, “An Evolutionary Technique for Performance-Energy-Temperature Optimized Scheduling of Parallel Tasks on Multi-Core Processors”, IEEE Transactions On Parallel And Distributed Systems, Vol. 27, No. 3, March 2016.
Mark A. Oxley, Sudeep Pasricha, Anthony A. Maciejewski, Howard Jay Siegel, Jonathan Apodaca, Dalton Young, Luis Briceno, ~Jay Smith, Shirish Bahirat, Bhavesh Khemka, Adrian Ramirez, and Yong Zou, “Makespan and Energy Robust Stochastic Static Resource Allocation of a Bag-of-Tasks to a Heterogeneous Computing System”, IEEE Transactions On Parallel And Distributed Systems, Vol. 26, No. 10, October 2015.
Peiquan Jin, Xingjun Hao, Xiaoliang Wang, and Lihua Yue, “Energy-Efficient Task Scheduling for CPU-Intensive Streaming Jobs on Hadoop”, IEEE Transactions On Parallel And Distributed Systems, Vol. 30, No. 6, June 2019.
Mark A. Oxley, Sudeep Pasricha, Anthony A. Maciejewski, Howard Jay Siegel, Jonathan Apodaca, Dalton Young, Luis Briceno, Jay Smith, Shirish Bahirat, Bhavesh Khemka, Adrian Ramirez, and Yong Zou, “Makespan and Energy Robust Stochastic Static Resource Allocation of a Bag-of-Tasks to a Heterogeneous Computing System”, IEEE Transactions On Parallel And Distributed Systems, Vol. 26, No. 10, October 2015.
Li Chen , Yuan Feng, Baochun Li and Bo Li, “Efficient Performance-Centric Bandwidth Allocation with Fairness Tradeoff”, IEEE Transactions On Parallel And Distributed Systems, Vol. 29, No. 8, August 2018.
Haitao Zhang , Xin Geng, and Huadong Ma, “Learning-Driven Interference-Aware Workload Parallelization for Streaming Applications in Heterogeneous Cluster”, IEEE Transactions On Parallel And Distributed Systems, Vol. 32, No. 1, January 2021.
Amin Yoosefi and Hamid Reza Naji, “A Clustering Algorithm for Communication-Aware Scheduling of Task Graphs on Multi-Core Reconfigurable Systems”, IEEE Transactions On Parallel And Distributed Systems, Vol. 28, No. 10, October 2017.
Jalal Khamse-Ashari , Ioannis Lambadaris, George Kesidis, Bhuvan Urgaonkar, “An Efficient and Fair Multi-Resource Allocation Mechanism for Heterogeneous Servers”, IEEE Transactions On Parallel And Distributed Systems, Vol. 29, No. 12, December 2018.
Hafiz Fahad Sheikh, Ishfaq Ahmad, and Dongrui Fan, “An Evolutionary Technique for Performance-Energy-Temperature Optimized Scheduling of Parallel Tasks on Multi-Core Processors”, IEEE Transactions On Parallel And Distributed Systems, Vol. 27, No. 3, March 2016.
Myeonggyun Han , Jinsu Park , and Woongki Baek, “Design and Implementation of a Criticality-and Heterogeneity-Aware Runtime System for Task-Parallel Applications”, IEEE Transactions On Parallel And Distributed Systems, Vol. 32, No. 5, March 2021.
Tamilselvi, T. ., Lakshmi, D. ., Lavanya, R. ., & Revathi, K. . (2023). Digital Companion for Elders in Tracking Health and Intelligent Recommendation Support using Deep Learning. International Journal on Recent and Innovation Trends in Computing and Communication, 11(3), 145–152. https://doi.org/10.17762/ijritcc.v11i3.6331
Dwarkanath Pande, S. ., & Hasane Ahammad, D. S. . (2022). Cognitive Computing-Based Network Access Control System in Secure Physical Layer. Research Journal of Computer Systems and Engineering, 3(1), 14–20. Retrieved from https://technicaljournals.org/RJCSE/index.php/journal/article/view/36
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
