Optimized Resource Allocation for High-Performance Cloud Systems using Machine Learning
Keywords:
Cloud resource allocation, LightGBM, feature bundling, adversarial validation, multi-cloud service placement, and machine learning.Abstract
Cloud computing forms the foundation of modern digital infrastructure, especially in multi-cloud environments where optimized resource allocation is critical for ensuring performance, reliability, and low-latency service delivery. This research aims to fill the gap in dynamic, intelligent resource allocation strategies by addressing issues like high-dimensional feature noise, data drift, and workload variability—limitations often overlooked in traditional rule-based approaches. A novel machine learning pipeline is proposed, integrating Leaf-Wise Feature Bundling (LFB) and Adversarial Validation Re-weighting into a LightGBM classifier. LFB reduces feature dimensionality by clustering highly correlated attributes, while adversarial validation detects train-test distribution shifts and assigns sample-specific weights to enhance generalization. The combined approach significantly improves classification performance, achieving 100% accuracy on a real-world multi-cloud dataset and outperforming baseline models. Experimental analyses confirm the robustness, scalability, and adaptability of the model, highlighting its potential for intelligent, real-time decision-making in complex, high-performance cloud systems.
Downloads
References
Grover, Vikas, Ishu Verma, and Praveen Rajagopalan. Achieving Digital Transformation Using Hybrid Cloud: Design standardized next-generation applications for any infrastructure. Packt Publishing Ltd, 2023.
Saif, Mufeed Ahmed Naji, S. K. Niranjan, Belal Abdullah Hezam Murshed, Hasib Daowd Esmail Al-Ariki, and Hudhaifa Mohammed Abdulwahab. "Multi-agent QoS-aware autonomic resource provisioning framework for elastic BPM in containerized multi-cloud environment." Journal of Ambient Intelligence and Humanized Computing 14, no. 9 (2023): 12895-12920.
Jangjou, Mehrdad, and Mohammad Karim Sohrabi. "A comprehensive survey on security challenges in different network layers in cloud computing." Archives of Computational Methods in Engineering 29, no. 6 (2022): 3587-3608
Chuang, Yen-Ching, and Yee Ming Chen. "Digital servitization of symbiotic service composition in product-service systems." Computers in Industry 138 (2022): 103630.
Ullah, Amjad, Tamas Kiss, József Kovács, Francesco Tusa, James Deslauriers, Huseyin Dagdeviren, Resmi Arjun, and Hamed Hamzeh. "Orchestration in the cloud-to-things compute continuum: taxonomy, survey and future directions." Journal of Cloud Computing 12, no. 1 (2023): 1-29.
Cen, Bowei, Chunchao Hu, Zexiang Cai, Zhigang Wu, Yanxu Zhang, Jianing Liu, and Zhuo Su. "A configuration method of computing resources for microservice-based edge computing apparatus in smart distribution transformer area." International Journal of Electrical Power & Energy Systems 138 (2022): 107935.
Yari Eili, Mansoureh, and Jalal Rezaeenour. "A survey on recommendation in process mining." Concurrency and Computation: Practice and Experience 34, no. 26 (2022): e7304.
Rosati, Riccardo, Luca Romeo, Gianalberto Cecchini, Flavio Tonetto, Paolo Viti, Adriano Mancini, and Emanuele Frontoni. "From knowledge-based to big data analytic model: a novel IoT and machine learning based decision support system for predictive maintenance in Industry 4.0." Journal of Intelligent Manufacturing 34, no. 1 (2023): 107-121.
Kamila, Nilayam Kumar, Jaroslav Frnda, Subhendu Kumar Pani, Rashmi Das, Sardar MN Islam, Pawan Kumar Bharti, and Kamalakanta Muduli. "Machine learning model design for high performance cloud computing & load balancing resiliency: An innovative approach." Journal of King Saud University-Computer and Information Sciences 34, no. 10 (2022): 9991-10009.
Kumar, Yogesh, Surabhi Kaul, and Yu-Chen Hu. "Machine learning for energy-resource allocation, workflow scheduling and live migration in cloud computing: State-of-the-art survey." Sustainable Computing: Informatics and Systems 36 (2022): 100780.
Guo, Ya-guang, Qian Yin, Yixiong Wang, Jun Xu, and Leqi Zhu. "Efficiency and optimization of government service resource allocation in a cloud computing environment." Journal of Cloud Computing 12, no. 1 (2023): 18.
Vhatkar, Kapil N., and Girish P. Bhole. "Optimal container resource allocation in cloud architecture: A new hybrid model." Journal of King Saud University-Computer and Information Sciences 34, no. 5 (2022): 1906-1918.
Fernández-Cerero, Damián, José A. Troyano, Agnieszka Jakóbik, and Alejandro Fernández-Montes. "Machine learning regression to boost scheduling performance in hyper-scale cloud-computing data centres." Journal of King Saud University-Computer and Information Sciences 34, no. 6 (2022): 3191-3203.
Sangaiah, Arun Kumar, Amir Javadpour, Pedro Pinto, Samira Rezaei, and Weizhe Zhang. "Enhanced resource allocation in distributed cloud using fuzzy meta-heuristics optimization." Computer Communications 209 (2023): 14-25.
Amer, Dina A., Gamal Attiya, Ibrahim Zeidan, and Aida A. Nasr. "Elite learning Harris hawks optimizer for multi-objective task scheduling in cloud computing." The Journal of Supercomputing 78, no. 2 (2022): 2793-2818.
Feng, Yuxin, and Feiyang Liu. "Resource management in cloud computing using deep reinforcement learning: a survey." In China aeronautical science and technology youth science forum, pp. 635-643. Singapore: Springer Nature Singapore, 2022.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
