Integrating Long Short-Term Memory and Reinforcement Learning in Federated Learning Frameworks for Energy-Efficient Signal Processing in UAV-Assisted Wireless Communication Networks

Authors

  • Mahesh Y. Sumthane, Kirti Saraswat

Keywords:

UAV, Long Short-Term Memory, Reinforcement Learning, signal processing, wireless communication networks, Federated Learning , energy efficiency

Abstract

This paper presents a comprehensive study of signal processing algorithms designed for enhancing the energy efficiency of UAV-aided wireless communication networks. We explore a sequence of advanced machine learning techniques, each tailored to address specific challenges within the network. We begin by detailing the application of Long Short-Term Memory (LSTM) networks, which are adept at uncovering patterns in data with unknown objectives or constraints. Echo-State Networks (ESNs) are then introduced for their proficiency in sequence and pattern detection, essential for classification and regression prediction problems in signal processing. We further examine the role of Reinforcement Learning (RL) in actively engaging with prediction problems and NP-hard problems, leveraging a reward-based system to facilitate active learning. In addressing the critical concerns of data privacy and excessiveness, Federated Learning (FL) is proposed as a decentralized solution that promotes local training on UAVs, significantly reducing the need for data centralization. Through the methods outlined, we achieve a novel optimization framework that integrates the aforementioned techniques, commencing with the identification and mitigation of unwanted vehicles in the network, which is processed into a Data Traffic Matrix. This feeds into an LTE DIC algorithm based on correlation and culminates in an optimization process that considers specific network parameters 'P' and 'B'. The results, derived from the comparative analysis using the established techniques, indicate a significant improvement in network efficiency. The proposed framework demonstrates a marked enhancement in energy efficiency, with an observed improvement percentage over existing methods. This substantiates the efficacy of the integrated approach, suggesting that the application of machine learning algorithms can lead to superior performance in UAV-assisted networks, providing a significant step forward in the development of autonomous and efficient wireless communication systems.

Downloads

Download data is not yet available.

References

Maheswar, Rajagopal, Murugan Kathirvelu, and Kuppusamy Mohanasundaram. "Energy Efficiency in Wireless Networks." Energies 17, no. 2 (2024): 417.

Jeganathan, Anandpushparaj, Balaji Dhayabaran, Dushantha Nalin K. Jayakody, Sanjaya Arunapriya Ranchagodage Don, and P. Muthuchidambaranathan. "An intelligent age of information based self‐energized UAV‐assisted wireless communication system." IET Communications 17, no. 19 (2023): 2141-2151.

Rose, JT Anita, C. A. Subasini, F. Sangeetha Francelin Vinnarasi, and S. P. Karuppiah. "Power allocation for enhancing energy efficiency in unmanned aerial vehicle networks." International Journal of Communication Systems (2024): e5662.

Ghamari, Mohammad, Pablo Rangel, Mehrube Mehrubeoglu, Girma S. Tewolde, and R. Simon Sherratt. "Unmanned aerial vehicle communications for civil applications: A review." IEEE Access 10 (2022): 102492-102531.

Massaoudi, Ayman, Abdelwahed Berguiga, Ahlem Harchay, Mossaad Ben Ayed, and Hafedh Belmabrouk. "Spectral and energy efficiency trade-off in UAV-based olive irrigation systems." Applied Sciences 13, no. 19 (2023): 10739.

Gupta, Akshita, and Sachin Kumar Gupta. "A survey on green unmanned aerial vehicles‐based fog computing: Challenges and future perspective." Transactions on Emerging Telecommunications Technologies 33, no. 11 (2022): e4603.

Alkanhel, Reem, Ahsan Rafiq, Evgeny Mokrov, Abdukodir Khakimov, Mohammed Saleh Ali Muthanna, and Ammar Muthanna. "Enhanced Slime Mould Optimization with Deep-Learning-Based Resource Allocation in UAV-Enabled Wireless Networks." Sensors 23, no. 16 (2023): 7083.

Luo, Yixin, and Gui Fu. "UAV based device to device communication for 5G/6G networks using optimized deep learning models." Wireless Networks (2023): 1-15.

El-Gayar, Mostafa Mahmoud, and Mohammed Nasser Ajour. "Resource Allocation in UAV-Enabled NOMA Networks for Enhanced Six-G Communications Systems." Electronics 12, no. 24 (2023): 5033.

Alharbi, Hatem A., Barzan A. Yosuf, Mohammad Aldossary, Jaber Almutairi, and Jaafar MH Elmirghani. "Energy Efficient UAV-Based Service Offloading Over Cloud-Fog Architectures." IEEE Access 10 (2022): 89598-89613.

Alnakhli, Mohammad, Ehab Mahmoud Mohamed, Wazie M. Abdulkawi, and Sherief Hashima. "Joint User Association and Power Control in UAV Network: A Graph Theoretic Approach." Electronics 13, no. 4 (2024): 779.

Abdel-Basset, Mohamed, Reda Mohamed, Ibrahim Alrashdi, Karam M. Sallam, and Ibrahim A. Hameed. "Evolution-based energy-efficient data collection system for UAV-supported IoT: Differential evolution with population size optimization mechanism." Expert Systems with Applications 245 (2024): 123082.

Ding, Xufei, Wen Tian, Guangjie Liu, and Xiaopeng Ji. "Energy Consumption Minimization in Unmanned Aerial Vehicle-Enabled Secure Wireless Sensor Networks." Sensors 23, no. 23 (2023): 9411.

Sugesh, M. S., and G. Vairavel. "Systematic Literature Review on the Machine Learning Techniques for UAV-Assisted mm-Wave Communications." In International Conference on Electrical and Electronics Engineering, pp. 517-534. Singapore: Springer Nature Singapore, 2023.

Chen, Xiaomin, Qinbin Zhou, Zhiheng Wang, Qiang Sun, and Miaomiao Xu. "Reliable and energy-efficient UAV-assisted air-to-ground transmission: Design, modeling and analysis." Computer Communications 204 (2023): 66-77.

Bouchekara, Houssem REH, Abdulazeez F. Salami, Yusuf A. Sha’aban, Mouaaz Nahas, Mohammad S. Shahriar, and Mohammed A. Alanezi. "TUBER: Time-aware UAV-based energy-efficient reconfigurable routing scheme for smart wireless livestock sensor network." Plos one 19, no. 1 (2024): e0292301.

Qi, Fei, Weiliang Xie, Lei Liu, Tao Hong, and Fanqin Zhou. "UAV Digital Twin Based Wireless Channel Modeling for 6G Green IoT." Drones 7, no. 9 (2023): 562.

Ejiyeh, Atefeh Mohseni. "Secure, Robust, and Energy-Efficient Authenticated Data Sharing in UAV-Assisted 6G Networks." arXiv preprint arXiv:2402.11382 (2024).

Bajracharya, Rojeena, Rakesh Shrestha, Shiho Kim, and Haejoon Jung. "6G NR-U based wireless infrastructure UAV: Standardization, opportunities, challenges and future scopes." IEEE Access 10 (2022): 30536-30555.

Liu, Hao, Renwen Chen, Shanshan Ding, Zihao Jiang, Fei Liu, and Junyi Zhang. "An energy efficiency routing protocol for UAV-aided WSNs data collection." Ad Hoc Networks 154 (2024): 103378.

Javed, Sadaf, Ali Hassan, Rizwan Ahmad, Waqas Ahmed, Rehan Ahmed, Ahsan Saadat, and Mohsen Guizani. "State-of-the-Art and Future Research Challenges in UAV Swarms." IEEE Internet of Things Journal (2024).

Carvajal-Rodriguez, Jorge, Marco Morales, and Christian Tipantuña. "3D path planning algorithms in UAV-enabled communications systems: a mapping study." Future Internet 15, no. 9 (2023): 289.

Xu, Zhenyu, Jinfang Li, and Xun Xu. "Research on Emergency Communication Technology of UAV Based on D2D." In International Conference on 5G for Future Wireless Networks, pp. 84-99. Cham: Springer Nature Switzerland, 2022.

Sharma, Jatin, and Pawan Singh Mehra. "Secure communication in IOT-based UAV networks: A systematic survey." Internet of Things (2023): 100883.

Fathollahi, Leyla, Mahmood Mohassel Feghhi, and Mahmoud Atashbar. "Energy optimization for full-duplex wireless-powered IoT networks using rotary-wing UAV with multiple antennas." Computer Communications 215 (2024): 62-73.

Yang, Biao, Xuanrui Xiong, He Liu, Yumei Jia, Yunli Gao, Amr Tolba, and Xingguo Zhang. "Unmanned Aerial Vehicle Assisted Post-Disaster Communication Coverage Optimization Based on Internet of Things Big Data Analysis." Sensors 23, no. 15 (2023): 6795.

Azadur, Rahman Md, Chaitali J. Pawase, and KyungHi Chang. "Multi‐UAV path planning utilizing the PGA algorithm for terrestrial IoT sensor network under ISAC framework." Transactions on Emerging Telecommunications Technologies 35, no. 1 (2024): e4916.

Xu, Jinyong. "Efficient trajectory optimization and resource allocation in UAV 5G networks using dueling-Deep-Q-Networks." Wireless Networks (2023): 1-11.

Banafaa, Mohammed, Ömer Pepeoğlu, Ibraheem Shayea, Abdulraqeb Alhammadi, Zaid Shamsan, Muneef A. Razaz, Majid Alsagabi, and Sulaiman Al-Sowayan. "A Comprehensive Survey on 5G-and-Beyond Networks with UAVs: Applications, Emerging Technologies, Regulatory Aspects, Research Trends and Challenges." IEEE Access (2024).

Khan, Naveed, Ayaz Ahmad, Abdul Wakeel, Zeeshan Kaleem, Bushra Rashid, and Waqas Khalid. "Efficient UAVs Deployment and Resource Allocation in UAV-Relay Assisted Public Safety Networks for Video Transmission." IEEE Access (2024).

Lu, Yuxi, Wu Wen, Kostromitin Konstantin Igorevich, Peng Ren, Hongxia Zhang, Youxiang Duan, Hailong Zhu, and Peiying Zhang. "UAV Ad Hoc Network Routing Algorithms in Space–Air–Ground Integrated Networks: Challenges and Directions." Drones 7, no. 7 (2023): 448.

Al Amin, Ahmed, Junho Hong, Van-Hai Bui, and Wencong Su. "Emerging 6G/B6G wireless communication for the power infrastructure in smart cities: Innovations, challenges, and future perspectives." Algorithms 16, no. 10 (2023): 474.

Downloads

Published

26.03.2024

How to Cite

Kirti Saraswat, M. Y. S. (2024). Integrating Long Short-Term Memory and Reinforcement Learning in Federated Learning Frameworks for Energy-Efficient Signal Processing in UAV-Assisted Wireless Communication Networks. International Journal of Intelligent Systems and Applications in Engineering, 12(21s), 397–423. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/5437

Issue

Section

Research Article