Enhancing Routing Performance in Software-Defined Wireless Sensor Networks through Reinforcement Learning

Authors

  • Nilesh P. Sable Department of Information Technology, Bansilal Ramnath Agarwal Charitable Trusts, Vishwakarma Institute of Information Technology, SPPU, Pune, India
  • Vijay U. Rathod Department of Artificial Intelligence & Data Science, GH Raisoni College of Engineering & Management Wagholi, Pune, SPPU, Pune, India
  • Mangesh D. Salunke Department of Computer Engineering, Marathwada Mitramandal's Institute of Technology, SPPU, Pune, India
  • Hemantkumar B. Jadhav Department Department of Computer Engineering, Adsul's technical campus, Ahmednagar, India
  • Ravindra S. Tambe Department Department of Computer Engineering, Dr. Vithalrao Vikhe Patil College of Engineering, Ahmednagar, India
  • Suhas R. Kothavle Department of Computer Engineering, Marathwada Mitramandal's Institute of Technology, SPPU, Pune, India

Keywords:

WSNs, SDWSN, routing, RL-based WSN, RL, IoTs, Energy optimization

Abstract

Software-Defined Networking (SDN) has swiftly taken over networks in data centers, telecommunications companies, and organizations because to its programmable and adaptable control plane.  Due to its adaptability, SDN is a new architecture that is employed in numerous applications. The necessity for routing optimization has increased as a consequence of the exponential growth in network traffic demands needing quality of services.  In order to enable the Internet of Things (IoTs), it is considered to be vital.  Modern developments in SDN technology has allowed for central control and management, and programmatic interfaces enable flexible customization of network service like switches.  SDN for routing has been introduced in WSNs. The SDN controller uses a variety of different methods to establish the routing path, but none of them are sufficiently efficient to provide the ideal routing path. As a result, reinforcement learning (RL) is a practical method for figuring out the best routing path.  In this study, we improve the SDWSN's RL-based routing path.  It is recommended to use a reward system that contains the relevant network QoS and energy efficiency metrics. While the agent receives the award and chooses what to do next base on the reward received, the SDWSN controller improves the routing path based on prior information.  However, the Web also allows for remote management of the entire network.

Downloads

Download data is not yet available.

References

S. Lee et al., “A Framework for Policy Inconsistency Detection in Software-Defined Networks,” IEEE/ACM Trans. Netw., vol. 30, no. 3, pp. 1410–1423, 2022, doi: 10.1109/TNET.2022.3140824.

M. U. Younus, M. K. Khan, and A. R. Bhatti, “Improving the Software-Defined Wireless Sensor Networks Routing Performance Using Reinforcement Learning,” IEEE Internet Things J., vol. 9, no. 5, pp. 3495–3508, 2022, doi: 10.1109/JIOT.2021.3102130.

R. Kumar, U. Venkanna, and V. Tiwari, “Optimized Link Utilization Based Approach for Traffic Engineering in SDWSN,” Int. Symp. Adv. Networks Telecommun. Syst. ANTS, vol. 2019-Decem, pp. 1–6, 2019, doi: 10.1109/ANTS47819.2019.9118068.

G. Kim, Y. Kim, and H. Lim, “Deep Reinforcement Learning-Based Routing on Software-Defined Networks,” IEEE Access, vol. 10, pp. 18121–18133, 2022, doi: 10.1109/ACCESS.2022.3151081.

M. S. Azizi and M. L. Hasnaoui, “Software defined networking for energy efficient wireless sensor network,” Proc. - 2019 Int. Conf. Adv. Commun. Technol. Networking, CommNet 2019, pp. 1–7, 2019, doi: 10.1109/COMMNET.2019.8742362.

F. F. Jurado-Lasso, K. Clarke, and A. Nirmalathas, “A Software-Defined Management System for IP-Enabled WSNs,” IEEE Syst. J., vol. 14, no. 2, pp. 2335–2346, 2020, doi: 10.1109/JSYST.2019.2946781.

Q. Liu, T. Ozcelebi, L. Cheng, F. Kuipers, and J. Lukkien, “CluFlow: Cluster-based Flow Management in Software-Defined Wireless Sensor Networks,” IEEE Wirel. Commun. Netw. Conf. WCNC, vol. 2019-April, pp. 1–8, 2019, doi: 10.1109/WCNC.2019.8885485.

A. Shahraki, A. Taherkordi, O. Haugen, and F. Eliassen, “A Survey and Future Directions on Clustering: From WSNs to IoT and Modern Networking Paradigms,” IEEE Trans. Netw. Serv. Manag., vol. 18, no. 2, pp. 2242–2274, 2021, doi: 10.1109/TNSM.2020.3035315.

M. U. Younus, M. K. Khan, M. R. Anjum, S. Afridi, Z. A. Arain, and A. A. Jamali, “Optimizing the Lifetime of Software Defined Wireless Sensor Network via Reinforcement Learning,” IEEE Access, vol. 9, pp. 259–272, 2021, doi: 10.1109/ACCESS.2020.3046693.

F. F. Jurado-Lasso, L. Marchegiani, J. F. Jurado, A. M. Abu-Mahfouz, and X. Fafoutis, “A Survey on Machine Learning Software-Defined Wireless Sensor Networks (ML-SDWSNs): Current Status and Major Challenges,” IEEE Access, vol. 10, pp. 23560–23592, 2022, doi: 10.1109/ACCESS.2022.3153521.

Z. Min, Q. Hua, and Z. Jihong, “Dynamic switch migration algorithm with Q-learning towards scalable SDN control plane,” 2017 9th Int. Conf. Wirel. Commun. Signal Process. WCSP 2017 - Proc., vol. 2017-Janua, pp. 1–4, 2017, doi: 10.1109/WCSP.2017.8171121.

N. P. Sable, V. U. Rathod, P. N. Mahalle, and D. R. Birari, “A Multiple Stage Deep Learning Model for NID in MANETs,” 2022 Int. Conf. Emerg. Smart Comput. Informatics, ESCI 2022, pp. 1–6, 2022, doi: 10.1109/ESCI53509.2022.9758191.

V. U. Rathod and S. V Gumaste, “Effect Of Deep Channel To Improve Performance On Mobile Ad - Hoc,” vol. 41, no. 7, pp. 754–767, 2022.

Poonam N. Railkar Nilesh P. Sable,Vijay U. Rathod,Parikshit N. Mahalle, “An Efficient and Reliable Data Transmission Service using Network Coding Algorithms in Peer-to-Peer Network”, International Journal on Recent and Innovation Trends in Computing and Communication, Vol. 10, Issue- 1s (2022), 144 – 154

Prof. Shweta Jain. (2017). Design and Analysis of Low Power Hybrid Braun Multiplier using Ladner Fischer Adder. International Journal of New Practices in Management and Engineering, 6(03), 07 - 12. https://doi.org/10.17762/ijnpme.v6i03.59

Merwe, M. van der, Petrova, M., Jovanović, A., Santos, M., & Rodríguez, M. Text Summarization using Transformer-based Models. Kuwait Journal of Machine Learning, 1(3). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/141

Dhanikonda, S. R., Sowjanya, P., Ramanaiah, M. L., Joshi, R., Krishna Mohan, B. H., Dhabliya, D., & Raja, N. K. (2022). An efficient deep learning model with interrelated tagging prototype with segmentation for telugu optical character recognition. Scientific Programming, 2022doi:10.1155/2022/1059004

Downloads

Published

16.08.2023

How to Cite

Sable, N. P. ., Rathod, V. U. ., Salunke, M. D. ., Jadhav, H. B., Tambe, R. S. ., & Kothavle, S. R. . (2023). Enhancing Routing Performance in Software-Defined Wireless Sensor Networks through Reinforcement Learning. International Journal of Intelligent Systems and Applications in Engineering, 11(10s), 73–83. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/3235

Issue

Vol. 11 No. 10s (2023)

Section

Research Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.

IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.

Most read articles by the same author(s)