An Effective Transportation System Method for Optimal Path Planning Using Logistics UAVs Using Deep Q Networks
Keywords:
Unmanned Aerial Vehicle (UAV), Artificial Intelligence, Smart Transportation Systems, Path Planning, Route Planning, Cooperative Computing, Deep Q NetworkAbstract
Recent developments in Unmanned Aerial Vehicle (UAV) technology have shown that they will form an integral element of future communication and networking infrastructure. Although several studies have offered UAV-assisted methods for enhancing the performance of existing networks by increasing coverage and capacity but the architectures of autonomous UAV networks based on artificial intelligence has not yet been thoroughly investigated. However, the most current models for logistics UAV delivery do not account for the energy consumption of logistics UAVs or the varying schedules of their clients, meaning they are not applicable to real-world transportation networks. As a result, for a smart transportation system, we suggest reducing the overall energy cost of various logistics UAVs throughout the time it takes to deliver individual items. In this research, we maximize the UAV power by posing the UAV path planning issue as a traveling salesman problem. The UAV route planning is optimized under the restrictions of node energy consumption and task deadlines to achieve maximum energy efficiency of cooperative computing over the course of a UAV's life cycle. A Deep Q Network (DQN) based path planning algorithm is suggested to adjust to the uncertain and changing environment over time. In comparison to other algorithms, the proposed one performs better in simulations, increases the computational productivity of dynamic computing by a large margin, and achieves a good equilibrium between the two energy inputs. We also think about minimizing the UAV's spin rate to maximize efficiency and decrease power consumption. By lowering the number of turns while still visiting all of the waypoints, our suggested technique uses 2-5 times less energy.
Downloads
References
Y. Ma, H. Zhang, Y. Zhang, R. Gao, Z. Xu, and J. Yang, “Coordinated optimization algorithm combining GA with cluster for multi-UAVs to multi-tasks task assignment and path planning,” in 2019 IEEE 15th International Conference on Control and Automation (ICCA), pp. 1026–1031, Edinburgh, UK, 2019.
Y. Liu, H. N. Dai, H. Wang, M. Imran, and M. Shoaib, “UAV enabled data acquisition scheme with directional wireless energy transfer for Internet of things,” Computer Communications, vol. 155, pp. 184–196, 2020.
M. Zhou, H. Chen, L. Shu, and Y. Liu, “UAV-assisted sleep scheduling algorithm for energy-efficient data collection in agricultural Internet of things,” IEEE Internet of Things Journal, vol. 9, no. 13, pp. 11043–11056, 2022.
P. Wu, F. Xiao, C. Sha, H. Huang, and L. Sun, “Trajectory optimization for UAVs efficient charging in wireless rechargeable sensor networks,” IEEE Transactions on Vehicular Technology, vol. 69, no. 4, pp. 4207–4220, 2020.
Y. Chen, H. Liu, J. Guo et al.,“Cooperative networking strategy of UAV cluster for large-scale WSNs,” IEEE Sensors Journal, vol. 22, no. 22, pp. 22276–22290, 2022.
D. Darsena, G. Gelli, I. Iudice, and F. Verde, “Detection and blind channel estimation for UAV-aided wireless sensor networks in smart cities under mobile jamming attack,” IEEE Internet of Things Journal, vol. 9, no. 14, pp. 11932–11950, 2022.
B. Li, Z. Fei, and Y. Zhang, “UAV communications for 5G and beyond: recent advances and future trends,” IEEE Internet of Things Journal, vol. 6, no. 2, pp. 2241–2263, 2019.
L. Fan, W. Yan, X. Chen, Z. Chen, and Q. Shi, “An energy efficient design for UAV communication with mobile edge computing,” China Communications, vol. 16, no. 1, pp. 26–36, 2019.
Z. Yu, Y. Gong, S. Gong, and Y. Guo, “Joint task offloading and resource allocation in UAV-enabled mobile edge computing,” IEEE Internet of Things Journal, vol. 7, no. 4, pp. 3147–3159, 2020.
S. Jeong, O. Simeone, and J. Kang, “Mobile edge computing via a UAV-mounted cloudlet: optimization of bit allocation and path planning,” IEEE Transactions on Vehicular Technology, vol. 67, no. 3, pp. 2049–2063, 2018.
Y. Qian, F. Wang, J. Li, L. Shi, K. Cai, and F. Shu, “User association and path planning for UAV-aided mobile edge computing with energy restriction,” IEEE Wireless Communications Letters, vol. 8, no. 5, pp. 1312–1315, 2019.
Q. Hu, Y. Cai, G. Yu, Z. Qin, M. Zhao, and G. Li,“ Joint offloading and trajectory design for UAV-enabled mobile edge computing systems,” IEEE Internet of Things Journal, vol. 6, no. 2, pp. 1879–1892, 2019.
Letaief, K.B.; Chen, W.; Shi, Y.; Zhang, J.; Zhang, Y.-J.A. The roadmap to 6G: AI empowered wireless networks. IEEE Commun. Mag. 2019, 57, 84–90.
Challita, U.; Ferdowsi, A.; Chen, M.; Saad, W. Artificial intelligence for wireless connectivity and security of cellular-connected UAVs. arXiv 2018, arXiv:1804.05348.
Q. Liu, L. Shi, L. Sun, J. Li, M. Ding, and F. Shu, “Path planning for UAV-mounted mobile edge computing with deep reinforcement learning,” IEEE Transactions on Vehicular Technology, vol. 69, no. 5, pp. 5723–5728, 2020
B. Liu, C. Liu, and M. Peng, “Computation offloading and resource allocation in unmanned aerial vehicle networks,” IEEE Transactions on Vehicular Technology, pp. 1–15, 2022.
L. Zhang, B. Jabbari, and N. Ansari, “Deep reinforcement learning driven UAV-assisted edge computing,” IEEE Internet of Things Journal, vol. 9, no. 24, pp. 25449–25459, 2022.
L. Wang, K. Wang, C. Pan, W. Xu, N. Aslam, and A. Nallanathan, “Deep reinforcement learning based dynamic trajectory control for UAV-assisted mobile edge computing,” IEEE Transactions on Mobile Computing, vol. 21, no. 10, pp. 3536–3550, 2022.
G. V. Reddy et al., "Human Action Recognition Using Difference of Gaussian and Difference of Wavelet," in Big Data Mining and Analytics, vol. 6, no. 3, pp. 336-346, September 2023, doi: 10.26599/BDMA.2022.9020040.
S. Khetavath et al., "An Intelligent Heuristic Manta-Ray Foraging Optimization and Adaptive Extreme Learning Machine for Hand Gesture Image Recognition," in Big Data Mining and Analytics, vol. 6, no. 3, pp. 321-335, September 2023, doi: 10.26599/BDMA.2022.9020036.
Sudhakar, M. ., & Kaliyamurthie, K. P. . (2023). A Novel Machine learning Algorithms used to Detect Credit Card Fraud Transactions. International Journal on Recent and Innovation Trends in Computing and Communication, 11(2), 163–168. https://doi.org/10.17762/ijritcc.v11i2.6141
Muñoz, S., Hernandez, M., González, M., Thomas, P., & Anderson, C. Enhancing Engineering Education with Intelligent Tutoring Systems using Machine Learning. Kuwait Journal of Machine Learning, 1(2). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/116
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 P. Nithya, T. Annamani, Vijaykumar Shankar Kamble, CH. Mohan Sai Kumar, T. Karthikeyan, M. Sujaritha
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
