Object Detection and Tracking in Real-Time Video Streams Using Convolutional Neural Networks

Authors

  • Asmaa Aziz Jaber Collage of science ,chemistry department ,University of Basrah ,Iraq
  • Zahraa H. Ali Collage of science ,Geology department ,University of Basrah ,Iraq
  • Hind Abdel Amir Sabti Collage of science , chemistry department ,University of Basrah ,Iraq
  • Rana J. AL-Sukeinee Collage of science ,Physics department ,University of Basrah ,Iraq

Keywords:

CNN-based object detection, video analysis, image frames, preprocessing, edge detection

Abstract

A key task in computer vision with many applications is object detection. This paper describes an object detection system based on CNN and assesses how well it performs in the particular setting of Iraq. The suggested system makes use of video inputs, breaks them down into individual image frames, and applies pre-processing methods to improve the image quality. To extract significant features, the Sobel operator is used for edge detection and shape identification. A CNN network is created and trained to identify items in the image frames, such as automobiles, people, and buses. Metrics including accuracy, precision, recall, and F1 score are used to assess the system's performance. According to the data, the CNN-based system achieves an F1 score of 91% and scores 92% accurate, 89% precise, 94% recall, and 94% recall. These results demonstrate how well the suggested system performs in the item detection task in the particular research area of Iraq. The CNN-based system outperforms the Random Forest method in terms of accuracy, recall, and F1 score, as shown by a comparison with it. The findings of this study have practical applications in several areas in Iraq, including surveillance, traffic monitoring, and urban planning, and they expand object detection algorithms.

Downloads

Download data is not yet available.

References

Mohana et.al., " Simulation of Object Detection Algorithms for Video Survillance Applications", 2nd International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud), 2018.

Ren, S.; He, K.; Girshick, R.; and Sun, J. " Faster R-CNN: Towards realtime object detection with region proposal networks". Advances in neural information processing systems, 91-99, 2015.

Liu, W.; Anguelov, D.; Erhan, D.; Szegedy, C.; Reed, S.; Fu, C. Y.; and Berg, A. C. " SSD: Single shot multibox detector". European conference on computer vision, Springer, Cham, 9905, 21-3,2016..

Redmon, J.; Divvala, S.; Girshick, R.; and Farhadi, A. "You only look once: Unified, real-time object detection". Proceedings of the IEEE conference on computer vision and pattern recognition. Las Vegas, NV, 779-788, 2016.

Huang, J.; Rathod, V.; Sun, C.; Zhu, M.; Korattikara, A.; Fathi, A.; Fisher, L.; Wojna, Z.; Song, Y.; Guadarrama, S. and Murphy, K. "Speed/accuracy tradeoffs for modern convolutional object detectors". Proceedings of the IEEE conference on computer vision and pattern recognition. Honolulu, HI, 7310-7311, 2017.

Chandan, G.; Jain, A.; and Jain, H. " Real-time object detection and tracking using deep learning and OpenCV". International Conference on Inventive Research in Computing Applications (ICIRCA). Coimbatore, India, 1305-1308, 2018.

Wang, S.; Ozcan, K.; and Sharma, A. " Region-based deformable fully convolutional networks for multi-class object detection at signalized traffic intersections: NVIDIA AICity challenge 2017 Track 1". IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People, and Smart City Innovation (SmartWorld/SCALCOM/ UIC/ATC/CBDCom/IOP/SCI). Francisco, CA, 1-4, 2017.

Redmon, J.; and Farhadi, A. "Yolov3: An incremental improvement". arXiv preprint arXiv:1804.02767. Retrieved December 20, 2019, from http://arxiv. org/abs/1804.02767v1, 2018.

Howard, A.G.; Zhu, M.; Chen, B.; Kalenichenko, D.; Wang, W.; Weyand, T.; Andreetto, M.; and Adam, H. "Mobilenets: Efficient convolutional neural networks for mobile vision applications". arXiv preprint arXiv:1704.04861, 2017.

Tijtgat, N.; Van Ranst, W.; Goedeme, T.; Volckaert, B.; and De Turck, F. "Embedded real-time object detection for a UAV warning system". Proceedings of the IEEE International Conference on Computer Vision Workshops. Venice, Italy, 2110-2118, 2017.

Raj, M.; and Chandan, S. "Real-time vehicle and pedestrian detection through SSD in Indian traffic conditions". IEEE International Conference on Computing, Power, and Communication Technologies (GUCON). Uttar Pradesh, India, 439-444, 2018.

Seidaliyeva, U.; Akhmetov, D.; Ilipbayeva, L; and Matson, E.T. "RealTime and accurate drone detection in a video with a static background". Sensors, 20(14), 3856, 2020.

Artamonov, N.S.; and Yakimov, P.Y. "towards real-time traffic sign recognition via YOLO on a mobile GPU". Journal of Physics: Conference Series, 1096(1), 012086, 2018.

Blanco-Filgueira, B.; García-Lesta, D.; Fernández-Sanjurjo, M.; Brea, V. M.; and López, P. "Deep learning-based multiple object visual tracking on 208 N. H". Abdulghafoor and H. N. Abdullah Journal of Engineering Science and Technology February 2021, Vol. 16(1) embedded system for IoT and mobile edge computing applications. IEEE Internet of Things Journal, 6(3), 5423-5431, 2019.

Arularasan, A. N. ., Aarthi, E. ., Hemanth, S. V. ., Rajkumar, N. ., & Kalaichelvi, T. . (2023). Secure Digital Information Forward Using Highly Developed AES Techniques in Cloud Computing. International Journal on Recent and Innovation Trends in Computing and Communication, 11(4s), 122–128. https://doi.org/10.17762/ijritcc.v11i4s.6315

Jackson, B., Lewis, M., González, M., Gonzalez, L., & González, M. Improving Natural Language Understanding with Transformer Models. Kuwait Journal of Machine Learning, 1(4). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/152

Yadav, N., Saini, D.K.J.B., Uniyal, A., Yadav, N., Bembde, M.S., Dhabliya, D. Prediction of Omicron cases in India using LSTM: An advanced approach of artificial intelligence (2023) Journal of Interdisciplinary Mathematics, 26 (3), pp. 361-370.

Downloads

Published

03.09.2023

How to Cite

Aziz Jaber, A. ., H. Ali, Z. ., Amir Sabti, H. A. ., & AL-Sukeinee, R. J. . (2023). Object Detection and Tracking in Real-Time Video Streams Using Convolutional Neural Networks. International Journal of Intelligent Systems and Applications in Engineering, 12(1s), 505–511. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/3487

Issue

Section

Research Article