Efficient License Plate Detection and Recognition with YOLOv7 and OCR

Authors

  • Vincent Fanditama Wijaya, Benfano Soewito

Keywords:

YOLOv7, License Plate Recognition, Character Recognition, Performance Metrics, Optical Character Recognition

Abstract

This journal paper conducts a thorough investigation of YOLOv7's role in License Plate Recognition (LPR) for vehicles, with a specific focus on precision, recall, F1 score, mean Average Precision (mAP), and character recognition. Yet, the adaptability of Easy-OCR to various camera angles and its resource-efficient performance on compact devices present it as a valuable alternative. The future of character recognition in LPR systems should prioritize overcoming environmental challenges, license plate obstructions, and regional design variations. Solutions involve advanced pre-processing techniques and specialized algorithms tailored to address these issues. Simultaneously, refining the integration of Raspberry Pi, YOLOv7, and Easy OCR can lead to a scalable and efficient smart gate parking system. YOLOv7 excels in license plate detection, consistently achieving high precision (0.769), recall (0.8571), and F1 scores surpassing 0.66. Its steadily rising mAP (0.653) further underscores its ability to accurately localize license plates. In character detection, YOLOv7 outperforms Easy-OCR, boasting an average similarity rate of 94% compared to Easy-OCR's 80%. This innovative solution holds immense promise for enhancing parking efficiency, access control, and generating valuable urban data insights, ultimately addressing global parking challenges and improving the quality of urban living.

Downloads

Download data is not yet available.

References

H. Moussaoui, N. EL AKKAD and M. BENSLIMANE, "Arabic and Latin License Plate Detection and Recognition based on YOLOv7 and Image Processing Methods," 2023.

N. B. P. Awalgaonkar and R. Chaugule, "Automatic License Plate Recognition System using SSD," International Symposium of Asian Control Association on Intelligent Robotics and Industrial Automation, pp. 394-399, 2021.

Q. M. Aljelawy and T. M. Salman, "Detecting License Plate Number Using OCR Technique and Raspberry Pi 4 With Camera," in 2nd International Conference on Computing and Machine Intelligence, Turkey, 2022.

R. Lookmuang, K. Nambut and S. Usanavasin, "Smart Parking using IoT Technology," in 5th International Conference on Business and Industrial Research (ICBIR), 2018.

A. O. Agbeyangi, O. A. Alashiri and A. E. Otunuga, "Automatic Identification of Vehicle Plate Number using Raspberry Pi," in International Conference in Mathematics, Computer Engineering and Computer Science (ICMCECS), 2020.

L. Cao, X. Zheng and L. Fang, "The Semantic Segmentation of Standing Tree Images Based on the Yolo V7 Deep Learning Algorithm," Electronics, vol. 12, no. 4, p. 929, 2023.

L. Zhou, C. Zhang, F. Liu, Z. Qiu and Y. He, "Application of Deep Learning in Food: a review.," Comprehensive Reviews in Food Science and Food Safety, vol. 18, no. 6, pp. 1793-1811, 2019.

P. Chlap, H. Min, N. Vandenberg, J. Dowling, L. Holloway and A. Haworth, "A Review of Medical Image Data Augmentation Techniques for Deep Learning Applications," Journal of Medical Imaging and Radiation Oncology, vol. 65, no. 5, pp. 545-563, 2021.

C. Shorten and T. M. Khoshgoftaar, "A Survey on Image Data Augmentation for Deep Learning," Journal of Big Data, vol. 6, no. 1, pp. 1-48, 2019.

A. Bochkovskiy, C. Y. Wang and H.-Y. M. Liao, "YOLOv4: Optimal Speed and Accuracy of Object Detection," arXiv, vol. 10934, no. 2004, pp. 4-5, 2020.

S. Singha and B. Aydin, "Automated Drone Detection using YOLOv4," Drones, vol. V, no. 3, p. 95, 2021.

G. Jocher, L. Changyu, A. Hogan, L. Yu, P. Rai and T. Sullivan, " Ultralytics/yolov5: Initial Release," Zenodo, 2020.

C. Y. Wang, A. Bochkovskiy and H. Y. M. Liao, "YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-art for Real-time Object Detectors," in IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.

K. Jiang, T. Xie, R. Yan, X. Wen, D. Li, H. Jiang and J. Wang, "An Attention Mechanism-Improved YOLOv7 Object Detection Algorithm for Hemp Duck Count Estimation," Agriculture, vol. 12, no. 10, p. 1659, 2022.

W. Zhu, Q. Wang, L. Luo, Y. Zhang, Q. Lu, W. C. Yeh and J. Liang, "CPAM: Cross Patch Attention Module for Complex Texture Tile Block Defect Detection," Applied Sciences, vol. 12, no. 23, p. 11959, 2022.

X. Sun, P. Wu and S. C. Hoi, "Face Detection using Deep Learning: An Improved Faster RCNN Approach," Neurocomputing, no. 299, pp. 42-50, 2018.

L. Yang, J. Zhong, Y. Zhang, S. Bai, G. Li, Y. Yang and J. Zhang, "An Improving Faster-RCNN with Multi-Attention Resnet for Small Target Detection in Intelligent Autonomous Transport with 6G," IEEE Transactions on Intelligent Transportation Systems, 2022.

A. Narayan and R. Muthalagu, "Image Character Recognition using Convolutional Neural Networks," in Seventh International Conference on Bio Signals, Images, and Instrumentation, Philadelphia, 2021.

S. Drobac and K. Lindén, "Optical Character Recognition with Neural Networks and Post-Correction with Finite State Methods," International Journal on Document Analysis and Recognition (IJDAR), vol. 23, no. 4, pp. 279-295, 2020.

B. Rajyagor and R. Rakhlia, "Handwritten Character Recognition using Deep Learning," Int. J. Recent Technol. Eng, vol. 8, no. 6, pp. 2277-3878, 2020.

M. Al-Arini, F. Al-Hafiz and S. Amash, "Character Recognition from Images using a Convolutional Neural Network," Sixth International Congress on Information and Communication Technology, vol. 4, pp. 403-413, 2022.

T. Hegghammer, "OCR with Tesseract, Amazon Textract, and Google Document AI: a Benchmarking Experiment," Journal of Computational Social Science, vol. V, no. 1, pp. 861-882, 2022.

J. Memon, M. Sami, R. A. Khan and M. Uddin, "Handwritten Optical Character Recognition (OCR): A Comprehensive Systematic Literature Review (SLR)," IEEE Access, vol. 8, pp. 142642-142668, 2020.

K. Baierer, R. Dong and C. Neudecker, "Okralact-A Multi-Engine Open Source OCR Training System," 5th International Workshop on Historical Document Imaging and Processing, pp. 25-30, 2019.

N. Saleem, H. Muazzam, H. M. Tahir and U. Farooq, "Automatic License Plate Recognition using Extracted Features," 4th International Symposium on Computational and Business Intelligence, pp. 221-225, 2016.

M. M. Abdellatif, N. H. Elshabasy, A. E. Elashmawy and M. AbdelRaheem, "A Low Cost IoT-based Arabic License Plate Recognition Model for Smart Parking Systems," Ain Shams Engineering Journal, vol. 6, no. 102178, p. 14, 2023.

C. Yang and L. Zhou, "Design and Implementation of License Plate Recognition System Based on Android," in 11th International Conference on Computer Engineering and Networks, Singapore, 2022.

Y. Wang, Z. P. Bian, Y. Zhou and L. P. Chau, "Rethinking and Designing a High-performing Automatic License Plate Recognition Approach," IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 7, pp. 8868-8880, 2021.

K. Khan, A. Imran, H. Z. U. Rehman, A. Fazil, M. Zakwan and Z. Mahmood, "Performance Enhancement Method for Multiple License Plate Recognition in Challenging Environments," EURASIP Journal on Image and Video Processing, vol. 1, pp. 1-23, 2021.

H. Yu, X. Wang, Y. Shao, F. Qin, B. Chen and S. Gong, "Research on License Plate Location and Recognition in Complex Environment," Journal of Real-Time Image Processing, vol. 19, no. 4, pp. 823-837, 2022.

Downloads

Published

27.03.2024

How to Cite

Benfano Soewito, . V. F. W. (2024). Efficient License Plate Detection and Recognition with YOLOv7 and OCR. International Journal of Intelligent Systems and Applications in Engineering, 12(3), 1598–1605. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/5558

Issue

Section

Research Article