Efficient License Plate Detection and Recognition with YOLOv7 and OCR
Keywords:
YOLOv7, License Plate Recognition, Character Recognition, Performance Metrics, Optical Character RecognitionAbstract
This journal paper conducts a thorough investigation of YOLOv7's role in License Plate Recognition (LPR) for vehicles, with a specific focus on precision, recall, F1 score, mean Average Precision (mAP), and character recognition. Yet, the adaptability of Easy-OCR to various camera angles and its resource-efficient performance on compact devices present it as a valuable alternative. The future of character recognition in LPR systems should prioritize overcoming environmental challenges, license plate obstructions, and regional design variations. Solutions involve advanced pre-processing techniques and specialized algorithms tailored to address these issues. Simultaneously, refining the integration of Raspberry Pi, YOLOv7, and Easy OCR can lead to a scalable and efficient smart gate parking system. YOLOv7 excels in license plate detection, consistently achieving high precision (0.769), recall (0.8571), and F1 scores surpassing 0.66. Its steadily rising mAP (0.653) further underscores its ability to accurately localize license plates. In character detection, YOLOv7 outperforms Easy-OCR, boasting an average similarity rate of 94% compared to Easy-OCR's 80%. This innovative solution holds immense promise for enhancing parking efficiency, access control, and generating valuable urban data insights, ultimately addressing global parking challenges and improving the quality of urban living.
Downloads
References
H. Moussaoui, N. EL AKKAD and M. BENSLIMANE, "Arabic and Latin License Plate Detection and Recognition based on YOLOv7 and Image Processing Methods," 2023.
N. B. P. Awalgaonkar and R. Chaugule, "Automatic License Plate Recognition System using SSD," International Symposium of Asian Control Association on Intelligent Robotics and Industrial Automation, pp. 394-399, 2021.
Q. M. Aljelawy and T. M. Salman, "Detecting License Plate Number Using OCR Technique and Raspberry Pi 4 With Camera," in 2nd International Conference on Computing and Machine Intelligence, Turkey, 2022.
R. Lookmuang, K. Nambut and S. Usanavasin, "Smart Parking using IoT Technology," in 5th International Conference on Business and Industrial Research (ICBIR), 2018.
A. O. Agbeyangi, O. A. Alashiri and A. E. Otunuga, "Automatic Identification of Vehicle Plate Number using Raspberry Pi," in International Conference in Mathematics, Computer Engineering and Computer Science (ICMCECS), 2020.
L. Cao, X. Zheng and L. Fang, "The Semantic Segmentation of Standing Tree Images Based on the Yolo V7 Deep Learning Algorithm," Electronics, vol. 12, no. 4, p. 929, 2023.
L. Zhou, C. Zhang, F. Liu, Z. Qiu and Y. He, "Application of Deep Learning in Food: a review.," Comprehensive Reviews in Food Science and Food Safety, vol. 18, no. 6, pp. 1793-1811, 2019.
P. Chlap, H. Min, N. Vandenberg, J. Dowling, L. Holloway and A. Haworth, "A Review of Medical Image Data Augmentation Techniques for Deep Learning Applications," Journal of Medical Imaging and Radiation Oncology, vol. 65, no. 5, pp. 545-563, 2021.
C. Shorten and T. M. Khoshgoftaar, "A Survey on Image Data Augmentation for Deep Learning," Journal of Big Data, vol. 6, no. 1, pp. 1-48, 2019.
A. Bochkovskiy, C. Y. Wang and H.-Y. M. Liao, "YOLOv4: Optimal Speed and Accuracy of Object Detection," arXiv, vol. 10934, no. 2004, pp. 4-5, 2020.
S. Singha and B. Aydin, "Automated Drone Detection using YOLOv4," Drones, vol. V, no. 3, p. 95, 2021.
G. Jocher, L. Changyu, A. Hogan, L. Yu, P. Rai and T. Sullivan, " Ultralytics/yolov5: Initial Release," Zenodo, 2020.
C. Y. Wang, A. Bochkovskiy and H. Y. M. Liao, "YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-art for Real-time Object Detectors," in IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
K. Jiang, T. Xie, R. Yan, X. Wen, D. Li, H. Jiang and J. Wang, "An Attention Mechanism-Improved YOLOv7 Object Detection Algorithm for Hemp Duck Count Estimation," Agriculture, vol. 12, no. 10, p. 1659, 2022.
W. Zhu, Q. Wang, L. Luo, Y. Zhang, Q. Lu, W. C. Yeh and J. Liang, "CPAM: Cross Patch Attention Module for Complex Texture Tile Block Defect Detection," Applied Sciences, vol. 12, no. 23, p. 11959, 2022.
X. Sun, P. Wu and S. C. Hoi, "Face Detection using Deep Learning: An Improved Faster RCNN Approach," Neurocomputing, no. 299, pp. 42-50, 2018.
L. Yang, J. Zhong, Y. Zhang, S. Bai, G. Li, Y. Yang and J. Zhang, "An Improving Faster-RCNN with Multi-Attention Resnet for Small Target Detection in Intelligent Autonomous Transport with 6G," IEEE Transactions on Intelligent Transportation Systems, 2022.
A. Narayan and R. Muthalagu, "Image Character Recognition using Convolutional Neural Networks," in Seventh International Conference on Bio Signals, Images, and Instrumentation, Philadelphia, 2021.
S. Drobac and K. Lindén, "Optical Character Recognition with Neural Networks and Post-Correction with Finite State Methods," International Journal on Document Analysis and Recognition (IJDAR), vol. 23, no. 4, pp. 279-295, 2020.
B. Rajyagor and R. Rakhlia, "Handwritten Character Recognition using Deep Learning," Int. J. Recent Technol. Eng, vol. 8, no. 6, pp. 2277-3878, 2020.
M. Al-Arini, F. Al-Hafiz and S. Amash, "Character Recognition from Images using a Convolutional Neural Network," Sixth International Congress on Information and Communication Technology, vol. 4, pp. 403-413, 2022.
T. Hegghammer, "OCR with Tesseract, Amazon Textract, and Google Document AI: a Benchmarking Experiment," Journal of Computational Social Science, vol. V, no. 1, pp. 861-882, 2022.
J. Memon, M. Sami, R. A. Khan and M. Uddin, "Handwritten Optical Character Recognition (OCR): A Comprehensive Systematic Literature Review (SLR)," IEEE Access, vol. 8, pp. 142642-142668, 2020.
K. Baierer, R. Dong and C. Neudecker, "Okralact-A Multi-Engine Open Source OCR Training System," 5th International Workshop on Historical Document Imaging and Processing, pp. 25-30, 2019.
N. Saleem, H. Muazzam, H. M. Tahir and U. Farooq, "Automatic License Plate Recognition using Extracted Features," 4th International Symposium on Computational and Business Intelligence, pp. 221-225, 2016.
M. M. Abdellatif, N. H. Elshabasy, A. E. Elashmawy and M. AbdelRaheem, "A Low Cost IoT-based Arabic License Plate Recognition Model for Smart Parking Systems," Ain Shams Engineering Journal, vol. 6, no. 102178, p. 14, 2023.
C. Yang and L. Zhou, "Design and Implementation of License Plate Recognition System Based on Android," in 11th International Conference on Computer Engineering and Networks, Singapore, 2022.
Y. Wang, Z. P. Bian, Y. Zhou and L. P. Chau, "Rethinking and Designing a High-performing Automatic License Plate Recognition Approach," IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 7, pp. 8868-8880, 2021.
K. Khan, A. Imran, H. Z. U. Rehman, A. Fazil, M. Zakwan and Z. Mahmood, "Performance Enhancement Method for Multiple License Plate Recognition in Challenging Environments," EURASIP Journal on Image and Video Processing, vol. 1, pp. 1-23, 2021.
H. Yu, X. Wang, Y. Shao, F. Qin, B. Chen and S. Gong, "Research on License Plate Location and Recognition in Complex Environment," Journal of Real-Time Image Processing, vol. 19, no. 4, pp. 823-837, 2022.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.