Integrating Image Processing Techniques in the Faster R-CNN Model to Detect Errors in Mechanical Details

Authors

  • Dinh Do Van Dinh Do Van, Sao Do University, Hai Duong-03500, Viet Nam

Keywords:

OpenCV, computer vision, mechanical product details, convolutional neural networks (CNN)

Abstract

Machine Learning and Computer Vision are increasingly being applied in detecting product defects across various industries such as industrial and agricultural, leading to increased efficiency, accuracy, and reduced labor costs. In this study, we utilized image processing algorithms with OpenCV library, combined with deep learning model FASTER R-CNN to identify bearing faults. Unlike previous studies that mainly focused on measuring box-shaped objects or only identifying the outer radius of an object, our study emphasizes identifying the radii of bearings along with a deviation of 0.02 mm. The porposed FASTER R-CNN model to accurately identify faulty bearings with a precision of 98%. Through our research and experimentation, we have also found that the CNN model is more accurate in detection than other models such as YOLO and SSD.

Downloads

Download data is not yet available.

References

Li, Z., Li, B., & Li, J., “An Intelligent Method for Surface Defect Detection of Mechanical Parts Based on Deep Learning”, IEEE Access, 8, 37690-37699. 2020.

Singh, A., Verma, A. K., & Singh, A., “Deep learning based fault diagnosis of mechanical systems: a review”, Journal of Intelligent Manufacturing, 31(1), 1-26. 2020.

Liu, Y., Zhang, Y., & Shu, L., “A defect detection method for mechanical parts based on improved deep convolutional neural network”, Journal of Intelligent & Fuzzy Systems, 41(2), 2263-2272. 2021.

A. Synodinos, “Identification of railway track components and defects by analysis of wheel-rail interaction noise”, 23rd International Congress on Sound & Vibration. 2016.

H. S. Munawar,F.Ullah,A. Heravi ,M. J Thaheem and A. Maqsoom, “Inspecting Buildings Using Drones and Computer Vision: A Machine Learning Approach to Detect Cracks and Damages”, doi: 10.3390/drones6010005. 2022.

Othman, Nashwan & Salur, Mehmet & Karakose, Mehmet & Aydin, Ilhan, “An Embedded Real-Time Object Detection and Measurement of its Size”, 10.1109/IDAP.2018.8620812. 2018

I. B. Mustaffa and S. F. B. M. Khairul, “Identification of fruit size and maturity through fruit images using OpenCV-Python and Rasberry Pi”, 2017 International Conference on Robotics, Automation and Sciences (ICORAS), Melaka, Malaysia, 2017, pp. 1-3, doi: 10.1109/ICORAS.2017.8308068. 2017.

S. Albawi, T. A. Mohammed and S. Al-Zawi, “Understanding of a convolutional neural network”, 2017 International Conference on Engineering and Technology (ICET), Antalya, Turkey, 2017, pp. 1-6, doi: 10.1109/ICEngTechnol.2017.8308186. 2017.

Youzi Xiao, Zhiqiang Tian, Jiachen Yu, Yinshu Zhang, Shuai Liu, Shaoyi Du & Xuguang Lan, “A review of object detection based on deep learning”, SpringerLink 2020.

Adel Ammar, A. Koubâa, “Aerial Images Processing for Car Detection using Convolutional Neural Networks: Comparison between Faster R-CNN and YoloV3”, 2019.

Q. Ma,G. Tian, Y. Zeng,R. Li, H. Song ,Z. Wang, B. Gao and K. Zeng, “Pipeline In-Line Inspection Method”, Instrumentation and Data Management, doi: /10.3390/s21113862. 2021.

J. Selvaraj, P. Thangavelu, T Durai A. Kumar, S. Palaniappan, “Artificial Intelligence in Biomedical Image Processing”, Machine Learning and Systems Biology in Genomics and Health. 2022.

Y. Chen, “Machine vision inspection technology in industrial applications detection[J]”, Electronic Test. 18:79-80 (2015)

Carlos Calderon-Cordova, María Guajala, Rodrigo Barba, et al, “Design of a Machine Vision Applied to Educational Board Game[C]”, International Conference on Information Technology and Science. 2016.

https://www.cognex.com/applications/return-on-investment-eliminate-defects, Accessed January 15, 2023

https://www.cognex.com/applications/products-in-action/disc-brake-inspection, Accessed on January 20, 2023

https://www.cognex.com/applications/products-in-action/medical-device-inspection , Accessed on January 22, 2023

M. J. Hasan, M. M. M. Islam and J.-M. Kim, “Bearing Fault Diagnosis Using Multidomain Fusion-Based Vibration Imaging and Multitask Learning”, 2022.doi: 10.3390/s22010056.

D. Neupane and J. Seok, “Bearing Fault Detection and Diagnosis Using Case Western Reserve University Dataset With Deep Learning Approaches: A Review”, 2020. doi: 10.1109/ACCESS.2020.2990528.

N. F. Waziralilah, A. Abu, M. H. Lim, L. K. Quen and A. Elfakharany, “A Review on Convolutional Neural Network in Bearing Fault Diagnosis”, 2019. doi: 10.1051/matecconf/201925506002.

H. Wang, J. Xu, R. Yan, C. Sun and X. Chen, “Intelligent Bearing Fault Diagnosis Using Multi-Head Attention-Based CNN”, 2020. doi: 10.1016/j.promfg.2020.07.005.

Begum, S. . S. ., Prasanth, K. D. ., Reddy, K. L. ., Kumar, K. S. ., & Nagasree, K. J. . (2023). RDNN for Classification and Prediction of Rock or Mine in Underwater Acoustics. International Journal on Recent and Innovation Trends in Computing and Communication, 11(3), 98–104. https://doi.org/10.17762/ijritcc.v11i3.6326

Hiroshi Yamamoto, An Ensemble Learning Approach for Credit Risk Assessment in Banking , Machine Learning Applications Conference Proceedings, Vol 1 2021.

Downloads

Published

16.07.2023

How to Cite

Van, D. D. . (2023). Integrating Image Processing Techniques in the Faster R-CNN Model to Detect Errors in Mechanical Details. International Journal of Intelligent Systems and Applications in Engineering, 11(3), 124–130. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/3149

Issue

Section

Research Article