The Modified ORB Algorithm for Enhanced Augmented Reality Feature Detection and Tracking

Authors

  • Wedad S. Salem Computers and Systems Department, Electronics Research Institute, Cairo 12622, Egypt; and PhD, Department of Electrical Engineering, Benha Faculty of Engineering, Benha University, Benha, Egypt
  • Hesham F. Ali Computers and Systems Department, Electronics Research Institute, Cairo 12622, Egypt
  • Samia A. Mashali Computers and Systems Department, Electronics Research Institute, Cairo 12622, Egypt
  • Ashraf. S. Mohra Department of Electrical Engineering, Benha Faculty of Engineering, Benha University, Benha 13512, Egypt

Keywords:

Augmented Reality, Feature Detection, Feature Tracking, Camera Pose Estimation, Modified ORB Algorithm

Abstract

Augmented Reality (AR) has witnessed substantial growth in recent years, with applications spanning from gaming and education to healthcare and industrial training. A fundamental challenge in AR systems is the accurate detection and tracking of visual features in real-time. In this paper, we introduce the Modified ORB (Oriented FAST and Rotated BRIEF), a novel approach designed to enhance feature detection, tracking, and camera pose estimation in AR environments. The Modified ORB algorithm leverages innovative techniques such as adaptive scale selection, homography-aware descriptors, hybrid thresholding, and real-time keyframe selection to achieve robust performance across diverse scene conditions. Through extensive experiments and comparisons with traditional methods, we demonstrate the algorithm's superior accuracy, robustness, and computational efficiency. The Modified ORB algorithm represents a significant advancement in the field of augmented reality, paving the way for more immersive and practical AR applications.

Downloads

Download data is not yet available.

References

W. Sallam Fatouh, H. Farouk Ali, S. Abd Elrazek Mashali, and A. Shouki Seliem, “Image-based localization for augmented reality application: A Review,” in 2021 the 5th International Conference on Virtual and Augmented Reality Simulations (ICVARS 2021), Association for Computing Machinery ACM, Mar. 2021, pp. 7–16. doi: 10.1145/3463914.3463916.

Y. Tian, X. Zhou, X. Wang, Z. Wang, and H. Yao, “Registration and occlusion handling based on the FAST ICP-ORB method for augmented reality systems,” Multimed Tools Appl, vol. 80, no. 14, pp. 21041–21058, Jun. 2021, doi: 10.1007/S11042-020-10342-5.

Z. Cai, Y. Ou, Y. Ling, J. Dong, J. Lu, and H. Lee, “Feature Detection and Matching With Linear Adjustment and Adaptive Thresholding,” IEEE Access, vol. 8, pp. 189735–189746, Jan. 2020, doi: 10.1109/ACCESS.2020.3030183.

S. A. K. Tareen and Z. Saleem, “A comparative analysis of SIFT, SURF, KAZE, AKAZE, ORB, and BRISK,” 2018 International Conference on Computing, Mathematics and Engineering Technologies: Invent, Innovate and Integrate for Socioeconomic Development, iCoMET 2018 - Proceedings, vol. 2018-January, pp. 1–10, Apr. 2018, doi: 10.1109/ICOMET.2018.8346440.

M. S. Alam, M. A. Morshidi, T. S. Gunawan, and R. F. Olanrewaju, “A Comparative Analysis of Feature Extraction Algorithms for Augmented Reality Applications,” in 2021 IEEE 7th International Conference on Smart Instrumentation, Measurement and Applications, ICSIMA, IEEE, Aug. 2021, pp. 59–63. doi: 10.1109/ICSIMA50015.2021.9526295.

M. Bansal, M. Kumar, and M. Kumar, “2D object recognition: a comparative analysis of SIFT, SURF and ORB feature descriptors,” Multimed Tools Appl, vol. 80, no. 12, pp. 18839–18857, May 2021, doi: 10.1007/S11042-021-10646-0.

R. Wang, L. Zeng, S. Wu, and K. K. L. Wong, “Illumination-robust feature detection based on adaptive threshold function,” Computing, 2023, doi: 10.1007/S00607-020-00868-9.

C. Liu and S. Dang, “The Research and Application of Improved ORB Feature Matching Algorithm,” in Advances in Guidance, Navigation and Control: Proceedings of 2022 International Conference on Guidance, Navigation and Control, Springer Nature Singapore, 2023, pp. 4246–4255. doi: 10.1007/978-981-19-6613-2_413.

Y. Zhang, Y. Xie, Q. Wang, Y. Chang, and X. Zhang, “Fast Target Recognition Based on Improved ORB Feature,” Applied Sciences 2022, Vol. 12, Page 786, vol. 12, no. 2, p. 786, Jan. 2022, doi: 10.3390/APP12020786.

Y. Dai and J. Wu, “An Improved ORB Feature Extraction Algorithm based on Enhanced Image and Truncated Adaptive Threshold,” IEEE Access, vol. 11, pp. 32073–32081, 2023, doi: 10.1109/ACCESS.2023.3261665.

J. Liu, J. Yu, C. Wang, and X. Zhang, “An ORB feature matching algorithm for mobile devices,” ACM International Conference Proceeding Series, pp. 116–119, Apr. 2018, doi: 10.1145/3192975.3193021.

J. W. Bian et al., “GMS: Grid-Based Motion Statistics for Fast, Ultra-robust Feature Correspondence,” Int J Comput Vis, vol. 128, no. 6, pp. 1580–1593, Jun. 2020, doi: 10.1007/S11263-019-01280-3.

A. P. Tafti et al., “A comparative study on the application of SIFT, SURF, BRIEF and ORB for 3D surface reconstruction of electron microscopy images,” Comput Methods Biomech Biomed Eng Imaging Vis, vol. 6, no. 1, 2018, doi: 10.1080/21681163.2016.1152201.

X. Yang, J. Yang, H. He, and H. Chen, “A Hybrid 3D Registration Method of Augmented Reality for Intelligent Manufacturing,” IEEE Access, vol. 7, pp. 181867–181883, 2019, doi: 10.1109/ACCESS.2019.2959809.

S. Wang, A. Zhang, and Y. Li, “Feature extraction algorithm based on improved ORB with adaptive threshold,” pp. 1–6, Jun. 2023, doi: 10.1109/ICIT58465.2023.10143089.

J. Liu, A. Liang, E. Zhao, M. Pang, and D. Zhang, “Homography Matrix-Based Local Motion Consistent Matching for Remote Sensing Images,” Remote Sensing 2023, Vol. 15, Page 3379, vol. 15, no. 13, p. 3379, Jul. 2023, doi: 10.3390/RS15133379.

Y. Wang, J. Rui, X. Zhang, X. Wang, and X. Wu, “Method for online matching of multiple identical targets using local homography matrix based on moving DLT,” Meas Sci Technol, vol. 33, no. 5, p. 055009, Feb. 2022, doi: 10.1088/1361-6501/AC4F01.

D. Barath, D. Mishkin, M. Polic, W. Förstner, and J. Matas, “A Large-Scale Homography Benchmark,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 21360–21370. Accessed: Jul. 16, 2023. [Online]. Available: https://github.

A. Bosch, A. Zisserman, and X. Muñoz, “Scene classification using a hybrid generative/discriminative approach,” IEEE Trans Pattern Anal Mach Intell, vol. 30, no. 4, 2008, doi: 10.1109/TPAMI.2007.70716.

K. Van De Sande, T. Gevers, and C. Snoek, “Evaluating color descriptors for object and scene recognition,” IEEE Trans Pattern Anal Mach Intell, vol. 32, no. 9, 2010, doi: 10.1109/TPAMI.2009.154.

D. N. Ai, X. H. Han, X. Ruan, and Y. W. Chen, “Color independent components based SIFT descriptors for object/scene classification,” IEICE Trans Inf Syst, vol. E93-D, no. 9, 2010, doi: 10.1587/transinf.E93.D.2577.

Y. Li, W. Liu, X. Li, Q. Huang, and X. Li, “GA-SIFT: A new scale invariant feature transform for multispectral image using geometric algebra,” Inf Sci (N Y), vol. 281, 2014, doi: 10.1016/j.ins.2013.12.022.

H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, “Speeded-Up Robust Features (SURF),” Computer Vision and Image Understanding, vol. 110, no. 3, 2008, doi: 10.1016/j.cviu.2007.09.014.

E. Rosten, R. Porter, and T. Drummond, “Faster and better: A machine learning approach to corner detection,” IEEE Trans Pattern Anal Mach Intell, vol. 32, no. 1, pp. 105–119, 2010, doi: 10.1109/TPAMI.2008.275.

K. Mikolajczyk and C. Schmid, “A performance evaluation of local descriptors,” IEEE Trans Pattern Anal Mach Intell, vol. 27, no. 10, pp. 1615–1630, Oct. 2005, doi: 10.1109/TPAMI.2005.188.

Downloads

Published

29.01.2024

How to Cite

Salem, W. S. ., Ali, H. F. ., Mashali, S. A. ., & Mohra, A. S. . (2024). The Modified ORB Algorithm for Enhanced Augmented Reality Feature Detection and Tracking . International Journal of Intelligent Systems and Applications in Engineering, 12(13s), 188–196. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/4586

Issue

Vol. 12 No. 13s (2024)

Section

Research Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.

IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.