A Hybrid Approach for Background Subtraction in Video: Combining RPCA, LBP, and Grassmann Average

Authors

  • Jeevith S. H. Assistant Professor, Dept. of E&TE,SSIT , Tumakuru,India
  • Lakshmikanth S.
  • Sandeep Kumar K.

Keywords:

Histogram equalization, Local Binary Pattern, Robust Principal Component Analysis, Grassmann Average

Abstract

Background subtraction from moving video faces problems such as the complexity of the background, its movement and the change in light intensity arise and fragmented object make it difficult to detect moving objects in video. This paper presents a Novel hybrid model using Robust Principal Component Analysis (RPCA) and LBP (Local Binary Pattern) for background subtraction using Grassmann Average. Grassmann Average (GA) reduces the big outliers and RPCA gives sparse matrix (foreground information) and low rank matrix (back ground information). Feature extraction is done by using Local Binary Pattern (LBP). Finally, proposed RPCA-GA algorithm is executed in CD Net dataset. The results of proposed method are compared with various methods and also yields high Precision and Recall.

Downloads

Download data is not yet available.

References

Peng.C, Chen. Y, Kang.Z, Chen. C,Cheng, Q, Robust principal component analysis: A factorization-based approach with linear complexity. Information Sciences 513, 2020, pp.581-599.

Vaswani, N, Bouwmans, T, Javed, S, Narayanamurthy, P, Robust subspace learning: Robust PCA, robust subspace tracking, and robust subspace recovery. IEEE signal processing magazine, 35(4), 2018, pp.32-55.

Vaswani, N, Narayanamurthy P, Static and dynamic robust PCA and matrix completion: A review. Proceedings of the IEEE, 106(8), 2018, pp.1359-1379.

Chen Y, Fan J, Ma C, Yan Y, Bridging convex and nonconvex optimization in robust PCA: Noise, outliers, and missing data. arXiv preprint arXiv:2001.05484, 2020.

Yang J.H, Zhao X.L, Ji T.Y, Ma T.H, Huang, T.Z, Low-rank tensor train for tensor robust principal component analysis. Applied Mathematics and Computation, 367, 2020, p.124783.

Minnehan, B, Savakis, A, Grassmann Manifold Optimization for Fast $ L_1 $-Norm Principal Component Analysis. IEEE Signal Processing Letters, 26(2), 2018, pp.242-246.

Tripathi, R.K., Jalal A.S, Agrawal, S.C., Abandoned or removed object detection from visual surveillance: a review. Multimedia Tools and Applications, 78(6), 2019, pp.7585-7620.

Liu, K. and Ma, H., October. Exploring background-bias for anomaly detection in surveillance videos. In Proceedings of the 27th ACM International Conference on Multimedia, 2019, pp. 1490-1499.

Ansari, M. and Singh, D.K., Human detection techniques for real time surveillance: A comprehensive survey. Multimedia Tools and Applications, 80(6), 2021, pp.8759-8808.

Mabrouk, A.B. and Zagrouba, E, Abnormal behavior recognition for intelligent video surveillance systems: A review. Expert Systems with Applications, 91,2018, pp.480-491.

Goyal, K. and Singhai, J, Review of background subtraction methods using Gaussian mixture model for video surveillance systems. Artificial Intelligence Review, 50(2), 2018,pp.241-259.

Bouwmans, T., Javed, S., Sultana, M. and Jung, S.K., Deep neural network concepts for background subtraction: A systematic review and comparative evaluation. Neural Networks, 117, 2019, pp.8-66.

Azeez, B. and Alizadeh, F., February. Review and Classification of Trending Background Subtraction-Based Object Detection Techniques. In 2020 6th International Engineering Conference “Sustainable Technology and Development”(IEC), 2020, pp. 185-190). IEEE.

Jenifa Sabeena, S. ., & Antelin Vijila, S. . (2023). Moulded RSA and DES (MRDES) Algorithm for Data Security. International Journal on Recent and Innovation Trends in Computing and Communication, 11(2), 154–162. https://doi.org/10.17762/ijritcc.v11i2.6140

Zhang, T., Li, J., Jia, W., Sun, J. and Yang, H., Fast and robust occluded face detection in ATM surveillance. Pattern Recognition Letters, 107, 2018,pp.33-40.

Sun, S., Kuang, Z., Sheng, L., Ouyang, W. and Zhang, W, Optical flow guided feature: A fast and robust motion representation for video action recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, 2018,pp. 1390-1399.

Zhou, D., Frémont, V., Quost, B., Dai, Y. and Li, H., Moving object detection and segmentation in urban environments from a moving platform. Image and Vision Computing, 68, 2017,pp.76-87.

Đokić, L., Jokić, A., Petrović, M., Slavković, N. and Miljković, Z., Application of metaheuristic optimization algorithms for image registration in mobile robot visual control. Serbian Journal of Electrical Engineering, 18(2), 2021, pp.155-170.

Kushwaha, A., Khare, A., Prakash, O. and Khare, M., Dense optical flow based background subtraction technique for object segmentation in moving camera environment. IET Image Processing, 14(14), 2020, pp.3393-3404.

Mohanty, S.K. and Rup, S., An adaptive background modeling for foreground detection using spatio-temporal features. Multimedia Tools and Applications, 80(1), 2021, pp.1311-1341.

Qiu, S. and Li, X., Moving target extraction and background reconstruction algorithm. Journal of Ambient Intelligence and Humanized Computing, 2020, pp.1-9.

Zhang, K., Tong, S., Shi, H., Yue, G. and Zhao, J., Moving object detection of assembly components based on improved background subtraction algorithm. In IOP Conference Series: Materials Science and Engineering (Vol. 1009, No. 1, p. 012063), 2021,IOP Publishing.

Maddalena, L. and Petrosino, A., Self-organizing background subtraction using color and depth data. Multimedia Tools and Applications, 78(9), 2019, pp.11927-11948.

Lu, X., Xu, C., Wang, L. and Teng, L., Improved background subtraction method for detecting moving objects based on GMM. IEEJ Transactions on Electrical and Electronic Engineering, 13(11), 2018, pp.1540-1550.

Khatri, K. ., & Sharma, D. A. . (2020). ECG Signal Analysis for Heart Disease Detection Based on Sensor Data Analysis with Signal Processing by Deep Learning Architectures. Research Journal of Computer Systems and Engineering, 1(1), 06–10. Retrieved from https://technicaljournals.org/RJCSE/index.php/journal/article/view/11

Tah, A., Roy, S., Das, P. and Mitra, A., Moving object detection and segmentation using background subtraction by kalman filter. Indian Journal of Science and Technology, 10(19) ,2017..

Ali, Y.H. and Mohammed, M.R., 2019. Extracting Background Model in Video Surveillance By Using Hybrid Techniques. AL-MANSOUR JOURNAL, (31).

Guo, J., Wang, J., Bai, R., Zhang, Y. and Li, Y., September. A new moving object detection method based on frame-difference and background subtraction. In IOP conference series: materials science and engineering (Vol. 242, No. 1, p. 012115). 2017, IOP Publishing.

Xu, Z., Min, B. and Cheung, R.C., A robust background initialization algorithm with superpixel motion detection. Signal processing: image communication, 71, 2019, pp.1-12.

Yin, J., Liu, L., Li, H. and Liu, Q., The infrared moving object detection and security detection related algorithms based on W4 and frame difference. Infrared Physics & Technology, 77, 2016,pp.302-315.

Lee, S.H., Lee, G.C., Yoo, J. and Kwon, S., Wisenetmd: Motion detection using dynamic background region analysis. Symmetry, 11(5), 2019, p.621,pp.1-15.

Camplani, M., Maddalena, L., Alcover, G.M., Petrosino, A. and Salgado, L., September. A benchmarking framework for background subtraction in RGBD videos. In International Conference on Image Analysis and Processing 2017, pp. 219-229. Springer, Cham.

Sehairi, K., Fatima, C. and Meunier, J., April. A Benchmark of Motion Detection Algorithms for Static Camera: Application on CDnet 2012 Dataset. In International Conference on Computer Science and its Applications, 2018, pp. 235-245. Springer, Cham.

Chakraborty, R., Yang, L., Hauberg, S. and Vemuri, B., Intrinsic grassmann averages for online linear, robust and nonlinear subspace learning. IEEE transactions on pattern analysis and machine intelligence, 2020.

Mandal, M., Saxena, P., Vipparthi, S.K. and Murala, S., CANDID: Robust change dynamics and deterministic update policy for dynamic background subtraction. In 2018 24th international conference on pattern recognition (ICPR) , August 2018, pp. 2468-2473,IEEE.

St-Charles, P.L., Bilodeau, G.A. and Bergevin, R., Subsense: A universal change detection method with local adaptive sensitivity. IEEE Transactions on Image Processing, 24(1), 2014.,pp.359-373.

Ahn, H. and Kang, M., Dynamic background subtraction with masked rpca. Signal, Image and Video Processing, 15(3), 2021,pp.467-474.

Block diagram for pre-processing phase

Downloads

Published

01.07.2023

How to Cite

S. H., J. ., S., L. ., & Kumar K., S. . (2023). A Hybrid Approach for Background Subtraction in Video: Combining RPCA, LBP, and Grassmann Average. International Journal of Intelligent Systems and Applications in Engineering, 11(7s), 299–310. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2955