Selected Three Frame Difference Method for Moving Object Detection
AbstractThree frame difference is one of the well-known method that is used to perform moving object detection. According to the theory, the presence of a moving object is estimated by subtracting consecutive three image frames that provide moving object edges. However, these edges do not give complete information of the moving object which means that the method leads to loss of information. Some post-processing methods such as morphological operations, optical flow and combining these techniques are necessary to be apply for obtaining complete information of moving object. In this paper, we present a new approach called Selected Three Frame Difference (STFD) to detect moving object in video sequences without any post processing operations. We initially propose an algorithm that selects three images considering the local maximum value of frame differences. Instead of using consecutive three frames, these three selected image differences that include non-overlapping object frames are applied to the logical and operator. We mathematically prove that the entire moving object is always detected in the second selected image. We tested the proposed method on public benchmark and real datasets collected from our laboratory. To validate the performance of our approach, we also compared with three frame difference method on all dataset.
T. B. Moeslund, “Introduction to Video and Image Processing: Building Real Systems and Applications” in Springer Science & Business Media, Heidelberg, NJ, USA: 2012.
M. Ekinci, E. Gedikli, “Silhouette based human motion detection and analysis for real-time automated video surveillance” in Turkish Journal of Electrical Engineering and Computer Sciences 2005; 13(2): 199-229.
E. Simsek, B. Ozyer, L. Bayindir, G. T.Ozyer, “Human-animal recognition in camera trap images” in IEEE 26th Signal Processing and Communications Applications Conference (SIU); Cesme, Izmir, Turkey; 2018. pp. 1-4
S. S. Sengar, S. Mukhopadhyay, “Moving object area detection using normalized self-adaptive optical flow” in Optik 2016; 127(16): 6258-6267.
E. Simsek, B. Ozyer, G. T. Ozyer, “Foto-kapan Görüntülerinde Hareketli Nesne Tespiti ve Konumunun Belirlenmesi” in Erzincan University Journal of Science and Technology, 12(2), 902-919.
V. Karavasilis, C. Nikou, A. Likas, “Visual tracking using spatially weighted likelihood of Gaussian mixtures” in Computer Vision and Image Understanding 2015; 140: 43-57.
E. Simsek, B. Ozyer, G.T. Ozyer, “Object Detection on Camera-Trap Images with Local Features” in Gümüşhane University Journal of Science and Technology 2019; 9(4), 633-644.
A.J. Lipton, H. Fujiyoshi, R. S. Patil, “Moving target classification and tracking from real-time video” in Proceedings Fourth IEEE Workshop on Applications of Computer Vision; Princeton, NJ, USA; 1998. pp.8-14.
F. Moscheni, F. Dufaux, M. Kunt, “Object tracking based on temporal and spatial information” in IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings; Atlanta, GA, USA; 1996. pp.1914-1917.
Z. Wang, K. Liao, J. Xiong, Q. Zhang, “Moving object detection based on temporal information” in IEEE Signal Processing Letters 2011; 21(11): 1403-1407.
Y. Zhang, X. Wang, BJPE.Qu, “Three-frame difference algorithm research based on mathematical morphology” in Procedia Engineering 2012; 29: 2705-2709.
Z. Zhu, Y. Wang, “A hybrid algorithm for automatic segmentation of slowly moving objects” in AEU-International Journal of Electronics and Communications 2012; 66(3): 249-254.
M. Yazdi, T. Bouwmans, “New trends on moving object detection in video images captured by a moving camera: A survey” in Computer Science Review 2018; 28: 157-177.
M. Yokoyama, T. Poggio, “A contour-based moving object detection and tracking” in IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance; San Diego, California, USA; 2005. pp. 271-276.
H. Wu, N. Liu, X. Luo, J. Su, L. Chen, “Real-time background subtraction-based video surveillance of people by integrating local texture patterns” in Signal, Image and Video Processing 2014; 8(4); 665-676.
T. Bouwmans, “Traditional and recent approaches in background modeling for foreground detection: An overview” in Computer Science Review 2014; 11: 31-66.
M. Piccardi, “Background subtraction techniques: a review” in IEEE International Conference on Systems, Man and Cybernetics; Hague, Netheirlands; 2004. pp. 3099-3104.
S. S. Sengar, S. Mukhopadhyay, “Moving object detection based on frame difference and W4” in Signal, Image and Video Processing 2017; 11 (7): 1357-1364.
X. Han, Y. Gao, Z. Lu, Z. Zhang, D. Niu, “Research on moving object detection algorithm based on improved three frame difference method and optical flow” in Fifth International Conference on Instrumentation and Measurement, Computer, Communication and Control (IMCCC); Qinhuangdao, China; 2015. pp. 580-584.
N. Singla, “Motion detection based on frame difference method” in International Journal of Information and Computation Technology 2014; 4(15): 1559-1565.
R. Jain, H. H. Nagel, “On the analysis of accumulative difference pictures from image sequences of real-world scenes” in IEEE Transactions on Pattern Analysis and Machine Intelligence 1979; (2): 206-214.
J. Xiao, H. Cheng, H. Sawhney, F. Han, “Vehicle detection and tracking in wide field-of-view aerial video” in IEEE Computer Society Conference on Computer Vision and Pattern Recognition; San Francisco, CA, USA; 2010. pp. 679-684.
L. Gang, N. Shangkun, Y. Yugan, W. Guanglei, Z. Siguo, “An improved moving objects detection algorithm” in International Conference on Wavelet Analysis and Pattern Recognition; Tianjin, China; 2013. pp. 96-102.
H. Zhang, H. Zhang, “A moving target detection algorithm based on dynamic scenes” in IEEE 8th International Conference on Computer Science and Education; Colombo, Sri Lanka; 2013. pp. 995-998.
J. S. Kulchandani, K. J. Dangarwala, “Moving object detection”: Review of recent research trends. in International Conference on Pervasive Computing (ICPC). Pune, India; 2015. pp.1-5.
W. Huang, Z. Liu, W. Pan, “The precise recognition of moving object in complex background” in IEEE Third International Conference on Natural Computation (ICNC 2007); Haikou, China; 2007. pp. 246-252 (2007).
A. Abdelli, H. J. Choi, “A four-frames differencing technique for moving objects detection in wide area surveillance” in IEEE International Conference on Big Data and Smart Computing (BigComp),Jeju, South Korea; 2017. pp. 210-214.
L. Shang, F. You, C. Han, X. Wang, S. Zhao, “Optimization of Three-Frame Difference Method and Improvement of Pedestrian Detection Code Book” in Journal of Physics: Conference Series 2019, August. (Vol. 1302, No. 2, p. 022014). IOP Publishing.
Godbehere, A. B., Matsukawa, A., and Goldberg, K. (2012). Visual tracking of human visitors under variable-lighting conditions for a responsive audio art installation. In American Control Conference (ACC), 2012 (pp. 4305-4312). IEEE.
KaewTraKulPong, P., and Bowden, R. (2002). An improved adaptive backgroundmixture model for real-time tracking with shadow detection. In Video-based surveillance systems (pp. 135-144). Springer US.
Zivkovic, Z. (2004). Improved adaptive Gaussian mixture model for background subtraction. In Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on (Vol. 2, pp. 28-31). IEEE.
Wren, C. R., Azarbayejani, A., Darrell, T., & Pentland, A. P. (1997). Pfinder: Real-time tracking of the human body. IEEE Transactions on pattern analysis and machine intelligence, 19(7), 780-785.
Zeevi, S., Background Subtractor CNT: A Fast Background Subtraction Algorithm (2016), https://zenodo.org/badge/DOI/10.5281/zenodo.4267853.svg
Qian, S., Cascitelli, A., (2017) Improve Background Subtraction with Aggregated Saliency. https://gist.github.com/Masterqsx/f63c2627873c2cdf7be9cb520c7060a7
Zivkovic Z. F. van der Heijden. (2006) Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern recognition letters, 27(7):773–780.
Guo, L., Xu, D., & Qiang, Z. (2016). Background subtraction using local SVD binary pattern. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops (pp. 86-94).
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.