Near-Duplicate Image Analysis: Comprehensive Approaches to Image Phylogeny Tree Construction and Forensic Applications

Authors

  • Hemalata Mote, Sujata Kulkarni

Keywords:

Near-duplicates, Image Phylogeny Tree, Digital Image Forensics, Evolutionary Reconstruction, Algorithmic Evaluation, Dissimilarity calculation.

Abstract

The proliferation of digital technology enables unrestricted image creation and modification. These modified images often resurface on social media, creating a trail of near-duplicate images. This leads to challenges in tracking and verifying the origins and modifications of the image. In fields such as digital image forensics, news tracking services, and copyright enforcement, it is crucial to establish the connections between these modified images. An Image Phylogeny Tree (IPT) is created from a set of such altered images to map the sequence of changes at different levels. Image phylogeny organizes a series of logically similar images to highlight any modifications made to them. This paper investigates the construction of Image Phylogeny Trees (IPTs) to trace these relationships. It examines various algorithms—Oriented Kruskal (OK), Best Prim (BP), Optimum Branching (OB), Automatic Oriented Kruskal (AOK), and Automatic Optimum Branching (AOB)—for their efficiency in mapping the transformation sequence from an original image to its modified counterparts, providing a framework for systematic image alteration analysis.

Downloads

Download data is not yet available.

References

Banerjee, S., and Ross, A. “Computing an image phylogeny tree from photo metrically modified iris images.” In 2017 IEEE International Joint Conference on Biometrics (IJCB), pp. 618-626, 2017, October. IEEE.

Banerjee, S., and Ross, A. “Face phylogeny tree: Deducing relationships between near-duplicate face images using Legendre polynomials and radial basis functions.” In 2019 IEEE 10th International Conference on Biometrics Theory, Applications and Systems (BTAS), pp. 1-9, 2019, September. IEEE.

Banerjee, S., and Ross, A. “Face phylogeny tree using basis functions.” IEEE Transactions on Biometrics, Behavior, and Identity Science, 2(4), 310-325, 2020.

Bay, H., Tuytelaars, T., and Gool, L. V. “Surf: Speeded up robust features.” In European conference on computer vision, pp. 404-417, 2006, May. Springer, Berlin, Heidelberg.

Bestagini, P., Tagliasacchi, M., and Tubaro, S. “Image phylogeny tree reconstruction based on region selection.” In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2059-2063, 2016, March. IEEE.

Castelletto, R., Milani, S., and Bestagini, P. “Phylogenetic minimum spanning tree reconstruction using auto encoders.” In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2817-2821, 2020, May. IEEE.

Costa, F. O., Oikawa, M., Dias, Z., Goldenstein, S., and Rocha, A. “Image phylogeny forests reconstruction.” IEEE Transactions on Information Forensics and Security, 9(10):1533-1546, 2014.

Costa, F., Oliveira, A., Ferrara, P., Dias, Z., Goldenstein, S., and Rocha, A. “New dissimilarity measures for image phylogeny reconstruction.” Pattern Analysis and Applications, 20(4), 1289-1305, 2017.

De Rosa, A., Uccheddu, F., Costanzo, A., Piva, A., and Barni, M. “Exploring image dependencies: a new challenge in image forensics.” In Media forensics and security II, Vol. 7541, pp. 337-348, 2010, January. SPIE.

Dias, Z., Goldenstein, S., and Rocha, A. “Exploring heuristic and optimum branching algorithms for image phylogeny.” Journal of Visual Communication and Image Representation, 24(7), 1124-1134, 2013.

Dias, Z., Goldenstein, S., and Rocha, A. “Large-scale image phylogeny: Tracing image ancestral relationships.” IEEE Multimedia, 20(3), 58-70, 2013.

Dias, Z., Goldenstein, S., and Rocha, A. “Toward image phylogeny forests: Automatically recovering semantically similar image relationships.” Forensic science international, 231(1-3), 178-189, 2013.

Dias, Z., Rocha, A., and Goldenstein, S. “Image phylogeny by minimal spanning trees.” IEEE Transactions on Information Forensics and Security, 7(2), 774-788, 2011.

Dias, Z., Rocha, A., and Goldenstein, S. “First steps towards image phylogeny.” In IEEE International Workshop on Information Forensics Security, pp. 1-6, 2010.

Kennedy, L., and Chang, S. F. “Internet image archaeology: Automatically tracing the manipulation history of photographs on the web.” In Proceedings of the 16th ACM international conference on Multimedia, pp. 349-358, 2008, October.

Le Philippe, N., Puech, W., and Fiorio, C. “Phylogeny of JPEG images by ancestor estimation using missing markers on image pairs.” In 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA), pp. 1-6, 2016, December. IEEE.

Melloni, A., Bestagini, P., Milani, S., Tagliasacchi, M., Rocha, A., and Tubaro, S. “Image phylogeny through dissimilarity metrics fusion.” In 2014 5th European Workshop on Visual Information Processing (EUVIP), pp. 1-6, 2014, December. IEEE.

Milani, S., Fontana, M., Bestagini, P., and Tubaro, S. “Phylogenetic analysis of near-duplicate images using processing age metrics.” In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2054-2058, 2016, March. IEEE.

Moreira, D., Bharati, A., Brogan, J., Pinto, A., Parowski, M., Bowyer, K. W., and Scheirer, W. J. “Image provenance analysis at scale.” IEEE Transactions on Image Processing, 27(12), 6109-6123, 2018.

Oikawa, M. A., Dias, Z., de Rezende Rocha, A., and Goldenstein, S. “Manifold learning and spectral clustering for image phylogeny forests.” IEEE Transactions on Information Forensics and Security, 11(1), 5-18, 2015.

Oikawa, M. A., Dias, Z., de Rezende Rocha, A., and Goldenstein, S. “Manifold learning and spectral clustering for image phylogeny forests.” IEEE Transactions on Information Forensics and Security, 11(1), 5-18, 2015.

Oikawa, Marina A., et al. "Distances in multimedia phylogeny." International Transactions in Operational Research 23.5: pp. 921-946, 2016.

Oliveira, A., Ferrara, P., De Rosa, A., Piva, A., Barni, M., Goldenstein, S., ... and Rocha, A. “Multiple parenting identification in image phylogeny.” In 2014 IEEE International Conference on Image Processing (ICIP), pp. 5347-5351, 2014, October. IEEE.

P. Bestagini et al., "An overview on video forensics," 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO), pp. 1229-1233, 2012.

Reinhard, E., Adhikhmin, M., Gooch, B., and Shirley, P. “Color transfer between images.” IEEE Computer graphics and applications, 21(5), 34-41, 2001.

Zitova, B., and Flusser, J. “Image registration methods: a survey.” Image and vision computing, 21(11), 977-1000, 2003.

Downloads

Published

12.06.2024

How to Cite

Hemalata Mote. (2024). Near-Duplicate Image Analysis: Comprehensive Approaches to Image Phylogeny Tree Construction and Forensic Applications. International Journal of Intelligent Systems and Applications in Engineering, 12(4), 1717–1727. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/6471

Issue

Section

Research Article

Similar Articles

You may also start an advanced similarity search for this article.