Deepfake Technology and Image Forensics: Advancements, Challenges, and Ethical Implications in Synthetic Media Detection

Authors

  • Nilakshi Jain Professor, Shah & Anchor Kutchhi Engineering College, Chembur, Mumbai, Maharashtra, India
  • Shwetambari Borade Assistant Professor Shah & Anchor Kutchhi Engineering College, Chembur, Mumbai, Maharashtra, India
  • Bhavesh Patel Professor, Shah & Anchor Kutchhi Engineering College, Chembur, Mumbai, Maharashtra, India
  • Vineet Kumar Founder & Global President, CyberPeace Foundation, Delhi, India
  • Mustansir Godhrawala Student, Shah & Anchor Kutchhi Engineering College, Chembur, Mumbai, Maharashtra, India
  • Shubham Kolaskar Student, Shah & Anchor Kutchhi Engineering College, Chembur, Mumbai, Maharashtra, India
  • Yash Nagare Student, Shah & Anchor Kutchhi Engineering College, Chembur, Mumbai, Maharashtra, India
  • Pratham Shah Student, Shah & Anchor Kutchhi Engineering College, Chembur, Mumbai, Maharashtra, India
  • Jayan Shah Student, Shah & Anchor Kutchhi Engineering College, Chembur, Mumbai, Maharashtra, India

Keywords:

Deepfake Technology, Detection Methods, Ethical Concerns, Image Forensics, Machine Learning Methodologies

Abstract

This comparative analysis delves into the dynamic landscape of deepfake technology and its intricate relationship with image forensics. Focused on advanced machine learning methodologies such as autoencoders, GANs, and CNNs, the exploration reveals both unprecedented possibilities and formidable challenges. While technical advancements showcase innovative solutions with notable accuracies, ethical concerns surrounding potential misuse highlight the urgency for robust detection methods. The versatility of approaches extends beyond detection to applications like image manipulation detection. Evaluation methods, combining subjective assessments and objective evaluations, stress the importance of a holistic understanding of deepfake challenges. This analysis offers a comprehensive snapshot of deepfake detection, showcasing significant strides in countering synthetic media threats. Sustained collaboration, innovation, and interdisciplinary approaches are deemed crucial for staying ahead in the ongoing battle against deepfake misuse.

Downloads

Download data is not yet available.

References

A. Heidari, N. Jafari Navimipour, H. Dag, and M. Unal, “Deepfake detection using deep learning methods: A systematic and comprehensive review,” Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery. John Wiley and Sons Inc, 2023. doi: 10.1002/widm.1520.

M. Zendran and A. Rusiecki, “Swapping face images with generative neural networks for deepfake technology - Experimental study,” in Procedia Computer Science, 2021. doi: 10.1016/j.procs.2021.08.086.

Y. Li et al., “DeepFake-o-meter: An Open Platform for DeepFake Detection,” in Proceedings - 2021 IEEE Symposium on Security and Privacy Workshops, SPW 2021, Institute of Electrical and Electronics Engineers Inc., May 2021, pp. 277–281. doi: 10.1109/SPW53761.2021.00047.

M. Viola and C. Voto, “Designed to abuse? Deepfakes and the non-consensual diffusion of intimate images,” Synthese, vol. 201, no. 1, 2023, doi: 10.1007/s11229-022-04012-2.

R. Rafique, R. Gantassi, R. Amin, J. Frnda, A. Mustapha, and A. H. Alshehri, “Deep fake detection and classification using error-level analysis and deep learning,” Sci Rep, vol. 13, no. 1, Dec. 2023, doi: 10.1038/s41598-023-34629-3.

B. Chen, T. Li, and W. Ding, “Detecting deepfake videos based on spatiotemporal attention and convolutional LSTM,” Inf Sci (N Y), vol. 601, pp. 58–70, Jul. 2022, doi: 10.1016/j.ins.2022.04.014.

Z. Shang, H. Xie, Z. Zha, L. Yu, Y. Li, and Y. Zhang, “PRRNet: Pixel-Region relation network for face forgery detection,” Pattern Recognit, vol. 116, Aug. 2021, doi: 10.1016/j.patcog.2021.107950.

S. Kingra, N. Aggarwal, and N. Kaur, “LBPNet: Exploiting texture descriptor for deepfake detection,” Forensic Science International: Digital Investigation, vol. 42, Sep. 2022, doi: 10.1016/j.fsidi.2022.301452.

Z. Guo, G. Yang, J. Chen, and X. Sun, “Fake face detection via adaptive manipulation traces extraction network,” Computer Vision and Image Understanding, vol. 204, Mar. 2021, doi: 10.1016/j.cviu.2021.103170.

V. V. V. N. S. Vamsi et al., “Deepfake detection in digital media forensics,” Global Transitions Proceedings, vol. 3, no. 1, pp. 74–79, Jun. 2022, doi: 10.1016/j.gltp.2022.04.017.

Y. Li et al., “Deepfake Text Detection in the Wild,” May 2023, [Online]. Available: http://arxiv.org/abs/2305.13242

Y. Li, X. Yang, P. Sun, H. Qi, and S. Lyu, “Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics,” Sep. 2019, [Online]. Available: http://arxiv.org/abs/1909.12962

European Association for Signal Processing, Improving Deepfake Detection by Mixing Top Solutions of the DFDC. 2022.

J. Zhang, K. Cheng, G. Sovernigo, and X. Lin, “A Heterogeneous Feature Ensemble Learning based Deepfake Detection Method,” in IEEE International Conference on Communications, Institute of Electrical and Electronics Engineers Inc., 2022, pp. 2084–2089. doi: 10.1109/ICC45855.2022.9838630.

Zankoya Dihuk, Institute of Electrical and Electronics Engineers, and Institute of Electrical and Electronics Engineers. Iraq Section, Effective and Fast DeepFake Detection Method Based on Haar Wavelet Transform. 2020.

P. Korshunov and S. Marcel, “Subjective and objective evaluation of deepfake videos,” in ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, Institute of Electrical and Electronics Engineers Inc., 2021, pp. 2510–2514. doi: 10.1109/ICASSP39728.2021.9414258.

S. Bin Son, S. H. Park, and Y. K. Lee, “A Measurement Study on Gray Channel-based Deepfake Detection,” in International Conference on ICT Convergence, IEEE Computer Society, 2021, pp. 428–430. doi: 10.1109/ICTC52510.2021.9621082.

Y. Patel et al., “An Improved Dense CNN Architecture for Deepfake Image Detection,” IEEE Access, vol. 11, pp. 22081–22095, 2023, doi: 10.1109/ACCESS.2023.3251417.

R. Mubarak, T. Alsboui, O. Alshaikh, I. Inuwa-Dute, S. Khan, and S. Parkinson, “A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats,” IEEE Access, vol. 6, pp. 1–33, 2023, doi: 10.1109/ACCESS.2017.DOI.

S. H. Lee, G. E. Yun, M. Y. Lim, and Y. K. Lee, “A Study on Effective Use of BPM Information in Deepfake Detection,” in International Conference on ICT Convergence, IEEE Computer Society, 2021, pp. 425–427. doi: 10.1109/ICTC52510.2021.9621186.

N. Guhagarkar, S. Desai, S. Vaishyampayan, and A. Save, “DEEPFAKE DETECTION TECHNIQUES: A REVIEW,” Online, 2021. [Online]. Available: www.viva-technology.org/New/IJRI

Z. Akhtar, “Deepfakes Generation and Detection: A Short Survey,” Journal of Imaging, vol. 9, no. 1. MDPI, Jan. 01, 2023. doi: 10.3390/jimaging9010018.

H. Ha, M. Kim, S. Han, and S. Lee, “Robust DeepFake Detection Method based on Ensemble of ViT and CNN,” in Proceedings of the ACM Symposium on Applied Computing, 2023. doi: 10.1145/3555776.3577769.

B. Chen and S. Tan, “FeatureTransfer: Unsupervised Domain Adaptation for Cross-Domain Deepfake Detection,” Security and Communication Networks, vol. 2021, 2021, doi: 10.1155/2021/9942754.

H. Chen, Y. Lin, B. Li, and S. Tan, “Learning Features of Intra-Consistency and Inter-Diversity: Keys Toward Generalizable Deepfake Detection,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 33, no. 3, 2023, doi: 10.1109/TCSVT.2022.3209336.

B. Zi, M. Chang, J. Chen, X. Ma, and Y. G. Jiang, “WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection,” in MM 2020 - Proceedings of the 28th ACM International Conference on Multimedia, 2020. doi: 10.1145/3394171.3413769.

H. Bao, L. X. Dang, and L. Zhang, “Improving Identity-Relevant Deepfake Video Detection in Real-World with Adversarial Data Augmentation,” in ACM International Conference Proceeding Series, 2022. doi: 10.1145/3545822.3545826.

W. Yang et al., “AVoiD-DF: Audio-Visual Joint Learning for Detecting Deepfake,” IEEE Transactions on Information Forensics and Security, vol. 18, 2023, doi: 10.1109/TIFS.2023.3262148.

Downloads

Published

23.02.2024

How to Cite

Jain, N. ., Borade, S. ., Patel, B. ., Kumar, V. ., Godhrawala, M. ., Kolaskar, S. ., Nagare, Y. ., Shah, P. ., & Shah, J. . (2024). Deepfake Technology and Image Forensics: Advancements, Challenges, and Ethical Implications in Synthetic Media Detection. International Journal of Intelligent Systems and Applications in Engineering, 12(16s), 49–58. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/4782

Issue

Vol. 12 No. 16s (2024)

Section

Research Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.

IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.

Most read articles by the same author(s)