IndDeepFake: Mitigating the Spread of Misinformation in India through a Multimodal Adversarial Network

Authors

  • Manish Kumar Singh Department of Computer Science, Jamia Hamdard University, Delhi, India.
  • Jawed Ahmed Department of Computer Science, Jamia Hamdard University, Delhi, India.
  • Kamlesh Kumar Raghuvanshi Department of Computer Science, Ramanujan College, University of Delhi, Delhi, India.
  • Mohammad Afshar Alam Department of Computer Science, Jamia Hamdard University, Delhi, India.

Keywords:

Fake news, Multimodal adversarial network, Misinformation mitigation, Indian fake news dataset, Information Credibility

Abstract

The issue of the distribution of fake news and misinformation on social media platforms is a rising global concern, which has affected India as well. This research paper introduces an innovative method for identifying and detecting fake news in India using a multimodal adversarial network. The approach presented in this study leverages both text and image characteristics to encompass the multimodal aspects of fake news. Adversarial training is employed to learn robust and discriminative features/characteristics that enable differentiating authentic news from fabricated news. Evaluation of the proposed method is conducted on an Indian fake news events dataset and achieves a high accuracy and  F1-score of 0.89 and 0.90 respectively. The experiment results indicate that the proposed multimodal adversarial network approach is effective in detecting fake news in the Indian context and thus helpful in mitigating the dissemination of misinformation.

Downloads

Download data is not yet available.

References

Lazer, D.M., Baum, M.A., Benkler, Y., Berinsky, A.J., Greenhill, K.M., Menczer, F., Metzger, M.J., Nyhan, B., Pennycook, G., Rothschild, D. and Schudson, M., 2018. The science of fake news. Science, 359(6380), pp.1094-1096. [CrossRef] [Google Scholar] [Publisher link]

The Wikipedia website, 2023. [Online]. Available: https://en.wikipedia.org/wiki/Fake_news_in_India

Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017). Fake news detection on social media: A data mining perspective. ACM SIGKDD Explorations Newsletter, 19(1), 22-36. [CrossRef] [Google Scholar] [Publisher link]

Vosoughi, S., Roy, D., & Aral, S. (2018). The spread of true and false news online. Science, 359(6380), 1146-1151 [CrossRef] [Google Scholar] [Publisher link]

Liu, Y. and Wu, Y.F., 2018, April. Early detection of fake news on social media through propagation path classification with recurrent and convolutional networks. In Proceedings of the AAAI conference on artificial intelligence (Vol. 32, No. 1) [CrossRef] [Google Scholar] [Publisher link]

Zhang, X. and Ghorbani, A.A., 2020. An overview of online fake news: Characterization, detection, and discussion. Information Processing & Management, 57(2), p.102025 [CrossRef] [Google Scholar] [Publisher link]

Toivonen, T., Heikinheimo, V., Fink, C., Hausmann, A., Hiippala, T., Järv, O., Tenkanen, H. and Di Minin, E., 2019. Social media data for conservation science: A methodological overview. Biological Conservation, 233, pp.298-315 [CrossRef] [Google Scholar] [Publisher link]

Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A. and Bengio, Y., 2020. Generative adversarial networks. Communications of the ACM, 63(11), pp.139-144 [CrossRef] [Google Scholar] [Publisher link]

Ma, X., Chen, Z. and Zhang, J., 2018, April. Fully convolutional network with cluster for semantic segmentation. In AIP Conference Proceedings (Vol. 1955, No. 1, p. 040049). AIP Publishing LLC [CrossRef] [Google Scholar] [Publisher link]

Gangireddy, S.C.R., Long, C. and Chakraborty, T., 2020, July. Unsupervised fake news detection: A graph-based approach. In Proceedings of the 31st ACM conference on hypertext and social media (pp. 75-83) [CrossRef] [Google Scholar] [Publisher link]

Raza, S. and Ding, C., 2022. Fake news detection based on news content and social contexts: a transformer-based approach. International Journal of Data Science and Analytics, 13(4), pp.335-362 [CrossRef] [Google Scholar] [Publisher link]

Weitzel, L., Prati, R.C. and Aguiar, R.F., 2016. The comprehension of figurative language: What is the influence of irony and sarcasm on NLP techniques?. Sentiment Analysis and Ontology Engineering: An Environment of Computational Intelligence, pp.49-74 [CrossRef] [Google Scholar] [Publisher link]

Singhal, S., Pandey, T., Mrig, S., Shah, R.R. and Kumaraguru, P., 2022, April. Leveraging Intra and Inter Modality Relationship for Multimodal Fake News Detection. In Companion Proceedings of the Web Conference 2022 (pp. 726-734) [CrossRef] [Google Scholar] [Publisher link]

Sahoo, S.R. and Gupta, B.B., 2021. Multiple features based approach for automatic fake news detection on social networks using deep learning. Applied Soft Computing, 100, p.106983 [CrossRef] [Google Scholar] [Publisher link]

Althobaiti, M.J., 2022. BERT-based Approach to Arabic Hate Speech and Offensive Language Detection in Twitter: Exploiting Emojis and Sentiment Analysis. International Journal of Advanced Computer Science and Applications, 13(5) [CrossRef] [Google Scholar] [Publisher link]

Nguyen, T.T. and Armitage, G., 2008. A survey of techniques for internet traffic classification using machine learning. IEEE communications surveys & tutorials, 10(4), pp.56-76 [CrossRef] [Google Scholar] [Publisher link]

Nasir, J.A., Khan, O.S. and Varlamis, I., 2021. Fake news detection: A hybrid CNN-RNN based deep learning approach. International Journal of Information Management Data Insights, 1(1), p.100007 [CrossRef] [Google Scholar] [Publisher link]

Choudhary, A. and Arora, A., 2021. Linguistic feature based learning model for fake news detection and classification. Expert Systems with Applications, 169, p.114171 [CrossRef] [Google Scholar] [Publisher link]

Scott, J., 2012. What is social network analysis? (p. 114). Bloomsbury Academic [CrossRef] [Google Scholar] [Publisher link]

Wang, Y., Ma, F., Jin, Z., Yuan, Y., Xun, G., Jha, K., Su, L. and Gao, J., 2018, July. Eann: Event adversarial neural networks for multi-modal fake news detection. In Proceedings of the 24th acm sigkdd international conference on knowledge discovery & data mining (pp. 849-857) [CrossRef] [Google Scholar] [Publisher link]

Peng, X. and Xintong, B., 2022. An effective strategy for multi-modal fake news detection. Multimedia Tools and Applications, 81(10), pp.13799-13822 [CrossRef] [Google Scholar] [Publisher link]

Wei, P., Wu, F., Sun, Y., Zhou, H. and Jing, X.Y., 2022. Modality and Event Adversarial Networks for Multi-Modal Fake News Detection. IEEE Signal Processing Letters, 29, pp.1382-1386 [CrossRef] [Google Scholar] [Publisher link]

Yuan, X., He, P., Zhu, Q. and Li, X., 2019. Adversarial examples: Attacks and defenses for deep learning. IEEE transactions on neural networks and learning systems, 30(9), pp.2805-2824 [CrossRef] [Google Scholar] [Publisher link]

Khattar, D., Goud, J.S., Gupta, M. and Varma, V., 2019, May. Mvae: Multimodal variational autoencoder for fake news detection. In The world wide web conference (pp. 2915-2921) [CrossRef] [Google Scholar] [Publisher link]

Qian, S., Wang, J., Hu, J., Fang, Q. and Xu, C., 2021, July. Hierarchical multi-modal contextual attention network for fake news detection. In Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval (pp. 153-162) [CrossRef] [Google Scholar] [Publisher link]

Yuan, H., Zheng, J., Ye, Q., Qian, Y. and Zhang, Y., 2021. Improving fake news detection with domain-adversarial and graph-attention neural network. Decision Support Systems, 151, p.113633 [CrossRef] [Google Scholar] [Publisher link]

Xu, T., Zhang, P., Huang, Q., Zhang, H., Gan, Z., Huang, X. and He, X., 2018. Attngan: Fine-grained text to image generation with attentional generative adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1316-1324) [CrossRef] [Google Scholar] [Publisher link]

The BharatFakeNewsKosh Website, 2023. [Online]. Available: https://bharatfakenewskosh.com/datasets/

The IFCN Website, 2023. [Online]. Available: https://www.poynter.org/ifcn/

Vandana, C.P. and Chikkamannur, A.A., 2021. Feature selection: An empirical study. International Journal of Engineering Trends and Technology, 69(2), pp.165-170 [CrossRef] [Google Scholar] [Publisher link]

Suthaharan, S. and Suthaharan, S., 2016. Support vector machine. Machine learning models and algorithms for big data classification: thinking with examples for effective learning, pp.207-235 [CrossRef] [Google Scholar] [Publisher link]

Rani, S. and Kumar, P., 2019. Deep learning based sentiment analysis using convolution neural network. Arabian Journal for Science and Engineering, 44, pp.3305-3314 [CrossRef] [Google Scholar] [Publisher link]

Suresh Arunachalam, T., Shahana, R. and Kavitha, T., 2019. Advanced Convolutional Neural Network Architecture: A Detailed Review. International Journal of Engineering Trends and Technology, 67(5), pp.183-187 [CrossRef] [Google Scholar] [Publisher link]

Ngiam, J., Khosla, A., Kim, M., Nam, J., Lee, H. and Ng, A.Y., 2011. Multimodal deep learning. In Proceedings of the 28th international conference on machine learning (ICML-11) (pp. 689-696) [CrossRef] [Google Scholar] [Publisher link]

Wang, W. Y. 2017. “Liar, Liar Pants on Fire”: A New Benchmark Dataset for Fake News Detection. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 422–426, Vancouver, Canada. Association for Computational Linguistics [CrossRef] [Google Scholar] [Publisher link]

Shu, K., Mahudeswaran, D. and Liu, H., 2019. FakeNewsTracker: a tool for fake news collection, detection, and visualization. Computational and Mathematical Organization Theory, 25, pp.60-71 [CrossRef] [Google Scholar] [Publisher link]

Shishah, W., 2021. Fake news detection using BERT model with joint learning. Arabian Journal for Science and Engineering, 46(9), pp.9115-9127 [CrossRef] [Google Scholar] [Publisher link]

Bisong, E. and Bisong, E., 2019. Regularization for deep learning. Building Machine Learning and Deep Learning Models on Google Cloud Platform: A Comprehensive Guide for Beginners, pp.415-421 [CrossRef] [Google Scholar] [Publisher link]

Rácz, A., Bajusz, D. and Héberger, K., 2019. Multi-level comparison of machine learning classifiers and their performance metrics. Molecules, 24(15), p.2811 [CrossRef] [Google Scholar] [Publisher link]

Meyes, R., Lu, M., de Puiseau, C.W. and Meisen, T., 2019. Ablation studies in artificial neural networks. arXiv preprint arXiv:1901.08644 [CrossRef] [Google Scholar] [Publisher link]

Li, K., Long, Y., Wang, H. and Wang, Y.F., 2021. Modeling and sensitivity analysis of concrete creep with machine learning methods. Journal of Materials in Civil Engineering, 33(8), p.04021206 [Google Scholar] [Publisher link]

Singh, M.K., Ahmed, J., Raghuvanshi, K.K. and Alam, M.A., 2023, January. BharatFakeNewsKosh: A Data Repository for Fake News Research in India. In International Conference on Smart Computing and Communication (pp. 277-288). Singapore: Springer Nature Singapore. [Google Scholar] [Publisher link]

Kumar, V. and Kumar, R., 2015. An adaptive approach for detection of blackhole attack in mobile ad hoc network. Procedia Computer Science, 48, pp.472-479.

Kumar, V. and Kumar, R., 2015, April. Detection of phishing attack using visual cryptography in ad hoc network. In 2015 International Conference on Communications and Signal Processing (ICCSP) (pp. 1021-1025). IEEE.

Kumar, V. and Kumar, R., 2015. An optimal authentication protocol using certificateless ID-based signature in MANET. In Security in Computing and Communications: Third International Symposium, SSCC 2015, Kochi, India, August 10-13, 2015. Proceedings 3 (pp. 110-121). Springer International Publishing.

Kumar, Vimal, and Rakesh Kumar. "A cooperative black hole node detection and mitigation approach for MANETs." In Innovative Security Solutions for Information Technology and Communications: 8th International Conference, SECITC 2015, Bucharest, Romania, June 11-12, 2015. Revised Selected Papers 8, pp. 171-183. Springer International Publishing, 2015.

Kumar, V., Shankar, M., Tripathi, A.M., Yadav, V., Rai, A.K., Khan, U. and Rahul, M., 2022. Prevention of Blackhole Attack in MANET using Certificateless Signature Scheme. Journal of Scientific & Industrial Research, 81(10), pp.1061-1072.

Deshwal, Vaishali, and Vimal Kumar. "Study of Coronavirus Disease (COVID-19) Outbreak in India." The Open Nursing Journal 15, no. 1 (2021).

Chinthamu, N. ., Gooda, S. K. ., Venkatachalam, C. ., S., S. ., & Malathy, G. . (2023). IoT-based Secure Data Transmission Prediction using Deep Learning Model in Cloud Computing. International Journal on Recent and Innovation Trends in Computing and Communication, 11(4s), 68–76. https://doi.org/10.17762/ijritcc.v11i4s.6308

Luca Ferrari, Deep Learning Techniques for Natural Language Translation , Machine Learning Applications Conference Proceedings, Vol 2 2022.

Jain, V., Beram, S. M., Talukdar, V., Patil, T., Dhabliya, D., & Gupta, A. (2022). Accuracy enhancement in machine learning during blockchain based transaction classification. Paper presented at the PDGC 2022 - 2022 7th International Conference on Parallel, Distributed and Grid Computing, 536-540. doi:10.1109/PDGC56933.2022.10053213 Retrieved from www.scopus.com

Downloads

Published

03.09.2023

How to Cite

Singh, M. K. ., Ahmed, J. ., Raghuvanshi, K. K. ., & Alam, M. A. . (2023). IndDeepFake: Mitigating the Spread of Misinformation in India through a Multimodal Adversarial Network. International Journal of Intelligent Systems and Applications in Engineering, 12(1s), 81–97. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/3397

Issue

Section

Research Article