Mathematical Modeling and Implementation of Multi-Scale Attention Feature Enhancement Network Algorithm for the Clarity of SEM and TEM Images

Authors

  • Tenneti Ram Prasad Department of Mathematics, Vasavi College of Engineering, Hyderabad, India
  • Mukesh Kumar Tripathi2 Tripathi Department of Computer Science & Engineering, Vardhaman College of Engineering, Hyderabad, India
  • CH. V. K. N. S. N. Moorthy Department of Mechanical Engineering, Vasavi College of Engineering, Hyderabad, India
  • Shivakumar Swamy N. Department of Computer Science and Engineering R.R. Institute of Technology, Bengaluru, Karnataka
  • Nandeeswar S. B. Department of Artificial Intelligence & Machine Learning, AMC Engineering College, Bengaluru
  • Manohar Koli Department of Computer Science, Karnataka University, Dharwad

Keywords:

Image Dehazing, Image restoration, Feature Enhancement, Fusion, Progressive Feature

Abstract

In this paper, the approach aims to improve image clarity and visual effects by considering both high and low-frequency haze characteristics. The inclusion of guidance information in cloudy appearances and the success of benchmark datasets, as well as real-world scanning electron microscope (SEM) and transmission electron microscope (TEM) images, suggest the versatility and practical applicability of the algorithm across different domains. The algorithm begins by utilizing a neural network trained to establish a mapping between hazy images and their corresponding clear versions. A progressive feature fusion module is introduced to enhance the utilization of guidance information from the generated reference image. This module combines features extracted from the hazy and reference pictures. The use of progressive feature fusion is highlighted, indicating a sophisticated approach to combining information from different sources This could help in preserving important details and structures during the dehazing process. Validation on Benchmark Datasets and Real-world Images: The practical applicability of the algorithm is demonstrated through its success on benchmark datasets, providing a standard for comparison, and real-world SEM and TEM images, showcasing its versatility across various domains. The combination of deep learning, progressive feature fusion, and end-to-end training is a robust framework for effective image dehazing, as demonstrated by the algorithm's impressive results in controlled datasets and real-world scenarios.

Downloads

Download data is not yet available.

References

Xie, Zhihua, Qiang Li, Sha Zong, and Guodong Liu. "Multiscale feature fusion deep network for single image dehazing with continuous memory mechanism." Optik 287 (2023): 171144.

Tian, Shishun, Tiantian Zeng, Wenbin Zou, Xia Li, and Lu Zhang. "DHIQA: quality assessment of dehazed images based on attentive multi-scale feature fusion and rank learning." Displays 79 (2023): 102495.

Mei, Kangfu, Aiwen Jiang, Juncheng Li, and Mingwen Wang. "Progressive feature fusion network for realistic image dehazing." In Computer Vision–ACCV 2018: 14th Asian Conference on Computer Vision, Perth, Australia, December 2–6, 2018, Revised Selected Papers, Part I 14, pp. 203-215. Springer International Publishing, 2019.

Shivendra, Kasa Chiranjeevi, and Mukesh Kumar Tripathi. "Detection of Fruits Image Applying Decision Tree Classifier Techniques." In Computational Intelligence and Data Analytics: Proceedings of ICCIDA 2022, pp. 127-139. Singapore: Springer Nature Singapore, 2022.

Liu, Yifan, Jincai Chen, Ping Lu, Chuanbo Zhu, Yugen Jian, Chao Sun, and Han Liang. "MFID-Net: Multi-scaled feature-fused image dehazing via dynamic weights." Displays 78 (2023): 102416.

Tan, Robby T. "Visibility in bad weather from a single image." In 2008 IEEE conference on computer vision and pattern recognition, pp. 1-8. IEEE, 2008.

He, Kaiming, Jian Sun, and Xiaoou Tang. "Single image haze removal using dark channel prior." IEEE transactions on pattern analysis and machine intelligence 33, no. 12 (2010): 2341-2353.

Tripathi, Mukesh Kumar et al., "Neutroscophic approach based intelligent system for automatic mango detection." Multimedia Tools and Applications (2023): 1-23.

Bai, Haoran, Jinshan Pan, Xinguang Xiang, and Jinhui Tang. "Self-guided image dehazing using progressive feature fusion." IEEE Transactions on Image Processing 31 (2022): 1217-1229.

Berman, Dana, and Shai Avidan. "Non-local image dehazing." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1674-1682. 2016.

Tripathi, Mukesh Kumar, and Dhananjay D. Maktedar. "Internal quality assessment of mango fruit: an automated grading system with ensemble classifier." The Imaging Science Journal 70, no. 4 (2022): 253-272.

Cai, Bolun, Xiangmin Xu, Kui Jia, Chunmei Qing, and Dacheng Tao. "Dehazenet: An end-to-end system for single image haze removal." IEEE transactions on image processing 25, no. 11 (2016): 5187-5198.

Ren, Wenqi, Si Liu, Hua Zhang, Jinshan Pan, Xiaochun Cao, and Ming-Hsuan Yang. "Single image dehazing via multi-scale convolutional neural networks." In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14, pp. 154-169. Springer International Publishing, 2016.

Moorthy, CH VKNSN, Mukesh kumar Tripathi, Nilesh Pandurang Bhosle, Vishnu Annarao Suryawanshi, Priyanka Amol Kadam, and Suvarna Abhimunyu Bahir. "Investigating Advanced and Innovative Non-Destructive Techniques to Grade the Quality of Mangifera Indica." International Journal of Intelligent Systems and Applications in Engineering 12, no. 1 (2024): 299-309.

Zhang, He, and Vishal M. Patel. "Densely connected pyramid dehazing network." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3194-3203. 2018

Ma, Yongrui. "GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazing." PhD diss., 2019.

Dong, Hang, Jinshan Pan, Lei Xiang, Zhe Hu, Xinyi Zhang, Fei Wang, and Ming-Hsuan Yang. "Multi-scale boosted dehazing network with dense feature fusion." In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 2157-2167. 2020.

Tripathi, Mukesh Kumar, M. Neelakantapp, Anant Nagesh Kaulage, Khan Vajid Nabilal, Sahebrao N. Patil, and Kalyan Devappa Bamane. "Breast Cancer Image Analysis and Classification Framework by Applying Machine Learning Techniques." International Journal of Intelligent Systems and Applications in Engineering 11, no. 3 (2023): 930-941.

Liu, Tao, Jun Cheng, and Shan Tan. "Spectral Bayesian Uncertainty for Image Super-Resolution." In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 18166-18175. 2023.

Ren, Wenqi, Lin Ma, Jiawei Zhang, Jinshan Pan, Xiaochun Cao, Wei Liu, and Ming-Hsuan Yang. "Gated fusion network for single image dehazing." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3253-3261. 2018.

Liu, Xiaohong, Yongrui Ma, Zhihao Shi, and Jun Chen. "Griddehazenet: Attention-based multi-scale network for image dehazing." In Proceedings of the IEEE/CVF international conference on computer vision, pp. 7314-7323. 2019.

Tripathi, M.K., Reddy, P.K., Neelakantappa, M., Andhare, C.V., Shivendra "Identification of mango variety using near infrared spectroscopy”, Indonesian Journal of Electrical Engineering and Computer Science this link is disabled, 2023, 31(3), pp. 1776–1783.

Li, Runde, Jinshan Pan, Zechao Li, and Jinhui Tang. "Single image dehazing via conditional generative adversarial network." In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 8202-8211. 2018.

Tripathi, Mukesh Kumar, Dhananjay Maktedar, D. N. Vasundhara, CH VKNSN Moorthy, and Preeti Patil. "Residual Life Assessment (RLA) Analysis of Apple Disease Based on Multimodal Deep Learning Model." International Journal of Intelligent Systems and Applications in Engineering 11, no. 3 (2023): 1042-1050.

Ren, Wenqi, Jingang Zhang, Xiangyu Xu, Lin Ma, Xiaochun Cao, Gaofeng Meng, and Wei Liu. "Deep video dehazing with semantic segmentation." IEEE transactions on image processing 28, no. 4 (2018): 1895-1908.

G. Meng, Y. Wang, J. Duan, S. Xiang, and C. Pan, “Efficient image dehazing with boundary constraint and contextual regularization,” in Proceedings of the IEEE International Conference on Computer Vision, Sydney, NSW, Australia, December 2013.

B. Bansal, J. Singh Sidhu, and K. Jyoti, “A review of image restoration based image defogging algorithms,” International Journal of Image, Graphics and Signal Processing, vol. 9, no. 11, pp. 62–74, 2017.

W. Ren, S. Liu, H. Zhang, J. Pan, X. Cao, and M.-H. Yang, “Single image dehazing via multi-scale convolutional neural networks,” in European Conference on Computer Vision, pp. 154–169, Springer, Berlin, Germany, 2016.

C. O. Ancuti, C. Ancuti, M. Sbert, and R. Timofte, “Dense haze: a benchmark for image dehazing with dense-haze and haze-free images,” 2019, http://arxiv.org/abs/1904.02904.

Downloads

Published

29.01.2024

How to Cite

Prasad, T. R. ., Tripathi, M. K. T., Moorthy, C. V. K. N. S. N. ., Swamy N., S. ., S. B., N. ., & Koli, M. . (2024). Mathematical Modeling and Implementation of Multi-Scale Attention Feature Enhancement Network Algorithm for the Clarity of SEM and TEM Images. International Journal of Intelligent Systems and Applications in Engineering, 12(13s), 230–238. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/4590

Issue

Section

Research Article