Object Detection in Satellite Images with Canis Hunt Optimized Tetralet Attention enabled Explainable Convolutional Neural Network

Authors

  • Mayur Vijaykumar Tiwari, Sanjay Vasant Dudul

Keywords:

Object detection, Satellite images, Explainable Convolutional Neural Network, Tetralet Attention, and Canis Hunt Optimization

Abstract

Object detection has always been a research hotspot in computer vision, specifically detection from satellite images remains a challenging research area. Several conventional researches have been developed but failed to work with high-quality images and satellite images. The object detection in the research is proposed with the Canis Hunt Optimized Tetralet Attention enabled Explainable Convolutional Neural Network (CHunt-TetraExNN). The proposed model aims to provide accurate detection from the satellite image inputs. The Tetralet attention module incorporated with the model is composed of triplet attention followed by positional attention, which provides the accurate estimation of the attentional features that are highly helpful in the process of object detection. Further, the research model is supported by the Canis Hunt Optimization, which is the combination of the adaptability and the hunt characteristics of the Lapins and Latrans that belong to the Canis Family. Thus, the model provided accurate estimation outcomes in the research of object detection from the satellite images, which are estimated with an Accuracy of 96.55%, Precision of 94.59%, Recall of 96.56%, and F1 score of 95.6%.

Downloads

Download data is not yet available.

References

Zhao, Y., Yang, R., Guo, C. and Chen, X., “Parallel Space and Channel Attention for Stronger Remote Sensing Object Detection.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 2023.

Makantasis, K., Voulodimos, A., Doulamis, A., Doulamis, N. and Georgoulas, I., “Hyperspectral image classification with tensor-based rank-R learning models.” In 2019 IEEE International Conference on Image Processing (ICIP), 3148-3125,2019.

Makantasis, K., Doulamis, A.D., Doulamis, N.D. and Nikitakis, A., “Tensor-based classification models for hyperspectral data analysis.” IEEE Transactions on Geoscience and Remote Sensing, 56(12), pp.6884-6898, 2018.

Makantasis, K., Karantzalos, K., Doulamis, A. and Loupos, K., “Deep learning-based man-made object detection from hyperspectral data.” In Advances in Visual Computing: 11th International Symposium, ISVC 2015, Las Vegas, NV, USA, December 14-16, 2015, Proceedings, Part I, 11, pp. 717-727, 2015.

Ding, J., Xue, N., Xia, G.S., Bai, X., Yang, W., Yang, M.Y., Belongie, S., Luo, J., Datcu, M., Pelillo, M. and Zhang, L., “Object detection in aerial images: A large-scale benchmark and challenges.” IEEE transactions on pattern analysis and machine intelligence, 44(11), pp.7778-7796, 2021.

Kaselimi, M., Voulodimos, A., Daskalopoulos, I., Doulamis, N. and Doulamis, A., “A vision transformer model for convolution-free multilabel classification of satellite imagery in deforestation monitoring.” IEEE Transactions on Neural Networks and Learning Systems. 2022.

Yi, D., Su, J. and Chen, W.H., “Probabilistic faster R-CNN with stochastic region proposing: Towards object detection and recognition in remote sensing imagery.” Neurocomputing,459, pp.290-301, 2021.

Liu, L., Liu, Y., Yan, J., Liu, H., Li, M., Wang, J. and Zhou, K., “Object detection in large-scale remote sensing images with a distributed deep learning framework.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15, pp.8142-8154, 2022.

Zakaria, Y., Mokhtar, S.A., Baraka, H. and Hadhoud, M., “Improving Small and Cluttered Object Detection by Incorporating Instance Level Denoising Into Single-Shot Alignment Network for Remote Sensing Imagery.” IEEE Access, 10, pp.51176-51190, 2022.

Wang, L., Shoulin, Y., Alyami, H., Laghari, A.A., Rashid, M., Almotiri, J., Alyamani, H.J. and Alturise, F., “A novel deep learning‐based single shot multibox detector model for object detection in optical remote sensing images.” 2022.

Wang, L., Long, C., Li, X., Tang, X., Bai, Z. and Gao, H., “CSFFNet: Lightweight cross‐scale feature fusion network for salient object detection in remote sensing images.” IET Image Processing, 18(3), pp.602-614, 2024.

Girshick, R., Donahue, J., Darrell, T. and Malik, J., “Rich feature hierarchies for accurate object detection and semantic segmentation.” In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 580-587, 2014.

Wang, K., Bai, F., Li, J., Liu, Y. and Li, Y., “MashFormer: A novel multiscale aware hybrid detector for remote sensing object detection.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 16, pp.2753-2763, 2023.

Xu, Y., Wu, X., Wang, L., Xu, L., Shao, Z. and Fei, A., “HOFA-Net: A High-Order Feature Association Network for Dense Object Detection in Remote Sensing.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 2023.

Yu, Y., Gao, J., Liu, C., Guan, H., Li, D., Yu, C., Jin, S., Li, F. and Li, J., “OA-CapsNet: A one-stage anchor-free capsule network for geospatial object detection from remote sensing imagery.” Canadian Journal of Remote Sensing, 47(3), pp.485-498, 2021.

Qu, J., Su, C., Zhang, Z. and Razi, A., “Dilated convolution and feature fusion SSD network for small object detection in remote sensing images.” IEEE Access, 8, pp.82832-82843, 2020.

Girshick, R., “Fast r-cnn.” In Proceedings of the IEEE international conference on computer vision, pp. 1440-1448, 2015.

Ren, S., He, K., Girshick, R. and Sun, J., “Faster r-cnn: Towards real-time object detection with region proposal networks.” Advances in neural information processing systems, 28, 2015.

Chen, C., Gong, W., Chen, Y. and Li, W., “Object detection in remote sensing images based on a scene-contextual feature pyramid network.” Remote Sensing, 11(3), p.339, 2019.

Yang, X., Sun, H., Fu, K., Yang, J., Sun, X., Yan, M. and Guo, Z., “Automatic ship detection in remote sensing images from google earth of complex scenes based on multiscale rotation dense feature pyramid networks.” Remote sensing, 10(1), p.132, 2018.

Liu, S. and Huang, D., “Receptive field block net for accurate and fast object detection.” In Proceedings of the European conference on computer vision (ECCV), pp. 385-400, 2018.

Zhang, T., Zhuang, Y., Chen, H., Chen, L., Wang, G., Gao, P. and Dong, H., “Object-Centric Masked Image Modeling Based Self-Supervised Pretraining for Remote Sensing Object Detection.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 2023.

Haryono, A., Jati, G. and Jatmiko, W., “Oriented object detection in satellite images using convolutional neural network based on ResNeXt.” ETRI Journal. 2023.

Airbus Aircraft Detection Dataset, https://www.kaggle.com/datasets/airbusgeo/airbus-aircrafts-sample-dataset accessed April, 2024.

Kang, S.H. and Kim, J.Y., “Application of fast non-local means algorithm for noise reduction using separable color channels in light microscopy images.” International Journal of Environmental Research and Public Health, 18(6), p.2903, 2021.

Xia, X. and Kulis, B., “W-net: A deep model for fully unsupervised image segmentation.” arXiv preprint arXiv:1711.08506, 2017.

Saleh, E.S., Haridas, T.M. and Supriya, M.H., “March. Unsupervised image segmentation model based on w net architecture and conditional random field for underwater images.” In 2021 7th International Conference on Advanced Computing and Communication Systems (ICACCS), Vol. 1, pp. 34-39, 2021.

Shi, J. and Malik, J., “Normalized cuts and image segmentation.” IEEE Transactions on pattern analysis and machine intelligence, 22(8), pp.888-905, 2000.

Rangsee, P., Raja, K.B. and Venugopal, K.R., “modified local ternary pattern based face recognition using SVM.” In 2018 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), (Vol. 3, pp. 343-350), 2018.

Jafarpour, S., Sedghi, Z. and Amirani, M.C., “A robust brain MRI classification with GLCM features.” International Journal of Computer Applications, 37(12), pp.1-5, 2012.

Zulpe, N. and Pawar, V., “GLCM textural features for brain tumor classification.” International Journal of Computer Science Issues (IJCSI), 9(3), p.354, 2012.

Demir, A., Yilmaz, F. and Kose, O., “Early detection of skin cancer using deep learning architectures: resnet-101 and inception-v3.” In 2019 medical technologies congress (TIPTEKNO), (pp. 1-4), 2019.

Ghosal, P., Nandanwar, L., Kanchan, S., Bhadra, A., Chakraborty, J. and Nandi, D., “Brain tumor classification using ResNet-101 based squeeze and excitation deep neural network.” In 2019 Second International Conference on Advanced Computational and Communication Paradigms (ICACCP), (pp. 1-6), 2019.

Yan, X. and Li, Y., “A method of lane edge detection based on Canny algorithm.” In 2017 Chinese Automation Congress (CAC) (pp. 2120-2124), 2017.

Song, R., Zhang, Z. and Liu, H., “Edge connection based Canny edge detection algorithm.” Pattern Recognition and Image Analysis, 27, pp.740-747, 2017.

Kar, A., Bhattacharjee, D., Basu, D.K., Nasipuri, M. and Kundu, M., “An adaptive block based integrated LDP, GLCM, and Morphological features for Face Recognition.” arXiv preprint arXiv:1312.1512, 2013.

Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D. and Batra, D., “Grad-cam: Visual explanations from deep networks via gradient-based localization.” In Proceedings of the IEEE international conference on computer vision, (pp. 618-626), 2017.

Misra, D., Nalamada, T., Arasanipalai, A.U. and Hou, Q., “Rotate to attend: Convolutional triplet attention module.” In Proceedings of the IEEE/CVF winter conference on applications of computer vision, (pp. 3139-3148), 2021.

Zhuang, H., Qin, Z., Wang, X., Bendersky, M., Qian, X., Hu, P. and Chen, D.C., “Cross-positional attention for debiasing clicks.” In Proceedings of the Web Conference 2021, (pp. 788-797), 2021.

Pierezan, J. and Coelho, L.D.S., “Coyote optimization algorithm: a new metaheuristic for global optimization problems.” In 2018 IEEE congress on evolutionary computation (CEC), (pp. 1-8), 2018.

Mirjalili, S., Mirjalili, S.M. and Lewis, A., “Grey wolf optimizer.” Advances in engineering software, 69, pp.46-61, 2014.

Teng, Z., Duan, Y., Liu, Y., Zhang, B. and Fan, J., “Global to local: Clip-LSTM-based object detection from remote sensing images.” IEEE Transactions on Geoscience and Remote Sensing, 60, pp.1-13, 2021.

Peng, Y., Jia, S., Xie, L. and Shang, J., “An Attention-BiLSTM Model for Satellite Operation Prediction with Correlation Telemetry.” 2023.

Wu, Z.Z., Wang, X.F., Zou, L., Xu, L.X., Li, X.L. and Weise, T., “Hierarchical object detection for very high-resolution satellite images.” Applied Soft Computing, 113, p.107885, 2021.

Downloads

Published

12.06.2024

How to Cite

Mayur Vijaykumar Tiwari. (2024). Object Detection in Satellite Images with Canis Hunt Optimized Tetralet Attention enabled Explainable Convolutional Neural Network. International Journal of Intelligent Systems and Applications in Engineering, 12(4), 45–58. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/6173

Issue

Section

Research Article