A Framework for Flood Extent Mapping using CNN Transfer Learning
Keywords:
Image classification, Convolutional Neural Networks, Flood severity classification, Transfer learning, pre-trained modelsAbstract
One of the most common natural disasters is flooding that endangers infrastructure and life of human beings, particularly in heavily populated areas. The ability to identify flooded regions quickly and precisely is critical for emergency response planning and damage assessment. This research is aimed at mapping the flooded regions as per their severity levels to improve community resilience and decision making in disaster scenarios. To accomplish this task, image classification technique is used. In this study, for the purpose of classification our designed dataset having images of the flood of varying severity levels are categorized into three classes viz mild, moderate, and severe. Further to improve the classification task, Convolutional Neural Networks (CNNs) with transfer learning approach is used. CNN is powerful enough to extract features from large volumes of visual data and is particularly excellent at exploiting semantic information, however, requires huge amount of training data. In this article instead of building and training a CNN from start for flood severity image classification, pre-built and pre-trained networks via transfer learning are used. A comparative analysis using VGG16, MobilNet, and ResNet50 (which are prominent CNN pretrained models) has been performed in this study. The average recall, precision, and F1-score are used to assess performance. Experiment analysis shows that fine-tuned pretrained ResNet50 model performs better as compared to state of art models for flood image classification application.
Downloads
References
Rodriguez, J.; Vos, F.; Below, R.; Guha-Sapir, D. Annual Disaster Statistical Review 2008: The Numbers and Trends; Centre for Research on the Epidemiology of Disasters (CRED): Brussels, Belgium, 2009.
Jonkman, S.N. Global perspectives on loss of human life caused by floods. Nat. Hazards 2005, 34, 151–175.[CrossRef]
Mishra, Ashutosh. "An assessment of climate change-natural disaster linkage in Indian context." J Geol Geosci 3.5 (2014): 167..
Ireland, G.; Volpi, M.; Petropoulos, G.P. Examining the capability of supervised machine learning classifiers in extracting flooded areas from Landsat TM imagery: A case study from a Mediterranean flood. Remote Sens. 2015, 7, 3372–3399. [CrossRef]
Krizhevsky, A.; Sutskever, I.; Hinton, G. Magenet classification with deep convolutional neural networks.In Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA, 3–6 December 2012; pp. 1097–1105.
Grossberg, S. Recurrent neural networks. Scholarpedia 2013, 8, 1888. [CrossRef]
Fu, G.; Liu, C.; Zhou, R.; Sun, T.; Zhang, Q. Classification for high resolution remote sensing imagery using a fully convolutional network. Remote Sens. 2017, 9, 498. [CrossRef]
Hu,W.; Huang, Y.;Wei, L.; Zhang, F.; Li, H. Deep convolutional neural networks for hyperspectral image classification. J. Sens. 2015, 2015, 258619. [CrossRef]
Sainath, T.N.; Mohamed, A.R.; Kingsbury, B.; Ramabhadran, B. Deep convolutional neural networks for LVCSR. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, BC, Canada, 26–31 May 2013; pp. 8614–8618.
Ball, J.E.; Anderson, D.T.; Chan, C.S. Comprehensive survey of deep learning in remote sensing: Theories, tools, and challenges for the community. J. Appl. Remote Sens. 2017, 11, 042609. [CrossRef]
Akhtar, M.K.; Corzo, G.A.; van Andel, S.J.; Jonoski, A. River flow forecasting with artificial neural networks using satellite observed precipitation pre-processed with flow length and travel time information: Case study of the Ganges river basin. Hydrol. Earth Syst. Sci. 2009, 13, 1607–1618. [CrossRef]
Maier, H.R.; Jain, A.; Dandy, G.C.; Sudheer, K.P. Methods used for the development of neural networks for the prediction of water resource variables in river systems: Current status and future directions. Environ. Model. Softw. 2010, 25, 891–909. [CrossRef]
Hitokoto, M.; Sakuraba, M.; Sei, Y. Development of the real-time river stage prediction method using deep learning. J. Jpn. Soc. Civ. Eng. JSCE Ser. B1 Hydraul. Eng. 2016, 72, I_187–I_192. [CrossRef]
Hochreiter, P.; Schmidhuber, J. Long short-term memory. Neural Comput. 1997, 9, 1735–1780. [CrossRef] [PubMed]
Gers, F.A.; Schmidhuber, J.; Cummins, F. Learning to forget: Continual prediction with LSTM. In Proceedings of the 9th International Conference on Artificial Neural Networks (ICANN) 99, Edinburgh, UK, 7–10 September 1999; Volume 9, pp. 850–855. [CrossRef]
Pratt, L.Y. Discriminability-Based Transfer between Neural Networks. In Proceedings of the Conference of the Advances in NIPS 5, Denver, CO, USA, 30 November–3 December 1992; pp. 204–211.
R. M. Haralick, K. Shanmugam, and I. Dinstein, “Textural features for image classification,” IEEE Transactions on Systems, Man, and Cybernetics, vol. SMC-3, no. 6, pp. 610–621, Nov 1973.
R. M. Haralick, “Statistical and structural approaches to texture,” Proceedings of the IEEE, vol. 67, no. 5, pp. 786–804, May 1979.
B. S. Manjunath and W.-Y. Ma, “Texture features for browsing and retrieval of image data,” IEEE Transactions on pattern analysis and machine intelligence, vol. 18, no. 8, pp. 837–842, 1996.
J. Han and K.-K. Ma, “Rotation-invariant and scale-invariant gabor features for texture image retrieval,” Image and vision computing, vol. 25, no. 9, pp. 1474–1481, 2007.
S. N. Talbar, R. S. Holambe, and T. R. Sontakke, “Supervised texture classification using wavelet transform,” in Signal Processing Proceedings, 1998. ICSP ’98. 1998 Fourth International Conference on, vol. 2, 1998, pp. 1177–1180 vol.2.
Zhao, Zhong-Qiu, et al. "Object detection with deep learning: A review." IEEE transactions on neural networks and learning systems 30.11 (2019): 3212-3232.
Ahmed, Omar, and Adnan Brifcani. "Gene expression classification based on deep learning." 2019 4th Scientific International Conference Najaf (SICN). IEEE, 2019.
Obaid, Kavi B., Subhi Zeebaree, and Omar M. Ahmed. "Deep learning models based on image classification: a review." International Journal of Science and Business 4.11 (2020): 75-81.
Sanghvi, Kavish, et al. "Fauna image classification using convolutional neural network." International Journal of Future Generation Communication and Networking 13.1s (2020): 08-16.
Mateen, Muhammad, et al. "Fundus image classification using VGG-19 architecture with PCA and SVD." Symmetry 11.1 (2018): 1.
Gao, Qishuo, Samsung Lim, and Xiuping Jia. "Hyperspectral image classification using convolutional neural networks and multiple feature learning." Remote Sensing 10.2 (2018): 299.
Agarap, Abien Fred. "An architecture combining convolutional neural network (CNN) and support vector machine (SVM) for image classification." arXiv preprint arXiv:1712.03541 (2017).
Zhong, Chengliang, et al. "SAR target image classification based on transfer learning and model compression." IEEE Geoscience and Remote Sensing Letters 16.3 (2018): 412-416.
Song, Jia, et al. "A survey of remote sensing image classification based on CNNs." Big earth data 3.3 (2019): 232-254.
K. Hariharan, A. Lobo and S. Deshmukh, "Hybrid Approach for Effective Disaster Management Using Twitter Data and Image-Based Analysis," 2021 International Conference on Communication information and Computing Technology (ICCICT), 2021, pp. 1-6, doi: 10.1109/ICCICT50803.2021.9510029.
VGG16—Convolutional Network for Classification and Detection. 2018. Available online: https://neurohive.io/en/popularnetworks/ vgg16/ (accessed on December 2021).
Phiphiphatphaisit, Sirawan, and Olarik Surinta. "Food image classification with improved MobileNet architecture and data augmentation." Proceedings of the 2020 The 3rd International Conference on Information Science and System. 2020.
Ali, Luqman, et al. "Performance evaluation of deep CNN-based crack detection and localization techniques for concrete structures." Sensors 21.5 (2021): 1688.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
