Training of the Artificial Neural Networks using Crow Search Algorithm
AbstractArtificial Neural Networks are a method frequently used in problem-solving today. In the past, it has been used in many areas such as classification, pattern recognition and image processing. The most important and demanding part of Artificial Neural Networks is the training process of the network. The main challenge in network training is the process of determining the optimum connection weights and bias values for the network. In the literature, many algorithms have been proposed for training Artificial Neural Networks. This article proposed a new hybrid algorithm called CSA-MLP for training Artificial Neural Networks using the Crow Search Algorithm. Crow Search Algorithm is a population-based meta-heuristic optimization algorithm, inspired by the behavior of crows to store their surplus nutrients and take them back from the storage area when needed. Crow Search Algorithm has been proposed to solve different optimization problems in terms of its simplicity with two different adjustable parameters (flight length and awareness probability), obtaining an effective convergence rate in a short time and having a faster technique compared to algorithms frequently used in engineering problems with different constraints and functions. In the experiments, five classification datasets (xor, balloon, iris, breast cancer, heart) were used. The CSA-MLP algorithm was compared with the SMS-MLP in terms of the mean squared error, classification rate, the statistical metrics (sensitivity, specificity, precision, f1-score) and the convergence graph. Furthermore, the proposed CSA-MLP algorithm was compared with seven algorithms in literature in terms of best classification accuracy. The experimental results show that the Crow Search Algorithm is a reliable approach in training Multi-Layer Perceptron. CSA-MLP achieved better results than SMS-MLP and other algorithms.
Tumer, A.E. and S. Edebali, An artificial neural network model for wastewater treatment plant of Konya. International Journal of Intelligent Systems and Applications in Engineering, 2015. 3(4): p. 131-135.
Ergezer, H., M. Dikmen, and E. Özdemir, Yapay sinir ağları ve tanıma sistemleri. PiVOLKA, 2003. 2(6): p. 14-17.
Yegnanarayana, B., Artificial neural networks. 2009: PHI Learning Pvt. Ltd.
Öztemel, E., Yapay sinir ağları. 2012: Papatya.
Yurdakul, E.M., Türkiye'de ithalatın gelişimi ve ithalatın yapay sinir ağları yöntemi ile tahmin edilebilirliğine yönelik bir analiz. 2014.
GÜNLER, M.A., Identification of Facial Expressions Using Artificial Neural Networks (Ann). a Master’s Thesis, Electrical & Electronics Engineering, 2012.
Yamany, W., et al. Moth-flame optimization for training multi-layer perceptrons. in 2015 11th International computer engineering Conference (ICENCO). 2015. IEEE.
Jaddi, N.S., S. Abdullah, and A.R. Hamdan, Optimization of neural network model using modified bat-inspired algorithm. Applied Soft Computing, 2015. 37: p. 71-86.
Mohammadi, F. and H. Abdi, A modified crow search algorithm (MCSA) for solving economic load dispatch problem. Applied Soft Computing, 2018. 71: p. 51-65.
Gupta, D., et al., Improved diagnosis of Parkinson's disease using optimized crow search algorithm. Computers & Electrical Engineering, 2018. 68: p. 412-424.
Kocyigit, Y., A. Alkan, and H. Erol, Classification of EEG recordings by using fast independent component analysis and artificial neural network. Journal of Medical Systems, 2008. 32(1): p. 17-20.
Aljarah, I., H. Faris, and S. Mirjalili, Optimizing connection weights in neural networks using the whale optimization algorithm. Soft Computing, 2018. 22(1): p. 1-15.
Rincon, P., Science/nature| crows and jays top bird IQ scale. BBC News, 2005.
Prior, H., A. Schwarz, and O. Güntürkün, Mirror-induced behavior in the magpie (Pica pica): evidence of self-recognition. PLoS biology, 2008. 6(8): p. e202.
Askarzadeh, A., A novel metaheuristic method for solving constrained engineering optimization problems: crow search algorithm. Computers & Structures, 2016. 169: p. 1-12.
Emery, N.J., Cognitive ornithology: the evolution of avian intelligence. Philosophical Transactions of the Royal Society B: Biological Sciences, 2006. 361(1465): p. 23-43.
Díaz, P., et al., An improved crow search algorithm applied to energy problems. Energies, 2018. 11(3): p. 571.
Sola, J. and J. Sevilla, Importance of input data normalization for the application of neural networks to complex industrial problems. IEEE Transactions on nuclear science, 1997. 44(3): p. 1464-1468.
Gulcu, Ş., Training of the Artificial Neural Networks using States of Matter Search Algorithm. International Journal of Intelligent Systems and Applications in Engineering, 2020. 8(3): p. 131-136.
Copyright (c) 2021 Feyza Erdogan, Saban Gurcu
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.