Analysis Effect of Gradient Descent Optimization on Logistic Regression in Brain Stroke Prediction

Authors

  • Rohini B. Jadhav Associate Professor, Department of Information Technology, Bharati Vidyapeeth (Deemed to be University) College of Engineering, Pune, Maharashtra, India
  • Veena Jadhav Assistant Professor, Department of Computer Engineering, Bharati Vidyapeeth(Deemed to be University) College of Engineering, Pune, Maharashtra, India
  • Netra Patil Assistant Professor, Department of Computer Engineering, Bharati Vidyapeeth(Deemed to be University) College of Engineering, Pune, Maharashtra, India
  • Akash Suryawanshi Assistant Professor, Department of Computer Engineering, Bharati Vidyapeeth(Deemed to be University) College of Engineering, Pune, Maharashtra, India
  • Mrunal Bewoor Associate Professor, Department of Information Technology, Bharati Vidyapeeth (Deemed to be University) College of Engineering, Pune, Maharashtra, India
  • Mayuri Molawade Assistant Professor, Department of Computer Engineering, Bharati Vidyapeeth(Deemed to be University) College of Engineering, Pune, Maharashtra, India

Keywords:

Gradient Descent Method, Logistic Regression, Statistical Analysis, Cost Function, ML

Abstract

This work aims to investigate how gradient descent optimization affects the ability of Logistic Regression models to predict brain strokes. For binary classification problems like predicting strokes, logistic regression is commonly employed due to its clarity and simplicity. However, the optimization algorithm selected can have a significant impact on the convergence rate and overall forecast accuracy. In this work, the effectiveness of models developed using different optimization techniques is compared to that of models trained using Gradient Descent. We conducted a comprehensive study to evaluate the performance of two well-known approaches, the Gradient Descent Method (GDM) and Logistic Regression (LR), to learn and predict the occurrence of brain strokes.  Through the use of these methodologies and their advancement, our research intends to create the most accurate predictive model, giving healthcare providers accurate and reliable stroke risk evaluations. The long-term goal of this research is to create a statistical model that not only explains the link between the dependent and independent factors but also provides informative data on the impact of certain patient features on the risk of brain stroke. By accomplishing this, we want to pave the way for more targeted and effective medicines, which will lead to better patient outcomes and a sharp drop in fatal brain stroke cases in the years to come.

Downloads

Download data is not yet available.

References

Ogbadu E. E., (2012). “Appraisal of the practical application of marketing research by SMEs in Nigeria” Kuwait Chapter of Arabian Journal of Business and Management Review 2(2)

Ogundele O. J. K., Akingbade W. A., SakaR. O.,ElegundeA. F. and AliuA. A, (2013). “Marketing Practice of Small and Medium Enterprises (SMEs): Perspective from a Developing Country” in Mediterranean Journal of Social Sciences MCSER Publishing, Rome-Italy 4(3)

Ogechukwu A. D., Oboreh J. S., Umukoro. F and Uche A. V., (2013) “Small and Medium Scale Enterprises (SMEs) in Nigeria the Marketing Interface” in Global Journal of Management and Business Research Marketing 13(9)

Holdershaw J., and Gendall P., (2008). “Understanding and predicting human behaviour” in ANZCA08 Conference, Power and Place. Wellington

Yada, K., Motoda, H., Washio, T. and Miyawaki, A. (2005) Consumer behaviour analysis by graph mining technique, New Mathematics and Natural Computation, 2 (1), 59-68.

Vijayalakshmi S., Mahalakshmi V., and Magesh S., (2013). “Knowledge discovery from consumer behavior in electronic home appliances market in Chennai by using data mining techniques” in African Journal of Business Management 7(34), 3332- 3342

Khan I., (2012). “Impact of Customers Satisfaction And Customers Retention on Customer Loyalty” in International Journal of Scientific & Technology Research 1(2)

Kushta, Elmira & Trushaj, Gladiola.Implementation of the Logistic Regression Model and its Applications. Journal 0f Advances In Mathematics. 18. 46-51. 10.24297/jam.v18i.8557(2020)

Priyanka Rajendra, Shahram Latif” Prediction of diabetes using logistic regression and EnsembleTechniques”,volume1, 20-21,100032, 2021.

Peshawa J. Muhammad Ali, Haval Abdulkarim Ahmed; “Gradient Descent Algorithm: Case Study”, Machine Learning Technical Reports, 2021

Shiliang Sun, Zehui Cao, Han Zhu, and Jing Zhao” A Survey of Optimization Methods from Machine Learning Perspective” Published in IEEE Transactions on Cybernetics (Volume: 50, Issue: 8, August 2020) .

Claudio Gambella, Bissan Ghaddar, Joe Naoum-Sawaya,” Optimization problems for machine learning: A survey”, European Journal of Operational Research, Volume 290, Issue 3,2021, Pages 807-828, ISSN 0377-2217, https://doi.org/10.1016/j.ejor.2020.08.045.

Jiawei Zhang “Gradient Descent-based Optimization Algorithms for Deep Learning Models Training arXiv:1903.03614 [cs.LG] [v1] Mon, 11 Mar 2019 12:59:47 UTC (298 KB), https://doi.org/10.48550/arXiv.1903.03614

Chuanlei Zhang ,1 Minda Yao ,1 Wei Chen ,2,3 Shanwen Zhang,4 Dufeng Chen,5 and Yuliang Wu6 , “Gradient Descent Optimization in Deep Learning Model Training Based on Multistage and Method Strategy” Volume 2021, Article ID 9956773,15 pages https://doi.org/10.1155/2021/9956773

J. Duchi, E. Hazan, and Y. Singer, “Adaptive subgradient methods for online learning methods for online Learning and stochastic optimization,” Journal of Machine Learning Research, vol. 12, no. 61, pp. 2121– 2159, 2011.

M. D. Zeiler, “Adadelta: an adaptive learning rate method,” 2012, https://arxiv.org/abs/1212.5701

S. Ruder, “An overview of gradient descent optimization algorithms,” 2016, https://arxiv.org/abs/1609.04747.

Haiqing Li a,b,*, Chairun Nasirin c, Azher M. Abed d, Dmitry Olegovich Bokov e,f, Lakshmi Thangavelu g, Haydar Abdulameer Marhoon h,i, Md Lutfor Rahman j,*“Optimization and design of machine learning computational technique for prediction of physical separation process” Arabian Journal of Chemistry (2022) 15, 103680

Abbasimehr H., Setak M., and Tarokh M., (2014). “A Comparative Assessment of the Performance of Ensemble Learning in Customer Churn Prediction” in The International Arab Journal of Information Technology, 11

Zhang Y., and Zhao Z., (2014). “Study on Consumer Behavior Predict in E-commerce Based on MultiAgent” in International Journal of u- and e- Service, Science and Technology 7(6) 403-412

Taubinsky, D. (2013), `From intentions to actions: A model and experimental evidence of inattentive choice', working paper

Ibrahim Y., and Vignali C., (2005). “Predicting Consumer Patronage Behaviour in the Egyptian Fast Food Business” in Innovative Marketing 1(2)

Shao Jinbo, Li Xiu, and Liu Wenhuang (2007), “The Application ofAdaBoost in Customer Churn Prediction," In Proceedings of Service Systems and Service Management, 2007 International Conference 1-6

Inokuchi, A., Washio, T., Nishimura, Y., Motoda, H. (2002) General Framework for Mining Frequent Structures in Graphs. Proc. of the International Workshop on Active Mining. 23-30.

Sharma A., and Panigrahi P. K., (2011). “A Neural Network based Approach for Predicting Customer Churn in Cellular Network Services” in International Journal of Computer Applications 27(11) (0975 – 8887)

Nadali, A; Kakhky, E.N.; Nosratabadi, H.E.,(2011) "Evaluating the success level of data mining projects based on CRISP-DM methodology by a Fuzzy expert system," Electronics Computer Technology (ICECT), 3rd International Conference on , 6, 161-165.

Khetani, V. ., Gandhi, Y. ., Bhattacharya, S. ., Ajani, S. N. ., & Limkar, S. . (2023). Cross-Domain Analysis of ML and DL: Evaluating their Impact in Diverse Domains. International Journal of Intelligent Systems and Applications in Engineering, 11(7s), 253–262.

Dhanwanth, B. ., Saravanakumar, R. ., Tamilselvi, T. ., & Revathi, K. . (2023). A Smart Remote Monitoring System for Prenatal Care in Rural Areas. International Journal on Recent and Innovation Trends in Computing and Communication, 11(3), 30–36. https://doi.org/10.17762/ijritcc.v11i3.6196

Dhablia, A. (2021). Integrated Sentimental Analysis with Machine Learning Model to Evaluate the Review of Viewers. Machine Learning Applications in Engineering Education and Management, 1(2), 07–12. Retrieved from http://yashikajournals.com/index.php/mlaeem/article/view/12

Mandal, D., Shukla, A., Ghosh, A., Gupta, A., & Dhabliya, D. (2022). Molecular dynamics simulation for serial and parallel computation using leaf frog algorithm. Paper presented at the PDGC 2022 - 2022 7th International Conference on Parallel, Distributed and Grid Computing,552-557. doi:10.1109/PDGC56933.2022.10053161 Retrieved from www.scopus.com

Downloads

Published

06.09.2023

How to Cite

Jadhav, R. B. ., Jadhav, V. ., Patil, N. ., Suryawanshi, A. ., Bewoor, M. ., & Molawade, M. . (2023). Analysis Effect of Gradient Descent Optimization on Logistic Regression in Brain Stroke Prediction. International Journal of Intelligent Systems and Applications in Engineering, 11(11s), 17–26. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/3431

Issue

Section

Research Article