Enhanced Heart Disease Risk Prediction with Hyperparameter-Tuned Ensemble Models

Authors

  • Alok Singh Chauhan, Mega Novita, Bambang Agus Herlambang, Dhyanendra Jain, Muhammad Saifuddin Zuhri, Priya Mishra, Dian Ayu Zahraini, Shikha Verma

Keywords:

Heart disease prediction; Ensemble learning; Machine learning algorithms; early diagnosis; Clinical decision-making

Abstract

Due to a number of risk factors, heart disease is a serious worldwide health concern that needs quick access to reliable early diagnosis and management techniques. Accurate prediction presents challenges, as seen in the limitations of traditional diagnostic methods. With the growing population, early-stage diagnosis becomes critical. Recent technological advancements have led to research in machine learning applications in healthcare, addressing these challenges. By examining pertinent variables, this work seeks to create an efficient machine learning model for the prediction of heart disease. A number of supervised learning techniques are used, such as XGBoost, K-Nearest Neighbor, Gradient Boosting, Random Forest, Decision Tree, and Logistic Regression. The primary goal is to estimate individuals' heart disease probability based on these factors. In this research, we overcome traditional diagnostic method limitations by utilizing ensemble methods, including the Gradient Boosting algorithm. This approach enhances heart disease prediction accuracy by integrating weak models. These methods open new avenues for heart disease management through detailed data analysis. The results show an impressive overall accuracy score of 99.02%. The developed model provides valuable insights, aiding informed decisions in diagnosis and treatment. Its integration into clinics supports early detection, potentially improving patient outcomes and reducing heart disease-related mortality. Beyond predictions, this study streamlines medical decision-making and revolutionizes heart disease care, enhancing patients' quality of life.

Downloads

Download data is not yet available.

References

Coffey S, Roberts-Thomson R, Brown A, Carapetis J, Chen M, Enriquez-Sarano M, Zühlke L and Prendergast B D 2021 Global epidemiology of valvular heart disease Nat. Rev. Cardiol.18

Wu W, He J and Shao X 2020 Incidence and mortality trend of congenital heart disease at the global, regional, and national level, 1990-2017 Med. (United States)99

Aluru J S, Barsouk A, Saginala K, Rawla P and Barsouk A 2022 Valvular Heart Disease Epidemiology Med. Sci. (Basel, Switzerland)10

Khan M A, Hashim M J, Mustafa H, Baniyas M Y, Al Suwaidi S K B M, AlKatheeri R, Alblooshi F M K, Almatrooshi M E A H, Alzaabi M E H, Al Darmaki R S and Lootah S N A H 2020 Global Epidemiology of Ischemic Heart Disease: Results from the Global Burden of Disease Study Cureus

Janiesch C, Zschech P and Heinrich K 2021 Machine learning and deep learning Electron. Mark.31

Shukla A K, Janmaijaya M, Abraham A and ... 2019 Engineering applications of artificial intelligence: A bibliometric analysis of 30 years (1988–2018) … Appl. Artif. …

Tran B X, Latkin C A, Vu G T, Nguyen H L T and ... 2019 The current research landscape of the application of artificial intelligence in managing cerebrovascular and heart diseases: A bibliometric and content analysis Int. J. …

Guo Y, Hao Z, Zhao S, Gong J and Yang F 2020 Artificial intelligence in health care: bibliometric analysis J. Med. Internet …

Jamwal A, Agrawal R, Sharma M, Kumar A and ... 2021 Machine learning applications for sustainable manufacturing: A bibliometric-based review for future research J. Enterp. …

Stoll A and Benner P 2021 Machine learning for material characterization with an application for predicting mechanical properties GAMM Mitteilungen44

Chatterjee S and Simonoff J S 2013 Handbook of Regression Analysis

Cutler D R, Edwards T C, Beard K H, Cutler A, Hess K T, Gibson J and Lawler J J 2007 Random forests for classification in ecology Ecology88

Alcaraz J, Labbé M and Landete M 2022 Support Vector Machine with feature selection: A multiobjective approach Expert Syst. Appl.204

Maillo J, Garcia S, Luengo J, Herrera F and Triguero I 2020 Fast and Scalable Approaches to Accelerate the Fuzzy k-Nearest Neighbors Classifier for Big Data IEEE Trans. Fuzzy Syst.28

Dinesh P and P. K 2022 Medical Image Prediction for Diagnosis of Breast Cancer Disease Comparing the Machine Learning Algorithms: SVM, KNN, Logistic Regression, Random Forest, and Decision Tree to Measure Accuracy ECS Trans.107

Fadilah Z and Murnawan 2021 Performance Comparison of K-Nearest Neighbor and Decision Tree C4.5 by Utilizing Particle Swarm Optimization for Prediction of Liver Disease Int. J. Open Inf. Technol.9

Feng X, Hua Y, Zou J, Jia S, Ji J, Xing Y, Zhou J and Liao J 2022 Intelligible Models for HealthCare: Predicting the Probability of 6-Month Unfavorable Outcome in Patients with Ischemic Stroke Neuroinformatics20

Mohan S, Thirumalai C and Srivastava G 2019 Effective heart disease prediction using hybrid machine learning techniques IEEE Access7

Shorewala V 2021 Early detection of coronary heart disease using ensemble techniques Informatics Med. Unlocked26

Ayano Y M, Schwenker F, Dufera B D and Debelee T G 2023 Interpretable Machine Learning Techniques in ECG-Based Heart Disease Classification: A Systematic Review Diagnostics13

Ahsan M M and Siddique Z 2022 Machine learning-based heart disease diagnosis: A systematic literature review Artif. Intell. Med.128

Fatima M and Pasha M 2017 Survey of Machine Learning Algorithms for Disease Diagnostic J. Intell. Learn. Syst. Appl.09

Ingre B, Yadav A and Soni A K 2018 Decision tree based intrusion detection system for NSL-KDD dataset Smart Innovation, Systems and Technologies vol 84

Budholiya K, Shrivastava S K and Sharma V 2022 An optimized XGBoost based diagnostic system for effective prediction of heart disease J. King Saud Univ. - Comput. Inf. Sci.34

Fawcett T 2006 An introduction to ROC analysis Pattern Recognit. Lett.27

Cort J. Willmott and Kenji Matsuura 2005 Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance Clim. Res.30

Hodson T O 2022 Root-mean-square error (RMSE) or mean absolute error (MAE): when to use them or not Geosci. Model Dev.15

POWERS D M . 2011 EVALUATION: FROM PRECISION, RECALL AND F-MEASURE TO ROC, INFORMEDNESS, MARKEDNESS & CORRELATION J. Mach. Learn. Technol.2

Kaggle 2021 Kaggle: Your Home for Data Science Website

Chang V, Bhavani V R, Xu A Q and Hossain M A 2022 An artificial intelligence model for heart disease detection using machine learning algorithms Healthc. Anal.2

K. Pazhanivel, A. Pravin, M. Sakthiganesh and M. Saravanan 2023 Diagnosis of Heart Disease using Machine Learning Algorithms Int. J. Adv. Res. Sci. Commun. Technol.

Ghumbre S U and Ghatol A A 2012 Heart disease diagnosis using machine learning Algorithm Advances in Intelligent and Soft Computing vol 132 AISC

Dey D, Slomka P J, Leeson P, Comaniciu D, Shrestha S, Sengupta P P and Marwick T H 2019 Artificial Intelligence in Cardiovascular Imaging: JACC State-of-the-Art Review J. Am. Coll. Cardiol.73

Johnson K W, Torres Soto J, Glicksberg B S, Shameer K, Miotto R, Ali M, Ashley E and Dudley J T 2018 Artificial Intelligence in Cardiology J. Am. Coll. Cardiol.71

Attia Z I, Kapa S, Lopez-Jimenez F, McKie P M, Ladewig D J, Satam G, Pellikka P A, Enriquez-Sarano M, Noseworthy P A, Munger T M, Asirvatham S J, Scott C G, Carter R E and Friedman P A 2019 Screening for cardiac contractile dysfunction using an artificial intelligence–enabled electrocardiogram Nat. Med.25

Zhou B, Khosla A, Lapedriza A, Oliva A and Torralba A 2016 Learning Deep Features for Discriminative Localization Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition vol 2016-December

Obermeyer Z and Emanuel E J 2016 Predicting the Future — Big Data, Machine Learning, and Clinical Medicine N. Engl. J. Med.375

Poplin R, Varadarajan A V., Blumer K, Liu Y, McConnell M V., Corrado G S, Peng L and Webster D R 2018 Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning Nat. Biomed. Eng.2

Esteva A, Kuprel B, Novoa R A, Ko J, Swetter S M, Blau H M and Thrun S 2017 Dermatologist-level classification of skin cancer with deep neural networks Nature542

Esteva A, Robicquet A, Ramsundar B, Kuleshov V, DePristo M, Chou K, Cui C, Corrado G, Thrun S and Dean J 2019 A guide to deep learning in healthcare Nat. Med.25

Min S, Lee B and Yoon S 2017 Deep learning in bioinformatics Brief. Bioinform.18

Topol E J 2019 High-performance medicine: the convergence of human and artificial intelligence Nat. Med.25

Rajpurkar P, Irvin J, Ball R L, Zhu K, Yang B, Mehta H, Duan T, Ding D, Bagul A, Langlotz C P, Patel B N, Yeom K W, Shpanskaya K, Blankenberg F G, Seekins J, Amrhein T J, Mong D A, Halabi S S, Zucker E J, Ng A Y and Lungren M P 2018 Deep learning for chest radiograph diagnosis: A retrospective comparison of the CheXNeXt algorithm to practicing radiologists PLoS Med.15

Ravi D, Wong C, Deligianni F, Berthelot M, Andreu-Perez J, Lo B and Yang G Z 2017 Deep Learning for Health Informatics IEEE J. Biomed. Heal. Informatics21

Arbabshirani M R, Plis S, Sui J and Calhoun V D 2017 Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls Neuroimage145

Liu X, Faes L, Kale A U, Wagner S K, Fu D J, Bruynseels A, Mahendiran T, Moraes G, Shamdas M, Kern C, Ledsam J R, Schmid M K, Balaskas K, Topol E J, Bachmann L M, Keane P A and Denniston A K 2019 A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis Lancet Digit. Heal.1

McKinney S M, Sieniek M, Godbole V, Godwin J, Antropova N, Ashrafian H, Back T, Chesus M, Corrado G C, Darzi A, Etemadi M, Garcia-Vicente F, Gilbert F J, Halling-Brown M, Hassabis D, Jansen S, Karthikesalingam A, Kelly C J, King D, Ledsam J R, Melnick D, Mostofi H, Peng L, Reicher J J, Romera-Paredes B, Sidebottom R, Suleyman M, Tse D, Young K C, De Fauw J and Shetty S 2020 International evaluation of an AI system for breast cancer screening Nature577

Gulshan V, Peng L, Coram M, Stumpe M C, Wu D, Narayanaswamy A, Venugopalan S, Widner K, Madams T, Cuadros J, Kim R, Raman R, Nelson P C, Mega J L and Webster D R 2016 Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs JAMA - J. Am. Med. Assoc.316

Beaulieu-Jones B K, Wu Z S, Williams C, Lee R, Bhavnani S P, Byrd J B and Greene C S 2019 Privacy-preserving generative deep neural networks support clinical data sharing Circ. Cardiovasc. Qual. Outcomes12

Alipanahi B, Delong A, Weirauch M T and Frey B J 2015 Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning Nat. Biotechnol.33

Litjens G, Kooi T, Bejnordi B E, Setio A A A, Ciompi F, Ghafoorian M, van der Laak J A W M, van Ginneken B and Sánchez C I 2017 A survey on deep learning in medical image analysis Med. Image Anal.42

Chauhan, A.S.; Lilhore, U.K.; Gupta, A.K.; Manoharan, P.; Garg, R.R.; Hajjej, F.; Keshta, I.; Raahemifar, K. Comparative Analysis of Supervised Machine and Deep Learning Algorithms for Kyphosis Disease Detection. Appl. Sci. 2023, 13, 5012. https://doi.org/10.3390/app13085012

Chauhan, A. S.; Singh, J.; Kumar, S.; Saxena, N.; Gupta, M.; Verma, P. Design and Assessment of Improved Convolutional Neural Network Based Brain Tumor Segmentation and Classification System. J Integr Sci Technol 2024, 12, 793. https://doi.org/10.62110/sciencein.jist.2024.v12.793

Naeem, A. B.; Senapati, B.; Chauhan, A. S.; Makhija, M.; Singh, A.; Gupta, M.; Tiwari, P. K.; AbdelRehim, W. M. F. . Hypothyroidism Disease Diagnosis by Using Machine Learning Algorithms. Int J Intell Syst Appl Eng 2023, 11, 368-373.

Novita, M., Chauhan, A. S., Ujianti, R. M. D., Marlina, D., Kusumo, H., Anwar, M. T., Piasecki, M., & Brik, M. G. (2024, May). Exploring deep learning and machine learning for novel red phosphor materials. Journal of Luminescence, 269, 120476. https://doi.org/10.1016/j.jlumin.2024.120476

Downloads

Published

12.06.2024

How to Cite

Alok Singh Chauhan. (2024). Enhanced Heart Disease Risk Prediction with Hyperparameter-Tuned Ensemble Models. International Journal of Intelligent Systems and Applications in Engineering, 12(4), 181–191. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/6186

Issue

Section

Research Article