Fine Tuning Bert Based Approach for Cardiovascular Disease Diagnosis


  • Avvaru R. V. Naga Suneetha Research Scholar, Department of Computer Science and Engineering,Vignan's Foundation for Science, Technology & Research(Deemed to be University),Vadlamudi, Guntur, Andhra Pradesh,India, 522213.
  • T. Mahalngam Associate professor, Department of Computer Science and Engineering Vignan's Foundation for Science, Technology & Research (Deemed to be University), Vadlamudi, Guntur, Andhra Pradesh, India, 522213. Yadadri-Bhuvanagiri District, Telangana,India, 508284.


Cardio Vascular Disease/Heart disease, Bi-directional Encoder Representations from Transformers (BERT), Fine Tuning


A range of diseases that affect your heart are considered to as coronary disease. The greatest hazard syndromes in the world, cardiovascular diseases (CVD) are regarded as having the greatest mortality rates. The healthcare systems of countries they have become very common and are now overstretching, over a period of time. Cholesterol, family background, higher The arterial pressure is, gender, stress, ageing that are an unhealthy lifestyle are the main danger elements for cardiovascular diseases. Predicated with these considerations, Experts have suggested others preliminary diagnosis techniques. Therefore, correct CVD prediction can both prevent life-threatening conditions and be fatal if incorrect. The majority times, cardiovascular disease is deadly. Medical diagnosis is a challenging task that is usually performed by domain experts. In the Natural language processing (NLP) field, Bidirectional encoder representations from transformers (BERT) and related models have recently achieved significant success. Contextual embeddings are created by pre-training BERT on a larger training corpus, and these embeddings can be used to enhance the efficiency of CVD data sets when implemented to small datasets with fine-tuning. Hence in this approach, Fine tuning BERT Based Approach for Cardio Vascular Disease diagnosis is presented. This approach will provide effective and accurate diagnosis to the CVD patients. This method's performance is evaluated in related to accuracy, precision, and recall (True Positive Rate).


Download data is not yet available.


Umarani Nagavelli, Debabrata Samanta and Partha Chakraborty, “Machine Learning Technology-Based Heart Disease Detection Models”, Hindawi Journal of Healthcare Engineering, Volume 2022, Article ID 7351061, 9 pages, doi:10.1155/2022/7351061

Yikuan Li, Mohammad Mamouei, Gholamreza Salimi-Khorshidi, Shishir Rao, Abdelaali Hassaine, Dexter Canoy, Thomas Lukasiewicz, Kazem Rahimi, “Hi-BEHRT: Hierarchical Transformer-based model for accurate prediction of clinical events using multimodal longitudinal electronic health records”, IEEE J Biomed Health Inform, 2022 Nov 25;PP, doi: 10.1109/JBHI.2022.3224727.

Chaimaa Boukhatem, Heba Yahia Youssef, Ali Bou Nassif, “Heart Disease Prediction Using Machine Learning”, 2022 Advances in Science and Engineering Technology International Conferences (ASET),DOI: 10.1109/ASET53988.2022.9734880

Manjula P, Aravind U R, Darshan M V, Halaswamy M H, Hemanth E, “Heart Attack Prediction Using Machine Learning Algorithms”, International Journal of Engineering Research & Technology (IJERT) ISSN: 2278-0181, ICEI - 2022 Conference Proceedings

Aqsa Rahim, Yawar Rasheed, Farooque Azam, Muhammad Waseem Anwar, Muhammad Abdul Rahim and Abdul Wahab Muzaffar, “An Integrated Machine Learning Framework for Effective Prediction of Cardiovascular Diseases”, IEEE Access ( Volume: 9), 2021,DOI: 10.1109/ACCESS.2021.3098688

B Padmajaa, Chintala Srinidhib, Kotha Sindhuc, Kalali Vanajad, N M Deepikae, E Krishna Rao Patrof, “Early and Accurate Prediction of Heart Disease Using Machine Learning Model”, Turkish Journal of Computer and Mathematics Education, Vol.12 No.6 (2021), 4516-4528,

Jialong Zhou, “Cardiovascular Disease Diagnosis Based on Stacking Technology”, 2021 IEEE Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC), 978-1-7281-9018-1/20, 2021 IEEE, DOI: 10.1109/IPEC51340.2021.9421128

Chao Che, Peiliang Zhang, Min Zhu, Yue Qu and Bo Jin, “Constrained transformer network for ECG signal processing and arrhythmia classification”, BMC Med Inform Decis Mak (2021) 21:184,

K. Samunnisa and B. Maloth (2016). Privacy-Preserving Scalar Product Computation over Personal Health Records. International Journal of Computer Engineering In Research Trends, 3(2), 27-42.

Harshit Jindal, Sarthak Agrawal, Rishabh Khera, Rachna Jain and Preeti Nagrath, “Heart disease prediction using machine learning algorithms”, IOP Conf. Series: Materials Science and Engineering 1022 (2021) 012072 IOP Publishing, doi:10.1088/1757-899X/1022/1/012072

Armin Yazdani, Kasturi Dewi Varathan, Yin Kia Chiam, Asad Waqar Malik and Wan Azman Wan Ahmad, “A novel approach for heart disease prediction using strength scores with signifcant predictors”, BMC Med Inform Decis Mak (2021) 21:194, doi:10.1186/s12911-021-01527-5

Alile, S. O. (2020). An Ischemic Heart Disease Prediction Model Based on Observed Symptoms Using Machine Learning. International Journal of Computer Engineering in Research Trends, 7(9), 9-22.

R. Thanga Selvi, I. Muthulakshmi, “An optimal artificial neural network based big data application for heart disease diagnosis and classification model”, Journal of Ambient Intelligence and Humanized Computing, 2020, doi:10.1007/s12652-020-02181-x

Zhenzhen Du, Yujie Yang, Jing Zheng, Qi Li, Denan Lin, Ye Li, Jianping

Fan, Wen Cheng, Xie-Hui Chen, Yunpeng Cai, “Accurate Prediction of Coronary Heart Disease for Patients With Hypertension From Electronic Health Records With Big Data and Machine-Learning Methods: Model Development and Performance Evaluation”, JMIR MEDICAL INFORMATICS, 2020, vol. 8, iss. 7, e17257, doi: 10.2196/17257

Abderrahmane Ed-daoudy, Khalil Maalmi, “Real-time machine learning for early detection of heart disease using big data approach”, 2019 International Conference on Wireless Technologies, Embedded and Intelligent Systems (WITS),DOI: 10.1109/WITS.2019.8723839

P. Umasankar, V. Thiagarasu, “Decision Support System For Heart Disease Diagnosis Using Interval Vague Set And Fuzzy Association Rule Mining”, Fourth International Conference on Devices, Circuits and Systems (ICDCS'18), ISBN: 978-1-5386-3476-9/18, 2018 IEEE

Long Hao, Sai Ho Ling and Frank Jiang, “Classification of Cardiovascular Disease via A New SoftMax Model”, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 978-1-5386-3646-6/18, 2018 IEEE

Abhay Kishore, Ajay Kumar, Karan Singh, Maninder Punia, Yogita Hambi, “Heart Attack Prediction Using Deep Learning”, International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 05 Issue: 04, Apr-2018

Tanmay Kasbe, Ravi Singh Pippal, “Design of Heart Disease Diagnosis System using Fuzzy Logic”, International Conference on Energy, Communication, Data Analytics and Soft Computing (ICECDS-2017), 978-1-5386-1887-5/17

Plekhova N.G, Grunberg K.V., Dolzhikov S.V, Nevzorova V.A., Rodionova L.V, “Medical Instrument-Computer System for Calculating the Fatal Outcome of Cardiovascular Diseases”, 2017 Second Russia and Pacific Conference on Computer Technology and Applications (RPC), DOI: 10.1109/RPC.2017.8168085

Cheryl Ann Alexander and Lidong Wang, “Big Data Analytics in Heart Attack Prediction”, Journal of Nursing and Care, 2017, 6:2, DOI: 10.4172/2167-1168.1000393

Zeinab Arabasadi, Roohallah Alizadehsani, Mohamad Roshanzamir, Hossein Moosaei, Ali Asghar Yarifard, Computer Aided Decision Making for Heart Disease Detection using Hybrid Neural Network - Genetic Algorithm, Computer Methods and Programs in Biomedicine (2017), doi: 10.1016/j.cmpb.2017.01.004

Sanjeev Kumar Jain and Basabi Bhaumik, “An Energy Efficient ECG Signal Processor Detecting Cardiovascular Diseases on Smartphone”, IEEE Transactions on Biomedical Circuits and Systems, 2016, 1932-4545, DOI: 10.1109/TBCAS.2016.2592382

F. Dell’Olio, M. De Palo, D. Conteduca, C. Ciminelli, M. N. Armenise, “Resonant Nanoplasmonic Platform for Fast and Early Diagnosis of Cardiovascular Diseases”, 2016 IEEE 2nd International Forum on Research and Technologies for Society and Industry Leveraging a better tomorrow (RTSI), 978-1-5090-1131-5/16, 2016 IEEE

Velugoti, S., Reddy, R. H., Tarannum, S., & Reddy, S. T. K. (2022). Lung nodule detection and classification using image processing techniques. International Journal of Computer Engineering in Research Trends, 9(7), 114-119.

Performance Comparative Graph




How to Cite

A. R. V. . Naga Suneetha and T. . Mahalngam, “Fine Tuning Bert Based Approach for Cardiovascular Disease Diagnosis”, Int J Intell Syst Appl Eng, vol. 11, no. 6s, pp. 59–66, May 2023.



Research Article