Heart Disease Detection from Neonatal Infrared Thermograms Using Multiresolution Features and Data Augmentation
AbstractMonitoring temperature changes of infants in the neonatal intensive care unit is very important. Especially for premature and very low birthweight infants, determining temperature changes in their skin immediately is extremely significant for follow-up processes. The development of medical infrared thermal imaging technologies provides accurate and contact-free measurement of body temperature. This method is used to detect thermal radiation emitted from the body to obtain skin temperature distributions. The purpose of this study is to develop an analysis system based on infrared thermal imaging to classify neonates as healthy or unhealthy using their skin temperature distribution. In this study, 258 infrared thermograms obtained applying data augmentation on 43 infrared thermograms captured from the Neonatal Intensive Care Unit were used. The following operations were performed: firstly, images were segmented to eliminate unnecessary details on the thermogram. Secondly, the features of the image were extracted applying Discrete Wavelet Transform (DWT), Ridgelet Transform (RT), Curvelet Transform (CuT), and Contourlet Transform (CoT) which are multiresolution analysis methods. Finally, these features are classified as healthy and unhealthy using classification methods such as Artificial Neural Network (ANN), Support Vector Machine (SVM) and Random Forest (RF). The best results were obtained with SVM as 96.12% of an accuracy, 94.05% of a sensitivity and 98.28% of a specificity.
A. Rogalski, Chrzanowski K., “Infrared devices and techniques,” Opto-Electronics Review, vol. 10, no. 2, pp. 111–136, 2012.
S. Sruthi, M. Sasikala, “A low cost thermal imaging system for medical diagnostic applications,” 2015 International Conference on Smart Technologies and Management for Computing, Communication, Controls, Energy and Materials (ICSTM), Chennai, India, pp. 621–623, 2015.
C. Hildebrandt, K. Zeilberger, E. F. C Ring, C. Raschner, “The application of medical infrared thermography in sports medicine,” An International Perspective on Topics in Sports Medicine and Sports Injury, vol. 14, pp. 258–274, Feb. 2012.
R. B. Knobel, B. D. Guenther, H. E. Rice, “Thermoregulation and thermography in neonatal physiology and disease,” Biological Research for Nursing, vol. 13, no. 3, pp. 274–282, 2011.
B. F. Jones, “A reappraisal of the use of infrared thermal image analysis in medicine,” IEEE Transactions on Medical Imaging, vol. 17, no. 6, pp. 1019–1027, 1998.
D. Savasci, A. H. Ornek, S. Ervural, M. Ceylan, M. Konak, H. Soylu, “Classification of Unhealthy and Healthy Neonates in Neonatal Intensive Care Units Using Medical Thermography Processing and Artificial Neural Network,” Classification Techniques for Medical Image Analysis and Computer Aided Diagnosis, Elsevier, 2019.
A. H. Ornek, D. Savasci, S. Ervural, M. Ceylan, H. Soylu, “Termogramların Değerlendirilmesinde Doğru Yaklaşımların Belirlenmesi,” URSI-TÜRKİYE 2018 IX. Bilimsel Kongresi, KTO Karatay Üniversitesi, Konya, Turkey (in Turkish), 2018.
O. Rioul, M. Vetterli, “Wavelets and signal processing,” IEEE Sig. Proc. Mag, pp. 14 – 38, Oct. 1991.
S. AlZubi, N. İslam, M. Abbod, “Multiresolution analysis using wavelet, ridgelet, and curvelet transforms for medical image segmentation,” International Journal of Biomedical Imaging, no.4, pp. 1-18, 2011.
M. Ceylan, “A new complex-valued intelligent system design on evaluating of the lung images with computerized tomography,” PhD, Selcuk University, Konya, Turkey (in Turkish with an abstract in English), 2009.
M. N. Do, M. Vetterli, “The finite ridgelet transform for image representation,” IEEE Transactions on Image Processing, vol. 12, no. 1, pp. 16-28, March. 2003.
J. M. Fadili, J. L. Starck, “Curvelets and ridgelets,” R.A. Meyers, ed. Encyclopedia of Complexity and Systems Science, 14, Springer New York, USA, 2009, pp. 1718-1738.
E. Candes, L. Demanet, D. Donoho, L. Ying, “Fast discrete curvelet transforms,” Multiscale Modeling & Simulation, vo. 5, no. 3, pp.861-899, 2006.
M. Ceylan, A. E. Canbilen, “Performance comparison of tetrolet transform and wavelet-based transforms for medical image denoising,” International Journal of Intelligent Systems and Applications in Engineering, vol. 5, no. 4, pp. 222-231, 2017.
M. N. Do, M. Vetterli, “Contourlets,” In J. Stoeckler and G.V. Welland Editors, Beyond Wavelets, Academic Press 2002, pp. 1-27.
G. H. Toro-Garay, R. J. Medina-Daza, “Fusion of WorldView2 images using contourlet, curvelet and ridgelet transforms for edge enhancement,” Revista Facultad de Ingeniería Universidad de Antioquia, Bogotá, Colombia, no. 85, pp. 8-17, Oct./Dec. 2017.
M. N. Do, M. Vetterli, “The contourlet transform: an efficient directional multiresolution image representation,” IEEE Transactions on image processing, vol. 14, no. 12, pp. 2091-2106, Dec. 2005.
F. Amato, A. López, E. M. Peña-Méndez, P. Vaňhara, A. Hampl, J. Havel, “Artificial neural networks in medical diagnosis,” Journal of Applied Biomedicine, vol. 11, no. 2, pp. 47–58, 2013.
I. Basheer, M. Hajmeer, “Artificial neural networks: Fundamentals, computing, design, and application” J Microbiol Meth, vol. 43, no. 3, pp. 3–31, Dec. 2000.
M. Negnevitsky, “Artificial intelligence,” A Guide to Intelligent Systems, Second Edition, 2005.
J. A. Freeman, D. M. Skapura, “Neural networks algorithms, applications, and programming techniques,” Computation and Neural Systems Series, Series Editor, 1991.
C. Cortes, V. Vapnik, “Support-vector networks,” Mach. Learn, vol. 20, no.3, pp. 273-297, 1995
O. Chapelle, P. Haffner, and V. N. Vapnik, “Support vector machines for histogram-based image classification,” IEEE transactions on Neural Networks, vol.10, no. 5, pp. 1055-1064, Sep. 1999.
V. Vapnik, “The Nature of Statistical Learning Theory,”MJ New York: Springer-Verlag, vol.1, 1995.
L. Breiman, “Random Forests,” Machine learning, vol. 45, no. 1, pp. 5-32, Oct. 2001.
L. Breiman, A. Cutler, “Random Forest” 2009, Online http://www.stat.berkeley.edu/~breiman/RandomForests/cc_home.htm
K. J. Archer, “Emprical characterization of random forest variable importance measure, computational statistical data analysis,” Computational Statistics & Data Analysis, vol. 52, no. 4, pp. 2249-2260, Jan. 2008.
D. Sharma, U.B. Yadav, P. Sharma, “The concept of sensitivity and specificity in relation to two types of errors and its application in medical research” Journal of Reliability and Statistical Studies, vol. 2, no.2, pp. 53–58, 2009.
D. Savasci, “Thermal Image Analysis for Neonatal Intensive Care Units,” Master Thesis, Konya Technical University, Konya, Turkey (in Turkish with an abstract in English), 2019.
Copyright (c) 2020 International Journal of Intelligent Systems and Applications in Engineering
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.