Heart Disease Detection from Neonatal Infrared Thermograms Using Multiresolution Features and Data Augmentation

Keywords: Artificial Neural Network, Data Augmentation, Infrared Thermal Imaging, Neonatal, Multiresolution Analysis Methods, Random Forest, Support Vector Machine.

Abstract

Monitoring temperature changes of infants in the neonatal intensive care unit is very important. Especially for premature and very low birthweight infants, determining temperature changes in their skin immediately is extremely significant for follow-up processes. The development of medical infrared thermal imaging technologies provides accurate and contact-free measurement of body temperature. This method is used to detect thermal radiation emitted from the body to obtain skin temperature distributions. The purpose of this study is to develop an analysis system based on infrared thermal imaging to classify neonates as healthy or unhealthy using their skin temperature distribution. In this study, 258 infrared thermograms obtained applying data augmentation on 43 infrared thermograms captured from the Neonatal Intensive Care Unit were used. The following operations were performed: firstly, images were segmented to eliminate unnecessary details on the thermogram. Secondly, the features of the image were extracted applying Discrete Wavelet Transform (DWT), Ridgelet Transform (RT), Curvelet Transform (CuT), and Contourlet Transform (CoT) which are multiresolution analysis methods. Finally, these features are classified as healthy and unhealthy using classification methods such as Artificial Neural Network (ANN), Support Vector Machine (SVM) and Random Forest (RF). The best results were obtained with SVM as 96.12% of an accuracy, 94.05% of a sensitivity and 98.28% of a specificity.

Downloads

Download data is not yet available.

Author Biographies

Murat Ceylan, Konya Technical University
Faculty of Engineering and Natural Sciences, Konya Technical University
Ahmet Haydar Ornek, Konya Technical University
Faculty of Engineering and Natural Sciences, Konya Technical University
Murat Konak, Selcuk University
Faculty of Medicine, Division of Neonatology, Department of Pediatrics, Selcuk University,Konya,Turkey
Hanifi Soylu, Selcuk University
Faculty of Medicine, Division of Neonatology, Department of Pediatrics, Selcuk University, Konya,Turkey

References

A. Rogalski, Chrzanowski K., “Infrared devices and techniques,” Opto-Electronics Review, vol. 10, no. 2, pp. 111–136, 2012.

S. Sruthi, M. Sasikala, “A low cost thermal imaging system for medical diagnostic applications,” 2015 International Conference on Smart Technologies and Management for Computing, Communication, Controls, Energy and Materials (ICSTM), Chennai, India, pp. 621–623, 2015.

C. Hildebrandt, K. Zeilberger, E. F. C Ring, C. Raschner, “The application of medical infrared thermography in sports medicine,” An International Perspective on Topics in Sports Medicine and Sports Injury, vol. 14, pp. 258–274, Feb. 2012.

R. B. Knobel, B. D. Guenther, H. E. Rice, “Thermoregulation and thermography in neonatal physiology and disease,” Biological Research for Nursing, vol. 13, no. 3, pp. 274–282, 2011.

B. F. Jones, “A reappraisal of the use of infrared thermal image analysis in medicine,” IEEE Transactions on Medical Imaging, vol. 17, no. 6, pp. 1019–1027, 1998.

D. Savasci, A. H. Ornek, S. Ervural, M. Ceylan, M. Konak, H. Soylu, “Classification of Unhealthy and Healthy Neonates in Neonatal Intensive Care Units Using Medical Thermography Processing and Artificial Neural Network,” Classification Techniques for Medical Image Analysis and Computer Aided Diagnosis, Elsevier, 2019.

A. H. Ornek, D. Savasci, S. Ervural, M. Ceylan, H. Soylu, “Termogramların Değerlendirilmesinde Doğru Yaklaşımların Belirlenmesi,” URSI-TÜRKİYE 2018 IX. Bilimsel Kongresi, KTO Karatay Üniversitesi, Konya, Turkey (in Turkish), 2018.

O. Rioul, M. Vetterli, “Wavelets and signal processing,” IEEE Sig. Proc. Mag, pp. 14 – 38, Oct. 1991.

S. AlZubi, N. İslam, M. Abbod, “Multiresolution analysis using wavelet, ridgelet, and curvelet transforms for medical image segmentation,” International Journal of Biomedical Imaging, no.4, pp. 1-18, 2011.

M. Ceylan, “A new complex-valued intelligent system design on evaluating of the lung images with computerized tomography,” PhD, Selcuk University, Konya, Turkey (in Turkish with an abstract in English), 2009.

M. N. Do, M. Vetterli, “The finite ridgelet transform for image representation,” IEEE Transactions on Image Processing, vol. 12, no. 1, pp. 16-28, March. 2003.

J. M. Fadili, J. L. Starck, “Curvelets and ridgelets,” R.A. Meyers, ed. Encyclopedia of Complexity and Systems Science, 14, Springer New York, USA, 2009, pp. 1718-1738.

E. Candes, L. Demanet, D. Donoho, L. Ying, “Fast discrete curvelet transforms,” Multiscale Modeling & Simulation, vo. 5, no. 3, pp.861-899, 2006.

M. Ceylan, A. E. Canbilen, “Performance comparison of tetrolet transform and wavelet-based transforms for medical image denoising,” International Journal of Intelligent Systems and Applications in Engineering, vol. 5, no. 4, pp. 222-231, 2017.

M. N. Do, M. Vetterli, “Contourlets,” In J. Stoeckler and G.V. Welland Editors, Beyond Wavelets, Academic Press 2002, pp. 1-27.

G. H. Toro-Garay, R. J. Medina-Daza, “Fusion of WorldView2 images using contourlet, curvelet and ridgelet transforms for edge enhancement,” Revista Facultad de Ingeniería Universidad de Antioquia, Bogotá, Colombia, no. 85, pp. 8-17, Oct./Dec. 2017.

M. N. Do, M. Vetterli, “The contourlet transform: an efficient directional multiresolution image representation,” IEEE Transactions on image processing, vol. 14, no. 12, pp. 2091-2106, Dec. 2005.

F. Amato, A. López, E. M. Peña-Méndez, P. Vaňhara, A. Hampl, J. Havel, “Artificial neural networks in medical diagnosis,” Journal of Applied Biomedicine, vol. 11, no. 2, pp. 47–58, 2013.

I. Basheer, M. Hajmeer, “Artificial neural networks: Fundamentals, computing, design, and application” J Microbiol Meth, vol. 43, no. 3, pp. 3–31, Dec. 2000.

M. Negnevitsky, “Artificial intelligence,” A Guide to Intelligent Systems, Second Edition, 2005.

J. A. Freeman, D. M. Skapura, “Neural networks algorithms, applications, and programming techniques,” Computation and Neural Systems Series, Series Editor, 1991.

C. Cortes, V. Vapnik, “Support-vector networks,” Mach. Learn, vol. 20, no.3, pp. 273-297, 1995

O. Chapelle, P. Haffner, and V. N. Vapnik, “Support vector machines for histogram-based image classification,” IEEE transactions on Neural Networks, vol.10, no. 5, pp. 1055-1064, Sep. 1999.

V. Vapnik, “The Nature of Statistical Learning Theory,”MJ New York: Springer-Verlag, vol.1, 1995.

L. Breiman, “Random Forests,” Machine learning, vol. 45, no. 1, pp. 5-32, Oct. 2001.

L. Breiman, A. Cutler, “Random Forest” 2009, Online http://www.stat.berkeley.edu/~breiman/RandomForests/cc_home.htm

K. J. Archer, “Emprical characterization of random forest variable importance measure, computational statistical data analysis,” Computational Statistics & Data Analysis, vol. 52, no. 4, pp. 2249-2260, Jan. 2008.

D. Sharma, U.B. Yadav, P. Sharma, “The concept of sensitivity and specificity in relation to two types of errors and its application in medical research” Journal of Reliability and Statistical Studies, vol. 2, no.2, pp. 53–58, 2009.

D. Savasci, “Thermal Image Analysis for Neonatal Intensive Care Units,” Master Thesis, Konya Technical University, Konya, Turkey (in Turkish with an abstract in English), 2019.

Published
2020-03-18
How to Cite
[1]
D. Savasci, M. Ceylan, A. H. Ornek, M. Konak, and H. Soylu, “Heart Disease Detection from Neonatal Infrared Thermograms Using Multiresolution Features and Data Augmentation”, IJISAE, vol. 8, no. 1, pp. 28-36, Mar. 2020.
Section
Research Article