Emotional Disorders Detection Using Machine Learning Algorithm

Authors

  • Callista Ivana Mogie, Tuga Mauritsius

Keywords:

Anxiety, Classification, Depression, Mental Health, Supervised machine learning

Abstract

Emotional disorders, namely anxiety and depression are the most debilitating mental illness. Early detection will minimize risks of developing complex disorders and suicidality. This study aimed to build and evaluate machine learning classification models in screening for anxiety, depression, and healthy control. Supervised machine learning algorithms including Random Forest, Artificial Neural Network, Support Vector Machine, and Naive Bayes were applied and compared to build superior models. The best algorithm for multiclass classification was Artificial Neural Network with an F1-score of 0.97. Additionally, for binary classification, the Support Vector Machine yielded the highest performance for both the 'Depression and Anxiety' class (F1-score: 0.99) and the 'Depression' class (F1-score: 0.98). For the 'Anxiety' class, the Artificial Neural Network exhibited the best performance with an F1-score of 0.99, while the Random Forest algorithm achieved the highest F1-score of 0.98 for the 'Healthy' class. These findings hold potential in assisting clinicians by providing more efficient treatment strategies.

Downloads

Download data is not yet available.

References

J. R. Bullis, H. Boettcher, S. Sauer‐Zavala, T. J. Farchione, and D. H. Barlow, “What is an emotional disorder? A transdiagnostic mechanistic definition with implications for assessment, treatment, and prevention,” Clinical Psychology: Science and Practice, vol. 26, no. 2, p. e12278, Mar. 2019, doi: 10.1111/cpsp.12278.

American Psychiatric Association, Diagnostic and statistical manual of mental disorders: DSM-5., 5th ed. Arlington: American Psychiatric Publishing, 2013.

D. H. Barlow, B. A. Harris, E. H. Eustis, and T. J. Farchione, “The unified protocol for transdiagnostic treatment of emotional disorders,” World Psychiatry, vol. 19, no. 2, pp. 245–246, May 2020, doi: 10.1002/wps.20748

R. N. Groen et al., “Comorbidity between depression and anxiety: Assessing the role of bridge mental states in dynamic psychological networks,” BMC Medicine, vol. 18, no. 1, Sep. 2020, doi: 10.1186/s12916-020-01738-z.

World Health Organization, World mental health report: Transforming mental health for all. WHO, 2022. [Online]. Available: https://www.who.int/publications/i/item/9789240049338

D. F. Santomauro et al., “Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic,” The Lancet, vol. 398, no. 10312, pp. 1700–1712, Nov. 2021, doi: 10.1016/s0140-6736(21)02143-7.J. Ingram, C. J. Hand, and G. Maciejewski, “Social isolation during COVID‐19 lockdown impairs cognitive function,” Applied Cognitive Psychology, vol. 35, no. 4, pp. 935–947, doi: 10.1002/acp.3821.

K. Vaishnavi, U. Nikhitha Kamath, B. Ashwath Rao, and N. V. Subba Reddy, “Predicting Mental Health Illness using Machine Learning Algorithms,” Journal of Physics: Conference Series, vol. 2161, no. 1, p. 012021, Jan. 2022, doi: 10.1088/1742-6596/2161/1/012021.

R. S. McIntyre and J. R. Calabrese, “Bipolar depression: the clinical characteristics and unmet needs of a complex disorder,” Current Medical Research and Opinion, vol. 35, no. 11, pp. 1993–2005, Aug. 2019, doi: 10.1080/03007995.2019.1636017.

H. Brooks et al., “Children and young people’s beliefs about mental health and illness in Indonesia: A qualitative study informed by the Common Sense Model of Self-Regulation,” PLOS ONE, vol. 17, no. 2, p. e0263232, Feb. 2022, doi: 10.1371/journal.pone.0263232.

G. Tampubolon and W. Hanandita, “Poverty and mental health in Indonesia,” Social Science & Medicine, vol. 106, pp. 20–27, Apr. 2014, doi: 10.1016/j.socscimed.2014.01.012.

M. Marthoenis, M. C. Aichberger, and M. Schouler-Ocak, “Patterns and Determinants of Treatment Seeking among Previously Untreated Psychotic Patients in Aceh Province, Indonesia: A Qualitative Study,” Scientifica, vol. 2016, pp. 1–7, 2016, doi: 10.1155/2016/9136079.

N. F. Praharso, H. Pols, and N. Tiliopoulos, “Mental health literacy of Indonesian health practitioners and implications for mental health system development,” Asian Journal of Psychiatry, vol. 54, p. 102168, Dec. 2020, doi: 10.1016/j.ajp.2020.102168.

E. Mahase, “Covid-19: Mental health consequences of pandemic need urgent research, paper advises,” BMJ, p. m1515, Apr. 2020, doi: 10.1136/bmj.m1515.

S. Ray, “A quick review of machine learning algorithms,” in 2019 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COMITCon), Feb. 2019. Accessed: May 20, 2023. [Online]. Available: http://dx.doi.org/10.1109/comitcon.2019.8862451.

J. Chung and J. Teo, “Mental Health Prediction Using Machine Learning: Taxonomy, Applications, and Challenges,” Applied Computational Intelligence and Soft Computing, vol. 2022, pp. 1–19, Jan. 2022, doi: 10.1155/2022/9970363.

F. Cacheda, D. Fernandez, F. J. Novoa, and V. Carneiro, “Early Detection of Depression: Social Network Analysis and Random Forest Techniques,” Journal of Medical Internet Research, vol. 21, no. 6, p. e12554, Jun. 2019, doi: 10.2196/12554.

M. W. Eysenck and M. Fajkowska, “Anxiety and depression: Toward overlapping and distinctive features,” Cognition and Emotion, vol. 32, no. 7, pp. 1391–1400, Jun. 2017, doi: 10.1080/02699931.2017.1330255.

S. Venkatraman, S. Parvin, W. Mansoor, and A. Gawanmeh, “Big data analytics and internet of things for personalised healthcare: Opportunities and challenges,” International Journal of Electrical and Computer Engineering (IJECE), vol. 13, no. 4, p. 4306, Aug. 2023, doi: 10.11591/ijece.v13i4.pp4306-4316.

J. Maiga, G. G. Hungilo, and Pranowo, “Comparison of machine learning models in prediction of cardiovascular disease using health record data,” in 2019 International Conference on Informatics, Multimedia, Cyber and Information System (ICIMCIS), Oct. 2019. Accessed: Aug. 22, 2023. [Online]. Available: http://dx.doi.org/10.1109/icimcis48181.2019.8985205

C. Schröer, F. Kruse, and J. M. Gómez, “A systematic literature review on applying CRISP-DM process model,” Procedia Computer Science, vol. 181, pp. 526–534, 2021, doi: 10.1016/j.procs.2021.01.199.

A. Priya, S. Garg, and N. P. Tigga, “Predicting Anxiety, Depression and Stress in Modern Life using Machine Learning Algorithms,” Procedia Computer Science, vol. 167, pp. 1258–1267, 2020, doi: 10.1016/j.procs.2020.03.442.

S. Srinivasagopalan, J. Barry, V. Gurupur, and S. Thankachan, “A deep learning approach for diagnosing schizophrenic patients,” Journal of Experimental & Theoretical Artificial Intelligence, vol. 31, no. 6, pp. 803–816, Jan. 2019, doi: 10.1080/0952813x.2018.1563636.

M. T. R. Ullas, M. Begom, A. Ahmed, and R. Sultana, “A machine learning approach to detect depression and anxiety using supervised learning,” 2019. [Online]. Available: http://hdl.handle.net/10361/12274

S. Uddin, A. Khan, M. E. Hossain, and M. A. Moni, “Comparing different supervised machine learning algorithms for disease prediction,” BMC Medical Informatics and Decision Making, vol. 19, no. 1, Dec. 2019, doi: 10.1186/s12911-019-1004-8.

A. Sau and I. Bhakta, “Predicting anxiety and depression in elderly patients using machine learning technology,” Healthcare Technology Letters, vol. 4, no. 6, pp. 238–243, Nov. 2017, doi: 10.1049/htl.2016.0096.

D. Leightley, V. Williamson, J. Darby, and N. T. Fear, “Identifying probable post-traumatic stress disorder: applying supervised machine learning to data from a UK military cohort,” Journal of Mental Health, vol. 28, no. 1, pp. 34–41, Nov. 2018, doi: 10.1080/09638237.2018.1521946.

A. E. Tate, R. C. McCabe, H. Larsson, S. Lundström, P. Lichtenstein, and R. Kuja-Halkola, “Predicting mental health problems in adolescence using machine learning techniques,” PLOS ONE, vol. 15, no. 4, p. e0230389, Apr. 2020, doi: 10.1371/journal.pone.0230389.

Y. T. Jo, S. W. Joo, S. Shon, H. Kim, Y. Kim, and J. Lee, “Diagnosing schizophrenia with network analysis and a machine learning method,” International Journal of Methods in Psychiatric Research, vol. 29, no. 1, Feb. 2020, doi: 10.1002/mpr.1818.

P. Kumar, S. Garg, and A. Garg, “Assessment of Anxiety, Depression and Stress using Machine Learning Models,” Procedia Computer Science, vol. 171, pp. 1989–1998, 2020, doi: 10.1016/j.procs.2020.04.213.

C. R. Marmar et al., “Speech‐based markers for posttraumatic stress disorder in US veterans,” Depression and Anxiety, vol. 36, no. 7, pp. 607–616, Apr. 2019, doi: 10.1002/da.22890.

K. van Mens et al., “Applying machine learning on health record data from general practitioners to predict suicidality,” Internet Interventions, vol. 21, p. 100337, Sep. 2020, doi: 10.1016/j.invent.2020.100337.

Statista, “Mental health - Worldwide,” Statista, 2023. https://www.statista.com/outlook/hmo/mental-health/worldwide (accessed Jun. 01, 2023).

A. Teymoori et al., “Factorial structure and validity of depression (PHQ-9) and anxiety (GAD-7) scales after traumatic brain injury,” Journal of Clinical Medicine, vol. 9, no. 3, p. 873, Mar. 2020, doi: 10.3390/jcm9030873.

M. Shevlin et al., “Measurement invariance of the Patient Health Questionnaire (PHQ-9) and Generalized Anxiety Disorder scale (GAD-7) across four European countries during the COVID-19 pandemic,” BMC Psychiatry, vol. 22, no. 1, pp. 1–9, Mar. 2022, doi: 10.1186/s12888-022-03787-5.

A. Pranckeviciene et al., “Validation of the patient health questionnaire-9 and the generalized anxiety disorder-7 in Lithuanian student sample,” PLOS ONE, vol. 17, no. 1, p. e0263027, Jan. 2022, doi: 10.1371/journal.pone.0263027.

H. N. Cahyani and R. Arifudin, “Improving the Accuracy of Multinomial Naïve-Bayes Algorithm with Adaptive Boosting Using Information Gain for Classification of Movie Reviews Sentiment Analysis,” Journal of Advances in Information Systems and Technology, vol. 4, no. 1, pp. 50–59, Dec. 2022, doi: 10.15294/jaist.v4i1.60267.

M. Naseriparsa, A. Al-Shammari, M. Sheng, Y. Zhang, and R. Zhou, “RSMOTE: improving classification performance over imbalanced medical datasets,” Health Information Science and Systems, vol. 8, no. 1, Jun. 2020, doi: 10.1007/s13755-020-00112-w.

Lima, J. L. P., Macedo, D., & Zanchettin, C. (2019, July). Heartbeat Anomaly Detection using Adversarial Oversampling. 2019 International Joint Conference on Neural Networks (IJCNN). http://dx.doi.org/10.1109/ijcnn.2019.8852242

E. Leibenluft, “Pediatric irritability: A systems neuroscience approach,” Trends in Cognitive Sciences, vol. 21, no. 4, pp. 277–289, Apr. 2017, doi: 10.1016/j.tics.2017.02.002.

K. I. Crum et al., “Interaction of irritability and anxiety on emotional responding and emotion regulation: A functional MRI study,” Psychological Medicine, vol. 51, no. 16, pp. 2778–2788, Jun. 2020, doi: 10.1017/s0033291720001397.

Downloads

Published

24.03.2024

How to Cite

Callista Ivana Mogie. (2024). Emotional Disorders Detection Using Machine Learning Algorithm. International Journal of Intelligent Systems and Applications in Engineering, 12(3), 3354 –. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/5953

Issue

Section

Research Article