A Study of Multimodal Structure for Stress Recognition in IT Experts: Deep Analysis of Facial Expression Recognition with Deep Speech and Tone Analyzer
Keywords:
Mental Stress, FER model, Deep Speech,Tone AnalyzerAbstract
In today's world, mental stress is growing more pervasive and progressively more severe, endangering people's physical and mental well-being. Early stress detection is essential to preventing the negative consequences of stress on individuals. The usefulness of use objective indicators to identify stress has been shown in numerous studies. An increasing number of researchers have been attempting to identify stress using deep learning technology in recent years. In this paper, FER model is proposed.The computer vision problem known as Facial Expression Recognition (FER) aims to recognize and classify the various emotional expressions that are displayed on a human face. DeepSpeech can be used to train a model using gathering of voice data. The trained model can then be used for recognition or inference. Several pre-trained models are included in DeepSpeech. Digital audio is fed into DeepSpeech, which then outputs a "most likely" text transcript of the audio.IBM Tone Analyzer service employs language analysis to identify analytical, confident, tentative, fearful, angry, and joyful tones in user input (text).
Downloads
References
MS.N.Pavani, P.Supriya, A.SiriChandana3, B.Trinetra4, S.V.N.S.S.Supriya, “STRESS DETECTIONUSING IMAGE PROCESSING AND MACHINE LEARNING”, Dogo Rangsang Research Journal, Vol-08 Issue-14 No. 02: 2021
U SRINIVASULU REDDY, ADITYA VIVEK THOTA, A DHARUN, “Machine Learning Techniques for Stress Prediction in Working Employees”, 2018 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC)
D Y Liliana, “Emotion recognition from facial expression using deep
convolutional neural network”, 2018 International Conference of Computer and Informatics Engineering (IC2IE), Conf. Ser. 1193 012004
Kusuma H R, Devika Rani B S, Anjali K, Ashwini N, “Stress Detection in It Professionals Using Image Processing and MachineLearning”, International Journal of Advances in Engineering and Management (IJAEM), Volume 5, Issue 7 July 2023,pp. 255-259
Dr. S. Vaikole, S. Mulajkar, A. More, P. Jayaswal, S. Dhas, “Stress Detection through Speech Analysis using Machine Learning”, IJCRT | Volume 8, Issue 5 May 2020,pp. 2239-2244
B. Padmaja, V. V. Rama Prasad and K. V. N. Sunitha, “A Machine Learning Approach for Stress Detection using a Wireless Physical Activity Tracker”, International Journal of Machine Learning and Computing, Vol. 8, No. 1, February 2018, pp. 33-38
Adnan Ghaderi, Javad Frounchi, Alireza Farnam, “Machine Learning-based Signal Processing Using Physiological Signals for Stress Detection”, 22nd Iranian Conference on Biomedical Engineering(ICBME 2015), Iranian Research Organization for Science and Technology (IROST), Tehran, Iran, 25-27 November 2015
Virginia Sandulescu, Sally Andrews, Nicola Bellotto, Oscar Martinez Mozos, “Stress Detection Using Wearable Physiological Sensors”, International Work-Conference on the Interplay Between Natural and Artificial Computation,June 2015, DOI:10.1007/978-3-319-18914-7_55
Xingxing Zhang , Chao Xu 1, Wanli Xue 1, Jing Hu , Yongchuan He and Mengxin Gao, “Emotion Recognition Based on Multichannel Physiological Signals with Comprehensivenonlinear Processing”, www.mdpi.com/journal/sensors, Sensors 2018, 18, 3886; doi:10.3390/s18113886
Tanya Nijhawan, Girija Attigeri and T. Ananthakrishna, “Stress detection using natural language processing and machine learning over social interactions”,springer open access journal, https://doi.org/10.1186/s40537-022-00575-6,2022
Dorota Kami´nska, “Recognition of Human Mental Stress Using Machine Learning: A Case Study on Refugees”, Electronics 2023, 12, 3468.
Reshma Radheshamjee Baheti, Supriya Kinariwala, “Detection and Analysis of Stress using Machine Learning Techniques”, International Journal of Engineering and Advanced Technology (IJEAT), Volume-9 Issue-1, October 2019
Manjunath R., Shivashankar, Shivakumar Swamy N, Erappa G, Manohar Koli, Nandeeswar S. B., Niranjan R. Chougala, “A Smart Biomedical Healthcare System to Detect Stress using Internet of Medical Things, Machine Learning and Artificial Intelligence”, International Journal of Intelligent Systems and Applications in Engineering,Vol 11,Issue 4,2023,pp. 335-343
Rohini Hanchate, Harshal Narute, Siddharam Shavage, Karan Tiwari, “Stress Detection Using Machine Learning”, International Journal of Science and Healthcare Research, Vol. 8; Issue: 2; April-June 2023,pp-307-311
Kavitha S Patil, Pranav Sivaprasad, Udhay Kiran K, Sujay G S, “Projective exploration on individual stress levels using machine learning”, International Research Journal of Engineering and Technology (IRJET), Volume: 10 Issue: 04 | Apr 2023,pp-1449-1454
Mohamed Razeed Mohamed Nowfeek, “A Review of Machine Learning Approach for Mental Stress Detection”, Journal of Information Systems & Information Technology (JISIT), Vol. 6 No.2, 2021; pp- 72 – 83
Nisha Raichur, Nidhi Lonakadi, Priyanka Mural, “Detection of Stress Using Image Processing and Machine Learning Techniques”, International Journal of Engineering and Technology (IJET), Vol 9 No 3S July 2017
Z. Zainudin, S. Hasan, S.M. Shamsuddin and S. Argawal, “Stress Detection using Machine Learning and Deep Learning”, Asian Conference on Intelligent Computing and Data Sciences (ACIDS) 2021
S. A. Singh, P. K. Gupta, M. Rajeshwari, and T. Janumala, ‘‘Detection of stress using biosensors,’’ Mater. Today, vol. 5, no. 10, pp. 21003–21010, 2018
A. Alberdi, A. Aztiria, and A. Basarab, ‘‘Towards an automatic early stress recognition system for office environments based on multimodal measurements: A review,’’ J. Biomed. Informat., vol. 59, pp. 49–75, Feb. 2016.
U. Pluntke, S. Gerke, A. Sridhar, J. Weiss, and B. Michel, ‘‘Evaluation and classification of physical and psychological stress in firefighters using heart rate variability,’’ in Proc. 41st Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. (EMBC), Jul. 2019, pp. 2207–2212
G. Shanmugasundaram, S. Yazhini, E. Hemapratha, and S. Nithya, ‘‘A comprehensive review on stress detection techniques,’’ in Proc. IEEE Int. Conf. Syst., Comput., Automat. Netw. (ICSCAN), Mar. 2019, pp. 1–6
J. Wijsman, R. Vullers, S. Polito, C. Agell, J. Penders, and H. Hermens, ‘‘Towards ambulatory mental stress measurement from physiological parameters,’’ in Proc. Humaine Assoc. Conf. Affect. Comput. Intell. Interact., Sep. 2013, pp. 564–569
S. Elzeiny and M. Qaraqe, ‘‘Blueprint to workplace stress detection approaches,’’ in Proc. Int. Conf. Comput. Appl. (ICCA), Aug. 2018, pp. 407–412.
S. Elzeiny and M. Qaraqe, ‘‘Machine learning approaches to automatic stress detection: A review,’’ in Proc. IEEE/ACS 15th Int. Conf. Comput. Syst. Appl. (AICCSA), Oct. 2018, pp. 1–6.
S. S. Panicker and P. Gayathri, ‘‘A survey of machine learning techniques in physiology based mental stress detection systems,’’ Biocybern. Biomed. Eng., vol. 39, no. 2, pp. 444–469, Apr. 2019
G. Giannakakis, D. Grigoriadis, K. Giannakaki, O. Simantiraki, A. Roniotis, and M. Tsiknakis, ‘‘Review on psychological stress detection using biosignals,’’ IEEE Trans. Affect. Comput., early access, Jul. 9, 2019, doi: 0.1109/TAFFC.2019.2927337
Y. S. Can, N. Chalabianloo, D. Ekiz, J. Fernandez-Alvarez, G. Riva, and C. Ersoy, ‘‘Personal stress-level clustering and decision-level smoothing to enhance the performance of ambulatory stress detection with smartwatches,’’ IEEE Access, vol. 8, pp. 38146–38163, 2020
Y. S. Can, N. Chalabianloo, D. Ekiz, and C. Ersoy, ‘‘Continuous stress detection using wearable sensors in real life: Algorithmic programming contest case study,’’ Sensors, vol. 19, no. 8, p. 1849, Apr. 2019
N. Keshan, P. V. Parimi, and I. Bichindaritz, ‘‘Machine learning for stress detection from ECG signals in automobile drivers,’’ in Proc. IEEE Int. Conf. Big Data (Big Data), Santa Clara, CA, USA, Oct. 2015, pp. 2661–2669
V. Nasteski, ‘‘An overview of the supervised machine learning methods,’’ Horizons, vol. 4, pp. 51–62, Dec. 2017, doi: 10.20544/ horizons.b.04.1.17.p05.
A. Cantara and A. Ceniza, ‘‘Stress sensor prototype: Determining the stress level in using a computer through validated self-made heart rate (HR) and galvanic skin response (GSR) sensors and fuzzy logic algorithm,’’ Int. J. Eng. Res. Technol., vol. 5, no. 3, pp. 28–37, 2016
G. Mattavelli et al, Facial expressions recognition and discrimination in Parkinson’s disease, J. Neuropsychol. 15 (1) (2021) 46–68
Jing Zhang et.al, “Real time mental stress detection using multimodality expressions with deep learningframework”,frontiers in neuroscience,doi 10.3389/fnins.2022.947168
Wan-Ting Chew et.al “Facial Expression Recognition Via Enhanced Stress Convolution Neural Network for Stress Detection”, IAENG International Journal of Computer Science, 49:3, IJCS_49_3_20, Volume 49, Issue 3: September 2022
Menoua Keshishian et.al, “Understanding Adaptive, Multiscale Temporal Integration In Deep Speech Recognition Systems”, 35th Conference on Neural Information Processing Systems (NeurIPS 2021).
Downloads
Published
How to Cite
Issue
Section
License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.