Human Emotion Tracking System Using Deep Learning framework and Knowledge Graph
Keywords:
HEDA, EDA, Knowledge Graph, Human BehaviourAbstract
Human emotional tracking is a huge challenge. To address this work focus on the proposed research model HEDA that combines human emotions tracking using knowledge graph. The work uses PAFEW dataset to focus on the outcomes of the proposed work. The work also addresses the human physiology behavior using the concepts of EDA. Research in the area of emotion recognition based on electrodermal activity (EDA) tries to identify and categories human emotions by analyzing physiological data, especially changes in the electrical conductance of the skin. Emotion identification algorithms can be made more accurate and interpretable by incorporating a knowledge graph into the process.
Downloads
References
Paloniemi, Susanna, et al. "Integrating self-reports and electrodermal activity (EDA) measurement in studying emotions in professional learning." Methods for Researching Professional Learning and Development: Challenges, Applications and Empirical Illustrations. Cham: Springer International Publishing, 2022. 87-109.
Hossain, Md-Billal, et al. "Comparison of electrodermal activity from multiple body locations based on standard EDA indices’ quality and robustness against motion artifact." Sensors 22.9 (2022): 3177.
Tronstad, Christian, et al. "Current trends and opportunities in the methodology of electrodermal activity measurement." Physiological measurement 43.2 (2022): 02TR01.
Oh, Geesung, et al. "Multimodal data collection system for driver emotion recognition based on self-reporting in real-world driving." Sensors 22.12 (2022): 4402.
Gyrard, Amelie, and KarimaBoudaoud. "Interdisciplinary IoT and Emotion Knowledge Graph-Based Recommendation System to Boost Mental Health." Applied Sciences 12.19 (2022): 9712.
Wang, Shuo, et al. "Interpretable emotion analysis based on knowledge graph and OCC model." Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2022.
Schoene, Annika Marie, Nina Dethlefs, and Sophia Ananiadou. "RELATE: Generating a linguistically inspired Knowledge Graph for fine- grained emotion classification." Proceedings of the Thirteenth Language Resources and Evaluation Conference. 2022.
Aslan, Sinem, et al. "Recognizing the emotions evoked by artworks through visual features and knowledge graph-embeddings." Image Analysis and Processing. ICIAP 2022Workshops: ICIAP International Workshops, Lecce, Italy, May 23–27, 2022, Revised Selected Papers, Part I. Cham: Springer International Publishing, 2022.
Nagae, Taisuke, and Jaeryoung Lee. "Understanding Emotions in Children with Developmental Disabilities during Robot Therapy Using EDA." Sensors 22.14 (2022): 5116.
Yin, Guanghao, et al. "A multimodal framework for large-scale emotion recognition by fusing music and electrodermal activity signals." ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 18.3 (2022): 1-23.
Yu, Dian, and Shouqian Sun. "A systematic exploration of deep neural networks for EDA-based emotion recognition." Information 11.4 (2020): 212.
Lin, Wenqian, and Chao Li. "Review of Studies on Emotion Recognition and Judgment Based on Physiological Signals." Applied Sciences 13.4 (2023): 2573.
Hosseini, Elahe, et al. "A Low Cost EDA-based Stress Detection Using Machine Learning." 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).IEEE, 2022.
Sun, Kai, Jihong Zhu, and Jie Liang. "Emotion Recognition of Physical Activities for Health Monitoring Using Machine Learning."2022 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS).IEEE, 2022.
Santhiya, P., and S. Chitrakala. "PTCERE: Personality-trait mapping using cognitive-based emotion recognition from electroencephalogram signals." The Visual Computer (2022): 1-15.
Perry Fordson, Hayford, et al. "Emotion Recognition Method With Knowledge Graph Based on Electrodermal Activity." Frontiers in Neuroscience (2022): 718.
Al Machot, Fadi, et al. "A deep-learning model for subject-independent human emotion recognition using electrodermal activity sensors." Sensors 19.7 (2019): 1659.
Poli, Angelica, et al. "Preliminary results of IoT-enabled EDA-based analysis of physiological response to acoustic stimuli." IoT Technologies for HealthCare: 7th EAI International Conference, HealthyIoT 2020, Viana do Castelo, Portugal, December 3, 2020, Proceedings. Cham: Springer International Publishing, 2021.
Kyamakya, Kyandoghere, et al. "Emotion and stress recognition related sensors and machine learning technologies." Sensors 21.7 (2021): 2273.
Bagula, A., K. Kyamakya, and F. Al-Machot. "Emotion and stress recognition related sensors and machine learning technologies." (2021).
Zhang, Tenggan, et al. "Multimodal Fusion Strategies for Physiological-emotion Analysis." Proceedings of the 2nd on Multimodal Sentiment Analysis Challenge. 2021. 43-50.
Sanchez-Comas, Andres, et al. "Correlation analysis of different measurement places of galvanic skin response in test groups facing pleasant and unpleasant stimuli." Sensors 21.12 (2021): 4210.
Iadarola, Grazia, Angelica Poli, and Susanna Spinsante. "Analysis of galvanic skin response to acoustic stimuli by wearable devices."2021 IEEE International Symposium on Medical Measurements and Applications (MeMeA).IEEE, 2021.
Yang, Xiuleng, et al. "The effects of traveling in different transport modes on galvanic skin response (GSR) as a measure of stress: An observational study." Environment International 156 (2021): 106764
Iadarola, Grazia, Angelica Poli, and Susanna Spinsante. "Reconstruction of galvanic skin Response peaks via sparse representation." 2021 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).IEEE, 2021.
Panahi, Farnaz, SaeidRashidi, and Ali Sheikhani. "Application of fractional Fourier transform in feature extraction from ELECTROCARDIOGRAM and GALVANIC SKIN RESPONSE for emotion recognition." Biomedical Signal Processing and Control 69 (2021): 102863.
Shahabinejad, Mostafa, et al. "Toward personalized emotion recognition: A face recognition based attention method for facial emotion recognition." 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021).IEEE, 2021.
Desai, Usha, and Akshaya D. Shetty. "Electrodermal activity (EDA) for treatment of neurological and psychiatric disorder patients: a review." 2021 7th International Conference on Advanced Computing and Communication Systems (ICACCS).Vol. 1.IEEE, 2021.
Ladakis, I., and IoannaChouvarda. "Overview of biosignal analysis methods for the assessment of stress." Emerging Science Journal 5.2 (2021): 233-244.
Albertetti, Fabrizio, AlenaSimalastar, and AïchaRizzotti-Kaddouri. "Stress detection with deep learning approaches using physiological signals." IoT Technologies for HealthCare: 7th EAI International Conference, HealthyIoT 2020, Viana do Castelo, Portugal, December 3, 2020, Proceedings 7. Springer International Publishing, 2021.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
