EEG Based Emotion Recognition Using Ensemble Models and Laplacian Eigenmaps
Keywords:
Laplacian Eigenmaps, Dimensionality Reduction, Random Forest, eXtreme Gradient Boosting, Eigen values and Eigen Vectors, Ensemble Machine Learning, EEG Emotion RecognitionAbstract
Electroencephalography (EEG) signals provide valuable insights into human brain activity and emotional states. The DEAP dataset is a widely used resource containing EEG data and corresponding emotion labels recorded from participants watching music videos. Extracting meaningful EEG signal features is crucial for the recognition of emotions and other brain-computer interface applications. In this work, we explore the effectiveness of Laplacian Eigenmaps, a nonlinear dimensionality reduction technique, for extracting discriminative features from EEG signals on the DEAP dataset. We present an experimental study where we apply Laplacian Eigenmaps to reduce the high-dimensional EEG data into a lower-dimensional representation. Subsequently, we employ ensemble machine learning classifiers viz., Random Forest (RF) and eXtreme Gradient Boosting (XGB) classifiers for emotion classification based on the reduced features. The results demonstrate the capability of Laplacian Eigenmaps in capturing the underlying structure of EEG data, leading to improved emotion recognition accuracy with RF 98.1% and XGB 98.7% compared to other feature extraction.
Downloads
References
Koelstra, S., Muhl, C., Soleymani, M., Lee, J. S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012). DEAP: A Database for Emotion Analysis using Physiological Signals. IEEE Transactions on Affective Computing, 3(1), 18-31. DOI: [10.1109/T-AFFC.2011.15](https://doi.org/10.1109/T- AFFC.2011.15)
Soleymani, M., Lichtenauer, J., Pun, T., & Pantic, M. (2012). A Multimodal Database for Affective Computing Research. In Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII), 791-796. DOI: [10.1109/ACII.2011.97](https://doi.org/10.1109/ACII.2 011.97)
Yang, Y., Zhang, Y., & Zheng, W. (2018). EEG-Based Emotion Recognition using Deep Learning Network with Principal Component Based Covariate Shift Adaptation. IEEE Transactions on Affective Computing, 9(3), 321-334. DOI: [10.1109/TAFFC.2017.2665668](https://doi.org/10.1109/TAFFC.2017.2665668)
Zheng, W., Lu, Y., & Yang, Y. (2015). Investigating Critical Frequency Bands and Channels for EEG-based Emotion Recognition with Deep Neural Networks. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction (ICMI), 109-116. DOI:[10.1145/2818346.2820775](https://doi.org/10.114 5/2818346.2820775)
Bhatti AM, Majid M, Anwar SM, Khan B. Human emotion recognition and analysis in response to audio music using brain signals. Comput Human Behav 2016;65:267–75.
Harmon-Jones E, Gable PA, Peterson CK. The role of asymmetric frontal cortical activity in emotion-related phenomena: a review and update. Biol Psychol 2010;84:451–62.
Pizzagalli D, Regard M, Lehmann D. Rapid emotional face processing in the human right and left brain hemispheres: an ERP study. Neuroreport 1999;10:2691–8.
Lan Z, Sourina O, Wang L, Scherer R, Müller-Putz G. Unsupervised feature learning for EEG-based emotion recognition. 2017 Int. Conf. Cyberworlds. 2017. pp. 182–5.
Liu Y, Sourina O, Nguyen MK. Real-time EEG-based emotion recognition and its applications. Transaction on computational science XII. Springer; 2011. p. 256–77.
Tuomas E, Vuoskoski K. A review of music and emotion studies: approaches, emotion models, and stimuli. Music Percept An Interdiscip J 2013;30:307–40. http://dx.doi.org/10.1525/jams.2009.62.1.145 b i o c y b e r n e t i c s a n d b i o m e d i c a l e n g i n e e r i n g 4 0 ( 2 0 2 0 ) 9 1 0 – 9 2 6924
Cowen AS, Keltner D. Self-report captures 27 distinct categories of emotion bridged by continuous gradients. Proc Natl Acad Sci U S A 2017;114:E7900–9.
Jenke R, Peer A, Buss M. Feature extraction and selection for emotion recognition from EEG. IEEE Trans Affect Comput 2014;5:327–39.
Thammasan N, Moriyama K, Fukui K, Numao M. Continuous music-emotion recognition based on electroencephalogram. IEICE Trans Inf Syst 2016;99:1234–41.
Schaaff K, Schultz T. Towards emotion recognition from electroencephalographic signals. Affect. Comput. Intell. Interact. Work. 2009. ACII 2009. 3rd Int. Conf.. 2009. pp. 1–6.
Ianez E, Azorin JM, Ubeda A, Fernandez E, Sirvent JL (2010) LDA-based classifiers for a mental tasks-basezd brain–computer interface. In: Proceeding of the 2010 IEEE international conference on systems man and cybernetics (SMC 2010), 10–13 Oct 2010. IEEE Press, pp 546–551.
Koelstra S, Muhl C, Soleymani M, Lee J-S, Yazdani A, Ebrahimi T, et al. Deap: a database for emotion analysis; using physiological signals. IEEE Trans Affect Comput 2012;3:18–31.
Parmar U, Pandya DH (2021) Comparison of the supervised machine learning techniques using WPT for the fault diagnosis of cylindrical roller bearing. Int J Eng Sci Technol 13(2):50–56
G. K. P. Veeramallu, Y. Anupalli, S. k. Jilumudi and A. Bhattacharyya, "EEG based automatic emotion recognition using EMD and Random forest classifier," 2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kanpur, India, 2019, pp. 1-6, doi: 10.1109/ICCCNT45670.2019.8944903.
Parui, S., Bajiya, A. K. R., Samanta, D., & Chakravorty, N. (2019, December). Emotion recognition from EEG signal using XGBoost algorithm. In 2019 IEEE 16th India Council International Conference (INDICON) (pp. 1-4). IEEE.
J. D. Morris, “SAM: the self-assessment manikin. An efficient cross-cultural measurement of emotional response,” Journal of Advertising Research, vol. 35, no. 8, pp. 63–68, 1995
Available at https://engineering.case.edu/bearingdatacenter. Accessed 16 Sep 2021 Available at https://scikit-learn.org/stable/. Accessed 16 Sep 2021
G. K. P. Veeramallu, Y. Anupalli, S. k. Jilumudi and A. Bhattacharyya, "EEG based automatic emotion recognition using EMD and Random forest classifier," 2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kanpur, India, 2019, pp. 1-6, doi: 10.1109/ICCCNT45670.2019.8944903.
Belkin, Mikhail, and Partha Niyogi. "Laplacian eigenmaps for dimensionality reduction and data representation." Neural computation 15.6 (2003): 1373-1396.
Fan, J.; Wade, J.W.; Key, A.P.; Warren, Z.E.; Sarkar, N. EEG-Based Affect and Workload Recognition in a Virtual Driving Environment for ASD Intervention. IEEE Trans. Biomed. Eng. 2018, 65, 43–51. [CrossRef]
Soroush, M.Z.; Maghooli, K.; Setarehdan, S.K.; Nasrabadi, A.M. Emotion Classification through Nonlinear EEG Analysis Using Machine Learning Methods. Int. Clin. Neurosci. J. 2018, 5, 135–149
Li, Y.; Zheng, W.; Zong, Y.; Cui, Z.; Zhang, T.; Zhou, X. A Bi-Hemisphere Domain Adversarial Neural Network Model for EEG Emotion Recognition. IEEE Trans. Affect. Comput. 2021, 12, 494–504
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.