Advancements in Facial Expression Recognition: State-of-the-Art Techniques and Innovations
Keywords:
Facial Landmarks Detection, Deep Learning Models, Convolutional Neural Networks (CNN), Facial Expression Classification, Emotion Detection, Facial Image Processing, Artificial Intelligence (AI), Facial Expression AnalysisAbstract
Utilizing Machine Learning and Convolutional Neural Networks, researchers have unlocked the capacity to excel in identifying emotions by leveraging the potent and instinctive nature of facial expressions, a robust medium for individuals to communicate their feelings and aims. The development of efficient recognition systems is essential for enhancing human-computer interaction. However, the field of facial expression recognition encompasses various methodologies that can significantly impact the performance of facial recognition systems. In this study, we present a cutting-edge achievement of 95% accuracy on the FER2013 dataset, achieved by implementing a combination of innovative techniques inspired by recent research. In addition, we present innovative techniques aimed at boosting precision by amalgamating established CNN structures like VGG-16 and ResNet-50 with supplementary datasets like JAFFE and CK. In our endeavor to forecast emotions, we adopt an alternative method leveraging geometric attributes and facial landmarks to calculate and relay a feature set to an SVM model. Our findings unequivocally demonstrate the superiority of the ResNet50 model over others in real-time emotion prediction, significantly enhancing the system's accuracy.
Downloads
References
L. Zahara, P. Musa, E. P. Wibowo, I. Karim, and S. B. Musa, "The facial emotion recognition (FER-2013) dataset for prediction system of micro-expressions face using the convolu-tional neural network (CNN) algorithm based Raspberry Pi," in 2020 Fifth international conference on informatics and computing (ICIC), pp. 1-9: IEEE, 2020. https://doi.org/10.1109/ICIC50835.2020.9288560
P. S. Wijaya, A. A. Firdaus, A. P. J. Dwitama, and M. Mustiari, "Pengenalan Ekspresi Wajah Menggunakan DCT dan LDA untuk Aplikasi Pemutar Musik (MOODSIC)," Jurnal Teknologi Informasi dan Ilmu Komputer, vol. 5, no. 5, pp. 559-566, 2018. https://doi.org/10.25126/jtiik.201855935
N. A. Chinchanikar, "Facial Expression Recognition Using Deep Learning: A Review," International Research Journal of Engineering and Technology (IRJET), vol. 6, pp. 3274-3281, 2019 [4].
M. Wang, Z. Wang, S. Zhang, J. Luan, and Z. Jiao, "Face expression recognition based on deep convolution network," in 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), pp. 1-9: IEEE, 2018. https://doi.org/10.1109/CISP-BMEI.2018.8633014
A. Voulodimos, N. Doulamis, A. Doulamis, and E. Protopapadakis, "Deep learning for computer vision: A brief review," Computational intelligence and neuroscience, vol. 2018, 2018. https://doi.org/10.1155/2018/7068349
P. R. Dachapally, "Facial emotion detection using convolutional neural networks and representational autoencoder units," arXiv preprint arXiv:1706.01509, 2017.
D. Theckedath and R. Sedamkar, "Detecting affect states using VGG16, ResNet50 and SE-ResNet50 networks," SN Computer Science, vol. 1, no. 2, pp. 1-7, 2020. https://doi.org/10.1007/s42979-020-0114-9
A. Qashlim, B. Basri, H. Haeruddin, A. Ardan, I. Nurtanio, and A. A. Ilham, “Smartphone Technology Applications for Milkfish Image Segmentation Using OpenCV Library”, Int. J. Interact. Mob. Technol., vol. 14, no. 08, pp. pp. 150–163, May 2020. https://doi.org/10.3991/ ijim.v14i08.12423.
C. Gacav, B. Benligiray, and C. Topal, "Greedy search for descriptive spatial face features," in 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1497-1501: IEEE, 2017. https://doi.org/10.1109/ ICASSP.2017.7952406
N. Özbey and M. B. Gülmezoğlu, "Facial Expression Recognition Using Proposed Geometric Features," EasyChair2516-2314, 2021.
N. Gopalan, S. Bellamkonda, and V. S. Chaitanya, "Facial expression recognition using geometric landmark points and convolutional neural networks," in 2018 International Conference on Inventive Research in Computing Applications (ICIRCA), pp. 1149-1153: IEEE, 2018. https://doi.org/10.1109/ICIRCA.2018.8597226
L. Zhao, "A facial expression recognition method using two-stream convolutional networks in natural scenes," Journal of Information Processing Systems, vol. 17, no. 2, pp. 399-410, 2021.
M. I. Rusydi, R. Hadelina, O. W. Samuel, A. W. Setiawan, and C. Machbub, "Facial Features Extraction Based on Distance and Area of Points for Expression Recognition," in 2019 4th Asia-Pacific Conference on Intelligent Robot Systems (ACIRS), pp. 211-215: IEEE, 2019. https://doi.org/10.1109/ACIRS.2019.8936005
A. A. Pise, M. A. Alqahtani, P. Verma, D. A. Karras, and A. Halifa, "Methods for Facial Expression Recognition with Applications in Challenging Situations," Computational Intelligence and Neuroscience, vol. 2022. https://doi.org/10.1155/2022/9261438
A. M. Ayyal Awwad, “Visual Emotion-Aware Cloud Localization User Experience Framework Based on Mobile Location Services”, Int. J. Interact. Mob. Technol., vol. 15, no. 14, pp. pp. 140–156, Jul. 2021 https://doi.org/10.3991/ijim.v15i14.20061
Babu, G. H., Srinivas, M., Gnanaprakasam, C., Prabu, R. T., Devi, M. R., Ahammad, S. H., ... & Rashed, A. N. Z. (2023). Meander Line Base Asymmetric Co-planar Wave Guide (CPW) Feed Tri-Mode Antenna for Wi-MAX, North American Public Safety and Satellite Applications. Plasmonics, 18(3), 1007-1018
I. J. Goodfellow et al., "Challenges in representation learning: A report on three machine learning contests," in International conference on neural information processing, 2013, pp. 117-124: Springer. https://doi.org/10.1007/978-3-642-42051-1_16
P. Lucey, J. F. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews, "The extended cohn-kanade dataset (ck+): A complete dataset for action unit and emotion-specified expression," in 2010 ieee computer society conference on computer vision and pattern recognition workshops, 2010, pp. 94-101: IEEE. https://doi.org/10.1109/CVPRW.2010.5543262
Y. Celik, M. Talo, O. Yildirim, M. Karabatak, and U. R. Acharya, "Automated invasive ductal carcinoma detection based using deep transfer learning with whole-slide images," Pattern Recognition Letters, vol. 133, pp. 232-239, 2020. https://doi.org/10.1016/j.patrec. 2020.03.011
Krishnamoorthy, N. V., KH, S. M., Gnanaprakasam, C., Swarna, M., & Geetha, R. (2023, April). A Robust Blockchain Assisted Electronic Voting Mechanism with Enhanced Cyber Norms and Precautions. In 2023 Eighth International Conference on Science Technology Engineering and Mathematics (ICONSTEM) (pp. 1-8). IEEE.
Swarna, M., Geetha, R., Saranya, G., KH, S. M., & Gnanaprakasam, C. (2023, April). An Empirical Design of IoT based Health Surveillance Scheme for Coronavirus Affected Patients. In 2023 Eighth International Conference on Science Technology Engineering and Mathematics (ICONSTEM) (pp. 1-8). IEEE.
K. Li, Y. Jin, M. W. Akram, R. Han, and J. Chen, "Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy," The visual computer, vol. 36, no. 2, pp. 391-404, 2020. https://doi.org/10.1007/s00371-019-01627-4
B. Houshmand and N. M. Khan, "Facial expression recognition under partial occlusion from virtual reality headsets based on transfer learning," in 2020 IEEE Sixth International Conference on Multimedia Big Data (BigMM), 2020, pp. 70-75: IEEE. https://doi.org/10.1109/BigMM50055.2020.00020
S, Ziani., El Hassouani, Y. A new approach for extracting and characterizing fetal electrocardiogram. Traitement du Signal, Vol. 37, No. 3, pp. 379-386, 2020. https://doi.org/10.18280/ts.370304
S. Ziani and Y. El Hassouani, "Fetal-Maternal Electrocardiograms Mixtures Characterization Based on Time Analysis," 2019 5th International Conference on Optimization and Applications (ICOA), Kenitra, Morocco, pp. 1-5, 2019. https://doi.org/10.1109/ICOA.2019. 8727619
S. Ziani, A. Jbari and L. Bellarbi, "QRS complex characterization based on non-negative matrix factorization NMF", 2018 4th International Conference on Optimization and Applications (ICOA), Mohammedia, Morocco, pp. 1-5, 2018. https://doi.org/10.1109/ICOA. 2018.8370548
Geetha, R., Krishnamoorthy, N. V., Murugan, K. S., Gnanaprakasam, C., & Swarna, M. (2023, April). A Novel Deep Learning based Stress Analysis and Detection Scheme using Characteristic Data. In 2023 Eighth International Conference on Science Technology Engineering and Mathematics (ICONSTEM) (pp. 1-8). IEEE.
Gnanaprakasam, C., Indumathy, M., Khilar, R., & Kumar, P. S. (2022). Artificial intelligence based optimization for mapping IP addresses to prevent cyber-based attacks. Measurement: Sensors, 24, 100508.
Gnanaprakasam, C., Anand, S., Manoj Kumar, R., & Menaka, R. (2021). Facial Expression Image Analysis to Classify High and Low Level ASD Kids Using Attention Mechanism Embedded Deep Learning Technique. In Advances in Electrical and Computer Technologies: Select Proceedings of ICAECT 2020 (pp. 559-568). Springer Singapore.
C. Gnanaprakasam, Manoj Kumar Rajagopal, Attention Residual Network for Micro-expression Recognition Using Image Analysis, in Journal of Advanced Research in Dynamical & Control Systems, 07-Special Issue,2020, Pages- 1261 – 1272.
Gnanaprakasam, C., and Manoj Kumar Rajagopal. "Review on Facial Micro-Expression Detection." Int J Innov Technol Explor Eng 8 (2019): 1103-1115.
[32] Sumathi, S., C. Gnanaprakasam, and R. RANIHEMA MALINI. "Face Recognition-Average-Half-Face Using Wavelets." IPCV 2010: proceedings of the 2010 international conference on image processing, computer vision, & pattern recognition (Las Vegas NV, July 12-15, 2010). 2010.
Gnanaprakasam, C., S. Sumathi, and R. RaniHema Malini. "Average-half-face in 2D and 3D using wavelets for face recognition." Proceedings of the 9th WSEAS international conference on Signal processing. 2010.
Gnanaprakasam, C., and M. Rajagopal. "K.,(2023). Identification of Autism Spectrum Disorder using Residual Attention Network for Facial Image Analysis." J Current Trends Comp Sci Res 2.1: 31-39.
Gnanaprakasam, C., et al. "Long-Range and Low-Power Automated Soil Irrigation System Using Internet of Things: An Experimental Study." Contemporary Developments in Agricultural Cyber-Physical Systems. IGI Global, 2023. 87-104.
C, G. ., Rajagopal, M. K. ., Swaminathan, A. ., Livingston, L. M. M. ., & Ramkumar, G. . (2023). Cultivating Insight: Detecting Autism Spectrum Disorder through Residual Attention Network in Facial Image Analysis. International Journal on Recent and Innovation Trends in Computing and Communication, 11(11s), 333–340.
Jayaram, Ramaprabha, S. Irin Sherly, and C. Gnanaprakasam. "Study of ECG Analysis based Cardiac Disease Prediction using Deep Learning Techniques." International Journal of Intelligent Systems and Applications in Engineering 11.4 (2023): 431-438.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
