Harnessing the Power of Deep Learning For Hand Gesture Recognition
Keywords:
artificial intelligence, machine learning, gesture recognition, human interface, medical applicationAbstract
A lot of attention has been paid to hand gesture detection systems in recent times due to its numerous implications and effective human-computer interaction capabilities. This paper presents an effective Hand Gesture recognition (HGR) system that is based on Deep Learning (DL). The primary goal of proposed work is to improve the classification accuracy rate while identifying different Gestures. Moreover, we have used two dataset in the proposed work, one dataset is taken from UCI machine learning repository and other was collected manually from the real world. Data Normalization technique was implemented on the original datasets in order to make the data balanced and normalized. Soon after this, a total of 20 features were extracted from the normalized data to overcome the dataset dimensionality issues. Finally, for the identification and classification of gestures, we have used an advanced variant of DL namely; Bidirectional Long Short Term Memory (Bi-LSTM) in the proposed work. The simulation of the proposed Bi-LSTM based HGR system is examined and validated by comparing it with few state of art HGR techniques using MATLAB Software. Results revealed that the proposed model achieved an accuracy of 99.876% on standard dataset and 98.366% on real time dataset.
Downloads
References
Hasan, Haitham, and Sameem Abdul-Kareem. "RETRACTED ARTICLE:Human–computer interaction using vision-based hand gesture recognition systems: a survey." Neural Computing and Applications 25.2 (2014): 251-261.
Sagayam, K. Martin, and D. Jude Hemanth. "Hand posture and gesture recognition techniques for virtual reality applications: a survey." Virtual Reality 21.2 (2017): 91-107.
Bouchrika, Tahani, et al. "Cascaded hybrid Wavelet Network for hand gestures recognition." 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 2014.
Shi, W.T.; Lyu, Z.J.; Tang, S.T.; Chia, T.L.; Yang, C.Y. A bionic hand controlled by hand gesture recognition based on surface EMG signals: A preliminary study. Biocybern. Biomed. Eng. 2018, 38, 126–135. [CrossRef]
Tavakoli, M.; Benussi, C.; Lourenco, J.L. Single channel surface EMG control of advanced prosthetic hands: A simple, low cost and efficient approach. Expert Syst. Appl. 2017, 79, 322–332. [CrossRef]
Wang, N.; Lao, K.; Zhang, X. Design and Myoelectric Control of an Anthropomorphic Prosthetic Hand. J. Bionic Eng. 2017, 14, 47–59.
Nelson, A.; McCombe Waller, S.; Robucci, R.; Patel, C.; Banerjee, N. Evaluating touchless capacitive gesture recognition as an assistive device for upper extremity mobility impairment. J. Rehabil. Assist. Technol. Eng. 2018, 5, 1–13.
Sarkar, A.; Patel, K.A.; Ram, R.G.; Capoor, G.K. Gesture control of drone using a motion controller. In Proceedings of the 2016 International Conference on Industrial Informatics and Computer Systems (CIICS), Sharjah, Dubai, United Arab Emirates, 13–15 March 2016; pp. 1–5.
De Luca, C.J.; Gilmore, L.D.; Kuznetsov, M.; Roy, S.H. Filtering the surface EMG signal: Movement artifact and baseline noise contamination. J. Biomech. 2010, 43, 1573–1579.
Weiss, L.D.; Weiss, J.M.; Silver, J.K. Easy EMG E-Book: A Guide to Performing Nerve Conduction Studies and Electromyography; Elsevier Health Sciences: Amsterdam, The Netherlands, 2015.
Köpüklü, Okan, et al. "Real-time hand gesture detection and classification using convolutional neural networks." 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019). IEEE, 2019.
De Smedt, Quentin, Hazem Wannous, and Jean-Philippe Vandeborre. "Skeleton-based dynamic hand gesture recognition." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 2016.
J. M. Weiss, L. D. Weiss, and J. K. Silver, Easy EMG: a guide to performing nerve conduction studies and electromyography. Elsevier Health Sciences, 2015.
Türker, Hande, and Hasan Sze. "Surface electromyography in sports and exercise." Electrodiagnosis in new frontiers of clinical research (2013): 175-194.
McIntosh, Jess, et al. "Echoflex: Hand gesture recognition using ultrasound imaging." Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2017.
S. L. Aarthy, V. Malathi, Monia Hamdi, Inès Hilali-Jaghdam, Sayed Abdel-Khalek, Romany F. Mansour, "Recognition of Hand Gesture Using Electromyography Signal: Human-Robot Interaction", Journal of Sensors, vol. 2022.
S.M. Mane, R.A. Kambli, F.S. Kazi, N.M. Singh, Hand Motion Recognition from Single Channel Surface EMG Using Wavelet & Artificial Neural Network, Procedia Computer Science, Volume 49, 2015, Pages 58-65
Phat Nguyen Huu, Tan Phung Ngoc, "Hand Gesture Recognition Algorithm Using SVM and HOG Model for Control of Robotic System", Journal of Robotics, vol. 2021
Md Ferdous Wahid, Reza Tafreshi, Mubarak Al-Sowaidi, Reza Langari, Subject-independent hand gesture recognition using normalization and machine learning algorithms, Journal of Computational Science, Volume 27, 2018, Pages 69-76
Parvathy, P., Subramaniam, K., Prasanna Venkatesan, G.K.D. et al. RETRACTED ARTICLE: Development of hand gesture recognition system using machine learning. J Ambient Intell Human Comput 12, 6793–6800 (2021).
Bhushan, S.; Alshehri, M.; Keshta, I.; Chakraverti, A.K.; Rajpurohit, J.; Abugabah, A. An Experimental Analysis of Various Machine Learning Algorithms for Hand Gesture Recognition. Electronics 2022.
Wahid, Md Ferdous & Tafrershi, Reza & Al-Sowaidi, Mubarak & Langari, Reza. (2018). Subject-Independent Hand Gesture Recognition using Normalization and Machine Learning Algorithms. Journal of Computational Science.
Rhee, Kiwon, and Hyun-Chool Shin. "Electromyogram-based hand gesture recognition robust to various arm postures." International Journal of Distributed Sensor Networks 14.7 (2018).
Asif, A.R.; Waris, A.; Gilani, S.O.; Jamil, M.; Ashraf, H.; Shafique, M.; Niazi, I.K. Performance Evaluation of Convolutional Neural Network for Hand Gesture Recognition Using EMG. Sensors 2020.
Fang, Yinfeng, et al. "Improve inter-day hand gesture recognition via convolutional neural network-based feature fusion." International Journal of Humanoid Robotics 18.02 (2021).
Su, Hang, et al. "Depth vision guided hand gesture recognition using electromyographic signals." Advanced Robotics 34.15 (2020).
Rasel, Ahmed Abdal Shafi, and Mohammad Abu Yousuf. "An efficient framework for hand gesture recognition based on histogram of oriented gradients and support vector machine." International Journal of Information Technology and Computer Science 11.12 (2019).
Ashish Sharma, Anmol Mittal, Savitoj Singh, Vasudev Awatramani, Hand Gesture Recognition using Image Processing and Feature Extraction Techniques, Procedia Computer Science, Volume 173, 2020, Pages 181-190
Shuo Jiang, Qinghua Gao, Huaiyang Liu, Peter B. Shull, A novel, co-located EMG-FMG-sensing wearable armband for hand gesture recognition, Sensors and Actuators A: Physical, Volume 301, 2020.
M. F. Wahid, R. Tafreshi, M. Al-Sowaidi and R. Langari, "An efficient approach to recognize hand gestures using machine-learning algorithms," 2018 IEEE 4th Middle East Conference on Biomedical Engineering (MECBME), 2018, pp. 171-176.
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.
IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.
