MEMS based Wearable Smart-Glove and its Application of Gesture Detection and Sign Language Classification for Vocally Impaired with Integrated Health Monitoring System

Authors

  • Rekha H. Professor, Department of Information Science and Engineering Shridevi Institute of Engineering and Technology, India
  • Banda Saisandeep Assistant Professor, Department of ECE, Koneru Lakshmaiah Education Foundation, Guntur, Andhra Pradesh, India
  • Rashma M. Assistant professor, Department of fashion technology Sona college of technology, Salem, India
  • G. N. Keshava Murthy Assistant Professor, Department of Electronics and Instrumentation Engineering, Siddaganga Institute of Technology
  • Kamalika Tiwari Assistant Professor, Dr B C Roy Engineering College Durgapur, West Bengal, India.
  • Subhasis Datta Assistant Professor, Dr B C Roy Engineering College Durgapur, West Bengal, India.

Keywords:

Flex sensors, Bluetooth Device, micro-controller, Internet of Things, Health Monitoring, Raspberry Pico, LCD Display, APR 9600, Temperature Sensor, Heart Beat Sensor, Speaker, Analog to Digital Convertor, MEMS acceleration sensors

Abstract

Interactions between individuals with speech difficulties and those without have always posed challenges in communication. Gestures and sign language are recognized as the most natural and expressive means of communication between individuals with speech difficulties and those without. Through the utilization of glove-based communication systems designed for the hearing impaired, this intelligent glove enables individuals with vocal disabilities to engage in communication with others by using their sign language. Each glove is equipped with an embedded signal. The gesture module adapts the resistance of the flex sensor and accelerometer to correspond to specific gestures. Additionally, the design includes a text-to-speech converter that transforms intended actions into spoken output, which is then emitted through a speaker or transmitted via Bluetooth to a connected phone. This prototype also incorporates automatic message alerts for relevant parties, along with health monitoring capabilities for detecting human body temperature and heart rate. Overall, the health monitoring system is a valuable addition to the smart glove-based communication device, and it further enhances its potential to improve the lives of individuals with speech impairments.

Downloads

Download data is not yet available.

References

Ksitij Bantupalli and ying Xie, “American Sign Language Recognition using Deep Learning and Computer Vision”, IEEE,2018.

X. Zhang, Z. Yang, T. Chen, D. Chen, and M.-C. Huang, “Cooperative sensing and wearable computing for sequential hand gesture recognition,”IEEE Sensors J., vol. 19, no. 14, pp. 5775–5783, Jul. 2019.

J. Pan, Y. Luo, Y. Li, C.-K. Tham, C.-H. Heng, and A. V.-Y. Thean, “A wireless multi-channel capacitive sensor system for efficient glove-based gesture recognition with AI at the edge,” IEEE Trans. Circuits Syst. II: Exp. Briefs, vol. 67, no. 9, pp. 1624–1628, Sep. 2020.

W. Dong, L. Yang, R. Gravina, and G. Fortino, “Soft wrist-worn multi- functional sensor array for real-time hand gesture recognition,” IEEE Sensors J., Jan. 11, 2021, doi: 10.1109/JSEN.2021.3050175.

C. Demolder, A. Molina, F. L. Hammond III, and W.-H. Yeo, “Recent advances in wearable biosensing gloves and sensory feedback biosystems for enhancing rehabilitation, prostheses, healthcare, and virtual reality,” Biosensors Bioelectron., vol. 190, 2021, Art. no.113443.

Achyutha, P. N., Hebbale, S., & Vani, V. (2022). Real time COVID-19 facemask detection using deep learning. International Journal of Health Sciences, 6(S4), 1446–1462. https://doi.org/10.53730/ijhs.v6nS4.6231.

Nirmala G and C D Guruprakash (2023), A Novel Modified Energy and Throughput Efficient LOYAL UN-Supervised LEACH Method for Wireless Sensor Networks. IJEER 11(4), 877-885. DOI: 10.37391/ijeer.110401.

Murthy, R. K., Dhanraj, S., Manjunath, T. N., Achyutha, P. N., Prasad, A. N., & Gangambika, G. (2022). A survey on human activity recognition using CNN and LSTM. International Journal of Health Sciences, 6(S7), 3408–3417. https://doi.org/10.53730/ijhs.v6nS7.12479.

R. V S and Siddaraju, "Defective Motes Uncovering and Retrieval for Optimized Network," 2022 6th International Conference on Computing Methodologies and Communication (ICCMC), 2022, pp. 303-313, doi: 10.1109/ICCMC53470.2022.9754109.

Kalshetty, J. N., Achyutha Prasad, N., Mirani, D., Kumar, H., & Dhingra, H. (2022). Heart health prediction using web application. International Journal of Health Sciences, 6(S2), 5571–5578. https://doi.org/10.53730/ijhs.v6nS2.6479.

Prakash, N. C., Narasimhaiah, A. P., Nagaraj, J. B., Pareek, P. K., Sedam, R. V., & Govindhaiah, N. (2022). A survey on NLP based automatic extractive text summarization using spacy. International Journal of Health Sciences, 6(S8), 1514–1525. https://doi.org/10.53730/ijhs.v6nS8.10526.

Hebbale, S., Marndi, A., Achyutha, P. N., Manjula, G., Mohan, B. R., & Jagadeesh, B. N. (2022). Automated medical image classification using deep learning. International Journal of Health Sciences, 6(S5), 1650–1667. https://doi.org/10.53730/ijhs.v6nS5.9153.

Prakash, N. C. P., Narasimhaiah, A. P., Nagaraj, J. B., Pareek, P. K., Maruthikumar, N. B., & Manjunath, R. I. (2022). Implementation of NLP based automatic text summarization using spacy. International Journal of Health Sciences, 6(S5), 7508–7521. https://doi.org/10.53730/ijhs.v6nS5.10574.

Ramkrishna, S., Srinivas, C., Narasimhaiah, A. P., Muniraju, U., Maruthikumar, N. B., & Manjunath, R. I. (2022). A survey on blockchain security for cloud and IoT environment. International Journal of Health Sciences, 6(7), 28–43. https://doi.org/10.53730/ijhs.v6n7.10692.

Hebbale, S., Marndi, A., Manjunatha Kumar, B. H., Mohan, B. R. ., Achyutha, P. N., & Pareek, P. K. (2022). A survey on automated medical image classification using deep learning. International Journal of Health Sciences, 6(S1), 7850–7865. https://doi.org/10.53730/ijhs.v6nS1.6791.

Prasad N. Achyutha, Sushovan Chaudhury, Subhas Chandra Bose, Rajnish Kler, Jyoti Surve, Karthikeyan Kaliyaperumal, "User Classification and Stock Market-Based Recommendation Engine Based on Machine Learning and Twitter Analysis", Mathematical Problems in Engineering, vol. 2022, Article ID 4644855, 9 pages, 2022. https://doi.org/10.1155/2022/4644855.

S. Chaudhury, N. Achyutha Prasad, S. Chakrabarti, C. A. Kumar and M. A. Elashiri, "The Sentiment Analysis of Human Behavior on Products and Organizations using K-Means Clustering and SVM Classifier," 2022 3rd International Conference on Intelligent Engineering and Management (ICIEM), 2022, pp. 610-615, doi: 10.1109/ICIEM54221.2022.9853128.

G, M., Deshmukh, P., N. L., U. K., Macedo, V. D. J.., K B, V., N, A. P., & Tiwari, A. K. (2023). Resource Allocation Energy Efficient Algorithm for H-CRAN in 5G. International Journal on Recent and Innovation Trends in Computing and Communication, 11(3s), 118–126. https://doi.org/10.17762/ijritcc.v11i3s.6172.

S. Bhattacharyya, H. Rekha, S. Sarkar, N. Achyutha Prasad, B. N. Jagadeesh and S. Verma, "2.4 GHz Operational PSI-Shaped Patch Antenna Design For Multi Purpose Applications," 2023 2nd International Conference on Smart Technologies and Systems for Next Generation Computing (ICSTSN), Villupuram, India, 2023, pp. 1-6, doi: 10.1109/ICSTSN57873.2023.10151612.

P. K. Pareek, A. P. N, C. Srinivas and J. B. N, "Prediction of Rainfall in Karnataka Region using optimised MVC-LSTM Model," 2023 IEEE International Conference on Integrated Circuits and Communication Systems (ICICACS), Raichur, India, 2023, pp. 1-8, doi: 10.1109/ICICACS57338.2023.10100324.

Pooja Chopra, Vijay Suresh Gollamandala, Ahmed Najat Ahmed, S. B. G. Tilak Babu, Chamandeep Kaur, N. Achyutha Prasad, Stephen Jeswinde Nuagah, "Automated Registration of Multiangle SAR Images Using Artificial Intelligence", Mobile Information Systems, vol. 2022, Article ID 4545139, 10 pages, 2022. https://doi.org/10.1155/2022/4545139.

Prasad, A. K. ., M, D. K. ., Macedo, V. D. J. ., Mohan, B. R. ., & N, A. P. . (2023). Machine Learning Approach for Prediction of the Online User Intention for a Product Purchase. International Journal on Recent and Innovation Trends in Computing and Communication, 11(1s), 43–51. https://doi.org/10.17762/ijritcc.v11i1s.5992.

G. . T., R. . V., and U. K. . N. L., “Detecting Security Threats in Wireless Sensor Networks using Hybrid Network of CNNs and Long Short-Term Memory”, Int J Intell Syst Appl Eng, vol. 12, no. 1s, pp. 704–722, Sep. 2023.

Nirmala, G., Guruprakash, C.D. (2023). An Overview of Data Aggregation Techniques with Special Sensing Intelligent Device Selection Approaches. In: Kumar, A., Senatore, S., Gunjan, V.K. (eds) ICDSMLA 2021. Lecture Notes in Electrical Engineering, vol 947. Springer, Singapore. https://doi.org/10.1007/978-981-19-5936-3_58.

Rekha, V.S., Siddaraju (2023). Goodness Ratio and Throughput Improvement Using Multi-criteria LEACH Method in Group Sensing Device Network. In: Kumar, A., Senatore, S., Gunjan, V.K. (eds) ICDSMLA 2021. Lecture Notes in Electrical Engineering, vol 947. Springer, Singapore. https://doi.org/10.1007/978-981-19-5936-3_50.

Murthy, R. K., Dhanraj, S., Manjunath, T. N., Prasad, A. N., Pareek, P. K., & Kumar, H. N. (2022). A human activity recognition using CNN and long-term short-term memory. International Journal of Health Sciences, 6(S6), 10797–10809. https://doi.org/10.53730/ijhs.v6nS6.12919.

G. T and U. N. L, "Routing and Security in Wireless Ad-Hoc Networks: State of the Art and Recent Advances," 2023 IEEE Renewable Energy and Sustainable E-Mobility Conference (RESEM), Bhopal, India, 2023, pp. 1-8, doi: 10.1109/RESEM57584.2023.10236306.

Jipeng, T., Neelagar, M. B., & Rekha, V. S. (2021). Design of an embedded control scheme for control of remote appliances. Journal of Advanced Research in Instrumentation and Control Engineering, 7(3 & 4), 5-8.

Rekha V S and Dr. Siddaraju (2023), A Novel Buffer Packet Delivery Strategy for High Throughput and Better Health (HTBH) Method in Wireless Sensor Networks. IJEER 11(3), 866-876. DOI: 10.37391/ijeer.110334.

N. G and G. C. D, "Unsupervised Machine Learning Based Group Head Selection and Data Collection Technique," 2022 6th International Conference on Computing Methodologies and Communication (ICCMC), 2022, pp. 1183-1190, doi: 10.1109/ICCMC53470.2022.9753995. S. Chaudhury, N. Achyutha Prasad, S. Chakrabarti, C. A. Kumar and M. A. Elashiri, "The Sentiment Analysis of Human Behavior on Products and Organizations using K-Means Clustering and SVM Classifier," 2022 3rd International Conference on Intelligent Engineering and Management (ICIEM), 2022, pp. 610-615, doi: 10.1109/ICIEM54221.2022.9853128.

Hebbale, S., Marndi, A., Achyutha, P. N., Manjula, G., Mohan, B. R., & Jagadeesh, B. N. (2022). Automated medical image classification using deep learning. International Journal of Health Sciences, 6(S5), 1650–1667. https://doi.org/10.53730/ijhs.v6nS5.9153

Downloads

Published

24.03.2024

How to Cite

H., R. ., Saisandeep, B. ., M. , R. ., Murthy, G. N. K. ., Tiwari, K. ., & Datta, S. . (2024). MEMS based Wearable Smart-Glove and its Application of Gesture Detection and Sign Language Classification for Vocally Impaired with Integrated Health Monitoring System. International Journal of Intelligent Systems and Applications in Engineering, 12(20s), 495–502. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/5162

Issue

Vol. 12 No. 20s (2024)

Section

Research Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.

IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.

Similar Articles

You may also start an advanced similarity search for this article.