Implementation of Virtual Mouse Control System Using Hand Gestures for Web Service Discovery

Authors

  • G. V. Bhole Research Scholar, Bharati Vidyapeeth (Deemed to be University) College of Engineering, Pune, India
  • Shrikala Deshmukh Assistant Professor, Department of Information Technology, Bharati Vidyapeeth (Deemed to be University) College of Engineering, Pune, India
  • M. D. Gayakwad Assistant Professor, Department of Information Technology, Bharati Vidyapeeth (Deemed to be University) College of Engineering, Pune, India
  • P. R. Devale Professor, Department of Information Technology, Bharati Vidyapeeth (Deemed to be University) College of Engineering, Pune, India

Keywords:

Virtual mouse control, hand gesture, Web service Discovery, computer vision, Image processing, user experience, human-computer interface (HCI)

Abstract

There are important web services SOAP, UDDU and WSDL. These web services are designed and integrated in suitable website after discovery. The research work focuses on design of Virtual Mouse Control System Using Hand Gestures for the discovery among several web services.  This research article suggests a real-time virtual mouse controller based on hand movements and computer vision. Traditional physical mouse have drawbacks, such as requiring additional hardware and being challenging to use. Gesture-based interaction is made feasible with the use of this technology while overcoming practical difficulties, logistical problems, mobility issues, and accessibility issues. The system records hand motions using a built-in camera or webcam and processes them using colour segmentation and detection methods. By using a variety of hand gestures to control mouse actions including left clicks, right clicks, and scrolling, which can be constructed using MediaPipe, Python, and OpenCV, users can interact with computers in a more intuitive and natural way. The problem that this research aims to answer is the need for a more user-friendly and accessible manner of connecting with a computer that does not rely on physical mouse devices. A virtual mouse controller based on computer vision and hand gestures can benefit anyone with physical restrictions or discomfort from using a normal mouse by resolving this issue.The method also has the potential to limit the spread of infections by eliminating the requirement for physical touch with shared computer equipment.

Downloads

Download data is not yet available.

References

Singhal P, A. Haria, A. Subramanian, N. Asokkumar, S. Poddar, and J. S. Nayak, “Hand Gesture Recognition for Human Computer Interaction,” in Procedia Computer Science, Elsevier B.V., 2017, pp. 367–374. doi: 10.1016/j.procs.2017.09.092.

V. Sharma, H. Kolivand, D. Al-Jumeily Obe, M. Jayabalan, S. Asadianfam, and D. Al-Jumeily, “Gesture Recognition Techniques mobile multimedia learning for engineering education View project Health Care (Cervical Cancer) Data Screening View project Gesture Recognition Techniques.” [Online]. Available: https://www.researchgate.net/publication/368292413

T. Grzejszczak, R. Molle, and R. Roth, “Tracking of dynamic gesture fingertips position in video sequence,” Archives of Control Sciences, vol. 30, no. 1, pp. 101–122, 2020, doi: 10.24425/acs.2020.132587.

S. Shriram, B. Nagaraj, J. Jaya, S. Shankar, and P. Ajay, “Deep Learning-Based Real-Time AI Virtual Mouse System Using Computer Vision to Avoid COVID-19 Spread,” J Healthc Eng, vol. 2021, 2021, doi: 10.1155/2021/81330

Md. M. Ahmed, Md. A. Hossain, and A. F. M. Z. Abadin, “Implementation and Performance Analysis of Different Hand Gesture Recognition Methods,” Global Journal of Computer Science and Technology, pp. 13–20, Jul. 2019, doi: 10.34257/gjcstdvol19is3pg13.

R. Saroj, A. Kumar, A. Moolya, and D. Pandit, “VIRTUAL MOUSE USING COLOR DETECTION,” International Research Journal of Engineering and Technology, 2018, [Online]. Available: www.irjet.net

M. Oudah, A. Al-Naji, and J. Chahl, “Hand Gesture Recognition Based on Computer Vision: A Review of Techniques,” Journal of Imaging, vol. 6, no. 8. MDPI, Jul. 01, 2020. doi: 10.3390/JIMAGING6080073.

J. Farooq and M. B. Ali, “Real time hand gesture recognition for computer interaction,” in 2014 International Conference on Robotics and Emerging Allied Technologies in Engineering, iCREATE 2014 - Proceedings, IEEE Computer Society, 2014, pp. 73–77. doi: 10.1109/iCREATE.2014.6828342.

S. S. Rautaray, “Real Time Hand Gesture Recognition System for Dynamic Applications,” International Journal of UbiComp, vol. 3, no. 1, pp. 21–31, Jan. 2012, doi: 10.5121/iju.2012.3103.

K. H. Shibly, S. K. Dey, Md. A. Islam, S. I. Showrav.(2019). Design and Development of Hand Gesture-Based Virtual Mouse East-West University. Bangladesh Section, and IEEE Robotics and Automation Society. Bangladesh Chapter, 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT 2019) : May 3-5, 2019, Dhaka, Bangladesh

V. K. Sharma, V. Kumar, S. Tawara, and V. Jayaswal, “Virtual Mouse Control Using Hand Class Gesture.” [Online]. Available: https://www.researchgate.net/publication/347983092

G. N. Srinivas, S. Sanjay Pratap, V. S. Subrahmanyam, K. G. Nagapriya, A. Venkata, and S. Rao, “Virtual Mouse Control Using Hand Gesture Recognition,” International Research Journal of Engineering and Technology, [Online]. Available: www.irjet.net

D. S. Tran, N. H. Ho, H. J. Yang, S. H. Kim, and G. S. Lee, “Real-time virtual mouse system using RGB-D images and fingertip detection,” Multimed Tools Appl, vol. 80, no. 7, pp. 10473–10490, Mar. 2021, doi: 10.1007/s11042-020-10156-5.

R. TH. Hasan and A. Bibo Sallow, “Face Detection and Recognition Using OpenCV,” Journal of Soft Computing and Data Mining, vol. 2, no. 2, Oct. 2021, doi: 10.30880/jscdm.2021.02.02.008.

R. Kumar and A. Bajpai, “Mediapipe and CNNs for Real-Time ASL Gesture Recognition.”

C. Jensen, V. Borg, K. Hansen, and B. Juul-Kristensen, “Hypermobility spectrum disorder and long-lasting shoulder problems View project The CHAMPS-Study DK View project,” 1998. [Online]. Available: https://www.researchgate.net/publication/13419473

Mr. Dhanaraju, “Human-Eye Controlled Virtual Mouse,” Int J Res Appl Sci Eng Technol, vol. 10, no. 6, pp. 2623–2629, Jun. 2022, doi: 10.22214/ijraset.2022.44478.

K. Anand, S. Urolagin, and R. K. Mishra, “How does hand gestures in videos impact social media engagement - Insights based on deep learning,” International Journal of Information Management Data Insights, vol. 1, no. 2, Nov. 2021, doi: 10.1016/j.jjimei.2021.100036.

Downloads

Published

29.01.2024

How to Cite

Bhole, G. V. ., Deshmukh, S. ., Gayakwad, M. D. ., & Devale, P. R. . (2024). Implementation of Virtual Mouse Control System Using Hand Gestures for Web Service Discovery. International Journal of Intelligent Systems and Applications in Engineering, 12(13s), 663 –. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/4638

Issue

Vol. 12 No. 13s (2024)

Section

Research Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.

IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.