AI Virtual Mouse Using Hand Gestures

International Journal of Emerging Research in Science, Engineering, and Management

Vol. 2, Issue 1, pp. 288–297, January 2026

https://doi.org/10.58482/ijersem.v2i1.39

This work is licensed under a Creative Commons Attribution 4.0 International License .

AI Virtual Mouse Using Hand Gestures

B.Hima Bindu, Godugu Thejaswini, Kovuru Ramalakshmi, Konga Uma Maheswari, Sompalli Pavithra, Nemalla Venkateswara

Department of CSE, Siddharth Institute of Engineering & Technology, Puttur, India.

Abstract

This represents an increasing trend towards natural and touchless interfaces, driven by leaps in computer vision and AI. The mouse device itself imposes serious limitations, above all in sterile environments, accessibility-focused scenarios, and situations that absolutely require hands-free control. Deep learning-based gesture recognition overcomes this through virtual mouse systems-interpreting hand movements captured via a webcam into cursor actions. With an AI-enabled Virtual Mouse System, intuitive, touchless movements, clicks, drag, and scroll operations are provided through simple hand gestures. It enhances the sense of accessibility, hygiene, and allows for a seamless experience that proves quite valuable in healthcare, gaming, AR/VR applications, and other smart and interactive settings.

Keywords: Hand Gesture Recognition, AI Virtual Mouse, Computer Vision, Touchless Human–Computer Interaction, MediaPipe Hands.

📄 Download Full Text PDF

DOI: https://doi.org/10.58482/ijersem.v2i1.39

Open Access • Peer Reviewed Article

References

  1. A. Haria, A. Subramanian, N. Asokkumar, S. Poddar, and J. S. Nayak, “Hand Gesture Recognition for Human Computer Interaction,” Procedia Computer Science, vol. 115, pp. 367–374, Jan. 2017. https://doi.org/10.1016/j.procs.2017.09.092
  2. P. U. Vignesh, M. Thaqib-Ul-Rahman, S. Dheeraj, T. S. C. Reddy, and M. A. Uddin, “AI Virtual Mouse Using Hand Gesture Recognition,” International Research Journal on Advanced Engineering Hub (IRJAEH), vol. 3, no. 05, pp. 2259–2263, May 2025. https://doi.org/10.47392/irjaeh.2025.0332
  3. A. Tang, K. Lu, Y. Wang, J. Huang, and H. Li, “A Real-Time Hand Posture Recognition System Using Deep Neural Networks,” ACM Transactions on Intelligent Systems and Technology, vol. 6, no. 2, pp. 1–23, Mar. 2015. https://doi.org/10.1145/2735952
  4. X. Lou, “Vision-Based Hand Gesture Recognition Technology,” Applied and Computational Engineering, vol. 141, no. 1, pp. 54–59, Mar. 2025. https://doi.org/10.54254/2755-2721/2025.21696
  5. D. D. Doyle, A. L. Jennings, and J. T. Black, “Optical Flow Background Estimation for Real-Time Pan/Tilt Camera Object Tracking,” Measurement, vol. 48, pp. 195–207, Oct. 2013. https://doi.org/10.1016/j.measurement.2013.10.025
  6. M. Wu, “Gesture Recognition Based on Deep Learning: A Review,” ICST Transactions on e-Education and e-Learning, vol. 10, Mar. 2024. https://doi.org/10.4108/eetel.5191
  7. J. Ao, S. Liang, T. Yan, R. Hou, Z. Zheng, and J. Ryu, “Overcoming the Effect of Muscle Fatigue on Gesture Recognition Based on sEMG via Generative Adversarial Networks,” Expert Systems With Applications, vol. 238, p. 122304, Nov. 2023. https://doi.org/10.1016/j.eswa.2023.122304
  8. R. Matlani, R. Dadlani, S. Dumbre, S. Mishra, and A. Tewari, “Virtual Mouse Using Hand Gestures,” 2021 International Conference on Technological Advancements and Innovations (ICTAI), pp. 340–345, Nov. 2021. https://doi.org/10.1109/ICTAI53825.2021.9673251
  9. R. P. Sharma and G. K. Verma, “Human Computer Interaction Using Hand Gesture,” Procedia Computer Science, vol. 54, pp. 721–727, Jan. 2015. https://doi.org/10.1016/j.procs.2015.06.085
  10. K. Żywanowski et al., “Vision-Based Hand Pose Estimation Methods for Augmented Reality in Industry: Crowdsourced Evaluation on HoloLens 2,” Computers in Industry, vol. 171, p. 104328, Jun. 2025. https://doi.org/10.1016/j.compind.2025.104328
  11. S. Panagou, F. Fruggiero, and A. Lambiase, “Human Gesture System in Human Robot Interaction for Reliability Analysis,” Procedia Computer Science, vol. 200, pp. 1788–1795, Jan. 2022. https://doi.org/10.1016/j.procs.2022.01.379
  12. F. Zhang et al., “MediaPipe Hands: On-Device Real-Time Hand Tracking,” arXiv, Jun. 2020. https://doi.org/10.48550/arXiv.2006.10214
Download PDF

This article is part of Volume 2, Issue 1 (January 2026)

2026-01-31