Next-gen interaction experience using virtual mouse system

Pokanati, Naga Sesha Lakshmi and Alla, Satvik Reddy and Pampana, Sai Raja Pradeep and Mohammad, Ashan and Sakala, Swamy and Chintam, Veera Venkata Naga Surya Devi Sai (2025) Next-gen interaction experience using virtual mouse system. International Journal of Science and Research Archive, 15 (1). pp. 348-354. ISSN 2582-8185

The Virtual Mouse System is an innovative, touch-free control mechanism that replaces traditional computer mice using computer vision and artificial intelligence (AI). With a standard camera or webcam, it interprets hand, head, and eye gestures to perform actions like cursor movement, clicking, and scrolling. Designed for both general users and individuals with physical disabilities, it provides an intuitive, accessible, and futuristic interaction method. Key technologies like OpenCV and AI enable real- time gesture recognition, making it suitable for applications in accessibility, gaming, and education. This system eliminates physical devices, offering convenience and a modern dimension to human-computer interaction. This project focuses on developing a Virtual Mouse System using Python, MediaPipe, and PyAutoGUI, enabling users to control a computer cursor with simple hand gestures. The system leverages MediaPipe’s Hand Tracking API to detect hand landmarks and recognize specific gestures, which are then mapped to mouse actions such as cursor movement, clicking, dragging, and scrolling.