Scholarly open access journals, Peer-reviewed, and Refereed Journals, Impact factor 8.14 (Calculate by google scholar and Semantic Scholar | AI-Powered Research Tool) , Multidisciplinary, Monthly, Indexing in all major database & Metadata, Citation Generator, Digital Object Identifier(DOI)
This system integrates gesture and voice-based control for a robotic platform using Raspberry Pi 3, OpenCV, and Media Pipe for real-time processing. Hand gestures are captured via a camera and analyzed using Media Pipe’s hand-tracking module, which maps specific gestures to corresponding robotic movements. Simultaneously, voice commands are transmitted via Bluetooth using a mobile application, which the Raspberry Pi processes to trigger appropriate responses. The robot, driven by two low-RPM gear motors, exhibits noticeable latency due to Bluetooth communication delays and motor speed limitations. Performance analysis is conducted based on response time, movement accuracy, and overall latency, with results indicating that gesture control is more responsive, whereas voice control introduces additional delay due to Bluetooth transmission and processing overhead. This project demonstrates the feasibility of multimodal robotic control and serves as a foundation for further improvements, such as Wi-Fi-based communication, AI-enhanced processing, and more efficient motor control strategies to enhance responsiveness and overall efficiency.
Keywords:
Gesture, Raspberry pi, OpenCV, Bluetooth
Cite Article:
"Multimodal Human-Robot Interaction: Gesture and Voice-Controlled Robotics", International Journal of Science & Engineering Development Research (www.ijrti.org), ISSN:2455-2631, Vol.10, Issue 4, page no.a59-a64, April-2025, Available :http://www.ijrti.org/papers/IJRTI2504009.pdf
Downloads:
000353
ISSN:
2456-3315 | IMPACT FACTOR: 8.14 Calculated By Google Scholar| ESTD YEAR: 2016
An International Scholarly Open Access Journal, Peer-Reviewed, Refereed Journal Impact Factor 8.14 Calculate by Google Scholar and Semantic Scholar | AI-Powered Research Tool, Multidisciplinary, Monthly, Multilanguage Journal Indexing in All Major Database & Metadata, Citation Generator