Towards robust gesture-based control for mobile robots: Implementing and validating a limited recognition system on Voyager

Open Access

Issue		MATEC Web Conf. Volume 417, 2025 2025 RAPDASA-RobMech-PRASA-AMI Conference: Bridging the Gap between Industry & Academia - The 26^th Annual International RAPDASA Conference, joined by RobMech, PRASA and AMI, co-hosted by CSIR and Tshwane University of Technology, Pretoria


Article Number		04005
Number of page(s)		15
Section		Robotics and Mechatronics
DOI		https://doi.org/10.1051/matecconf/202541704005
Published online		25 November 2025

J. Qi, L. Ma, Z. Cul and Y. Yu, Computer vision-based hand gesture recognition for human-robot interaction: a review. Complex & Intelligent Systems, (2023). DOI: https://doi.org/10.1007/s40747-023-01173-6. [Google Scholar]
A. Eirale, M. Martini, M. Chiaberge, Human Following and Guidance by Autonomous Mobile Robots: A Comprehensive Review. IEEE Access, vol. 13, pp. 42214 – 42253 (2025). DOI: https://doi.org/10.1109/ACCESS.2025.3548134. [Google Scholar]
L. Guo, Z. Lu, L. Yao, Human-Machine Interaction Sensing Technology Based on Hand Gesture Recognition: A Review. IEEE Transactions on Human-Machine Systems, vol. 51(4), pp. 300-309 (2021). DOI: https://doi.org/10.1109/THMS.2021.3086003. [Google Scholar]
H.G. Tamiru, R.S. Yan, D.H. Long, D.H., Vision-based Hand Gesture Recognition for Mobile Service Robot Control. 8th International Conference on Manufacturing Science and Engineering, pp. 48-55 (2018). DOI: https://doi.org/10.2991/icmse-18.2018.11. [Google Scholar]
C. Hubert, N. Odic, M. Noel, S. Gharib, S.H.H. Zargarbashi, L. Séoud, MuViH: Multi-View Hand gesture dataset and recognition pipeline for human-robot interaction in a collaborative robotic finishing platform. Robotics and Computer-Integrated Manufacturing, vol. 94, pp. 102957 (2025). DOI: https://doi.org/10.1016/j.rcim.2025.102957. [Google Scholar]
C. Cui, M.S. Sunar, G.E. Su, Deep vision-based real-time hand gesture recognition: a review. PeerJ Computer Science, vol. 11, pp. 2921 (2025). DOI: https://doi.org/10.7717/peerj-cs.2921. [Google Scholar]
S. Budzan, R. Wyzgolik, M. Kciuk, K. Kulik, R. Masłowski, W. Ptasinski, O. Szkurłat, M. Szwedka, Ł. Wozniak, Using Gesture Recognition for AGV Control: Preliminary Research. Sensors, 23, pp. 3109 (2023). DOI: https://doi.org/10.3390/s23063109. [Google Scholar]
N. Mohamed, M.B. Mustafa, N. Jomhari, A Review of the Hand Gesture Recognition System: Current Progress and Future Directions. IEEE Access, vol. 9, pp. 157422 – 157436 (2021). DOI: https://doi.org/10.1109/ACCESS.2021.3129650. [Google Scholar]
M. Oudah, A. Al-Naji, J. Chahl, Hand Gesture Recognition Based on Computer Vision: A Review of Techniques, Journal of Imaging, vol. 6 (2020). DOI: https://doi.org/10.3390/jimaging6080073. [Google Scholar]
N. Robinson, B. Tidd, D. Campbell, D. Kulic, P. Corke, Robotic Vision for Human-Robot Interaction and Collaboration: A Survey and Systematic Review. Journal of the Association for Computing Machinery, vol. 37(4), pp. 111 (2021). DOI: https://doi.org/10.1145/1122445.1122456. [Google Scholar]
O. Köpüklü, A. Gunduz, N. Kose, G. Rigoll, Real-time Hand Gesture Detection and Classification using Convolutional Neural Networks. 14th IEEE International Conference on Automatic Face and Gesture Recognition, 14-18 May (2019). DOI: https://doi.org/10.1109/FG.2019.8756576. [Google Scholar]
P. Gawli, T. Desale, T. Deshmukh, S. Dongare, V. Gaikwad, S. Hajare, Gesture and Voice Controlled Wheelchair. 4^th International Conference on Sentiment Analysis and Deep Learning, Bhimdatta, Nepal, 8-20 February 2025 (2025). DOI: https://doi.org/10.1109/ICSADL65848.2025.10933372. [Google Scholar]
K. Purdon, J.S. Dickens, W. De Ronde, K. Ramruthan, G. Crafford, Voyager, a ground mobile robotic platform for research development, RAPDASA-RobMech-PRASA-AMI Conference, CSIR International Convention Centre, Pretoria, South Africa, 30 October – 2 November 2023 (2023). DOI: https://doi.org/10.1051/matecconf/202338804016. [Google Scholar]
Google AI for Developer, Hand landmarks detection guide. Available at: https://ai.google.dev/edge/mediapipe/solutions/vision/hand_landmarker. Accessed on: 19 December 2024. (2024) [Google Scholar]
Kiniv, Github: hand-gesture-recognition-mediapipe. Available at: https://github.com/kinivi/hand-gesture-recognition-mediapipe. Accessed on: 19 December 2024. (2020) [Google Scholar]
S. Mitra, T. Acharya, Gesture recognition: A survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 37(3), 311-324 (2007). DOI: https://doi.org/10.1109/TSMCC.2007.893280. [Google Scholar]

Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.

Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.

Initial download of the metrics may take a while.