Published on Sun Nov 10 2019

A Dynamic Modelling Framework for Human Hand Gesture Task Recognition

Sara Masoud, Bijoy Chowdhury, Young-Jun Son, Chieri Kubota, Russell Tronstad
0
0
0
Abstract

Gesture recognition and hand motion tracking are important tasks in advanced gesture based interaction systems. In this paper, we propose to apply a sliding windows filtering approach to sample the incoming streams of data from data gloves and a decision tree model to recognize the gestures in real time for a manual grafting operation of a vegetable seedling propagation facility. The sequence of these recognized gestures defines the tasks that are taking place, which helps to evaluate individuals' performances and to identify any bottlenecks in real time. In this work, two pairs of data gloves are utilized, which reports the location of the fingers, hands, and wrists wirelessly (i.e., via Bluetooth). To evaluate the performance of the proposed framework, a preliminary experiment was conducted in multiple lab settings of tomato grafting operations, where multiple subjects wear the data gloves while performing different tasks. Our results show an accuracy of 91% on average, in terms of gesture recognition in real time by employing our proposed framework.

Sun Sep 16 2018
Machine Learning
A Generic Multi-modal Dynamic Gesture Recognition System using Machine Learning
A machine learning system to identify dynamic gestures. Data was acquired using accelerometers embedded in Wii remotes and smartwatches. The system is able to classify gestures performed at varying speeds with minimum preprocessing.
0
0
0
Sun Nov 12 2017
Computer Vision
Hand Gesture Recognition with Leap Motion
This paper proposes a novel hand gesture recognition system with Leap Motion Controller. A series of features are extracted from Leap Motion tracking data. We feed these features along with HOG feature extracted from sensor images into a multi-class SVM classifier.
0
0
0
Sun Mar 10 2013
Computer Vision
Intelligent Approaches to interact with Machines using Hand Gesture Recognition in Natural way: A Survey
Hand gestures recognition (HGR) is one of the main areas of research for the engineers, scientists and bioinformatics. HGR can be applied from games tumultuouscontrol to vision enabled robot control, from virtual reality to smart home systems.
0
0
0
Wed Aug 11 2021
Computer Vision
Tracking Hand Hygiene Gestures with Leap Motion Controller
The process of hand washing, according to the WHO, is divided into stages. In this paper, videos of hand washing experts are segmented and analyzed with the goal of extracting their corresponding features. These features can be further processed in software to classify particular hand movements.
3
0
0
Tue Sep 07 2021
Computer Vision
Fine-grained Hand Gesture Recognition in Multi-viewpoint Hand Hygiene
This paper contributes a new high-quality dataset for hand gesture recognition in hand hygiene systems. Each sample belongs to one of seven steps introduced by the World Health Organization. The code and the MFH dataset are available at https://github.com/willogy-team/hand-
0
0
0
Tue Nov 10 2020
Computer Vision
Multi-modal Fusion for Single-Stage Continuous Gesture Recognition
Gesture recognition has myriad real-world applications including robotics and human-machine interaction. We introduce a single-stage continuous gesture recognition model that can detect and classify multiple gestures in a single video via a single model. This approach learns the natural transitions between gestures and non-gestures.
3
0
0