Pantomimic gestures for human-robot interaction

Michael Burke, Joan Lasenby

Research output: Contribution to journalArticleResearchpeer-review

15 Citations (Scopus)

Abstract

This paper introduces a pantomimic gesture interface, which classifies human hand gestures using unmanned aerial vehicle (UAV) behavior recordings as training data. We argue that pantomimic gestures are more intuitive than iconic gestures and show that a pantomimic gesture recognition strategy using micro-UAV behavior recordings can be more robust than one trained directly using hand gestures. Hand gestures are isolated by applying a maximum information criterion, with features extracted using principal component analysis and compared using a nearest neighbor classifier. These features are biased in that they are better suited to classifying certain behaviors. We show how a Bayesian update step accounting for the geometry of training features compensates for this, resulting in fairer classification results, and introduce a weighted voting system to aid in sequence labeling.

Original languageEnglish
Pages (from-to)1225-1237
Number of pages13
JournalIEEE Transactions on Robotics
Volume31
Issue number5
DOIs
Publication statusPublished - Oct 2015
Externally publishedYes

Keywords

  • Gesture recognition
  • human-robot interaction
  • pantomimic
  • principal component analysis (PCA)
  • time series classification

Cite this