Hybrid neural networks based approach for Holoscopic Micro-Gesture Recognition in images and videos

Garima Sharma, Shreyank Jyoti, Abhinav Dhall

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

1 Citation (Scopus)

Abstract

This paper presents an approach for hand based micro-gesture recognition in images and videos as part of the Holoscopic Micro-Gesture Recognition (HoMGR) challenge. The database consists of Holoscopic 3D Micro-Gesture images and videos. The proposed framework is an ensemble of convolutional neural network and deep neural network. The framework performs feature fusion technique on both handcrafted (local phase quantization) and deep features extracted from the neural network, to leverage on complimentary information. The powerful discriminative nature of the fused features has proved beneficial on the given HoMGR challenge data. The experiments show that the proposed approach is effective and outperforms the baseline on the Test set by an absolute margin of 26.67% for images and 2.47% for videos, respectively.

Original languageEnglish
Title of host publicationProceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018
Subtitle of host publication15–19 May 2018 Xi’an, China
EditorsSidney D’Mello, Louis‐Philippe Morency, Michel Valstar, Lijun Yin
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages808-814
Number of pages7
ISBN (Electronic)9781538623350
ISBN (Print)9781538623367
DOIs
Publication statusPublished - 2018
Externally publishedYes
EventIEEE International Conference on Automatic Face and Gesture Recognition 2018 - Xi'an, China
Duration: 15 May 201819 May 2018
Conference number: 13th
https://fg2018.cse.sc.edu/

Conference

ConferenceIEEE International Conference on Automatic Face and Gesture Recognition 2018
Abbreviated titleFG 2018
CountryChina
CityXi'an
Period15/05/1819/05/18
Internet address

Keywords

  • Holoscopy
  • Micro gesture recognition

Cite this

Sharma, G., Jyoti, S., & Dhall, A. (2018). Hybrid neural networks based approach for Holoscopic Micro-Gesture Recognition in images and videos. In S. D’Mello, LP. Morency, M. Valstar, & L. Yin (Eds.), Proceedings - 13th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2018: 15–19 May 2018 Xi’an, China (pp. 808-814). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/FG.2018.00130