GraphEx: facial action unit graph for micro-expression classification

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

1 Citation (Scopus)

Abstract

Facial micro-expressions are crucial cues for expressing human emotions. Existing works have shown substantial progress in detecting micro-expressions for various applications in the computer vision field. However, it is still onerous for existing methods to handle and interpret micro-expressions efficiently. This paper proposes a deep learning-based approach leveraging spatio-temporal and graph representation learning for micro-expression classification. We design a novel Spatial-Temporal Info Extraction Network (STIENet) for learning facial appearance and muscle motion from high dimensional video clip frames and summarizes them into more meaningful feature maps. We construct an action unit (AU) relation graph to further represent the AU co-occurrence in the same micro-expression video clip. A graph neural network (GNN) is used to learn AU-related graph embedding for the downstream classification task. Performance evaluation on two mainstream micro-expression datasets, i.e., CASME II and SAMM, show that the proposed framework outperforms other state-of-the-art methods for micro-expression classification.

Original languageEnglish
Title of host publication2022 IEEE International Conference on Image Processing - Proceedings
EditorsGiuseppe Valenzise, Thomas Maugey
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages3296-3300
Number of pages5
ISBN (Electronic)9781665496209
ISBN (Print)9781665496216
DOIs
Publication statusPublished - 2022
EventIEEE International Conference on Image Processing 2022 - Bordeaux, France
Duration: 16 Oct 202219 Oct 2022
Conference number: 29th
https://ieeexplore.ieee.org/xpl/conhome/9897158/proceeding (Proceedings)

Publication series

NameProceedings - International Conference on Image Processing, ICIP
PublisherIEEE, Institute of Electrical and Electronics Engineers
ISSN (Print)1522-4880
ISSN (Electronic)2381-8549

Conference

ConferenceIEEE International Conference on Image Processing 2022
Abbreviated titleICIP 2022
Country/TerritoryFrance
CityBordeaux
Period16/10/2219/10/22
Internet address

Keywords

  • Facial action units
  • graph convolutional network
  • micro-expression recognition
  • relation graph

Cite this