Automatic apex frame spotting in micro-expression database

Sze-Teng Liong, John See, KokSheik Wong, Anh Cat Le Ngo, Yee-Hui Oh, Raphael Phan

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

30 Citations (Scopus)


Micro-expression usually occurs at high-stakes situations and may provide useful information in the field of behavioral psychology for better interpretion and analysis. Unfortunately, it is technically challenging to detect and recognize micro-expressions due to its brief duration and the subtle facial distortions. Apex frame, which is the instant indicating the most expressive emotional state in a video, is effective to classify the emotion in that particular frame. In this work, we present a novel method to spot the apex frame of a spontaneous micro-expression video sequence. A binary search approach is employed to locate the index of the frame in which the peak facial changes occur. Features from specific facial regions are extracted to better represent and describe the expression details. The defined facial regions are selected based on the action unit and landmark coordinates of the subject, in which case these processes are automated. We consider three distinct feature descriptors to evaluate the reliability of the proposed approach. Improvements of at least 20% are achieved when compared to the baselines.

Original languageEnglish
Title of host publicationProceedings - 3rd IAPR Asian Conference on Pattern Recognition, ACPR 2015
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages5
ISBN (Electronic)9781479961009
Publication statusPublished - 2015
Externally publishedYes
EventIAPR Asian Conference on Pattern Recognition (ACPR) 2015 - Kuala Lumpur, Malaysia
Duration: 3 Nov 20166 Nov 2016
Conference number: 3rd (Proceedings)


ConferenceIAPR Asian Conference on Pattern Recognition (ACPR) 2015
Abbreviated titleACPR 2015
CityKuala Lumpur
Internet address

Cite this