EmotiW 2016: video and group-level emotion recognition challenges

Abhinav Dhall, Roland Goecke, Jyoti Joshi, Jesse Hoey, Tom Gedeon

Research output: Chapter in Book/Report/Conference proceedingConference PaperOther

126 Citations (Scopus)


This paper discusses the baseline for the Emotion Recognition in the Wild (EmotiW) 2016 challenge. Continuing on the theme of automatic affect recognition in the wild', the Emoti W challenge 2016 consists of two sub-challenges: An audio-video based emotion and a new group-based emotion recognition sub-challenges. The audio-video based subchallenge is based on the Acted Facial Expressions in the Wild (AFEW) database. The group-based emotion recognition sub-challenge is based on the Happy People Images (HAPPEI) database. We describe the data, baseline method, challenge protocols and the challenge results. A total of 22 and 7 teams participated in the audio-video based emotion and group-based emotion sub-challenges, respectively.

Original languageEnglish
Title of host publicationICMI'16 - Proceedings of the 18th ACM International Conference on Multimodal Interaction
Subtitle of host publicationNovember 12–16, 2016 Tokyo, Japan
EditorsLouis-Philippe Morency, Carlos Busso, Catherine Pelachaud
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages6
ISBN (Electronic)9781450345569
Publication statusPublished - 2016
Externally publishedYes
EventInternational Conference on Multimodal Interfaces 2016 - Tokyo, Japan
Duration: 12 Nov 201616 Nov 2016
Conference number: 18th
https://dl.acm.org/doi/proceedings/10.1145/2993148 (Proceedings)


ConferenceInternational Conference on Multimodal Interfaces 2016
Abbreviated titleICMI 2016
Internet address


  • Affect analysis in the wild
  • Audio-video data corpus
  • Emotion recognition
  • Facial expression challenge
  • Group-level emotion recognition

Cite this