EmotiW 2016: video and group-level emotion recognition challenges

Abhinav Dhall; Roland Goecke; Jyoti Joshi; Jesse Hoey; Tom Gedeon

doi:10.1145/2993148.2997638

EmotiW 2016: video and group-level emotion recognition challenges

Abhinav Dhall, Roland Goecke, Jyoti Joshi, Jesse Hoey, Tom Gedeon

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Other

81 Citations (Scopus)

Abstract

This paper discusses the baseline for the Emotion Recognition in the Wild (EmotiW) 2016 challenge. Continuing on the theme of automatic affect recognition in the wild', the Emoti W challenge 2016 consists of two sub-challenges: An audio-video based emotion and a new group-based emotion recognition sub-challenges. The audio-video based subchallenge is based on the Acted Facial Expressions in the Wild (AFEW) database. The group-based emotion recognition sub-challenge is based on the Happy People Images (HAPPEI) database. We describe the data, baseline method, challenge protocols and the challenge results. A total of 22 and 7 teams participated in the audio-video based emotion and group-based emotion sub-challenges, respectively.

Original language	English
Title of host publication	ICMI'16 - Proceedings of the 18th ACM International Conference on Multimodal Interaction
Subtitle of host publication	November 12–16, 2016 Tokyo, Japan
Editors	Louis-Philippe Morency, Carlos Busso, Catherine Pelachaud
Place of Publication	New York NY USA
Publisher	Association for Computing Machinery (ACM)
Pages	427-432
Number of pages	6
ISBN (Electronic)	9781450345569
DOIs	https://doi.org/10.1145/2993148.2997638
Publication status	Published - 2016
Externally published	Yes
Event	ACM International Conference on Multimodal Interaction 2016 - Tokyo, Japan Duration: 12 Nov 2016 → 16 Nov 2016 Conference number: 18th http://icmi.acm.org/2016/

Conference

Conference	ACM International Conference on Multimodal Interaction 2016
Abbreviated title	ICMI 2016
Country	Japan
City	Tokyo
Period	12/11/16 → 16/11/16
Internet address	http://icmi.acm.org/2016/

Keywords

Affect analysis in the wild
Audio-video data corpus
Emotion recognition
Facial expression challenge
Group-level emotion recognition

Access to Document

10.1145/2993148.2997638

Link to publication in Scopus

Cite this

Dhall, A., Goecke, R., Joshi, J., Hoey, J., & Gedeon, T. (2016). EmotiW 2016: video and group-level emotion recognition challenges. In L-P. Morency, C. Busso, & C. Pelachaud (Eds.), ICMI'16 - Proceedings of the 18th ACM International Conference on Multimodal Interaction: November 12–16, 2016 Tokyo, Japan (pp. 427-432). Association for Computing Machinery (ACM). https://doi.org/10.1145/2993148.2997638

Dhall, Abhinav ; Goecke, Roland ; Joshi, Jyoti ; Hoey, Jesse ; Gedeon, Tom. / EmotiW 2016 : video and group-level emotion recognition challenges. ICMI'16 - Proceedings of the 18th ACM International Conference on Multimodal Interaction: November 12–16, 2016 Tokyo, Japan . editor / Louis-Philippe Morency ; Carlos Busso ; Catherine Pelachaud. New York NY USA : Association for Computing Machinery (ACM), 2016. pp. 427-432

@inproceedings{b5c55397073e408c84b5d33a46714b0c,

title = "EmotiW 2016: video and group-level emotion recognition challenges",

abstract = "This paper discusses the baseline for the Emotion Recognition in the Wild (EmotiW) 2016 challenge. Continuing on the theme of automatic affect recognition in the wild', the Emoti W challenge 2016 consists of two sub-challenges: An audio-video based emotion and a new group-based emotion recognition sub-challenges. The audio-video based subchallenge is based on the Acted Facial Expressions in the Wild (AFEW) database. The group-based emotion recognition sub-challenge is based on the Happy People Images (HAPPEI) database. We describe the data, baseline method, challenge protocols and the challenge results. A total of 22 and 7 teams participated in the audio-video based emotion and group-based emotion sub-challenges, respectively.",

keywords = "Affect analysis in the wild, Audio-video data corpus, Emotion recognition, Facial expression challenge, Group-level emotion recognition",

author = "Abhinav Dhall and Roland Goecke and Jyoti Joshi and Jesse Hoey and Tom Gedeon",

year = "2016",

doi = "10.1145/2993148.2997638",

language = "English",

pages = "427--432",

editor = "Louis-Philippe Morency and Carlos Busso and Catherine Pelachaud",

booktitle = "ICMI'16 - Proceedings of the 18th ACM International Conference on Multimodal Interaction",

publisher = "Association for Computing Machinery (ACM)",

address = "United States of America",

note = "ACM International Conference on Multimodal Interaction 2016, ICMI 2016 ; Conference date: 12-11-2016 Through 16-11-2016",

url = "http://icmi.acm.org/2016/",

}

Dhall, A, Goecke, R, Joshi, J, Hoey, J & Gedeon, T 2016, EmotiW 2016: video and group-level emotion recognition challenges. in L-P Morency, C Busso & C Pelachaud (eds), ICMI'16 - Proceedings of the 18th ACM International Conference on Multimodal Interaction: November 12–16, 2016 Tokyo, Japan . Association for Computing Machinery (ACM), New York NY USA, pp. 427-432, ACM International Conference on Multimodal Interaction 2016, Tokyo, Japan, 12/11/16. https://doi.org/10.1145/2993148.2997638

EmotiW 2016 : video and group-level emotion recognition challenges. / Dhall, Abhinav; Goecke, Roland; Joshi, Jyoti; Hoey, Jesse; Gedeon, Tom.

ICMI'16 - Proceedings of the 18th ACM International Conference on Multimodal Interaction: November 12–16, 2016 Tokyo, Japan . ed. / Louis-Philippe Morency; Carlos Busso; Catherine Pelachaud. New York NY USA : Association for Computing Machinery (ACM), 2016. p. 427-432.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Other

TY - GEN

T1 - EmotiW 2016

T2 - ACM International Conference on Multimodal Interaction 2016

AU - Dhall, Abhinav

AU - Goecke, Roland

AU - Joshi, Jyoti

AU - Hoey, Jesse

AU - Gedeon, Tom

N1 - Conference code: 18th

PY - 2016

Y1 - 2016

N2 - This paper discusses the baseline for the Emotion Recognition in the Wild (EmotiW) 2016 challenge. Continuing on the theme of automatic affect recognition in the wild', the Emoti W challenge 2016 consists of two sub-challenges: An audio-video based emotion and a new group-based emotion recognition sub-challenges. The audio-video based subchallenge is based on the Acted Facial Expressions in the Wild (AFEW) database. The group-based emotion recognition sub-challenge is based on the Happy People Images (HAPPEI) database. We describe the data, baseline method, challenge protocols and the challenge results. A total of 22 and 7 teams participated in the audio-video based emotion and group-based emotion sub-challenges, respectively.

AB - This paper discusses the baseline for the Emotion Recognition in the Wild (EmotiW) 2016 challenge. Continuing on the theme of automatic affect recognition in the wild', the Emoti W challenge 2016 consists of two sub-challenges: An audio-video based emotion and a new group-based emotion recognition sub-challenges. The audio-video based subchallenge is based on the Acted Facial Expressions in the Wild (AFEW) database. The group-based emotion recognition sub-challenge is based on the Happy People Images (HAPPEI) database. We describe the data, baseline method, challenge protocols and the challenge results. A total of 22 and 7 teams participated in the audio-video based emotion and group-based emotion sub-challenges, respectively.

KW - Affect analysis in the wild

KW - Audio-video data corpus

KW - Emotion recognition

KW - Facial expression challenge

KW - Group-level emotion recognition

UR - http://www.scopus.com/inward/record.url?scp=85016619930&partnerID=8YFLogxK

U2 - 10.1145/2993148.2997638

DO - 10.1145/2993148.2997638

M3 - Conference Paper

AN - SCOPUS:85016619930

SP - 427

EP - 432

BT - ICMI'16 - Proceedings of the 18th ACM International Conference on Multimodal Interaction

A2 - Morency, Louis-Philippe

A2 - Busso, Carlos

A2 - Pelachaud, Catherine

PB - Association for Computing Machinery (ACM)

CY - New York NY USA

Y2 - 12 November 2016 through 16 November 2016

ER -

Dhall A, Goecke R, Joshi J, Hoey J, Gedeon T. EmotiW 2016: video and group-level emotion recognition challenges. In Morency L-P, Busso C, Pelachaud C, editors, ICMI'16 - Proceedings of the 18th ACM International Conference on Multimodal Interaction: November 12–16, 2016 Tokyo, Japan . New York NY USA: Association for Computing Machinery (ACM). 2016. p. 427-432 https://doi.org/10.1145/2993148.2997638