The more the merrier: analysing the affect of a group of people in images

Abhinav Dhall, Jyoti Joshi, Karan Sikka, Roland Goecke, Nicu Sebe

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

45 Citations (Scopus)

Abstract

The recent advancement of social media has given users a platform to socially engage and interact with a global population. With millions of images being uploaded onto social media platforms, there is an increasing interest in inferring the emotion and mood display of a group of people in images. Automatic affect analysis research has come a long way but has traditionally focussed on a single subject in a scene. In this paper, we study the problem of inferring the emotion of a group of people in an image. This group affect has wide applications in retrieval, advertisement, content recommendation and security. The contributions of the paper are: 1) a novel emotion labelled database of groups of people in images; 2) a Multiple Kernel Learning based hybrid affect inference model; 3) a scene context based affect inference model; 4) a user survey to better understand the attributes that affect the perception of affect of a group of people in an image. The detailed experimentation validation provides a rich baseline for the proposed database.

Original languageEnglish
Title of host publication2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG)
EditorsArun Ross, Stan Z. Li, Ioannis A. Kakadiaris, Sinisa Todorovic
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages8
ISBN (Electronic)9781479960262
DOIs
Publication statusPublished - 2015
Externally publishedYes
EventIEEE International Conference on Automatic Face and Gesture Recognition 2015 - Ljubljana, Slovenia
Duration: 4 May 20158 May 2015
Conference number: 11th
https://web.archive.org/web/20150316213121/http://www.fg2015.org/

Conference

ConferenceIEEE International Conference on Automatic Face and Gesture Recognition 2015
Abbreviated titleFG 2015
CountrySlovenia
CityLjubljana
Period4/05/158/05/15
Internet address

Cite this

Dhall, A., Joshi, J., Sikka, K., Goecke, R., & Sebe, N. (2015). The more the merrier: analysing the affect of a group of people in images. In A. Ross, S. Z. Li, I. A. Kakadiaris, & S. Todorovic (Eds.), 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) [7163151] IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/FG.2015.7163151