Automatic Group Level Affect and cohesion prediction in videos

Garima Sharma, Shreya Ghosh, Abhinav Dhall

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearch

Abstract

This paper proposes a database for group level emotion recognition in videos. The motivation is coming from the large number of information which the users are sharing online. This gives us the opportunity to use this perceived affect for various tasks. Most of the work in this area has been restricted to controlled environments. In this paper, we explore the group level emotion and cohesion in a real-world environment. There are several challenges involved in moving from a controlled environment to real-world scenarios such as face tracking limitations, illumination variations, occlusion and type of gatherings. As an attempt to address these challenges, we propose a 'Video level Group AFfect (VGAF), database containing 1, 004 videos downloaded from the web. The collected videos have a large variations in terms of gender, ethnicity, the type of social event, number of people, pose, etc. We have labelled our database for group level emotion and cohesion tasks and proposed a baseline based on the Inception V3 network on the database.

Original languageEnglish
Title of host publicationInternational Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) 2019
EditorsNadia Bianchi-Berthouze, Julien Epps, Andrea Kleinsmith, Picard Rosalind
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages161-167
Number of pages7
ISBN (Electronic)9781728138916
ISBN (Print)9781728138923
DOIs
Publication statusPublished - 2019
EventInternational Conference on Affective Computing and Intelligent Interaction Workshops and Demos 2019 - Cambridge, United Kingdom
Duration: 3 Sep 20196 Sep 2019
Conference number: 8th
http://acii-conf.org/2019/workshop-information/

Conference

ConferenceInternational Conference on Affective Computing and Intelligent Interaction Workshops and Demos 2019
Abbreviated titleACIIW 2019
CountryUnited Kingdom
CityCambridge
Period3/09/196/09/19
Internet address

Keywords

  • Context analysis
  • Group Cohesion
  • Group Level Emotion
  • Multimodal affect

Cite this

Sharma, G., Ghosh, S., & Dhall, A. (2019). Automatic Group Level Affect and cohesion prediction in videos. In N. Bianchi-Berthouze, J. Epps, A. Kleinsmith, & P. Rosalind (Eds.), International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) 2019 (pp. 161-167). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ACIIW.2019.8925231