Continuous facial expression recognition for affective interaction with virtual avatar

Zhengkun Shang, Jyoti Joshi, Jesse Hoey

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

Affect-Sensitive Human-Computer Interaction is enjoying growing attention. Emotions are an essential part of interaction, whether it is between humans or human and machine. This paper analyses the interaction of a user with four different virtual avatars, each manifesting distinct emotional displays, based on the principles of Affect Control Theory. Facial expressions are represented as a vector in a 3D continuous space and different sets of static visual features are evaluated for facial expression recognition. A probabilistic framework is used to simulate the interaction between the user and the virtual avatar. The results demonstrate that the probabilistic framework enables the system to perceive user's and agent's feelings.

Original languageEnglish
Title of host publication2017 IEEE International Conference on Image Processing - Proceedings
EditorsJiebo Luo, Wenjun Zeng, Yu-Jin Zhang
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages1995-1999
Number of pages5
ISBN (Electronic)9781509021758, 9781509021741
ISBN (Print)9781509021765
DOIs
Publication statusPublished - 2017
Externally publishedYes
EventIEEE International Conference on Image Processing 2017 - China National Convention Center (CNCC), Beijing, China
Duration: 17 Sep 201720 Sep 2017
Conference number: 24th
http://www.2017.ieeeicip.org/
http://2017.ieeeicip.org/

Conference

ConferenceIEEE International Conference on Image Processing 2017
Abbreviated titleICIP 2017
CountryChina
CityBeijing
Period17/09/1720/09/17
Internet address

Keywords

  • Affect Control Theory
  • Affective Computing
  • Emotion
  • Facial Expression
  • Human Computer Interaction

Cite this

Shang, Z., Joshi, J., & Hoey, J. (2017). Continuous facial expression recognition for affective interaction with virtual avatar. In J. Luo, W. Zeng, & Y-J. Zhang (Eds.), 2017 IEEE International Conference on Image Processing - Proceedings (pp. 1995-1999). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICIP.2017.8296631