Multimodal decomposition for enhanced subtle emotion recognition

Zun-Ci Lee; Raphael C.-W. Phan; Su-Wei Tan; Kuan-Heng Lee

doi:10.1109/APSIPA.2017.8282117

Multimodal decomposition for enhanced subtle emotion recognition

Zun-Ci Lee, Raphael C.-W. Phan, Su-Wei Tan, Kuan-Heng Lee

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research

2 Citations (Scopus)

Abstract

True human emotions may be revealed during brief moments of minute facial muscle movements. These so-called subtle emotions are low in intensity, sparse and short duration in nature. Despite such tiny presence, subtle emotions have shown to be useful for real-life applications including lie detection and clinical diagnosis. In this paper, we present a processing technique based on multimodal decomposition and emotion magnification that is viable to decompose and subsequently emphasize highly discriminative subtle emotions information. Through this method, promising results of 25-30% improvement in recognition performance are achieved. By further magnifying the decomposed emotion components, the subtle emotions intensity can be increased and further boost recognition performance by 3-4%.

Original language	English
Title of host publication	Proceedings - Ninth Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017
Editors	Chang-Su Kim, Wai Lam Hoo
Place of Publication	Piscataway NJ USA
Publisher	IEEE, Institute of Electrical and Electronics Engineers
Pages	665-671
Number of pages	7
ISBN (Electronic)	9781538615423, 9781538615416
ISBN (Print)	9781538615430
DOIs	https://doi.org/10.1109/APSIPA.2017.8282117
Publication status	Published - 2017
Externally published	Yes
Event	Annual Summit and Conference of the Asia-Pacific-Signal-and-Information-Processing-Association (APSIPA) 2017 - Kuala Lumpur, Malaysia Duration: 12 Dec 2017 → 15 Dec 2017 Conference number: 9th https://ieeexplore.ieee.org/xpl/conhome/8270695/proceeding (Proceedings)

Conference

Conference	Annual Summit and Conference of the Asia-Pacific-Signal-and-Information-Processing-Association (APSIPA) 2017
Abbreviated title	APSIPA ASC 2017
Country/Territory	Malaysia
City	Kuala Lumpur
Period	12/12/17 → 15/12/17
Internet address	https://ieeexplore.ieee.org/xpl/conhome/8270695/proceeding (Proceedings)

Keywords

Decomposition
Intensity
Magnification
Micro-expression recognition
Subtle emotion

Access to Document

10.1109/APSIPA.2017.8282117

Cite this

Lee, Z.-C., Phan, R. C.-W., Tan, S.-W., & Lee, K.-H. (2017). Multimodal decomposition for enhanced subtle emotion recognition. In C.-S. Kim, & W. Lam Hoo (Eds.), Proceedings - Ninth Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017 (pp. 665-671). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/APSIPA.2017.8282117

Lee, Zun-Ci ; Phan, Raphael C.-W. ; Tan, Su-Wei et al. / Multimodal decomposition for enhanced subtle emotion recognition. Proceedings - Ninth Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017. editor / Chang-Su Kim ; Wai Lam Hoo. Piscataway NJ USA : IEEE, Institute of Electrical and Electronics Engineers, 2017. pp. 665-671

@inproceedings{0827ab13fd4a40e7a8866aed9b82587e,

title = "Multimodal decomposition for enhanced subtle emotion recognition",

abstract = "True human emotions may be revealed during brief moments of minute facial muscle movements. These so-called subtle emotions are low in intensity, sparse and short duration in nature. Despite such tiny presence, subtle emotions have shown to be useful for real-life applications including lie detection and clinical diagnosis. In this paper, we present a processing technique based on multimodal decomposition and emotion magnification that is viable to decompose and subsequently emphasize highly discriminative subtle emotions information. Through this method, promising results of 25-30\% improvement in recognition performance are achieved. By further magnifying the decomposed emotion components, the subtle emotions intensity can be increased and further boost recognition performance by 3-4\%.",

keywords = "Decomposition, Intensity, Magnification, Micro-expression recognition, Subtle emotion",

author = "Zun-Ci Lee and Phan, \{Raphael C.-W.\} and Su-Wei Tan and Kuan-Heng Lee",

note = "Publisher Copyright: {\textcopyright} 2017 IEEE. Copyright: Copyright 2018 Elsevier B.V., All rights reserved.; Annual Summit and Conference of the Asia-Pacific-Signal-and-Information-Processing-Association (APSIPA) 2017, APSIPA ASC 2017 ; Conference date: 12-12-2017 Through 15-12-2017",

year = "2017",

doi = "10.1109/APSIPA.2017.8282117",

language = "English",

isbn = "9781538615430",

pages = "665--671",

editor = "Chang-Su Kim and \{Lam Hoo\}, Wai",

booktitle = "Proceedings - Ninth Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017",

publisher = "IEEE, Institute of Electrical and Electronics Engineers",

address = "United States of America",

url = "https://ieeexplore.ieee.org/xpl/conhome/8270695/proceeding",

}

Lee, Z-C, Phan, RC-W, Tan, S-W & Lee, K-H 2017, Multimodal decomposition for enhanced subtle emotion recognition. in C-S Kim & W Lam Hoo (eds), Proceedings - Ninth Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017. IEEE, Institute of Electrical and Electronics Engineers, Piscataway NJ USA, pp. 665-671, Annual Summit and Conference of the Asia-Pacific-Signal-and-Information-Processing-Association (APSIPA) 2017, Kuala Lumpur, Malaysia, 12/12/17. https://doi.org/10.1109/APSIPA.2017.8282117

Multimodal decomposition for enhanced subtle emotion recognition. / Lee, Zun-Ci; Phan, Raphael C.-W.; Tan, Su-Wei et al.
Proceedings - Ninth Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017. ed. / Chang-Su Kim; Wai Lam Hoo. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers, 2017. p. 665-671.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research

TY - GEN

T1 - Multimodal decomposition for enhanced subtle emotion recognition

AU - Lee, Zun-Ci

AU - Phan, Raphael C.-W.

AU - Tan, Su-Wei

AU - Lee, Kuan-Heng

N1 - Conference code: 9th

PY - 2017

Y1 - 2017

N2 - True human emotions may be revealed during brief moments of minute facial muscle movements. These so-called subtle emotions are low in intensity, sparse and short duration in nature. Despite such tiny presence, subtle emotions have shown to be useful for real-life applications including lie detection and clinical diagnosis. In this paper, we present a processing technique based on multimodal decomposition and emotion magnification that is viable to decompose and subsequently emphasize highly discriminative subtle emotions information. Through this method, promising results of 25-30% improvement in recognition performance are achieved. By further magnifying the decomposed emotion components, the subtle emotions intensity can be increased and further boost recognition performance by 3-4%.

AB - True human emotions may be revealed during brief moments of minute facial muscle movements. These so-called subtle emotions are low in intensity, sparse and short duration in nature. Despite such tiny presence, subtle emotions have shown to be useful for real-life applications including lie detection and clinical diagnosis. In this paper, we present a processing technique based on multimodal decomposition and emotion magnification that is viable to decompose and subsequently emphasize highly discriminative subtle emotions information. Through this method, promising results of 25-30% improvement in recognition performance are achieved. By further magnifying the decomposed emotion components, the subtle emotions intensity can be increased and further boost recognition performance by 3-4%.

KW - Decomposition

KW - Intensity

KW - Magnification

KW - Micro-expression recognition

KW - Subtle emotion

UR - https://www.scopus.com/pages/publications/85049914975

U2 - 10.1109/APSIPA.2017.8282117

DO - 10.1109/APSIPA.2017.8282117

M3 - Conference Paper

AN - SCOPUS:85049914975

SN - 9781538615430

SP - 665

EP - 671

BT - Proceedings - Ninth Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017

A2 - Kim, Chang-Su

A2 - Lam Hoo, Wai

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - Piscataway NJ USA

T2 - Annual Summit and Conference of the Asia-Pacific-Signal-and-Information-Processing-Association (APSIPA) 2017

Y2 - 12 December 2017 through 15 December 2017

ER -

Lee ZC, Phan RCW, Tan SW, Lee KH. Multimodal decomposition for enhanced subtle emotion recognition. In Kim CS, Lam Hoo W, editors, Proceedings - Ninth Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers. 2017. p. 665-671 doi: 10.1109/APSIPA.2017.8282117

Multimodal decomposition for enhanced subtle emotion recognition

Abstract

Conference

Keywords

Access to Document

Other files and links

Cite this