Abstract
Human emotion recognition has been widely used and intensively studied in many areas such as e-Commerce, online education, healthcare, human-computer interaction and recently human-centric software engineering (HCSE). HCSE investigates human factors in the entire software development lifecycle, and human emotion can be used in many scenarios such as requirement gathering and usability testing. However, even though existing studies have already shown the advantages of emotion recognition with multi-source data such as text, audio and video, the current research and practice in HCSE are primarily based on single-source data. In addition, emotion recognition in HCSE faces several challenges such as multiple participants, changing environments and real-time requirement. To tackle these challenges, this paper proposes Edge4Emotion, a novel edge computing-based multisource human emotion recognition platform for HCSE. Edge4Emotion takes the advantage of the edge computing paradigm to efficiently support the collection of multi-source data such as audio, video and physiological data from various IoT devices, and emotion recognition with both single- and multisource models. As an on-going project, this paper focuses on the platform design and the preliminary evaluation of the platform with representative emotion recognition applications. The platform will be further extended to include more multi-source learning models and serve as an open-source platform for the development and evaluation of multi-source emotion recognition models for HCSE.
Original language | English |
---|---|
Title of host publication | Proceedings - 21st IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing, CCGrid 2021 |
Editors | Laurent Lefevre, Stacy Patterson, Young Choon Lee, Haiying Shen, Shashikant Ilager, Mohammad Goudarzi, Adel N. Toosi, Rajkumar Buyya |
Place of Publication | Piscataway NJ USA |
Publisher | IEEE, Institute of Electrical and Electronics Engineers |
Pages | 610-613 |
Number of pages | 4 |
ISBN (Electronic) | 9781728195865 |
ISBN (Print) | 9781728195872 |
DOIs | |
Publication status | Published - 2021 |
Externally published | Yes |
Event | IEEE International Symposium on Cluster, Cloud and Internet Computing 2021 - Online, Melbourne, Australia Duration: 10 May 2021 → 13 May 2021 Conference number: 21st https://ieeexplore.ieee.org/xpl/conhome/9499314/proceeding (Proceedings) http://cloudbus.org/ccgrid2021/ (Website) |
Conference
Conference | IEEE International Symposium on Cluster, Cloud and Internet Computing 2021 |
---|---|
Abbreviated title | CCGrid 2021 |
Country/Territory | Australia |
City | Melbourne |
Period | 10/05/21 → 13/05/21 |
Internet address |
|
Keywords
- Edge Computing
- Emotion Recognition
- Human-Centric Software Engineering
- Multi-source
- Multisource