Edge4Emotion: An edge computing based multi-source emotion recognition platform for human-centric software engineering

Ben Cheng, Owen Wang, Di Shao, Chetan Arora, Thuong Hoang, Xiao Liu

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

5 Citations (Scopus)

Abstract

Human emotion recognition has been widely used and intensively studied in many areas such as e-Commerce, online education, healthcare, human-computer interaction and recently human-centric software engineering (HCSE). HCSE investigates human factors in the entire software development lifecycle, and human emotion can be used in many scenarios such as requirement gathering and usability testing. However, even though existing studies have already shown the advantages of emotion recognition with multi-source data such as text, audio and video, the current research and practice in HCSE are primarily based on single-source data. In addition, emotion recognition in HCSE faces several challenges such as multiple participants, changing environments and real-time requirement. To tackle these challenges, this paper proposes Edge4Emotion, a novel edge computing-based multisource human emotion recognition platform for HCSE. Edge4Emotion takes the advantage of the edge computing paradigm to efficiently support the collection of multi-source data such as audio, video and physiological data from various IoT devices, and emotion recognition with both single- and multisource models. As an on-going project, this paper focuses on the platform design and the preliminary evaluation of the platform with representative emotion recognition applications. The platform will be further extended to include more multi-source learning models and serve as an open-source platform for the development and evaluation of multi-source emotion recognition models for HCSE.

Original languageEnglish
Title of host publicationProceedings - 21st IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing, CCGrid 2021
EditorsLaurent Lefevre, Stacy Patterson, Young Choon Lee, Haiying Shen, Shashikant Ilager, Mohammad Goudarzi, Adel N. Toosi, Rajkumar Buyya
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages610-613
Number of pages4
ISBN (Electronic)9781728195865
ISBN (Print)9781728195872
DOIs
Publication statusPublished - 2021
Externally publishedYes
EventIEEE International Symposium on Cluster, Cloud and Internet Computing 2021 - Online, Melbourne, Australia
Duration: 10 May 202113 May 2021
Conference number: 21st
https://ieeexplore.ieee.org/xpl/conhome/9499314/proceeding (Proceedings)
http://cloudbus.org/ccgrid2021/ (Website)

Conference

ConferenceIEEE International Symposium on Cluster, Cloud and Internet Computing 2021
Abbreviated titleCCGrid 2021
Country/TerritoryAustralia
CityMelbourne
Period10/05/2113/05/21
Internet address

Keywords

  • Edge Computing
  • Emotion Recognition
  • Human-Centric Software Engineering
  • Multi-source
  • Multisource

Cite this