Skip to main navigation Skip to search Skip to main content

Survey on emotion sensing using mobile devices

  • Kangning Yang
  • , Benjamin Tag
  • , Chaofan Wang
  • , Yue Gu
  • , Zhanna Sarsenbayeva
  • , Tilman Dingler
  • , Greg Wadley
  • , Jorge Goncalves

Research output: Contribution to journalArticleOtherpeer-review

Abstract

The rapid development and ubiquity of mobile and wearable devices promises to enable researchers to monitor users&#x0027; granular emotional data in a less intrusive manner. Researchers have used a wide variety of mobile and wearable devices for this purpose, and have proposed various approaches to sense users&#x0027; emotional states. In this survey, we utilise three established digital libraries (<italic>ACM Digital Library</italic>, <italic>IEEE Xplore Digital Library</italic>, and <italic>Springer Nature</italic>). We analysed and critically assessed the different approaches used in the three stages (perception, learning, inference) of a typical mobile emotion sensing framework, following a structured paper selection process. The contribution of this survey is three-fold; first, we document all the latest relevant literature on mobile emotion sensing research; second, we describe how mobile and wearable devices use their sensing and computing capabilities to monitor human emotions; third, we discuss challenges and opportunities of mobile emotion sensing to demonstrate the potential of this thriving field of research.

Original languageEnglish
Pages (from-to)2678-2696
Number of pages19
JournalIEEE Transactions on Affective Computing
Volume14
Issue number4
DOIs
Publication statusPublished - 1 Oct 2023
Externally publishedYes

Keywords

  • Affective computing
  • Biomedical monitoring
  • Cameras
  • Emotion recognition
  • inference
  • learning
  • mobile emotion sensing
  • Monitoring
  • perception
  • Sensor systems
  • Sensors
  • Smart phones
  • Your phone, your emotions and everyday life

    Tag, B., Wadley, G., Koval, P., Kostakos, V., Gross, J., Cox, A. L., Goncalves, J., Sarsenbayeva, Z., Smith, W., Webber, S., Yang, K., Shi, Y. & Lowe-Brown, X.

    20/06/2320/07/23

    3 items of Media coverage, 1 Media contribution

    Press/Media: Article/Feature

Cite this