AI-mediated gaze-based intention recognition for smart eyewear: opportunities & challenges

Joshua Newn, Benjamin Tag, Ronal Singh, Eduardo Velloso, Frank Vetere

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearch

2 Citations (Scopus)

Abstract

Commercial smart eyewear products designed for day-today use have drastically improved in recent years. However, the current utility and applications of smart eyewear can be easily substituted with other smart wearables. In this paper, we propose the integration of an artificial agent capable of performing gaze-based intention recognition on smart eyewear to extend the device capabilities. As smart eyewear affords unobtrusive tracking of the user’s gaze while the user interacts naturally with the world, it serves as a perfect platform to discreetly identify the user’s intentions through gaze, allowing the agent to provide relevant, personalised and proactive assistance. We believe that integration our proposed agent in smart eyewear is an achievable goal in the coming years with the rapid progressions in computer vision, wearable technology and socially interactive artificial agents. This paper, therefore, discusses our proof-of-concept intention-aware agent, followed by its future opportunities and existing challenges for its integration in smart eyewear.

Original languageEnglish
Title of host publicationAdjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers
EditorsSaeed Abdullah
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Pages637-642
Number of pages6
ISBN (Electronic)9781450368698
DOIs
Publication statusPublished - 2019
Externally publishedYes
EventEyewear 2019: Third workshop on eyewear computing - 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing
Duration: 9 Sept 20199 Sept 2019
Conference number: 3rd
https://dl.acm.org/doi/10.1145/3341162.3347761 (Proceedings)
https://eyewear.pro/eyewear2019/ (Website)

Workshop

WorkshopEyewear 2019
Period9/09/199/09/19
Internet address

Keywords

  • Eyewear
  • Gaze tracking
  • Intention recognition
  • Wearables

Cite this