Gluey: developing a head-worn display interface to unify the interaction experience in distributed display environments

Marcos Serrano, Barrett Ens, Xing-Dong Yang, Pourang Irani

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

25 Citations (Scopus)


Distributed display environments (DDEs) allow use of various specialized devices but challenge designers to provide a clean flow of data across multiple displays. Upcoming consumer-ready head-worn displays (HWDs) can play a central role in unifying the interaction experience in such ecosystems. In this paper, we report on the design and development of Gluey, a user interface that acts as a 'glue' to facilitate seamless input transitions and data movement across displays. Based on requirements we refine for such an interface, Gluey leverages inherent headworn display attributes such as field-of-view tracking and an always-available canvas to redirect input and migrate content across multiple displays, while minimizing device switching costs. We implemented a functional prototype integrating Gluey's numerous interaction possibilities. From our experience in this integration and from user evaluation results, we identify the open challenges in using HWDs to unify the interaction experience in DDEs.

Original languageEnglish
Title of host publicationMobileHCI 2015 - Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services
Subtitle of host publicationCopenhagen, Denmark August 24-27, 2015
EditorsHans Gellersen, Ken Hinckley
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages11
ISBN (Electronic)9781450336529
Publication statusPublished - 2015
Externally publishedYes
EventMobile Collocated Interactions with Wearables 2015 - Copenhagen, Denmark
Duration: 24 Aug 201527 Aug 2015
Conference number: 17th


ConferenceMobile Collocated Interactions with Wearables 2015
Abbreviated titleMobile HCI 2015
Internet address


  • Content migration
  • Distributed displays
  • Head-worn display
  • Input redirection
  • Multi-display environments

Cite this