Gluey: developing a head-worn display interface to unify the interaction experience in distributed display environments

Marcos Serrano; Barrett Ens; Xing-Dong Yang; Pourang Irani

doi:10.1145/2785830.2785838

Gluey: developing a head-worn display interface to unify the interaction experience in distributed display environments

Marcos Serrano, Barrett Ens, Xing-Dong Yang, Pourang Irani

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

56 Citations (Scopus)

Abstract

Distributed display environments (DDEs) allow use of various specialized devices but challenge designers to provide a clean flow of data across multiple displays. Upcoming consumer-ready head-worn displays (HWDs) can play a central role in unifying the interaction experience in such ecosystems. In this paper, we report on the design and development of Gluey, a user interface that acts as a 'glue' to facilitate seamless input transitions and data movement across displays. Based on requirements we refine for such an interface, Gluey leverages inherent headworn display attributes such as field-of-view tracking and an always-available canvas to redirect input and migrate content across multiple displays, while minimizing device switching costs. We implemented a functional prototype integrating Gluey's numerous interaction possibilities. From our experience in this integration and from user evaluation results, we identify the open challenges in using HWDs to unify the interaction experience in DDEs.

Original language	English
Title of host publication	MobileHCI 2015 - Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services
Subtitle of host publication	Copenhagen, Denmark August 24-27, 2015
Editors	Hans Gellersen, Ken Hinckley
Place of Publication	New York NY USA
Publisher	Association for Computing Machinery (ACM)
Pages	161-171
Number of pages	11
ISBN (Electronic)	9781450336529
DOIs	https://doi.org/10.1145/2785830.2785838
Publication status	Published - 2015
Externally published	Yes
Event	Mobile Collocated Interactions with Wearables 2015 - Copenhagen, Denmark Duration: 24 Aug 2015 → 27 Aug 2015 Conference number: 17th http://mobilehci.acm.org/2015/

Conference

Conference	Mobile Collocated Interactions with Wearables 2015
Abbreviated title	Mobile HCI 2015
Country/Territory	Denmark
City	Copenhagen
Period	24/08/15 → 27/08/15
Internet address	http://mobilehci.acm.org/2015/

Keywords

Content migration
Distributed displays
Head-worn display
Input redirection
Multi-display environments

Access to Document

10.1145/2785830.2785838

Cite this

Serrano, M., Ens, B., Yang, X.-D., & Irani, P. (2015). Gluey: developing a head-worn display interface to unify the interaction experience in distributed display environments. In H. Gellersen, & K. Hinckley (Eds.), MobileHCI 2015 - Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services: Copenhagen, Denmark August 24-27, 2015 (pp. 161-171). Association for Computing Machinery (ACM). https://doi.org/10.1145/2785830.2785838

Serrano, Marcos ; Ens, Barrett ; Yang, Xing-Dong et al. / Gluey : developing a head-worn display interface to unify the interaction experience in distributed display environments. MobileHCI 2015 - Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services: Copenhagen, Denmark August 24-27, 2015. editor / Hans Gellersen ; Ken Hinckley. New York NY USA : Association for Computing Machinery (ACM), 2015. pp. 161-171

@inproceedings{ba3f5781b3d04f79930d085de57e46c9,

title = "Gluey: developing a head-worn display interface to unify the interaction experience in distributed display environments",

abstract = "Distributed display environments (DDEs) allow use of various specialized devices but challenge designers to provide a clean flow of data across multiple displays. Upcoming consumer-ready head-worn displays (HWDs) can play a central role in unifying the interaction experience in such ecosystems. In this paper, we report on the design and development of Gluey, a user interface that acts as a 'glue' to facilitate seamless input transitions and data movement across displays. Based on requirements we refine for such an interface, Gluey leverages inherent headworn display attributes such as field-of-view tracking and an always-available canvas to redirect input and migrate content across multiple displays, while minimizing device switching costs. We implemented a functional prototype integrating Gluey's numerous interaction possibilities. From our experience in this integration and from user evaluation results, we identify the open challenges in using HWDs to unify the interaction experience in DDEs.",

keywords = "Content migration, Distributed displays, Head-worn display, Input redirection, Multi-display environments",

author = "Marcos Serrano and Barrett Ens and Xing-Dong Yang and Pourang Irani",

year = "2015",

doi = "10.1145/2785830.2785838",

language = "English",

pages = "161--171",

editor = "Gellersen, {Hans } and Hinckley, {Ken }",

booktitle = "MobileHCI 2015 - Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services",

publisher = "Association for Computing Machinery (ACM)",

address = "United States of America",

note = "Mobile Collocated Interactions with Wearables 2015, Mobile HCI 2015 ; Conference date: 24-08-2015 Through 27-08-2015",

url = "http://mobilehci.acm.org/2015/",

}

Serrano, M, Ens, B, Yang, X-D & Irani, P 2015, Gluey: developing a head-worn display interface to unify the interaction experience in distributed display environments. in H Gellersen & K Hinckley (eds), MobileHCI 2015 - Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services: Copenhagen, Denmark August 24-27, 2015. Association for Computing Machinery (ACM), New York NY USA, pp. 161-171, Mobile Collocated Interactions with Wearables 2015, Copenhagen, Denmark, 24/08/15. https://doi.org/10.1145/2785830.2785838

Gluey: developing a head-worn display interface to unify the interaction experience in distributed display environments. / Serrano, Marcos; Ens, Barrett; Yang, Xing-Dong et al.
MobileHCI 2015 - Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services: Copenhagen, Denmark August 24-27, 2015. ed. / Hans Gellersen; Ken Hinckley. New York NY USA: Association for Computing Machinery (ACM), 2015. p. 161-171.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Gluey

T2 - Mobile Collocated Interactions with Wearables 2015

AU - Serrano, Marcos

AU - Ens, Barrett

AU - Yang, Xing-Dong

AU - Irani, Pourang

N1 - Conference code: 17th

PY - 2015

Y1 - 2015

N2 - Distributed display environments (DDEs) allow use of various specialized devices but challenge designers to provide a clean flow of data across multiple displays. Upcoming consumer-ready head-worn displays (HWDs) can play a central role in unifying the interaction experience in such ecosystems. In this paper, we report on the design and development of Gluey, a user interface that acts as a 'glue' to facilitate seamless input transitions and data movement across displays. Based on requirements we refine for such an interface, Gluey leverages inherent headworn display attributes such as field-of-view tracking and an always-available canvas to redirect input and migrate content across multiple displays, while minimizing device switching costs. We implemented a functional prototype integrating Gluey's numerous interaction possibilities. From our experience in this integration and from user evaluation results, we identify the open challenges in using HWDs to unify the interaction experience in DDEs.

AB - Distributed display environments (DDEs) allow use of various specialized devices but challenge designers to provide a clean flow of data across multiple displays. Upcoming consumer-ready head-worn displays (HWDs) can play a central role in unifying the interaction experience in such ecosystems. In this paper, we report on the design and development of Gluey, a user interface that acts as a 'glue' to facilitate seamless input transitions and data movement across displays. Based on requirements we refine for such an interface, Gluey leverages inherent headworn display attributes such as field-of-view tracking and an always-available canvas to redirect input and migrate content across multiple displays, while minimizing device switching costs. We implemented a functional prototype integrating Gluey's numerous interaction possibilities. From our experience in this integration and from user evaluation results, we identify the open challenges in using HWDs to unify the interaction experience in DDEs.

KW - Content migration

KW - Distributed displays

KW - Head-worn display

KW - Input redirection

KW - Multi-display environments

UR - http://www.scopus.com/inward/record.url?scp=84959342532&partnerID=8YFLogxK

U2 - 10.1145/2785830.2785838

DO - 10.1145/2785830.2785838

M3 - Conference Paper

AN - SCOPUS:84959342532

SP - 161

EP - 171

BT - MobileHCI 2015 - Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

A2 - Gellersen, Hans

A2 - Hinckley, Ken

PB - Association for Computing Machinery (ACM)

CY - New York NY USA

Y2 - 24 August 2015 through 27 August 2015

ER -

Serrano M, Ens B, Yang XD, Irani P. Gluey: developing a head-worn display interface to unify the interaction experience in distributed display environments. In Gellersen H, Hinckley K, editors, MobileHCI 2015 - Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services: Copenhagen, Denmark August 24-27, 2015. New York NY USA: Association for Computing Machinery (ACM). 2015. p. 161-171 doi: 10.1145/2785830.2785838

Gluey: developing a head-worn display interface to unify the interaction experience in distributed display environments

Abstract

Conference

Keywords

Access to Document

Other files and links

Cite this