Augmented Reality map navigation with freehand gestures

Kadek Satriadi; Barrett Michael Ens; Maxime Cordeil; Tobias Czauderna; Wesley Willett; Bernhard Jenny

doi:10.1109/VR.2019.8798340

Augmented Reality map navigation with freehand gestures

Kadek Satriadi, Barrett Michael Ens, Maxime Cordeil, Tobias Czauderna, Wesley Willett, Bernhard Jenny

Department of Human Centred Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

55 Citations (Scopus)

Abstract

Freehand gesture interaction has long been proposed as a 'natural' input method for Augmented Reality (AR) applications, yet has been little explored for intensive applications like multiscale navigation. In multiscale navigation, such as digital map navigation, pan and zoom are the predominant interactions. A position-based input mapping (e.g. grabbing metaphor) is intuitive for such interactions, but is prone to arm fatigue. This work focuses on improving digital map navigation in AR with mid-air hand gestures, using a horizontal intangible map display. First, we conducted a user study to explore the effects of handedness (unimanual and bimanual) and input mapping (position-based and rate-based). From these findings we designed DiveZoom and TerraceZoom, two novel hybrid techniques that smoothly transition between position- and rate-based mappings. A second user study evaluated these designs. Our results indicate that the introduced input-mapping transitions can reduce perceived arm fatigue with limited impact on performance.

Original language	English
Title of host publication	26th IEEE Conference on Virtual Reality and 3D User Interfaces - Osaka, Japan 23–27 March 2019 - Proceedings
Editors	Rob Teather, Yuta Itoh, Joe Gabbard, Ferran Argelaguet, Anne-Hélène Olivier, Dan Keefe
Place of Publication	Piscataway NJ USA
Publisher	IEEE, Institute of Electrical and Electronics Engineers
Pages	593-603
Number of pages	11
ISBN (Electronic)	9781728113777
ISBN (Print)	9781728113784
DOIs	https://doi.org/10.1109/VR.2019.8798340
Publication status	Published - 2019
Event	IEEE Conference on Virtual Reality and 3D User Interfaces 2019 - Osaka, Japan Duration: 23 Mar 2019 → 27 Mar 2019 Conference number: 26th http://ieeevr.org/2019/ https://ieeexplore-ieee-org.ezproxy.lib.monash.edu.au/xpl/conhome/8787730/proceeding (Proceedings)

Conference

Conference	IEEE Conference on Virtual Reality and 3D User Interfaces 2019
Abbreviated title	VR 2019
Country/Territory	Japan
City	Osaka
Period	23/03/19 → 27/03/19
Internet address	http://ieeevr.org/2019/ https://ieeexplore-ieee-org.ezproxy.lib.monash.edu.au/xpl/conhome/8787730/proceeding (Proceedings)

Keywords

Centered computing
Empirical studies in interaction design
Gestural input
Human
Human-centered computing
Humancentered computing
Mixed / augmented reality

Access to Document

10.1109/VR.2019.8798340

Cite this

Satriadi, K., Ens, B. M., Cordeil, M., Czauderna, T., Willett, W., & Jenny, B. (2019). Augmented Reality map navigation with freehand gestures. In R. Teather, Y. Itoh, J. Gabbard, F. Argelaguet, A.-H. Olivier, & D. Keefe (Eds.), 26th IEEE Conference on Virtual Reality and 3D User Interfaces - Osaka, Japan 23–27 March 2019 - Proceedings (pp. 593-603). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/VR.2019.8798340

Satriadi, Kadek ; Ens, Barrett Michael ; Cordeil, Maxime et al. / Augmented Reality map navigation with freehand gestures. 26th IEEE Conference on Virtual Reality and 3D User Interfaces - Osaka, Japan 23–27 March 2019 - Proceedings. editor / Rob Teather ; Yuta Itoh ; Joe Gabbard ; Ferran Argelaguet ; Anne-Hélène Olivier ; Dan Keefe. Piscataway NJ USA : IEEE, Institute of Electrical and Electronics Engineers, 2019. pp. 593-603

@inproceedings{19ac36ee570842ada1d66b01e048f38f,

title = "Augmented Reality map navigation with freehand gestures",

abstract = "Freehand gesture interaction has long been proposed as a 'natural' input method for Augmented Reality (AR) applications, yet has been little explored for intensive applications like multiscale navigation. In multiscale navigation, such as digital map navigation, pan and zoom are the predominant interactions. A position-based input mapping (e.g. grabbing metaphor) is intuitive for such interactions, but is prone to arm fatigue. This work focuses on improving digital map navigation in AR with mid-air hand gestures, using a horizontal intangible map display. First, we conducted a user study to explore the effects of handedness (unimanual and bimanual) and input mapping (position-based and rate-based). From these findings we designed DiveZoom and TerraceZoom, two novel hybrid techniques that smoothly transition between position- and rate-based mappings. A second user study evaluated these designs. Our results indicate that the introduced input-mapping transitions can reduce perceived arm fatigue with limited impact on performance.",

keywords = "Centered computing, Empirical studies in interaction design, Gestural input, Human, Human-centered computing, Humancentered computing, Mixed / augmented reality",

author = "Kadek Satriadi and Ens, {Barrett Michael} and Maxime Cordeil and Tobias Czauderna and Wesley Willett and Bernhard Jenny",

year = "2019",

doi = "10.1109/VR.2019.8798340",

language = "English",

isbn = "9781728113784",

pages = "593--603",

editor = "Teather, {Rob } and Itoh, {Yuta } and Gabbard, {Joe } and Ferran Argelaguet and Olivier, {Anne-H{\'e}l{\`e}ne } and Keefe, {Dan }",

booktitle = "26th IEEE Conference on Virtual Reality and 3D User Interfaces - Osaka, Japan 23–27 March 2019 - Proceedings",

publisher = "IEEE, Institute of Electrical and Electronics Engineers",

address = "United States of America",

note = "IEEE Conference on Virtual Reality and 3D User Interfaces 2019, VR 2019 ; Conference date: 23-03-2019 Through 27-03-2019",

url = "http://ieeevr.org/2019/, https://ieeexplore-ieee-org.ezproxy.lib.monash.edu.au/xpl/conhome/8787730/proceeding",

}

Satriadi, K, Ens, BM, Cordeil, M, Czauderna, T, Willett, W & Jenny, B 2019, Augmented Reality map navigation with freehand gestures. in R Teather, Y Itoh, J Gabbard, F Argelaguet, A-H Olivier & D Keefe (eds), 26th IEEE Conference on Virtual Reality and 3D User Interfaces - Osaka, Japan 23–27 March 2019 - Proceedings. IEEE, Institute of Electrical and Electronics Engineers, Piscataway NJ USA, pp. 593-603, IEEE Conference on Virtual Reality and 3D User Interfaces 2019, Osaka, Japan, 23/03/19. https://doi.org/10.1109/VR.2019.8798340

Augmented Reality map navigation with freehand gestures. / Satriadi, Kadek; Ens, Barrett Michael; Cordeil, Maxime et al.
26th IEEE Conference on Virtual Reality and 3D User Interfaces - Osaka, Japan 23–27 March 2019 - Proceedings. ed. / Rob Teather; Yuta Itoh; Joe Gabbard; Ferran Argelaguet; Anne-Hélène Olivier; Dan Keefe. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers, 2019. p. 593-603.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Augmented Reality map navigation with freehand gestures

AU - Satriadi, Kadek

AU - Ens, Barrett Michael

AU - Cordeil, Maxime

AU - Czauderna, Tobias

AU - Willett, Wesley

AU - Jenny, Bernhard

N1 - Conference code: 26th

PY - 2019

Y1 - 2019

N2 - Freehand gesture interaction has long been proposed as a 'natural' input method for Augmented Reality (AR) applications, yet has been little explored for intensive applications like multiscale navigation. In multiscale navigation, such as digital map navigation, pan and zoom are the predominant interactions. A position-based input mapping (e.g. grabbing metaphor) is intuitive for such interactions, but is prone to arm fatigue. This work focuses on improving digital map navigation in AR with mid-air hand gestures, using a horizontal intangible map display. First, we conducted a user study to explore the effects of handedness (unimanual and bimanual) and input mapping (position-based and rate-based). From these findings we designed DiveZoom and TerraceZoom, two novel hybrid techniques that smoothly transition between position- and rate-based mappings. A second user study evaluated these designs. Our results indicate that the introduced input-mapping transitions can reduce perceived arm fatigue with limited impact on performance.

AB - Freehand gesture interaction has long been proposed as a 'natural' input method for Augmented Reality (AR) applications, yet has been little explored for intensive applications like multiscale navigation. In multiscale navigation, such as digital map navigation, pan and zoom are the predominant interactions. A position-based input mapping (e.g. grabbing metaphor) is intuitive for such interactions, but is prone to arm fatigue. This work focuses on improving digital map navigation in AR with mid-air hand gestures, using a horizontal intangible map display. First, we conducted a user study to explore the effects of handedness (unimanual and bimanual) and input mapping (position-based and rate-based). From these findings we designed DiveZoom and TerraceZoom, two novel hybrid techniques that smoothly transition between position- and rate-based mappings. A second user study evaluated these designs. Our results indicate that the introduced input-mapping transitions can reduce perceived arm fatigue with limited impact on performance.

KW - Centered computing

KW - Empirical studies in interaction design

KW - Gestural input

KW - Human

KW - Human-centered computing

KW - Humancentered computing

KW - Mixed / augmented reality

UR - http://www.scopus.com/inward/record.url?scp=85071856048&partnerID=8YFLogxK

U2 - 10.1109/VR.2019.8798340

DO - 10.1109/VR.2019.8798340

M3 - Conference Paper

AN - SCOPUS:85071856048

SN - 9781728113784

SP - 593

EP - 603

BT - 26th IEEE Conference on Virtual Reality and 3D User Interfaces - Osaka, Japan 23–27 March 2019 - Proceedings

A2 - Teather, Rob

A2 - Itoh, Yuta

A2 - Gabbard, Joe

A2 - Argelaguet, Ferran

A2 - Olivier, Anne-Hélène

A2 - Keefe, Dan

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - Piscataway NJ USA

T2 - IEEE Conference on Virtual Reality and 3D User Interfaces 2019

Y2 - 23 March 2019 through 27 March 2019

ER -

Satriadi K, Ens BM, Cordeil M, Czauderna T, Willett W, Jenny B. Augmented Reality map navigation with freehand gestures. In Teather R, Itoh Y, Gabbard J, Argelaguet F, Olivier AH, Keefe D, editors, 26th IEEE Conference on Virtual Reality and 3D User Interfaces - Osaka, Japan 23–27 March 2019 - Proceedings. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers. 2019. p. 593-603 doi: 10.1109/VR.2019.8798340

Augmented Reality map navigation with freehand gestures

Abstract

Conference

Keywords

Access to Document

Other files and links

Cite this