Augmented Reality map navigation with freehand gestures

Kadek Satriadi, Barrett Michael Ens, Maxime Cordeil, Tobias Czauderna, Wesley Willett, Bernhard Jenny

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

28 Citations (Scopus)


Freehand gesture interaction has long been proposed as a 'natural' input method for Augmented Reality (AR) applications, yet has been little explored for intensive applications like multiscale navigation. In multiscale navigation, such as digital map navigation, pan and zoom are the predominant interactions. A position-based input mapping (e.g. grabbing metaphor) is intuitive for such interactions, but is prone to arm fatigue. This work focuses on improving digital map navigation in AR with mid-air hand gestures, using a horizontal intangible map display. First, we conducted a user study to explore the effects of handedness (unimanual and bimanual) and input mapping (position-based and rate-based). From these findings we designed DiveZoom and TerraceZoom, two novel hybrid techniques that smoothly transition between position- and rate-based mappings. A second user study evaluated these designs. Our results indicate that the introduced input-mapping transitions can reduce perceived arm fatigue with limited impact on performance.

Original languageEnglish
Title of host publication26th IEEE Conference on Virtual Reality and 3D User Interfaces - Osaka, Japan 23–27 March 2019 - Proceedings
EditorsRob Teather, Yuta Itoh, Joe Gabbard, Ferran Argelaguet, Anne-Hélène Olivier, Dan Keefe
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages11
ISBN (Electronic)9781728113777
ISBN (Print)9781728113784
Publication statusPublished - 2019
EventIEEE Conference on Virtual Reality and 3D User Interfaces 2019 - Osaka, Japan
Duration: 23 Mar 201927 Mar 2019
Conference number: 26th (Proceedings)


ConferenceIEEE Conference on Virtual Reality and 3D User Interfaces 2019
Abbreviated titleVR 2019
Internet address


  • Centered computing
  • Empirical studies in interaction design
  • Gestural input
  • Human
  • Human-centered computing
  • Humancentered computing
  • Mixed / augmented reality

Cite this