On the shoulder of the giant: a multi-scale mixed reality collaboration with 360 video sharing and tangible interaction

Thammathip Piumsomboon, Gun A. Lee, Andrew Irlitti, Barrett Ens, Bruce H. Thomas, Mark Billinghurst

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

21 Citations (Scopus)


We propose a multi-scale Mixed Reality (MR) collaboration between the Giant, a local Augmented Reality user, and the Miniature, a remote Virtual Reality user, in Giant-Miniature Collaboration (GMC). The Miniature is immersed in a 360-video shared by the Giant who can physically manipulate the Miniature through a tangible interface, a combined 360-camera with a 6 DOF tracker. We implemented a prototype system as a proof of concept and conducted a user study (n=24) comprising of four parts comparing: A) two types of virtual representations, B) three levels of Miniature control, C) three levels of 360-video view dependencies, and D) four 360-camera placement positions on the Giant. The results show users prefer a shoulder mounted camera view, while a view frustum with a complimentary avatar is a good visualization for the Miniature virtual representation. From the results, we give design recommendations and demonstrate an example Giant-Miniature Interaction.

Original languageEnglish
Title of host publicationProceedings of the 2019 CHI Conference on Human Factors in Computing Systems
EditorsAnna Cox, Vassilis Kostakos
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages17
ISBN (Electronic)9781450359702
Publication statusPublished - 2019
EventInternational Conference on Human Factors in Computing Systems 2019 - Glasgow, United Kingdom
Duration: 4 May 20199 May 2019
Conference number: 37th
https://dl.acm.org/doi/proceedings/10.1145/3290605 (Proceedings)


ConferenceInternational Conference on Human Factors in Computing Systems 2019
Abbreviated titleCHI 2019
CountryUnited Kingdom
Internet address


  • Live panorama sharing
  • Mixed reality
  • Multi-scale
  • Remote collaboration
  • Tangible user interface
  • Wearable interface

Cite this