CoVAR: mixed-platform remote collaborative Augmented and Virtual Realities system with shared collaboration cues

Thammathip Piumsomboon; Arindam Dey; Barrett Ens; Gun Lee; Mark Billinghurst

doi:10.1109/ISMAR-Adjunct.2017.72

CoVAR: mixed-platform remote collaborative Augmented and Virtual Realities system with shared collaboration cues

Thammathip Piumsomboon, Arindam Dey, Barrett Ens, Gun Lee, Mark Billinghurst

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Other

11 Citations (Scopus)

Abstract

We present CoVAR, a novel Virtual Reality (VR) and Augmented Reality (AR) system for remote collaboration. It supports collaboration between AR and VR users by sharing a 3D reconstruction of the AR user's environment. To enhance this mixed platform collaboration, it provides natural inputs such as eye-gaze and hand gestures, remote embodiment through avatar's head and hands, and awareness cues of field-of-view and gaze cue. In this paper, we describe the system architecture, setup and calibration procedures, input methods and interaction, and collaboration enhancement features.

Original language	English
Title of host publication	Adjunct Proceedings - 2017 IEEE International Symposium on Mixed and Augmented Reality
Subtitle of host publication	Nantes, France 9-13 October 2017
Editors	Wolfgang Broll, Holger Regenbrecht, J Edward Swan II
Place of Publication	Piscataway NJ USA
Publisher	IEEE, Institute of Electrical and Electronics Engineers
Pages	218-219
Number of pages	2
ISBN (Electronic)	9780769563275
ISBN (Print)	9781538614549
DOIs	https://doi.org/10.1109/ISMAR-Adjunct.2017.72
Publication status	Published - 2017
Externally published	Yes
Event	IEEE International Symposium on Mixed and Augmented Reality, Adjunct 2017 - Nantes, France Duration: 9 Oct 2017 → 13 Oct 2017 Conference number: 16th https://ismar2017.sciencesconf.org/

Conference

Conference	IEEE International Symposium on Mixed and Augmented Reality, Adjunct 2017
Abbreviated title	ISMAR-Adjunct 2017
Country	France
City	Nantes
Period	9/10/17 → 13/10/17
Internet address	https://ismar2017.sciencesconf.org/

Keywords

Eye tracking
Mixed reality
Remote collaboration

Access to Document

10.1109/ISMAR-Adjunct.2017.72

Link to publication in Scopus

Cite this

Piumsomboon, T., Dey, A., Ens, B., Lee, G., & Billinghurst, M. (2017). CoVAR: mixed-platform remote collaborative Augmented and Virtual Realities system with shared collaboration cues. In W. Broll, H. Regenbrecht, & J. E. Swan II (Eds.), Adjunct Proceedings - 2017 IEEE International Symposium on Mixed and Augmented Reality: Nantes, France 9-13 October 2017 (pp. 218-219). [8088489] IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ISMAR-Adjunct.2017.72

Piumsomboon, Thammathip ; Dey, Arindam ; Ens, Barrett ; Lee, Gun ; Billinghurst, Mark. / CoVAR : mixed-platform remote collaborative Augmented and Virtual Realities system with shared collaboration cues. Adjunct Proceedings - 2017 IEEE International Symposium on Mixed and Augmented Reality: Nantes, France 9-13 October 2017. editor / Wolfgang Broll ; Holger Regenbrecht ; J Edward Swan II. Piscataway NJ USA : IEEE, Institute of Electrical and Electronics Engineers, 2017. pp. 218-219

@inproceedings{8fc3d46b82a54ef0ab1f7fbbf88fb67e,

title = "CoVAR: mixed-platform remote collaborative Augmented and Virtual Realities system with shared collaboration cues",

abstract = "We present CoVAR, a novel Virtual Reality (VR) and Augmented Reality (AR) system for remote collaboration. It supports collaboration between AR and VR users by sharing a 3D reconstruction of the AR user's environment. To enhance this mixed platform collaboration, it provides natural inputs such as eye-gaze and hand gestures, remote embodiment through avatar's head and hands, and awareness cues of field-of-view and gaze cue. In this paper, we describe the system architecture, setup and calibration procedures, input methods and interaction, and collaboration enhancement features.",

keywords = "Eye tracking, Mixed reality, Remote collaboration",

author = "Thammathip Piumsomboon and Arindam Dey and Barrett Ens and Gun Lee and Mark Billinghurst",

year = "2017",

doi = "10.1109/ISMAR-Adjunct.2017.72",

language = "English",

isbn = "9781538614549",

pages = "218--219",

editor = "Broll, {Wolfgang } and Regenbrecht, {Holger } and {Swan II}, {J Edward }",

booktitle = "Adjunct Proceedings - 2017 IEEE International Symposium on Mixed and Augmented Reality",

publisher = "IEEE, Institute of Electrical and Electronics Engineers",

address = "United States of America",

note = "IEEE International Symposium on Mixed and Augmented Reality, Adjunct 2017<br/>, ISMAR-Adjunct 2017 ; Conference date: 09-10-2017 Through 13-10-2017",

url = "https://ismar2017.sciencesconf.org/",

}

Piumsomboon, T, Dey, A, Ens, B, Lee, G & Billinghurst, M 2017, CoVAR: mixed-platform remote collaborative Augmented and Virtual Realities system with shared collaboration cues. in W Broll, H Regenbrecht & JE Swan II (eds), Adjunct Proceedings - 2017 IEEE International Symposium on Mixed and Augmented Reality: Nantes, France 9-13 October 2017., 8088489, IEEE, Institute of Electrical and Electronics Engineers, Piscataway NJ USA, pp. 218-219, IEEE International Symposium on Mixed and Augmented Reality, Adjunct 2017
, Nantes, France, 9/10/17. https://doi.org/10.1109/ISMAR-Adjunct.2017.72

CoVAR : mixed-platform remote collaborative Augmented and Virtual Realities system with shared collaboration cues. / Piumsomboon, Thammathip; Dey, Arindam; Ens, Barrett; Lee, Gun; Billinghurst, Mark.

Adjunct Proceedings - 2017 IEEE International Symposium on Mixed and Augmented Reality: Nantes, France 9-13 October 2017. ed. / Wolfgang Broll; Holger Regenbrecht; J Edward Swan II. Piscataway NJ USA : IEEE, Institute of Electrical and Electronics Engineers, 2017. p. 218-219 8088489.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Other

TY - GEN

T1 - CoVAR

T2 - IEEE International Symposium on Mixed and Augmented Reality, Adjunct 2017<br/>

AU - Piumsomboon, Thammathip

AU - Dey, Arindam

AU - Ens, Barrett

AU - Lee, Gun

AU - Billinghurst, Mark

N1 - Conference code: 16th

PY - 2017

Y1 - 2017

N2 - We present CoVAR, a novel Virtual Reality (VR) and Augmented Reality (AR) system for remote collaboration. It supports collaboration between AR and VR users by sharing a 3D reconstruction of the AR user's environment. To enhance this mixed platform collaboration, it provides natural inputs such as eye-gaze and hand gestures, remote embodiment through avatar's head and hands, and awareness cues of field-of-view and gaze cue. In this paper, we describe the system architecture, setup and calibration procedures, input methods and interaction, and collaboration enhancement features.

AB - We present CoVAR, a novel Virtual Reality (VR) and Augmented Reality (AR) system for remote collaboration. It supports collaboration between AR and VR users by sharing a 3D reconstruction of the AR user's environment. To enhance this mixed platform collaboration, it provides natural inputs such as eye-gaze and hand gestures, remote embodiment through avatar's head and hands, and awareness cues of field-of-view and gaze cue. In this paper, we describe the system architecture, setup and calibration procedures, input methods and interaction, and collaboration enhancement features.

KW - Eye tracking

KW - Mixed reality

KW - Remote collaboration

UR - http://www.scopus.com/inward/record.url?scp=85040220080&partnerID=8YFLogxK

U2 - 10.1109/ISMAR-Adjunct.2017.72

DO - 10.1109/ISMAR-Adjunct.2017.72

M3 - Conference Paper

AN - SCOPUS:85040220080

SN - 9781538614549

SP - 218

EP - 219

BT - Adjunct Proceedings - 2017 IEEE International Symposium on Mixed and Augmented Reality

A2 - Broll, Wolfgang

A2 - Regenbrecht, Holger

A2 - Swan II, J Edward

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - Piscataway NJ USA

Y2 - 9 October 2017 through 13 October 2017

ER -

Piumsomboon T, Dey A, Ens B, Lee G, Billinghurst M. CoVAR: mixed-platform remote collaborative Augmented and Virtual Realities system with shared collaboration cues. In Broll W, Regenbrecht H, Swan II JE, editors, Adjunct Proceedings - 2017 IEEE International Symposium on Mixed and Augmented Reality: Nantes, France 9-13 October 2017. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers. 2017. p. 218-219. 8088489 https://doi.org/10.1109/ISMAR-Adjunct.2017.72