GestureExplorer: Immersive visualisation and exploration of gesture data

Ang Li, Jiazhou Liu, Maxime Cordeil, Jack Topliss, Thammathip Piumsomboon, Barrett Ens

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

1 Citation (Scopus)


This paper presents the design and evaluation of GestureExplorer, an Immersive Analytics tool that supports the interactive exploration, classification and sensemaking with large sets of 3D temporal gesture data. GestureExplorer features 3D skeletal and trajectory visualisations of gestures combined with abstract visualisations of clustered sets of gestures. By leveraging the large immersive space afforded by a Virtual Reality interface our tool allows free navigation and control of viewing perspective for users to gain a better understanding of gestures. We explored a selection of classification methods to provide an overview of the dataset that was linked to a detailed view of the data that showed different visualisation modalities. We evaluated GestureExplorer with two user studies and collected feedback from participants with diverse visualisation and analytics backgrounds. Our results demonstrated the promising capability of GestureExplorer for providing a useful and engaging experience in exploring and analysing gesture data.

Original languageEnglish
Title of host publicationProceedings of the 2023 CHI Conference on Human Factors in Computing Systems
EditorsStefanie Mueller, Julie R. Williamson, Max L. Wilson
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages16
ISBN (Electronic)9781450394215
Publication statusPublished - 2023
EventInternational Conference on Human Factors in Computing Systems 2023 - Hamburg, Germany
Duration: 23 Apr 202328 Apr 2023 (Website) (Proceedings)


ConferenceInternational Conference on Human Factors in Computing Systems 2023
Abbreviated titleCHI 2023
Internet address


  • gesture elicitation study
  • immersive analytics
  • virtual reality

Cite this