Starting Your Multimodal HRI Study Journey

Kavindie Katuwandeniya; Hashini Senaratne; Yanran Jiang; Brandon Matthews; Leimin Tian; Dana Kulić

doi:10.1109/HRI61500.2025.10973915

Starting Your Multimodal HRI Study Journey

Kavindie Katuwandeniya
, Hashini Senaratne
, Yanran Jiang
, Brandon Matthews
, Leimin Tian
, Dana Kulić

Electrical and Computer Systems Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Other

Abstract

This tutorial aims to equip researchers with the knowledge and skills to leverage multimodal data in human-robot interaction (HRI) studies. It covers the HRI study cycle, from sensor selection to data analysis, introducing commonly used sensors, pre-processing data, feature extraction techniques, fusion techniques and analysis techniques: both frequentist and Bayesian. Hands-on exercises using public datasets are designed to provide practical experience. The concluding panel discussion on ethics and bias in HRI is focused on fostering broader ethical considerations of HRI studies. Website tutorial is found online at https://sites.google.com/monash.edu/multimodal-hri-study-tutorial.

Original language	English
Title of host publication	Proceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction
Editors	Jauwairia Nasir
Place of Publication	Piscataway NJ USA
Publisher	IEEE, Institute of Electrical and Electronics Engineers
Pages	2006-2008
Number of pages	3
ISBN (Electronic)	9798350378931
ISBN (Print)	9798350378948
DOIs	https://doi.org/10.1109/HRI61500.2025.10973915
Publication status	Published - 2025
Event	Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI) 2025 - Melbourne, Australia Duration: 4 Mar 2025 → 6 Mar 2025 Conference number: 20th https://ieeexplore.ieee.org/xpl/conhome/10973274/proceeding (Proceedings) https://humanrobotinteraction.org/2025/ (Website)

Publication series

Name	ACM/IEEE International Conference on Human-Robot Interaction
Publisher	IEEE, Institute of Electrical and Electronics Engineers
ISSN (Electronic)	2167-2148

Conference

Conference	Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI) 2025
Abbreviated title	HRI 2025
Country/Territory	Australia
City	Melbourne
Period	4/03/25 → 6/03/25
Internet address	https://ieeexplore.ieee.org/xpl/conhome/10973274/proceeding (Proceedings) https://humanrobotinteraction.org/2025/ (Website)

Keywords

Ethics and Bias in HRI data
HRI Study Design
Multimodal data

Access to Document

10.1109/HRI61500.2025.10973915

Cite this

Katuwandeniya, K., Senaratne, H., Jiang, Y., Matthews, B., Tian, L., & Kulić, D. (2025). Starting Your Multimodal HRI Study Journey. In J. Nasir (Ed.), Proceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction (pp. 2006-2008). (ACM/IEEE International Conference on Human-Robot Interaction). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/HRI61500.2025.10973915

Katuwandeniya, Kavindie ; Senaratne, Hashini ; Jiang, Yanran et al. / Starting Your Multimodal HRI Study Journey. Proceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction. editor / Jauwairia Nasir. Piscataway NJ USA : IEEE, Institute of Electrical and Electronics Engineers, 2025. pp. 2006-2008 (ACM/IEEE International Conference on Human-Robot Interaction).

@inproceedings{2c3c92e3bec2422facb0709496d736bd,

title = "Starting Your Multimodal HRI Study Journey",

abstract = "This tutorial aims to equip researchers with the knowledge and skills to leverage multimodal data in human-robot interaction (HRI) studies. It covers the HRI study cycle, from sensor selection to data analysis, introducing commonly used sensors, pre-processing data, feature extraction techniques, fusion techniques and analysis techniques: both frequentist and Bayesian. Hands-on exercises using public datasets are designed to provide practical experience. The concluding panel discussion on ethics and bias in HRI is focused on fostering broader ethical considerations of HRI studies. Website tutorial is found online at https://sites.google.com/monash.edu/multimodal-hri-study-tutorial.",

keywords = "Ethics and Bias in HRI data, HRI Study Design, Multimodal data",

author = "Kavindie Katuwandeniya and Hashini Senaratne and Yanran Jiang and Brandon Matthews and Leimin Tian and Dana Kuli{\'c}",

note = "Publisher Copyright: {\textcopyright} 2025 IEEE.; Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI) 2025, HRI 2025 ; Conference date: 04-03-2025 Through 06-03-2025",

year = "2025",

doi = "10.1109/HRI61500.2025.10973915",

language = "English",

isbn = "9798350378948",

series = "ACM/IEEE International Conference on Human-Robot Interaction",

publisher = "IEEE, Institute of Electrical and Electronics Engineers",

pages = "2006--2008",

editor = "Jauwairia Nasir",

booktitle = "Proceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction",

address = "United States of America",

url = "https://ieeexplore.ieee.org/xpl/conhome/10973274/proceeding, https://humanrobotinteraction.org/2025/",

}

Katuwandeniya, K, Senaratne, H, Jiang, Y, Matthews, B, Tian, L & Kulić, D 2025, Starting Your Multimodal HRI Study Journey. in J Nasir (ed.), Proceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction. ACM/IEEE International Conference on Human-Robot Interaction, IEEE, Institute of Electrical and Electronics Engineers, Piscataway NJ USA, pp. 2006-2008, Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI) 2025, Melbourne, Victoria, Australia, 4/03/25. https://doi.org/10.1109/HRI61500.2025.10973915

Starting Your Multimodal HRI Study Journey. / Katuwandeniya, Kavindie; Senaratne, Hashini; Jiang, Yanran et al.
Proceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction. ed. / Jauwairia Nasir. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers, 2025. p. 2006-2008 (ACM/IEEE International Conference on Human-Robot Interaction).

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Other

TY - GEN

T1 - Starting Your Multimodal HRI Study Journey

AU - Katuwandeniya, Kavindie

AU - Senaratne, Hashini

AU - Jiang, Yanran

AU - Matthews, Brandon

AU - Tian, Leimin

AU - Kulić, Dana

N1 - Conference code: 20th

PY - 2025

Y1 - 2025

N2 - This tutorial aims to equip researchers with the knowledge and skills to leverage multimodal data in human-robot interaction (HRI) studies. It covers the HRI study cycle, from sensor selection to data analysis, introducing commonly used sensors, pre-processing data, feature extraction techniques, fusion techniques and analysis techniques: both frequentist and Bayesian. Hands-on exercises using public datasets are designed to provide practical experience. The concluding panel discussion on ethics and bias in HRI is focused on fostering broader ethical considerations of HRI studies. Website tutorial is found online at https://sites.google.com/monash.edu/multimodal-hri-study-tutorial.

AB - This tutorial aims to equip researchers with the knowledge and skills to leverage multimodal data in human-robot interaction (HRI) studies. It covers the HRI study cycle, from sensor selection to data analysis, introducing commonly used sensors, pre-processing data, feature extraction techniques, fusion techniques and analysis techniques: both frequentist and Bayesian. Hands-on exercises using public datasets are designed to provide practical experience. The concluding panel discussion on ethics and bias in HRI is focused on fostering broader ethical considerations of HRI studies. Website tutorial is found online at https://sites.google.com/monash.edu/multimodal-hri-study-tutorial.

KW - Ethics and Bias in HRI data

KW - HRI Study Design

KW - Multimodal data

UR - https://www.scopus.com/pages/publications/105004876212

U2 - 10.1109/HRI61500.2025.10973915

DO - 10.1109/HRI61500.2025.10973915

M3 - Conference Paper

AN - SCOPUS:105004876212

SN - 9798350378948

T3 - ACM/IEEE International Conference on Human-Robot Interaction

SP - 2006

EP - 2008

BT - Proceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction

A2 - Nasir, Jauwairia

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - Piscataway NJ USA

T2 - Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI) 2025

Y2 - 4 March 2025 through 6 March 2025

ER -

Katuwandeniya K, Senaratne H, Jiang Y, Matthews B, Tian L, Kulić D. Starting Your Multimodal HRI Study Journey. In Nasir J, editor, Proceedings of the 2025 ACM/IEEE International Conference on Human-Robot Interaction. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers. 2025. p. 2006-2008. (ACM/IEEE International Conference on Human-Robot Interaction). doi: 10.1109/HRI61500.2025.10973915

Starting Your Multimodal HRI Study Journey

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Cite this