"Hey Model!"– natural user interactions and agency in accessible interactive 3D models

Sam Reinders; Matthew Butler; Kimbal Marriott

doi:10.1145/3313831.3376145

"Hey Model!"– natural user interactions and agency in accessible interactive 3D models

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

Abstract

While developments in 3D printing have opened up opportunities for improved access to graphical information for people who are blind or have low vision (BLV), they can provide only limited detailed and contextual information. Interactive 3D printed models (I3Ms) that provide audio labels and/or a conversational agent interface potentially overcome this limitation. We conducted a Wizard-of-Oz exploratory study to uncover the multi-modal interaction techniques that BLV people would like to use when exploring I3Ms, and investigated their attitudes towards different levels of model agency. These findings informed the creation of an I3M prototype of the solar system. A second user study with this model revealed a hierarchy of interaction, with BLV users preferring tactile exploration, followed by touch gestures to trigger audio labels, and then natural language to fill in knowledge gaps and confirm understanding.

Original language	English
Title of host publication	Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
Editors	Joanna McGrenere, Andy Cockburn
Place of Publication	New York NY USA
Publisher	Association for Computing Machinery (ACM)
Number of pages	13
ISBN (Electronic)	9781450367080
DOIs	https://doi.org/10.1145/3313831.3376145
Publication status	Published - 21 Apr 2020
Event	International Conference on Human Factors in Computing Systems 2020 - Hawaii, Honolulu , United States of America Duration: 25 Apr 2020 → 30 Apr 2020 Conference number: 38th https://chi2020.acm.org (Website) https://dl.acm.org/doi/proceedings/10.1145/3313831 (Proceedings)

Conference

Conference	International Conference on Human Factors in Computing Systems 2020
Abbreviated title	CHI 2020
Country/Territory	United States of America
City	Honolulu
Period	25/04/20 → 30/04/20
Internet address	https://chi2020.acm.org (Website) https://dl.acm.org/doi/proceedings/10.1145/3313831 (Proceedings)

Keywords

accessibility
individuals with disabilities & assistive technologies
input techniques
touch/haptic/pointing/gesture

Access to Document

10.1145/3313831.3376145

Cite this

@inproceedings{b75c1408997a4214b71d42b8ea00a8a2,

title = "{"}Hey Model!{"}– natural user interactions and agency in accessible interactive 3D models",

abstract = "While developments in 3D printing have opened up opportunities for improved access to graphical information for people who are blind or have low vision (BLV), they can provide only limited detailed and contextual information. Interactive 3D printed models (I3Ms) that provide audio labels and/or a conversational agent interface potentially overcome this limitation. We conducted a Wizard-of-Oz exploratory study to uncover the multi-modal interaction techniques that BLV people would like to use when exploring I3Ms, and investigated their attitudes towards different levels of model agency. These findings informed the creation of an I3M prototype of the solar system. A second user study with this model revealed a hierarchy of interaction, with BLV users preferring tactile exploration, followed by touch gestures to trigger audio labels, and then natural language to fill in knowledge gaps and confirm understanding.",

keywords = "accessibility, individuals with disabilities \& assistive technologies, input techniques, touch/haptic/pointing/gesture",

author = "Sam Reinders and Matthew Butler and Kimbal Marriott",

year = "2020",

month = apr,

day = "21",

doi = "10.1145/3313831.3376145",

language = "English",

editor = "McGrenere, \{Joanna \} and Cockburn, \{Andy \}",

booktitle = "Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems",

publisher = "Association for Computing Machinery (ACM)",

address = "United States of America",

note = "International Conference on Human Factors in Computing Systems 2020, CHI 2020 ; Conference date: 25-04-2020 Through 30-04-2020",

url = "https://chi2020.acm.org, https://dl.acm.org/doi/proceedings/10.1145/3313831",

}

Reinders, S , Butler, M & Marriott, K 2020, "Hey Model!"– natural user interactions and agency in accessible interactive 3D models. in J McGrenere & A Cockburn (eds), Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems., 18, Association for Computing Machinery (ACM), New York NY USA, International Conference on Human Factors in Computing Systems 2020, Honolulu , Hawaii, United States of America, 25/04/20. https://doi.org/10.1145/3313831.3376145

"Hey Model!"– natural user interactions and agency in accessible interactive 3D models. / Reinders, Sam ; Butler, Matthew ; Marriott, Kimbal.
Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ed. / Joanna McGrenere; Andy Cockburn. New York NY USA: Association for Computing Machinery (ACM), 2020. 18.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - "Hey Model!"– natural user interactions and agency in accessible interactive 3D models

AU - Reinders, Sam

AU - Butler, Matthew

AU - Marriott, Kimbal

N1 - Conference code: 38th

PY - 2020/4/21

Y1 - 2020/4/21

N2 - While developments in 3D printing have opened up opportunities for improved access to graphical information for people who are blind or have low vision (BLV), they can provide only limited detailed and contextual information. Interactive 3D printed models (I3Ms) that provide audio labels and/or a conversational agent interface potentially overcome this limitation. We conducted a Wizard-of-Oz exploratory study to uncover the multi-modal interaction techniques that BLV people would like to use when exploring I3Ms, and investigated their attitudes towards different levels of model agency. These findings informed the creation of an I3M prototype of the solar system. A second user study with this model revealed a hierarchy of interaction, with BLV users preferring tactile exploration, followed by touch gestures to trigger audio labels, and then natural language to fill in knowledge gaps and confirm understanding.

AB - While developments in 3D printing have opened up opportunities for improved access to graphical information for people who are blind or have low vision (BLV), they can provide only limited detailed and contextual information. Interactive 3D printed models (I3Ms) that provide audio labels and/or a conversational agent interface potentially overcome this limitation. We conducted a Wizard-of-Oz exploratory study to uncover the multi-modal interaction techniques that BLV people would like to use when exploring I3Ms, and investigated their attitudes towards different levels of model agency. These findings informed the creation of an I3M prototype of the solar system. A second user study with this model revealed a hierarchy of interaction, with BLV users preferring tactile exploration, followed by touch gestures to trigger audio labels, and then natural language to fill in knowledge gaps and confirm understanding.

KW - accessibility

KW - individuals with disabilities & assistive technologies

KW - input techniques

KW - touch/haptic/pointing/gesture

UR - https://www.scopus.com/pages/publications/85091286635

U2 - 10.1145/3313831.3376145

DO - 10.1145/3313831.3376145

M3 - Conference Paper

AN - SCOPUS:85091286635

BT - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

A2 - McGrenere, Joanna

A2 - Cockburn, Andy

PB - Association for Computing Machinery (ACM)

CY - New York NY USA

T2 - International Conference on Human Factors in Computing Systems 2020

Y2 - 25 April 2020 through 30 April 2020

ER -

"Hey Model!"– natural user interactions and agency in accessible interactive 3D models

Abstract

Conference

Keywords

Access to Document

Other files and links

Cite this