Exploring gesture sonification to support reflective craft practice

Thomas Smith; Simon J. Bowen; Bettina Nissen; Jonathan Hook; Arno Verhoeven; John Bowers; Peter Wright; Patrick Olivier

doi:10.1145/2702123.2702497

Exploring gesture sonification to support reflective craft practice

Thomas Smith, Simon J. Bowen, Bettina Nissen, Jonathan Hook, Arno Verhoeven, John Bowers, Peter Wright, Patrick Olivier

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

20 Citations (Scopus)

Abstract

Much of the knowing employed in skilled craft practice is difficult to communicate solely through written or verbal description. Consequently, the reflection and development of a craft practice in this manner may miss important nuances of practitioners' skills and experiences. We created digital technologies to sonify (using audio to perceptualize data) a group of craft practitioners' gestures to explore how we can aid their reflection in and on their craft, and consequently develop it. Over a number of workshops, the design of these sonifications were iterated based on how the practitioners responded to them. We found that direct sonification of gesture (sounds generated directly from motion sensor data) helped practitioners understand and reflect upon their own and each other's practice, encouraged discussion and enabled modification of craft technique.

Original language	English
Title of host publication	SIGCHI/CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems
Subtitle of host publication	April 18–23, 2015 Seoul, Republic of Korea
Editors	Kori Inkpen, Woontack Woo
Place of Publication	New York NY USA
Publisher	Association for Computing Machinery (ACM)
Pages	67-76
Number of pages	10
ISBN (Electronic)	9781450331456
DOIs	https://doi.org/10.1145/2702123.2702497
Publication status	Published - 2015
Externally published	Yes
Event	International Conference on Human Factors in Computing Systems 2015 - Seoul, Korea, South Duration: 18 Apr 2015 → 23 Apr 2015 Conference number: 33rd https://chi2015.acm.org/ https://dl.acm.org/doi/proceedings/10.1145/2702123 (Proceedings)

Conference

Conference	International Conference on Human Factors in Computing Systems 2015
Abbreviated title	CHI 2015
Country/Territory	Korea, South
City	Seoul
Period	18/04/15 → 23/04/15
Internet address	https://chi2015.acm.org/ https://dl.acm.org/doi/proceedings/10.1145/2702123 (Proceedings)

Keywords

Craft skills
Reflective practice
Sonification

Access to Document

10.1145/2702123.2702497

Cite this

Smith, T., Bowen, S. J., Nissen, B., Hook, J., Verhoeven, A., Bowers, J., Wright, P., & Olivier, P. (2015). Exploring gesture sonification to support reflective craft practice. In K. Inkpen, & W. Woo (Eds.), SIGCHI/CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: April 18–23, 2015 Seoul, Republic of Korea (pp. 67-76). Association for Computing Machinery (ACM). https://doi.org/10.1145/2702123.2702497

Smith, Thomas ; Bowen, Simon J. ; Nissen, Bettina et al. / Exploring gesture sonification to support reflective craft practice. SIGCHI/CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: April 18–23, 2015 Seoul, Republic of Korea. editor / Kori Inkpen ; Woontack Woo. New York NY USA : Association for Computing Machinery (ACM), 2015. pp. 67-76

@inproceedings{f3357e5091a5481f97a2e5ac3bdf3858,

title = "Exploring gesture sonification to support reflective craft practice",

abstract = "Much of the knowing employed in skilled craft practice is difficult to communicate solely through written or verbal description. Consequently, the reflection and development of a craft practice in this manner may miss important nuances of practitioners' skills and experiences. We created digital technologies to sonify (using audio to perceptualize data) a group of craft practitioners' gestures to explore how we can aid their reflection in and on their craft, and consequently develop it. Over a number of workshops, the design of these sonifications were iterated based on how the practitioners responded to them. We found that direct sonification of gesture (sounds generated directly from motion sensor data) helped practitioners understand and reflect upon their own and each other's practice, encouraged discussion and enabled modification of craft technique.",

keywords = "Craft skills, Reflective practice, Sonification",

author = "Thomas Smith and Bowen, {Simon J.} and Bettina Nissen and Jonathan Hook and Arno Verhoeven and John Bowers and Peter Wright and Patrick Olivier",

year = "2015",

doi = "10.1145/2702123.2702497",

language = "English",

pages = "67--76",

editor = "Inkpen, {Kori } and Woo, {Woontack }",

booktitle = "SIGCHI/CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems",

publisher = "Association for Computing Machinery (ACM)",

address = "United States of America",

note = "International Conference on Human Factors in Computing Systems 2015, CHI 2015 ; Conference date: 18-04-2015 Through 23-04-2015",

url = "https://chi2015.acm.org/, https://dl.acm.org/doi/proceedings/10.1145/2702123",

}

Smith, T, Bowen, SJ, Nissen, B, Hook, J, Verhoeven, A, Bowers, J, Wright, P & Olivier, P 2015, Exploring gesture sonification to support reflective craft practice. in K Inkpen & W Woo (eds), SIGCHI/CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: April 18–23, 2015 Seoul, Republic of Korea. Association for Computing Machinery (ACM), New York NY USA, pp. 67-76, International Conference on Human Factors in Computing Systems 2015, Seoul, Korea, South, 18/04/15. https://doi.org/10.1145/2702123.2702497

Exploring gesture sonification to support reflective craft practice. / Smith, Thomas; Bowen, Simon J.; Nissen, Bettina et al.
SIGCHI/CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: April 18–23, 2015 Seoul, Republic of Korea. ed. / Kori Inkpen; Woontack Woo. New York NY USA: Association for Computing Machinery (ACM), 2015. p. 67-76.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Exploring gesture sonification to support reflective craft practice

AU - Smith, Thomas

AU - Bowen, Simon J.

AU - Nissen, Bettina

AU - Hook, Jonathan

AU - Verhoeven, Arno

AU - Bowers, John

AU - Wright, Peter

AU - Olivier, Patrick

N1 - Conference code: 33rd

PY - 2015

Y1 - 2015

N2 - Much of the knowing employed in skilled craft practice is difficult to communicate solely through written or verbal description. Consequently, the reflection and development of a craft practice in this manner may miss important nuances of practitioners' skills and experiences. We created digital technologies to sonify (using audio to perceptualize data) a group of craft practitioners' gestures to explore how we can aid their reflection in and on their craft, and consequently develop it. Over a number of workshops, the design of these sonifications were iterated based on how the practitioners responded to them. We found that direct sonification of gesture (sounds generated directly from motion sensor data) helped practitioners understand and reflect upon their own and each other's practice, encouraged discussion and enabled modification of craft technique.

AB - Much of the knowing employed in skilled craft practice is difficult to communicate solely through written or verbal description. Consequently, the reflection and development of a craft practice in this manner may miss important nuances of practitioners' skills and experiences. We created digital technologies to sonify (using audio to perceptualize data) a group of craft practitioners' gestures to explore how we can aid their reflection in and on their craft, and consequently develop it. Over a number of workshops, the design of these sonifications were iterated based on how the practitioners responded to them. We found that direct sonification of gesture (sounds generated directly from motion sensor data) helped practitioners understand and reflect upon their own and each other's practice, encouraged discussion and enabled modification of craft technique.

KW - Craft skills

KW - Reflective practice

KW - Sonification

UR - http://www.scopus.com/inward/record.url?scp=84951100383&partnerID=8YFLogxK

U2 - 10.1145/2702123.2702497

DO - 10.1145/2702123.2702497

M3 - Conference Paper

AN - SCOPUS:84951100383

SP - 67

EP - 76

BT - SIGCHI/CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems

A2 - Inkpen, Kori

A2 - Woo, Woontack

PB - Association for Computing Machinery (ACM)

CY - New York NY USA

T2 - International Conference on Human Factors in Computing Systems 2015

Y2 - 18 April 2015 through 23 April 2015

ER -

Smith T, Bowen SJ, Nissen B, Hook J, Verhoeven A, Bowers J et al. Exploring gesture sonification to support reflective craft practice. In Inkpen K, Woo W, editors, SIGCHI/CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems: April 18–23, 2015 Seoul, Republic of Korea. New York NY USA: Association for Computing Machinery (ACM). 2015. p. 67-76 doi: 10.1145/2702123.2702497

Exploring gesture sonification to support reflective craft practice

Abstract

Conference

Keywords

Access to Document

Other files and links

Cite this