Exploring gesture sonification to support reflective craft practice

Thomas Smith, Simon J. Bowen, Bettina Nissen, Jonathan Hook, Arno Verhoeven, John Bowers, Peter Wright, Patrick Olivier

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

7 Citations (Scopus)


Much of the knowing employed in skilled craft practice is difficult to communicate solely through written or verbal description. Consequently, the reflection and development of a craft practice in this manner may miss important nuances of practitioners' skills and experiences. We created digital technologies to sonify (using audio to perceptualize data) a group of craft practitioners' gestures to explore how we can aid their reflection in and on their craft, and consequently develop it. Over a number of workshops, the design of these sonifications were iterated based on how the practitioners responded to them. We found that direct sonification of gesture (sounds generated directly from motion sensor data) helped practitioners understand and reflect upon their own and each other's practice, encouraged discussion and enabled modification of craft technique.

Original languageEnglish
Title of host publicationSIGCHI/CHI 2015 - Proceedings of the 33rd Annual CHI Conference on Human Factors in Computing Systems
Subtitle of host publicationApril 18–23, 2015 Seoul, Republic of Korea
EditorsKori Inkpen, Woontack Woo
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages10
ISBN (Electronic)9781450331456
Publication statusPublished - 2015
Externally publishedYes
EventInternational Conference on Human Factors in Computing Systems 2015 - Seoul, Korea, Republic of (South)
Duration: 18 Apr 201523 Apr 2015
Conference number: 33rd
https://dl.acm.org/doi/proceedings/10.1145/2702123 (Proceedings)


ConferenceInternational Conference on Human Factors in Computing Systems 2015
Abbreviated titleCHI 2015
CountryKorea, Republic of (South)
Internet address


  • Craft skills
  • Reflective practice
  • Sonification

Cite this