Abstract
Rhythm is the first musical concept deaf people learn in music classes. However, hearing loss limits the amount of information that allows a deaf person to evaluate his or her performance and stay in sync with other musicians. In this paper, we investigated how a visual and vibrotactile music-sensorysubstitution device, MuSS-Bits++, affects rhythm discrimination, reproduction, and expressivity of deaf people. We conducted a controlled study with 11 deaf children and found that most participants felt more confident wearing the device in vibration mode even when it did not objectively improve their accuracy. Furthermore, we studied how MuSS-Bits++ can be used in music classes at deaf schools and what challenges and opportunities arise in such a setting. Based on these studies, we discuss insights and future directions that support the design and development of music-sensory-substitution systems for music making.
Original language | English |
---|---|
Title of host publication | Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems |
Editors | Anind Dey, Ed Cutrell, m.c. shraefel |
Place of Publication | New York NY USA |
Publisher | Association for Computing Machinery (ACM) |
Number of pages | 10 |
ISBN (Electronic) | 9781450356206, 9781450356213 |
DOIs | |
Publication status | Published - 2018 |
Externally published | Yes |
Event | International Conference on Human Factors in Computing Systems 2018 - Palais des Congrès de Montréal, Montreal, Canada Duration: 21 Apr 2018 → 26 Apr 2018 Conference number: 36th https://chi2018.acm.org/ https://dl.acm.org/doi/proceedings/10.1145/3173574 (Proceedings) |
Conference
Conference | International Conference on Human Factors in Computing Systems 2018 |
---|---|
Abbreviated title | CHI 2018 |
Country/Territory | Canada |
City | Montreal |
Period | 21/04/18 → 26/04/18 |
Internet address |
Keywords
- Assistive technology
- Deaf
- Design
- Music
- Sensory substitution