Abstract
In this paper, we propose a prototype of music visualization system that captures and records the music component into digital data form, and then displays the data in visual form for children with hearing impairments. The analog sound data of music played physically is scaled into a binary matrix and scalar values that is then used as data structures for transcribing the output. We designed a system that detects tune and speed from a physical violin, and demonstrated three tangible music visualizations that children see in their daily lives, employing a flowerpot, plants and a picture of frame. We describe how the data captured from physical musical instruments can be seen through these objects, and suggest future possibilities for interactive sound visualization in music education for children with hearing impairments. Copyright is held by the owner/author(s).
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the IDC 2015, The 14th International Conference on Interaction Design and Children |
| Editors | Melissa Lee, Taylor Strelevitz |
| Place of Publication | New York NY USA |
| Publisher | Association for Computing Machinery (ACM) |
| Pages | 426-429 |
| Number of pages | 4 |
| ISBN (Electronic) | 9781450335904 |
| DOIs | |
| Publication status | Published - 2015 |
| Externally published | Yes |
| Event | Interaction Design and Children (ACM) 2015 - Boston, United States of America Duration: 21 Jun 2015 → 24 Jun 2015 Conference number: 14th https://dl.acm.org/doi/proceedings/10.1145/2771839 (Proceedings) |
Conference
| Conference | Interaction Design and Children (ACM) 2015 |
|---|---|
| Abbreviated title | IDC 2015 |
| Country | United States of America |
| City | Boston |
| Period | 21/06/15 → 24/06/15 |
| Internet address |
|
Keywords
- Assistive technology
- Music education
- Music visualization