Abstract
Collaboration is built on trust, and establishing trust with a creative Artificial Intelligence is difficult when the decision process or internal state driving its behaviour isn’t exposed. When human musicians improvise together, a number of extra-musical cues are used to augment musical communication and expose mental or emotional states which affect musical decisions and the effectiveness of the collaboration. We developed a collaborative improvising AI drummer that communicates its confidence through an emoticon-based visualisation. The AI was trained on musical performance data, as well as real-time skin conductance, of musicians improvising with professional drummers, exposing both musical and extra-musical cues to inform its generative process. Uni- and bi-directional extra-musical communication with real and false values were tested by experienced improvising musicians. Each condition was evaluated using the FSS-2 questionnaire, as a proxy for musical engagement. The results show a positive correlation between extra-musical communication of machine internal state and human musical engagement.
Original language | English |
---|---|
Title of host publication | Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems |
Editors | Anna Cox, Vassilis Kostakos |
Place of Publication | New York NY USA |
Publisher | Association for Computing Machinery (ACM) |
Number of pages | 11 |
ISBN (Electronic) | 9781450359702 |
DOIs | |
Publication status | Published - 2019 |
Event | International Conference on Human Factors in Computing Systems 2019 - Glasgow, United Kingdom Duration: 4 May 2019 → 9 May 2019 Conference number: 37th https://chi2019.acm.org https://dl.acm.org/doi/proceedings/10.1145/3290605 (Proceedings) |
Conference
Conference | International Conference on Human Factors in Computing Systems 2019 |
---|---|
Abbreviated title | CHI 2019 |
Country | United Kingdom |
City | Glasgow |
Period | 4/05/19 → 9/05/19 |
Internet address |
Keywords
- AI systems
- Extra-musical communication
- Improvisation