Harmony across music, visuals and movement in a new audio-visual gestural performance

Alon Ilsar; Matthew Hughes

doi:10.1145/3374920.3375283

Harmony across music, visuals and movement in a new audio-visual gestural performance

Alon Ilsar, Matthew Hughes

Department of Human Centred Computing

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

2 Citations (Scopus)

Abstract

© 2020 Association for Computing Machinery. This paper describes the technology, concepts and development of Computer Storm, a live audio-visual piece created for a gestural instrument, the ?AirSticks'. The AirSticks allow the composition, performance and improvisation of live electronic music and graphics using movements captured by handheld motion controllers. In this piece, the AirSticks are combined with commodity depth sensors, and a custom visualisation system ?Confluence' which generates graphics from music and motion in real-Time. The hardware used to display the images within the performance space is also described, as well as an overview of the resulting performance, which explores harmony across music, visuals and movement, and investigates our complex relationship with technology.

Original language	English
Title of host publication	TEI'20 - Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction
Editors	Orit Shaer, Jelle van Dijk, Andrew Kun
Place of Publication	New York NY USA
Publisher	Association for Computing Machinery (ACM)
Pages	625-630
Number of pages	6
ISBN (Electronic)	9781450361071
DOIs	https://doi.org/10.1145/3374920.3375283
Publication status	Published - 2020
Event	Tangible, Embedded, and Embodied Interaction 2020 - Sydney, Australia Duration: 9 Feb 2020 → 12 Feb 2020 Conference number: 14th https://tei.acm.org/2020/ https://dl.acm.org/doi/proceedings/10.1145/3374920 (Proceedings)

Conference

Conference	Tangible, Embedded, and Embodied Interaction 2020
Abbreviated title	TEI 2020
Country/Territory	Australia
City	Sydney
Period	9/02/20 → 12/02/20
Internet address	https://tei.acm.org/2020/ https://dl.acm.org/doi/proceedings/10.1145/3374920 (Proceedings)

Keywords

Audio-visual
Electronic music
Gestural control
Mixed reality
Music visualization
Performance

Access to Document

10.1145/3374920.3375283

Cite this

Ilsar, A., & Hughes, M. (2020). Harmony across music, visuals and movement in a new audio-visual gestural performance. In O. Shaer, J. van Dijk, & A. Kun (Eds.), TEI'20 - Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction (pp. 625-630). Association for Computing Machinery (ACM). https://doi.org/10.1145/3374920.3375283

@inproceedings{4ae89610168a40618f8fa0f8566d959f,

title = "Harmony across music, visuals and movement in a new audio-visual gestural performance",

abstract = "{\textcopyright} 2020 Association for Computing Machinery. This paper describes the technology, concepts and development of Computer Storm, a live audio-visual piece created for a gestural instrument, the ?AirSticks'. The AirSticks allow the composition, performance and improvisation of live electronic music and graphics using movements captured by handheld motion controllers. In this piece, the AirSticks are combined with commodity depth sensors, and a custom visualisation system ?Confluence' which generates graphics from music and motion in real-Time. The hardware used to display the images within the performance space is also described, as well as an overview of the resulting performance, which explores harmony across music, visuals and movement, and investigates our complex relationship with technology.",

keywords = "Audio-visual, Electronic music, Gestural control, Mixed reality, Music visualization, Performance",

author = "Alon Ilsar and Matthew Hughes",

year = "2020",

doi = "10.1145/3374920.3375283",

language = "English",

pages = "625--630",

editor = "Shaer, {Orit } and {van Dijk}, {Jelle } and Kun, {Andrew }",

booktitle = "TEI'20 - Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction",

publisher = "Association for Computing Machinery (ACM)",

address = "United States of America",

note = "Tangible, Embedded, and Embodied Interaction 2020, TEI 2020 ; Conference date: 09-02-2020 Through 12-02-2020",

url = "https://tei.acm.org/2020/, https://dl.acm.org/doi/proceedings/10.1145/3374920",

}

Ilsar, A & Hughes, M 2020, Harmony across music, visuals and movement in a new audio-visual gestural performance. in O Shaer, J van Dijk & A Kun (eds), TEI'20 - Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction. Association for Computing Machinery (ACM), New York NY USA, pp. 625-630, Tangible, Embedded, and Embodied Interaction 2020, Sydney, New South Wales, Australia, 9/02/20. https://doi.org/10.1145/3374920.3375283

Harmony across music, visuals and movement in a new audio-visual gestural performance. / Ilsar, Alon; Hughes, Matthew.
TEI'20 - Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction. ed. / Orit Shaer; Jelle van Dijk; Andrew Kun. New York NY USA: Association for Computing Machinery (ACM), 2020. p. 625-630.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Harmony across music, visuals and movement in a new audio-visual gestural performance

AU - Ilsar, Alon

AU - Hughes, Matthew

N1 - Conference code: 14th

PY - 2020

Y1 - 2020

N2 - © 2020 Association for Computing Machinery. This paper describes the technology, concepts and development of Computer Storm, a live audio-visual piece created for a gestural instrument, the ?AirSticks'. The AirSticks allow the composition, performance and improvisation of live electronic music and graphics using movements captured by handheld motion controllers. In this piece, the AirSticks are combined with commodity depth sensors, and a custom visualisation system ?Confluence' which generates graphics from music and motion in real-Time. The hardware used to display the images within the performance space is also described, as well as an overview of the resulting performance, which explores harmony across music, visuals and movement, and investigates our complex relationship with technology.

AB - © 2020 Association for Computing Machinery. This paper describes the technology, concepts and development of Computer Storm, a live audio-visual piece created for a gestural instrument, the ?AirSticks'. The AirSticks allow the composition, performance and improvisation of live electronic music and graphics using movements captured by handheld motion controllers. In this piece, the AirSticks are combined with commodity depth sensors, and a custom visualisation system ?Confluence' which generates graphics from music and motion in real-Time. The hardware used to display the images within the performance space is also described, as well as an overview of the resulting performance, which explores harmony across music, visuals and movement, and investigates our complex relationship with technology.

KW - Audio-visual

KW - Electronic music

KW - Gestural control

KW - Mixed reality

KW - Music visualization

KW - Performance

UR - http://www.scopus.com/inward/record.url?scp=85082460832&partnerID=8YFLogxK

U2 - 10.1145/3374920.3375283

DO - 10.1145/3374920.3375283

M3 - Conference Paper

SP - 625

EP - 630

BT - TEI'20 - Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction

A2 - Shaer, Orit

A2 - van Dijk, Jelle

A2 - Kun, Andrew

PB - Association for Computing Machinery (ACM)

CY - New York NY USA

T2 - Tangible, Embedded, and Embodied Interaction 2020

Y2 - 9 February 2020 through 12 February 2020

ER -

Harmony across music, visuals and movement in a new audio-visual gestural performance

Abstract

Conference

Keywords

Access to Document

Other files and links

Cite this