Cinejack: using live music to control narrative visuals

Guy Schofield; David Green; Thomas Smith; Peter Wright; Patrick Olivier

doi:10.1145/2598510.2598520

Cinejack: using live music to control narrative visuals

Guy Schofield, David Green, Thomas Smith, Peter Wright, Patrick Olivier

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

3 Citations (Scopus)

Abstract

We present Cinejack, a system for directing narrative video through live musical performance. Cinejack interprets highlevel musical content from live instruments and translates it into cinematographic actions such as edits, framings and simulated camera movements. We describe Cinejack's technical development in terms of a novel and highly pragmatic approach to interface design, where the affordances of users' own musical instruments are used as controllers through an interpretive interaction scheme.

Original language	English
Title of host publication	DIS' 2014 - Proceedings of the 2014 ACM SIGCHI Conference on Designing Interactive Systems
Subtitle of host publication	June 21-25, 2014 Vancouver, BC, Canada
Editors	Shaowen Bardzell, Carman Neustaedter, Eric Paulos
Place of Publication	New York NY USA
Publisher	Association for Computing Machinery (ACM)
Pages	209-218
Number of pages	10
ISBN (Electronic)	9781450329026
DOIs	https://doi.org/10.1145/2598510.2598520
Publication status	Published - 2014
Externally published	Yes
Event	Designing Interactive Systems 2014 - Vancouver, Canada Duration: 21 Jun 2014 → 25 Jun 2014 http://www.dis2014.org/

Conference

Conference	Designing Interactive Systems 2014
Abbreviated title	DIS 2014
Country/Territory	Canada
City	Vancouver
Period	21/06/14 → 25/06/14
Internet address	http://www.dis2014.org/

Keywords

Digital arts
Interdisciplinary design
Music technology
Practice-based research
Research in the wild

Access to Document

10.1145/2598510.2598520

Cite this

Schofield, G., Green, D., Smith, T., Wright, P., & Olivier, P. (2014). Cinejack: using live music to control narrative visuals. In S. Bardzell, C. Neustaedter, & E. Paulos (Eds.), DIS' 2014 - Proceedings of the 2014 ACM SIGCHI Conference on Designing Interactive Systems: June 21-25, 2014 Vancouver, BC, Canada (pp. 209-218). Association for Computing Machinery (ACM). https://doi.org/10.1145/2598510.2598520

Schofield, Guy ; Green, David ; Smith, Thomas et al. / Cinejack : using live music to control narrative visuals. DIS' 2014 - Proceedings of the 2014 ACM SIGCHI Conference on Designing Interactive Systems: June 21-25, 2014 Vancouver, BC, Canada. editor / Shaowen Bardzell ; Carman Neustaedter ; Eric Paulos. New York NY USA : Association for Computing Machinery (ACM), 2014. pp. 209-218

@inproceedings{6e66961c8dbd4b0b80ca7c1dff7a618b,

title = "Cinejack: using live music to control narrative visuals",

abstract = "We present Cinejack, a system for directing narrative video through live musical performance. Cinejack interprets highlevel musical content from live instruments and translates it into cinematographic actions such as edits, framings and simulated camera movements. We describe Cinejack's technical development in terms of a novel and highly pragmatic approach to interface design, where the affordances of users' own musical instruments are used as controllers through an interpretive interaction scheme.",

keywords = "Digital arts, Interdisciplinary design, Music technology, Practice-based research, Research in the wild",

author = "Guy Schofield and David Green and Thomas Smith and Peter Wright and Patrick Olivier",

year = "2014",

doi = "10.1145/2598510.2598520",

language = "English",

pages = "209--218",

editor = "Bardzell, {Shaowen } and Neustaedter, {Carman } and Paulos, {Eric }",

booktitle = "DIS' 2014 - Proceedings of the 2014 ACM SIGCHI Conference on Designing Interactive Systems",

publisher = "Association for Computing Machinery (ACM)",

address = "United States of America",

note = "Designing Interactive Systems 2014, DIS 2014 ; Conference date: 21-06-2014 Through 25-06-2014",

url = "http://www.dis2014.org/",

}

Schofield, G, Green, D, Smith, T, Wright, P & Olivier, P 2014, Cinejack: using live music to control narrative visuals. in S Bardzell, C Neustaedter & E Paulos (eds), DIS' 2014 - Proceedings of the 2014 ACM SIGCHI Conference on Designing Interactive Systems: June 21-25, 2014 Vancouver, BC, Canada. Association for Computing Machinery (ACM), New York NY USA, pp. 209-218, Designing Interactive Systems 2014, Vancouver, British Columbia, Canada, 21/06/14. https://doi.org/10.1145/2598510.2598520

Cinejack: using live music to control narrative visuals. / Schofield, Guy; Green, David; Smith, Thomas et al.
DIS' 2014 - Proceedings of the 2014 ACM SIGCHI Conference on Designing Interactive Systems: June 21-25, 2014 Vancouver, BC, Canada. ed. / Shaowen Bardzell; Carman Neustaedter; Eric Paulos. New York NY USA: Association for Computing Machinery (ACM), 2014. p. 209-218.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Cinejack

T2 - Designing Interactive Systems 2014

AU - Schofield, Guy

AU - Green, David

AU - Smith, Thomas

AU - Wright, Peter

AU - Olivier, Patrick

PY - 2014

Y1 - 2014

N2 - We present Cinejack, a system for directing narrative video through live musical performance. Cinejack interprets highlevel musical content from live instruments and translates it into cinematographic actions such as edits, framings and simulated camera movements. We describe Cinejack's technical development in terms of a novel and highly pragmatic approach to interface design, where the affordances of users' own musical instruments are used as controllers through an interpretive interaction scheme.

AB - We present Cinejack, a system for directing narrative video through live musical performance. Cinejack interprets highlevel musical content from live instruments and translates it into cinematographic actions such as edits, framings and simulated camera movements. We describe Cinejack's technical development in terms of a novel and highly pragmatic approach to interface design, where the affordances of users' own musical instruments are used as controllers through an interpretive interaction scheme.

KW - Digital arts

KW - Interdisciplinary design

KW - Music technology

KW - Practice-based research

KW - Research in the wild

UR - http://www.scopus.com/inward/record.url?scp=84904464236&partnerID=8YFLogxK

U2 - 10.1145/2598510.2598520

DO - 10.1145/2598510.2598520

M3 - Conference Paper

AN - SCOPUS:84904464236

SP - 209

EP - 218

BT - DIS' 2014 - Proceedings of the 2014 ACM SIGCHI Conference on Designing Interactive Systems

A2 - Bardzell, Shaowen

A2 - Neustaedter, Carman

A2 - Paulos, Eric

PB - Association for Computing Machinery (ACM)

CY - New York NY USA

Y2 - 21 June 2014 through 25 June 2014

ER -

Schofield G, Green D, Smith T, Wright P, Olivier P. Cinejack: using live music to control narrative visuals. In Bardzell S, Neustaedter C, Paulos E, editors, DIS' 2014 - Proceedings of the 2014 ACM SIGCHI Conference on Designing Interactive Systems: June 21-25, 2014 Vancouver, BC, Canada. New York NY USA: Association for Computing Machinery (ACM). 2014. p. 209-218 doi: 10.1145/2598510.2598520

Cinejack: using live music to control narrative visuals

Abstract

Conference

Keywords

Access to Document

Other files and links

Cite this