Cinejack: using live music to control narrative visuals

Guy Schofield, David Green, Thomas Smith, Peter Wright, Patrick Olivier

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

3 Citations (Scopus)


We present Cinejack, a system for directing narrative video through live musical performance. Cinejack interprets highlevel musical content from live instruments and translates it into cinematographic actions such as edits, framings and simulated camera movements. We describe Cinejack's technical development in terms of a novel and highly pragmatic approach to interface design, where the affordances of users' own musical instruments are used as controllers through an interpretive interaction scheme.

Original languageEnglish
Title of host publicationDIS' 2014 - Proceedings of the 2014 ACM SIGCHI Conference on Designing Interactive Systems
Subtitle of host publicationJune 21-25, 2014 Vancouver, BC, Canada
EditorsShaowen Bardzell, Carman Neustaedter, Eric Paulos
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages10
ISBN (Electronic)9781450329026
Publication statusPublished - 2014
Externally publishedYes
EventDesigning Interactive Systems 2014 - Vancouver, Canada
Duration: 21 Jun 201425 Jun 2014


ConferenceDesigning Interactive Systems 2014
Abbreviated titleDIS 2014
Internet address


  • Digital arts
  • Interdisciplinary design
  • Music technology
  • Practice-based research
  • Research in the wild

Cite this