Jammify: interactive multi-sensory system for digital art jamming

Sachith Muthukumarana; Don Samitha Elvitigala; Qin Wu; Yun Suen Pai; Suranga Nanayakkara

doi:10.1007/978-3-030-85607-6_2

Jammify: interactive multi-sensory system for digital art jamming

Sachith Muthukumarana, Don Samitha Elvitigala, Qin Wu, Yun Suen Pai, Suranga Nanayakkara

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

2 Citations (Scopus)

Abstract

As social distancing is becoming the new normal, technology holds the potential to bridge this societal gap through novel interaction modalities that allow multiple users to collaborate and create content together. We present Jammify, an interactive multi-sensory system that focuses on providing a unique digital art-jamming experience with a visual display and a wearable arm-sleeve. The ‘jamming-canvas’ visual display is a two-sided LED light wall (2 m × 6 m) where users can draw free-hand gestures on either side and switch between two view modes: own-view and shared-view. The arm-sleeve uses shape-memory-alloy integrated fabric to sense and re-create a subtle and natural touch sensation on each other’s hands. We describe the details of the design and interaction possibilities based on the diverse combinations of both input and output modalities of the system, as well as findings from a user study with ten participants.

Original language	English
Title of host publication	Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference Bari, Italy, August 30 – September 3, 2021 Proceedings, Part V
Editors	Carmelo Ardito, Rosa Lanzilotti, Alessio Malizia, Helen Petrie, Antonio Piccinno, Giuseppe Desolda, Kori Inkpen
Place of Publication	Cham Switzerland
Publisher	Springer
Pages	23-41
Number of pages	19
ISBN (Electronic)	9783030856076
ISBN (Print)	9783030856069
DOIs	https://doi.org/10.1007/978-3-030-85607-6_2
Publication status	Published - 2021
Externally published	Yes
Event	IFIP TC13 Conference on Human-Computer Interaction 2021 - Bari, Italy Duration: 30 Aug 2021 → 3 Sept 2021 Conference number: 18th https://link.springer.com/book/10.1007/978-3-030-85623-6 (Proceedings)

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	12936
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	IFIP TC13 Conference on Human-Computer Interaction 2021
Abbreviated title	INTERACT 2021
Country/Territory	Italy
City	Bari
Period	30/08/21 → 3/09/21
Internet address	https://link.springer.com/book/10.1007/978-3-030-85623-6 (Proceedings)

Keywords

Collaborative drawing
Crowd and creativity
Digital drawings
Haptics
I/O Interface
Large displays
Touch

Access to Document

10.1007/978-3-030-85607-6_2

Cite this

Muthukumarana, S., Elvitigala, D. S., Wu, Q., Pai, Y. S., & Nanayakkara, S. (2021). Jammify: interactive multi-sensory system for digital art jamming. In C. Ardito, R. Lanzilotti, A. Malizia, H. Petrie, A. Piccinno, G. Desolda, & K. Inkpen (Eds.), Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference Bari, Italy, August 30 – September 3, 2021 Proceedings, Part V (pp. 23-41). (Lecture Notes in Computer Science; Vol. 12936). Springer. https://doi.org/10.1007/978-3-030-85607-6_2

Muthukumarana, Sachith ; Elvitigala, Don Samitha ; Wu, Qin et al. / Jammify : interactive multi-sensory system for digital art jamming. Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference Bari, Italy, August 30 – September 3, 2021 Proceedings, Part V. editor / Carmelo Ardito ; Rosa Lanzilotti ; Alessio Malizia ; Helen Petrie ; Antonio Piccinno ; Giuseppe Desolda ; Kori Inkpen. Cham Switzerland : Springer, 2021. pp. 23-41 (Lecture Notes in Computer Science).

@inproceedings{37f95929de6148aa8614b4715be89147,

title = "Jammify: interactive multi-sensory system for digital art jamming",

abstract = "As social distancing is becoming the new normal, technology holds the potential to bridge this societal gap through novel interaction modalities that allow multiple users to collaborate and create content together. We present Jammify, an interactive multi-sensory system that focuses on providing a unique digital art-jamming experience with a visual display and a wearable arm-sleeve. The {\textquoteleft}jamming-canvas{\textquoteright} visual display is a two-sided LED light wall (2 m × 6 m) where users can draw free-hand gestures on either side and switch between two view modes: own-view and shared-view. The arm-sleeve uses shape-memory-alloy integrated fabric to sense and re-create a subtle and natural touch sensation on each other{\textquoteright}s hands. We describe the details of the design and interaction possibilities based on the diverse combinations of both input and output modalities of the system, as well as findings from a user study with ten participants.",

keywords = "Collaborative drawing, Crowd and creativity, Digital drawings, Haptics, I/O Interface, Large displays, Touch",

author = "Sachith Muthukumarana and Elvitigala, {Don Samitha} and Qin Wu and Pai, {Yun Suen} and Suranga Nanayakkara",

note = "Funding Information: Acknowledgement. This work was supported by Assistive Augmentation research grant under the Entrepreneurial Universities (EU) initiative of New Zealand. We thank Peter Cleveland, Robyn Walton, and Prasanth Sasikumar for their assistance in constructing the LED display. Publisher Copyright: {\textcopyright} 2021, IFIP International Federation for Information Processing.; IFIP TC13 Conference on Human-Computer Interaction 2021, INTERACT 2021 ; Conference date: 30-08-2021 Through 03-09-2021",

year = "2021",

doi = "10.1007/978-3-030-85607-6_2",

language = "English",

isbn = "9783030856069",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "23--41",

editor = "Carmelo Ardito and Rosa Lanzilotti and Alessio Malizia and Helen Petrie and Antonio Piccinno and Giuseppe Desolda and Kori Inkpen",

booktitle = "Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference Bari, Italy, August 30 – September 3, 2021 Proceedings, Part V",

url = "https://link.springer.com/book/10.1007/978-3-030-85623-6",

}

Muthukumarana, S, Elvitigala, DS, Wu, Q, Pai, YS & Nanayakkara, S 2021, Jammify: interactive multi-sensory system for digital art jamming. in C Ardito, R Lanzilotti, A Malizia, H Petrie, A Piccinno, G Desolda & K Inkpen (eds), Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference Bari, Italy, August 30 – September 3, 2021 Proceedings, Part V. Lecture Notes in Computer Science, vol. 12936, Springer, Cham Switzerland, pp. 23-41, IFIP TC13 Conference on Human-Computer Interaction 2021, Bari, Italy, 30/08/21. https://doi.org/10.1007/978-3-030-85607-6_2

Jammify: interactive multi-sensory system for digital art jamming. / Muthukumarana, Sachith; Elvitigala, Don Samitha; Wu, Qin et al.
Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference Bari, Italy, August 30 – September 3, 2021 Proceedings, Part V. ed. / Carmelo Ardito; Rosa Lanzilotti; Alessio Malizia; Helen Petrie; Antonio Piccinno; Giuseppe Desolda; Kori Inkpen. Cham Switzerland: Springer, 2021. p. 23-41 (Lecture Notes in Computer Science; Vol. 12936).

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Jammify

T2 - IFIP TC13 Conference on Human-Computer Interaction 2021

AU - Muthukumarana, Sachith

AU - Elvitigala, Don Samitha

AU - Wu, Qin

AU - Pai, Yun Suen

AU - Nanayakkara, Suranga

N1 - Conference code: 18th

PY - 2021

Y1 - 2021

N2 - As social distancing is becoming the new normal, technology holds the potential to bridge this societal gap through novel interaction modalities that allow multiple users to collaborate and create content together. We present Jammify, an interactive multi-sensory system that focuses on providing a unique digital art-jamming experience with a visual display and a wearable arm-sleeve. The ‘jamming-canvas’ visual display is a two-sided LED light wall (2 m × 6 m) where users can draw free-hand gestures on either side and switch between two view modes: own-view and shared-view. The arm-sleeve uses shape-memory-alloy integrated fabric to sense and re-create a subtle and natural touch sensation on each other’s hands. We describe the details of the design and interaction possibilities based on the diverse combinations of both input and output modalities of the system, as well as findings from a user study with ten participants.

AB - As social distancing is becoming the new normal, technology holds the potential to bridge this societal gap through novel interaction modalities that allow multiple users to collaborate and create content together. We present Jammify, an interactive multi-sensory system that focuses on providing a unique digital art-jamming experience with a visual display and a wearable arm-sleeve. The ‘jamming-canvas’ visual display is a two-sided LED light wall (2 m × 6 m) where users can draw free-hand gestures on either side and switch between two view modes: own-view and shared-view. The arm-sleeve uses shape-memory-alloy integrated fabric to sense and re-create a subtle and natural touch sensation on each other’s hands. We describe the details of the design and interaction possibilities based on the diverse combinations of both input and output modalities of the system, as well as findings from a user study with ten participants.

KW - Collaborative drawing

KW - Crowd and creativity

KW - Digital drawings

KW - Haptics

KW - I/O Interface

KW - Large displays

KW - Touch

UR - http://www.scopus.com/inward/record.url?scp=85115215324&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-85607-6_2

DO - 10.1007/978-3-030-85607-6_2

M3 - Conference Paper

AN - SCOPUS:85115215324

SN - 9783030856069

T3 - Lecture Notes in Computer Science

SP - 23

EP - 41

BT - Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference Bari, Italy, August 30 – September 3, 2021 Proceedings, Part V

A2 - Ardito, Carmelo

A2 - Lanzilotti, Rosa

A2 - Malizia, Alessio

A2 - Petrie, Helen

A2 - Piccinno, Antonio

A2 - Desolda, Giuseppe

A2 - Inkpen, Kori

PB - Springer

CY - Cham Switzerland

Y2 - 30 August 2021 through 3 September 2021

ER -

Muthukumarana S, Elvitigala DS, Wu Q, Pai YS, Nanayakkara S. Jammify: interactive multi-sensory system for digital art jamming. In Ardito C, Lanzilotti R, Malizia A, Petrie H, Piccinno A, Desolda G, Inkpen K, editors, Human-Computer Interaction – INTERACT 2021 - 18th IFIP TC 13 International Conference Bari, Italy, August 30 – September 3, 2021 Proceedings, Part V. Cham Switzerland: Springer. 2021. p. 23-41. (Lecture Notes in Computer Science). doi: 10.1007/978-3-030-85607-6_2

Jammify: interactive multi-sensory system for digital art jamming

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Jammify, ARS ELECTRONICA

Cite this

Jammify: interactive multi-sensory system for digital art jamming

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Activities

Jammify, ARS ELECTRONICA

Cite this