The challenges of multimodality and multi-sensoriality

Methodological issues in analyzing tactile signed interaction

Research output: Contribution to journalArticleResearchpeer-review

3 Citations (Scopus)

Abstract

Reflecting on the challenges of capturing and analyzing the multimodal complexity of human interactions, this paper examines the potentials of Conversation Analysis (CA) methods for illuminating the language and social interaction of deafblind signers, who operate with alternative resources in interaction. Generally, human interaction is managed through the rich and continuous flow of multimodal information and relies on simultaneous use of vocal-auditive and visuo-spatial resources to establish and coordinate interaction. CA can help us analyze how deafblind interactants who have no access to such resources manage to coordinate interaction, initiating, sustaining, and terminating social encounters. In this study, the primary modes and resources that deafblind interactants employ for communication are a tactile form of Australian Sign Language (Auslan) and haptic sensations that they experience and generate. Despite the limited range of modalities available, deafblind participants orient to the turn-taking mechanisms proposed by CA frameworks for spoken interaction. This paper considers the involvement of entire bodies in social interaction, addressing an audio and visual basis for communication. This study increases understanding of interaction through multi-sensory resources and bodily conduct that constitute the intersubjective worlds of deafblind interlocutors.

Original languageEnglish
Pages (from-to)215-227
Number of pages13
JournalJournal of Pragmatics
Volume143
DOIs
Publication statusPublished - 1 Jan 2019

Keywords

  • Auslan
  • Multimodality
  • Sensoriality
  • Sign language
  • Tactile
  • Touch

Cite this

@article{c1625275711b4d4d92561ceaea8b8286,
title = "The challenges of multimodality and multi-sensoriality: Methodological issues in analyzing tactile signed interaction",
abstract = "Reflecting on the challenges of capturing and analyzing the multimodal complexity of human interactions, this paper examines the potentials of Conversation Analysis (CA) methods for illuminating the language and social interaction of deafblind signers, who operate with alternative resources in interaction. Generally, human interaction is managed through the rich and continuous flow of multimodal information and relies on simultaneous use of vocal-auditive and visuo-spatial resources to establish and coordinate interaction. CA can help us analyze how deafblind interactants who have no access to such resources manage to coordinate interaction, initiating, sustaining, and terminating social encounters. In this study, the primary modes and resources that deafblind interactants employ for communication are a tactile form of Australian Sign Language (Auslan) and haptic sensations that they experience and generate. Despite the limited range of modalities available, deafblind participants orient to the turn-taking mechanisms proposed by CA frameworks for spoken interaction. This paper considers the involvement of entire bodies in social interaction, addressing an audio and visual basis for communication. This study increases understanding of interaction through multi-sensory resources and bodily conduct that constitute the intersubjective worlds of deafblind interlocutors.",
keywords = "Auslan, Multimodality, Sensoriality, Sign language, Tactile, Touch",
author = "Shimako Iwasaki and Meredith Bartlett and Howard Manns and Louisa Willoughby",
year = "2019",
month = "1",
day = "1",
doi = "10.1016/j.pragma.2018.05.003",
language = "English",
volume = "143",
pages = "215--227",
journal = "Journal of Pragmatics",
issn = "0378-2166",
publisher = "Elsevier",

}

The challenges of multimodality and multi-sensoriality : Methodological issues in analyzing tactile signed interaction. / Iwasaki, Shimako; Bartlett, Meredith; Manns, Howard; Willoughby, Louisa.

In: Journal of Pragmatics, Vol. 143, 01.01.2019, p. 215-227.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - The challenges of multimodality and multi-sensoriality

T2 - Methodological issues in analyzing tactile signed interaction

AU - Iwasaki, Shimako

AU - Bartlett, Meredith

AU - Manns, Howard

AU - Willoughby, Louisa

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Reflecting on the challenges of capturing and analyzing the multimodal complexity of human interactions, this paper examines the potentials of Conversation Analysis (CA) methods for illuminating the language and social interaction of deafblind signers, who operate with alternative resources in interaction. Generally, human interaction is managed through the rich and continuous flow of multimodal information and relies on simultaneous use of vocal-auditive and visuo-spatial resources to establish and coordinate interaction. CA can help us analyze how deafblind interactants who have no access to such resources manage to coordinate interaction, initiating, sustaining, and terminating social encounters. In this study, the primary modes and resources that deafblind interactants employ for communication are a tactile form of Australian Sign Language (Auslan) and haptic sensations that they experience and generate. Despite the limited range of modalities available, deafblind participants orient to the turn-taking mechanisms proposed by CA frameworks for spoken interaction. This paper considers the involvement of entire bodies in social interaction, addressing an audio and visual basis for communication. This study increases understanding of interaction through multi-sensory resources and bodily conduct that constitute the intersubjective worlds of deafblind interlocutors.

AB - Reflecting on the challenges of capturing and analyzing the multimodal complexity of human interactions, this paper examines the potentials of Conversation Analysis (CA) methods for illuminating the language and social interaction of deafblind signers, who operate with alternative resources in interaction. Generally, human interaction is managed through the rich and continuous flow of multimodal information and relies on simultaneous use of vocal-auditive and visuo-spatial resources to establish and coordinate interaction. CA can help us analyze how deafblind interactants who have no access to such resources manage to coordinate interaction, initiating, sustaining, and terminating social encounters. In this study, the primary modes and resources that deafblind interactants employ for communication are a tactile form of Australian Sign Language (Auslan) and haptic sensations that they experience and generate. Despite the limited range of modalities available, deafblind participants orient to the turn-taking mechanisms proposed by CA frameworks for spoken interaction. This paper considers the involvement of entire bodies in social interaction, addressing an audio and visual basis for communication. This study increases understanding of interaction through multi-sensory resources and bodily conduct that constitute the intersubjective worlds of deafblind interlocutors.

KW - Auslan

KW - Multimodality

KW - Sensoriality

KW - Sign language

KW - Tactile

KW - Touch

UR - http://www.scopus.com/inward/record.url?scp=85047356036&partnerID=8YFLogxK

U2 - 10.1016/j.pragma.2018.05.003

DO - 10.1016/j.pragma.2018.05.003

M3 - Article

VL - 143

SP - 215

EP - 227

JO - Journal of Pragmatics

JF - Journal of Pragmatics

SN - 0378-2166

ER -