TY - JOUR
T1 - The challenges of multimodality and multi-sensoriality
T2 - Methodological issues in analyzing tactile signed interaction
AU - Iwasaki, Shimako
AU - Bartlett, Meredith
AU - Manns, Howard
AU - Willoughby, Louisa
PY - 2019/1/1
Y1 - 2019/1/1
N2 - Reflecting on the challenges of capturing and analyzing the multimodal complexity of human interactions, this paper examines the potentials of Conversation Analysis (CA) methods for illuminating the language and social interaction of deafblind signers, who operate with alternative resources in interaction. Generally, human interaction is managed through the rich and continuous flow of multimodal information and relies on simultaneous use of vocal-auditive and visuo-spatial resources to establish and coordinate interaction. CA can help us analyze how deafblind interactants who have no access to such resources manage to coordinate interaction, initiating, sustaining, and terminating social encounters. In this study, the primary modes and resources that deafblind interactants employ for communication are a tactile form of Australian Sign Language (Auslan) and haptic sensations that they experience and generate. Despite the limited range of modalities available, deafblind participants orient to the turn-taking mechanisms proposed by CA frameworks for spoken interaction. This paper considers the involvement of entire bodies in social interaction, addressing an audio and visual basis for communication. This study increases understanding of interaction through multi-sensory resources and bodily conduct that constitute the intersubjective worlds of deafblind interlocutors.
AB - Reflecting on the challenges of capturing and analyzing the multimodal complexity of human interactions, this paper examines the potentials of Conversation Analysis (CA) methods for illuminating the language and social interaction of deafblind signers, who operate with alternative resources in interaction. Generally, human interaction is managed through the rich and continuous flow of multimodal information and relies on simultaneous use of vocal-auditive and visuo-spatial resources to establish and coordinate interaction. CA can help us analyze how deafblind interactants who have no access to such resources manage to coordinate interaction, initiating, sustaining, and terminating social encounters. In this study, the primary modes and resources that deafblind interactants employ for communication are a tactile form of Australian Sign Language (Auslan) and haptic sensations that they experience and generate. Despite the limited range of modalities available, deafblind participants orient to the turn-taking mechanisms proposed by CA frameworks for spoken interaction. This paper considers the involvement of entire bodies in social interaction, addressing an audio and visual basis for communication. This study increases understanding of interaction through multi-sensory resources and bodily conduct that constitute the intersubjective worlds of deafblind interlocutors.
KW - Auslan
KW - Multimodality
KW - Sensoriality
KW - Sign language
KW - Tactile
KW - Touch
UR - http://www.scopus.com/inward/record.url?scp=85047356036&partnerID=8YFLogxK
U2 - 10.1016/j.pragma.2018.05.003
DO - 10.1016/j.pragma.2018.05.003
M3 - Article
AN - SCOPUS:85047356036
VL - 143
SP - 215
EP - 227
JO - Journal of Pragmatics
JF - Journal of Pragmatics
SN - 0378-2166
ER -