Designing speech, acoustic and multimodal interactions

Cosmin Munteanu, Pourang Irani, Sharon Oviatt, Matthew Aylett, Gerald Penn, Shimei Pan, Nikhil Sharma, Frank Rudzicz, Randy Gomez, Benjamin Cowan, Keisuke Nakamura

Research output: Chapter in Book/Report/Conference proceedingConference PaperOtherpeer-review

21 Citations (Scopus)


Traditional interfaces are continuously being replaced by mobile, wearable, or pervasive interfaces. Yet when it comes to the input and output modalities enabling our interactions, we have yet to fully embrace some of the most natural forms of communication and information processing that humans possess: speech, language, gestures, thoughts. Very little HCI attention has been dedicated to designing and developing spoken language, acoustic-based, or multimodal interaction techniques, especially for mobile and wearable devices. In addition to the enormous, recent engineering progress in processing such modalities, there is now sufficient evidence that many real-life applications do not require 100% accuracy of processing multimodal input to be useful, particularly if such modalities complement each other. This multidisciplinary, one-day workshop will bring together interaction designers, usability researchers, and general HCI practitioners to analyze the opportunities and directions to take in designing more natural interactions especially with mobile and wearable devices, and to look at how we can leverage recent advances in speech, acoustic, and multimodal processing.

Original languageEnglish
Title of host publicationProceedings of the 2017 ACM SIGCHI Conference on Human Factors in Computing Systems
EditorsCliff Lampe, m.c. schraefel
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages8
ISBN (Electronic)9781450346566
Publication statusPublished - 2017
Externally publishedYes
EventInternational Conference on Human Factors in Computing Systems 2017 - Colorado Convention Center, Denver, United States of America
Duration: 6 May 201711 May 2017
Conference number: 35th (Proceedings)


ConferenceInternational Conference on Human Factors in Computing Systems 2017
Abbreviated titleCHI 2017
Country/TerritoryUnited States of America
Internet address

Cite this