Toward open-microphone engagement for multiparty interactions

Rebecca Lunsford, Sharon Oviatt, Alexander M. Arthur

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

13 Citations (Scopus)

Abstract

There currently is considerable interest in developing new open-microphone engagement techniques for speech and multimodal interfaces that perform robustly in complex mobile and multiparty field environments. State-of-the-art audio-visual open-microphone engagement systems aim to eliminate the need for explicit user engagement by processing more implicit cues that a user is addressing the system, which results in lower cognitive load for the user. This is an especially important consideration for mobile and educational interfaces due to the higher load required by explicit system engagement. In the present research, longitudinal data were collected with six triads of high-school students who engaged in peer tutoring on math problems with the aid of a simulated computer assistant. Results revealed that amplitude was 3.25dB higher when users addressed a computer rather than human peer when no lexical marker of intended interlocutor was present, and 2.4dB higher for all data. These basic results were replicated for both matched and adjacent utterances to computer versus human partners. With respect to dialogue style, speakers did not direct a higher ratio of commands to the computer, although such dialogue differences have been assumed in prior work. Results of this research reveal that amplitude is a powerful cue marking a speaker's intended addressee, which should be leveraged to design more effective microphone engagement during computer-assisted multiparty interactions.

Original languageEnglish
Title of host publicationICMI '06 - Proceedings of the 8th international conference on Multimodal interfaces
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Pages273-280
Number of pages8
ISBN (Print)159593541X, 9781595935410
DOIs
Publication statusPublished - 2006
Externally publishedYes
EventInternational Conference on Multimodal Interfaces 2006 - Banff, AB, Canada
Duration: 2 Nov 20064 Nov 2006
Conference number: 8th

Conference

ConferenceInternational Conference on Multimodal Interfaces 2006
Abbreviated titleICMI'06
CountryCanada
CityBanff, AB
Period2/11/064/11/06

Keywords

  • Collaborative peer tutoring
  • Computer-supported collaborative work
  • Dialogue style
  • Intended addressee
  • Multimodal interaction
  • Open-microphone engagement
  • Spoken amplitude
  • User communication modeling

Cite this

Lunsford, R., Oviatt, S., & Arthur, A. M. (2006). Toward open-microphone engagement for multiparty interactions. In ICMI '06 - Proceedings of the 8th international conference on Multimodal interfaces (pp. 273-280). Association for Computing Machinery (ACM). https://doi.org/10.1145/1180995.1181049