Modeling global and focal hyperarticulation during human-computer error resolution

Sharon Oviatt, Gina Anne Levow, Elliott Moreton, Margaret MacEachern

Research output: Contribution to journalArticleResearchpeer-review

26 Citations (Scopus)

Abstract

When resolving errors with interactive systems, people sometimes hyperarticulate - or adopt a clarified style of speech that has been associated with increased recognition errors. The primary goals of the present study were: (1) to provide a comprehensive analysis of acoustic, prosodic, and phonological adaptations to speech during human-computer error resolution after different types of recognition error; and (2) to examine changes in speech during both global and focal utterance repairs. A semi- automatic simulation method with a novel error-generation capability was used to compare speech immediately before and after system recognition errors. Matched original-repeat utterance pairs then were analyzed for type and magnitude 'of linguistic adaptation during global and focal repairs. Results indicated that the primary hyperarticulate changes in speech following all error types were durational, with increases in number and length of pauses most noteworthy. Speech also was adapted toward a more deliberate and hyperclear articulatory style. During focal error repairs, large durational effects functioned together with pitch and amplitude to provide selective prominence marking of the repair region. These results corroborate and generalize the computer-elicited hyperarticulate adaptation model (CHAM). Implications are discussed for improved error handling in next-generation spoken language and multimodal systems.

Original languageEnglish
Pages (from-to)3080-3098
Number of pages19
JournalJournal of the Acoustical Society of America
Volume104
Issue number5
DOIs
Publication statusPublished - 30 Oct 1998
Externally publishedYes

Cite this