Evaluation of the Scusi? Spoken language interpretation system - A case study

Thomas Kleinbauer, Ingrid Zukerman, Su Nam Kim

    Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

    4 Citations (Scopus)

    Abstract

    We present a performance evaluation framework for Spoken Language Understanding (SLU) modules, focusing on three elements: (1) characterization of spoken utterances, (2) experimental design, and (3) quantitative evaluation metrics. We then describe the application of our framework to Scusi?— our SLU system that focuses on referring expressions.

    Original languageEnglish
    Title of host publicationSixth International Joint Conference on Natural Language Processing (ICNLP 2013), Proceedings of the Main Conference
    EditorsRuslan Mitkov, Jong C Park
    Place of PublicationStroudsburg PA USA
    PublisherAssociation for Computational Linguistics (ACL)
    Pages225-233
    Number of pages9
    ISBN (Electronic)9784990734800
    ISBN (Print)9784990734800
    Publication statusPublished - 2013
    EventInternational Joint Conference on Natural Language Processing 2013 - Nagoya, Japan
    Duration: 14 Oct 201318 Oct 2013
    Conference number: 6th

    Conference

    ConferenceInternational Joint Conference on Natural Language Processing 2013
    Abbreviated titleIJCNLP 2013
    Country/TerritoryJapan
    CityNagoya
    Period14/10/1318/10/13

    Cite this