NAIST at the CLEF 2013 QA4MRE pilot task

Philip Arthur; Graham Neubig; Sakriani Sakti; Tomoki Toda; Satoshi Nakamura

NAIST at the CLEF 2013 QA4MRE pilot task

Philip Arthur, Graham Neubig, Sakriani Sakti, Tomoki Toda, Satoshi Nakamura

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

Abstract

This paper describes the Nara Institute of Science and Technology's system for the entrance exam pilot task of CLEF 2013 QA4MRE. The core of the system is a similar to the system for the main task of CLEF 2013 QA4MRE. We use minimum error rate training (MERT) to train the weights of the model and also propose a novel method for MERT with the addition of a threshold that defines the certainty with which we must answer questions. The system received a score of 22% c@1.

Original language	English
Title of host publication	2013 Cross Language Evaluation Forum Conference
Volume	1179
Publication status	Published - 2013
Externally published	Yes
Event	2013 Cross Language Evaluation Forum Conference, CLEF 2013 - Valencia, Spain Duration: 23 Sep 2013 → 26 Sep 2013

Conference

Conference	2013 Cross Language Evaluation Forum Conference, CLEF 2013
Country	Spain
City	Valencia
Period	23/09/13 → 26/09/13

Keywords

Discriminative learning
Inter-sentence features
Linear feature model
Machine reading
Minimum error rate training
Question answering

Access to Document

Link to publication in Scopus

Cite this

@inproceedings{7fb869691a674e56a214686d6ccdb242,

title = "NAIST at the CLEF 2013 QA4MRE pilot task",

abstract = "This paper describes the Nara Institute of Science and Technology's system for the entrance exam pilot task of CLEF 2013 QA4MRE. The core of the system is a similar to the system for the main task of CLEF 2013 QA4MRE. We use minimum error rate training (MERT) to train the weights of the model and also propose a novel method for MERT with the addition of a threshold that defines the certainty with which we must answer questions. The system received a score of 22% c@1.",

keywords = "Discriminative learning, Inter-sentence features, Linear feature model, Machine reading, Minimum error rate training, Question answering",

author = "Philip Arthur and Graham Neubig and Sakriani Sakti and Tomoki Toda and Satoshi Nakamura",

year = "2013",

language = "English",

volume = "1179",

booktitle = "2013 Cross Language Evaluation Forum Conference",

note = "2013 Cross Language Evaluation Forum Conference, CLEF 2013 ; Conference date: 23-09-2013 Through 26-09-2013",

}

TY - GEN

T1 - NAIST at the CLEF 2013 QA4MRE pilot task

AU - Arthur, Philip

AU - Neubig, Graham

AU - Sakti, Sakriani

AU - Toda, Tomoki

AU - Nakamura, Satoshi

PY - 2013

Y1 - 2013

N2 - This paper describes the Nara Institute of Science and Technology's system for the entrance exam pilot task of CLEF 2013 QA4MRE. The core of the system is a similar to the system for the main task of CLEF 2013 QA4MRE. We use minimum error rate training (MERT) to train the weights of the model and also propose a novel method for MERT with the addition of a threshold that defines the certainty with which we must answer questions. The system received a score of 22% c@1.

AB - This paper describes the Nara Institute of Science and Technology's system for the entrance exam pilot task of CLEF 2013 QA4MRE. The core of the system is a similar to the system for the main task of CLEF 2013 QA4MRE. We use minimum error rate training (MERT) to train the weights of the model and also propose a novel method for MERT with the addition of a threshold that defines the certainty with which we must answer questions. The system received a score of 22% c@1.

KW - Discriminative learning

KW - Inter-sentence features

KW - Linear feature model

KW - Machine reading

KW - Minimum error rate training

KW - Question answering

UR - http://www.scopus.com/inward/record.url?scp=84922051490&partnerID=8YFLogxK

M3 - Conference Paper

AN - SCOPUS:84922051490

VL - 1179

BT - 2013 Cross Language Evaluation Forum Conference

T2 - 2013 Cross Language Evaluation Forum Conference, CLEF 2013

Y2 - 23 September 2013 through 26 September 2013

ER -