NAIST at the CLEF 2013 QA4MRE pilot task

Philip Arthur; Graham Neubig; Sakriani Sakti; Tomoki Toda; Satoshi Nakamura

NAIST at the CLEF 2013 QA4MRE pilot task

Philip Arthur, Graham Neubig, Sakriani Sakti, Tomoki Toda, Satoshi Nakamura

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

Abstract

This paper describes the Nara Institute of Science and Technology's system for the entrance exam pilot task of CLEF 2013 QA4MRE. The core of the system is a similar to the system for the main task of CLEF 2013 QA4MRE. We use minimum error rate training (MERT) to train the weights of the model and also propose a novel method for MERT with the addition of a threshold that defines the certainty with which we must answer questions. The system received a score of 22% c@1.

Original language	English
Title of host publication	2013 Cross Language Evaluation Forum Conference
Volume	1179
Publication status	Published - 2013
Externally published	Yes
Event	Cross Language Evaluation Forum Conference 2013 - Valencia, Spain Duration: 23 Sept 2013 → 26 Sept 2013 Conference number: 4th http://clef2013.clef-initiative.eu/index.php

Conference

Conference	Cross Language Evaluation Forum Conference 2013
Abbreviated title	CLEF 2013
Country/Territory	Spain
City	Valencia
Period	23/09/13 → 26/09/13
Internet address	http://clef2013.clef-initiative.eu/index.php

Keywords

Discriminative learning
Inter-sentence features
Linear feature model
Machine reading
Minimum error rate training
Question answering

Cite this

@inproceedings{7fb869691a674e56a214686d6ccdb242,

title = "NAIST at the CLEF 2013 QA4MRE pilot task",

abstract = "This paper describes the Nara Institute of Science and Technology's system for the entrance exam pilot task of CLEF 2013 QA4MRE. The core of the system is a similar to the system for the main task of CLEF 2013 QA4MRE. We use minimum error rate training (MERT) to train the weights of the model and also propose a novel method for MERT with the addition of a threshold that defines the certainty with which we must answer questions. The system received a score of 22\% c@1.",

keywords = "Discriminative learning, Inter-sentence features, Linear feature model, Machine reading, Minimum error rate training, Question answering",

author = "Philip Arthur and Graham Neubig and Sakriani Sakti and Tomoki Toda and Satoshi Nakamura",

year = "2013",

language = "English",

volume = "1179",

booktitle = "2013 Cross Language Evaluation Forum Conference",

note = "Cross Language Evaluation Forum Conference 2013, CLEF 2013 ; Conference date: 23-09-2013 Through 26-09-2013",

url = "http://clef2013.clef-initiative.eu/index.php",

}

TY - GEN

T1 - NAIST at the CLEF 2013 QA4MRE pilot task

AU - Arthur, Philip

AU - Neubig, Graham

AU - Sakti, Sakriani

AU - Toda, Tomoki

AU - Nakamura, Satoshi

N1 - Conference code: 4th

PY - 2013

Y1 - 2013

N2 - This paper describes the Nara Institute of Science and Technology's system for the entrance exam pilot task of CLEF 2013 QA4MRE. The core of the system is a similar to the system for the main task of CLEF 2013 QA4MRE. We use minimum error rate training (MERT) to train the weights of the model and also propose a novel method for MERT with the addition of a threshold that defines the certainty with which we must answer questions. The system received a score of 22% c@1.

AB - This paper describes the Nara Institute of Science and Technology's system for the entrance exam pilot task of CLEF 2013 QA4MRE. The core of the system is a similar to the system for the main task of CLEF 2013 QA4MRE. We use minimum error rate training (MERT) to train the weights of the model and also propose a novel method for MERT with the addition of a threshold that defines the certainty with which we must answer questions. The system received a score of 22% c@1.

KW - Discriminative learning

KW - Inter-sentence features

KW - Linear feature model

KW - Machine reading

KW - Minimum error rate training

KW - Question answering

UR - https://www.scopus.com/pages/publications/84922051490

M3 - Conference Paper

AN - SCOPUS:84922051490

VL - 1179

BT - 2013 Cross Language Evaluation Forum Conference

T2 - Cross Language Evaluation Forum Conference 2013

Y2 - 23 September 2013 through 26 September 2013

ER -

NAIST at the CLEF 2013 QA4MRE pilot task

Abstract

Conference

Keywords

Other files and links

Cite this