Evaluating multiple choice question generator

Sieow Yeek Tan; Ching Chieh Kiu; Dickson Lukose

doi:10.1007/978-3-642-32826-8_29

Evaluating multiple choice question generator

Sieow Yeek Tan, Ching Chieh Kiu, Dickson Lukose

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

3 Citations (Scopus)

Abstract

Semantic-based computer-assisted automated question generator has been increasingly popular as a tool for creating personalized assessment questions.Various question generator tools have been proposed, such as those which generate structured question from a text file, generate Multiple Choice Question (MCQ) from a text file or from ontology-based knowledge representation. A comparison framework and evaluation methodology is required to evaluate different question generator tools. This paper discusses the requirement and criteria to carry out performance comparison of different MCQ generator. A feature comparison of Question Generation (QG) tool, namely Mimos-QG with the existing QG tools is presented. We have evaluated our QG tool based on several standard criteria such as the correctness of (a) distractor generation, (b) answer choice grouping strategy and (c) syntactical and pedagogical quality on three different domain ontologies. The experimental result indicated that Mimos-QG is capable of producing good quality direct type and grouping type multiple choice questions.

Original language	English
Title of host publication	Knowledge Technology - Third Knowledge Technology Week, KTW 2011, Revised Selected Papers
Pages	283-292
Number of pages	10
DOIs	https://doi.org/10.1007/978-3-642-32826-8_29
Publication status	Published - 2012
Externally published	Yes
Event	Knowledge Technology Week 2011 - Kajang, Malaysia Duration: 18 Jul 2011 → 22 Jul 2011 Conference number: 3rd https://link.springer.com/book/10.1007%2F978-3-642-32826-8 (SpringerLink - entire proceedings)

Publication series

Name	Communications in Computer and Information Science
Volume	295 CCIS
ISSN (Print)	1865-0929

Conference

Conference	Knowledge Technology Week 2011
Abbreviated title	KTW 2011
Country/Territory	Malaysia
City	Kajang
Period	18/07/11 → 22/07/11
Internet address	https://link.springer.com/book/10.1007%2F978-3-642-32826-8 (SpringerLink - entire proceedings)

Keywords

Education Technology
Multiple Choice Question Generator
Ontology
Question Generator
Semantic Web

Access to Document

10.1007/978-3-642-32826-8_29

Cite this

@inproceedings{ecbb7a0b03ce4b6ea75a38fb954bfc73,

title = "Evaluating multiple choice question generator",

abstract = "Semantic-based computer-assisted automated question generator has been increasingly popular as a tool for creating personalized assessment questions.Various question generator tools have been proposed, such as those which generate structured question from a text file, generate Multiple Choice Question (MCQ) from a text file or from ontology-based knowledge representation. A comparison framework and evaluation methodology is required to evaluate different question generator tools. This paper discusses the requirement and criteria to carry out performance comparison of different MCQ generator. A feature comparison of Question Generation (QG) tool, namely Mimos-QG with the existing QG tools is presented. We have evaluated our QG tool based on several standard criteria such as the correctness of (a) distractor generation, (b) answer choice grouping strategy and (c) syntactical and pedagogical quality on three different domain ontologies. The experimental result indicated that Mimos-QG is capable of producing good quality direct type and grouping type multiple choice questions.",

keywords = "Education Technology, Multiple Choice Question Generator, Ontology, Question Generator, Semantic Web",

author = "Tan, {Sieow Yeek} and Kiu, {Ching Chieh} and Dickson Lukose",

year = "2012",

doi = "10.1007/978-3-642-32826-8_29",

language = "English",

isbn = "9783642328251",

series = "Communications in Computer and Information Science",

pages = "283--292",

booktitle = "Knowledge Technology - Third Knowledge Technology Week, KTW 2011, Revised Selected Papers",

note = "Knowledge Technology Week 2011, KTW 2011 ; Conference date: 18-07-2011 Through 22-07-2011",

url = "https://link.springer.com/book/10.1007%2F978-3-642-32826-8",

}

Evaluating multiple choice question generator. / Tan, Sieow Yeek; Kiu, Ching Chieh; Lukose, Dickson.
Knowledge Technology - Third Knowledge Technology Week, KTW 2011, Revised Selected Papers. 2012. p. 283-292 (Communications in Computer and Information Science; Vol. 295 CCIS).

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Evaluating multiple choice question generator

AU - Tan, Sieow Yeek

AU - Kiu, Ching Chieh

AU - Lukose, Dickson

N1 - Conference code: 3rd

PY - 2012

Y1 - 2012

N2 - Semantic-based computer-assisted automated question generator has been increasingly popular as a tool for creating personalized assessment questions.Various question generator tools have been proposed, such as those which generate structured question from a text file, generate Multiple Choice Question (MCQ) from a text file or from ontology-based knowledge representation. A comparison framework and evaluation methodology is required to evaluate different question generator tools. This paper discusses the requirement and criteria to carry out performance comparison of different MCQ generator. A feature comparison of Question Generation (QG) tool, namely Mimos-QG with the existing QG tools is presented. We have evaluated our QG tool based on several standard criteria such as the correctness of (a) distractor generation, (b) answer choice grouping strategy and (c) syntactical and pedagogical quality on three different domain ontologies. The experimental result indicated that Mimos-QG is capable of producing good quality direct type and grouping type multiple choice questions.

AB - Semantic-based computer-assisted automated question generator has been increasingly popular as a tool for creating personalized assessment questions.Various question generator tools have been proposed, such as those which generate structured question from a text file, generate Multiple Choice Question (MCQ) from a text file or from ontology-based knowledge representation. A comparison framework and evaluation methodology is required to evaluate different question generator tools. This paper discusses the requirement and criteria to carry out performance comparison of different MCQ generator. A feature comparison of Question Generation (QG) tool, namely Mimos-QG with the existing QG tools is presented. We have evaluated our QG tool based on several standard criteria such as the correctness of (a) distractor generation, (b) answer choice grouping strategy and (c) syntactical and pedagogical quality on three different domain ontologies. The experimental result indicated that Mimos-QG is capable of producing good quality direct type and grouping type multiple choice questions.

KW - Education Technology

KW - Multiple Choice Question Generator

KW - Ontology

KW - Question Generator

KW - Semantic Web

UR - http://www.scopus.com/inward/record.url?scp=84865599315&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-32826-8_29

DO - 10.1007/978-3-642-32826-8_29

M3 - Conference Paper

AN - SCOPUS:84865599315

SN - 9783642328251

T3 - Communications in Computer and Information Science

SP - 283

EP - 292

BT - Knowledge Technology - Third Knowledge Technology Week, KTW 2011, Revised Selected Papers

T2 - Knowledge Technology Week 2011

Y2 - 18 July 2011 through 22 July 2011

ER -

Evaluating multiple choice question generator

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Cite this