Benchmarking introductory programming exams: How and why

null Simon; Judy Sheard; Daryl D'Souza; Peter Klemperer; Leo Porter; Juha Sorva; Martijn Stegeman; Daniel Zingaro

doi:10.1145/2899415.2899473

Benchmarking introductory programming exams: How and why

Simon, Judy Sheard, Daryl D'Souza, Peter Klemperer, Leo Porter, Juha Sorva, Martijn Stegeman, Daniel Zingaro

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

8 Citations (Scopus)

Abstract

Ten selected questions have been included in 13 introductory programming exams at seven institutions in five countries. The students' results on these questions, and on the exams as a whole, lead to the development of a benchmark against which the exams in other introductory programming courses can be assessed. We illustrate some potential benefits of comparing exam performance against this benchmark, and show other uses to which it can be put, for example to assess the size and the overall difficulty of an exam. We invite others to apply the benchmark to their own courses and to share the results with us.

Original language	English
Title of host publication	Proceedings of the 21st Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2016)
Subtitle of host publication	11th - 13th July 2016, Universidad Catolica San Pablo, Arequipa, Peru
Editors	Janet Carter, Yvan Tupac
Place of Publication	New York, New York
Publisher	Association for Computing Machinery (ACM)
Pages	154-159
Number of pages	6
ISBN (Electronic)	9781450342315
DOIs	https://doi.org/10.1145/2899415.2899473
Publication status	Published - 11 Jul 2016
Event	Annual Conference on Innovation and Technology in Computer Science Education 2016 - Arequipa, Peru Duration: 11 Jul 2016 → 13 Jul 2016 Conference number: 21st http://ucsp.edu.pe/iticse2016/ https://dl.acm.org/doi/proceedings/10.1145/2899415 (Proceedings)

Conference

Conference	Annual Conference on Innovation and Technology in Computer Science Education 2016
Abbreviated title	ITiCSE 2016
Country	Peru
City	Arequipa
Period	11/07/16 → 13/07/16
Other	ITiCSE 2016, the 21th Annual Conference on Innovation and Technology in Computer Science Education, will take place in Arequipa, Peru, hosted by Universidad Católica San Pablo. The ACM Special Interest Group on Computer Science Education (SIGCSE) is sponsoring the event.
Internet address	http://ucsp.edu.pe/iticse2016/ https://dl.acm.org/doi/proceedings/10.1145/2899415 (Proceedings)

Keywords

Benchmarking
Examination
Introductory programming

Access to Document

10.1145/2899415.2899473

Link to publication in Scopus

Cite this

Simon, Sheard, J., D'Souza, D., Klemperer, P., Porter, L., Sorva, J., Stegeman, M., & Zingaro, D. (2016). Benchmarking introductory programming exams: How and why. In J. Carter, & Y. Tupac (Eds.), Proceedings of the 21st Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2016): 11th - 13th July 2016, Universidad Catolica San Pablo, Arequipa, Peru (pp. 154-159). Association for Computing Machinery (ACM). https://doi.org/10.1145/2899415.2899473

Simon, ; Sheard, Judy ; D'Souza, Daryl ; Klemperer, Peter ; Porter, Leo ; Sorva, Juha ; Stegeman, Martijn ; Zingaro, Daniel. / Benchmarking introductory programming exams : How and why. Proceedings of the 21st Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2016): 11th - 13th July 2016, Universidad Catolica San Pablo, Arequipa, Peru. editor / Janet Carter ; Yvan Tupac. New York, New York : Association for Computing Machinery (ACM), 2016. pp. 154-159

@inproceedings{67bffa382fc84be8986126886d229ab3,

title = "Benchmarking introductory programming exams: How and why",

abstract = "Ten selected questions have been included in 13 introductory programming exams at seven institutions in five countries. The students' results on these questions, and on the exams as a whole, lead to the development of a benchmark against which the exams in other introductory programming courses can be assessed. We illustrate some potential benefits of comparing exam performance against this benchmark, and show other uses to which it can be put, for example to assess the size and the overall difficulty of an exam. We invite others to apply the benchmark to their own courses and to share the results with us.",

keywords = "Benchmarking, Examination, Introductory programming",

author = "Simon and Judy Sheard and Daryl D'Souza and Peter Klemperer and Leo Porter and Juha Sorva and Martijn Stegeman and Daniel Zingaro",

year = "2016",

month = jul,

day = "11",

doi = "10.1145/2899415.2899473",

language = "English",

pages = "154--159",

editor = "{ Carter}, Janet and Tupac, {Yvan }",

booktitle = "Proceedings of the 21st Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2016)",

publisher = "Association for Computing Machinery (ACM)",

address = "United States of America",

note = "Annual Conference on Innovation and Technology in Computer Science Education 2016, ITiCSE 2016 ; Conference date: 11-07-2016 Through 13-07-2016",

url = "http://ucsp.edu.pe/iticse2016/, https://dl.acm.org/doi/proceedings/10.1145/2899415",

}

Simon, , Sheard, J, D'Souza, D, Klemperer, P, Porter, L, Sorva, J, Stegeman, M & Zingaro, D 2016, Benchmarking introductory programming exams: How and why. in J Carter & Y Tupac (eds), Proceedings of the 21st Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2016): 11th - 13th July 2016, Universidad Catolica San Pablo, Arequipa, Peru. Association for Computing Machinery (ACM), New York, New York, pp. 154-159, Annual Conference on Innovation and Technology in Computer Science Education 2016, Arequipa, Peru, 11/07/16. https://doi.org/10.1145/2899415.2899473

Benchmarking introductory programming exams : How and why. / Simon, ; Sheard, Judy; D'Souza, Daryl; Klemperer, Peter; Porter, Leo; Sorva, Juha; Stegeman, Martijn; Zingaro, Daniel.

Proceedings of the 21st Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2016): 11th - 13th July 2016, Universidad Catolica San Pablo, Arequipa, Peru. ed. / Janet Carter; Yvan Tupac. New York, New York : Association for Computing Machinery (ACM), 2016. p. 154-159.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Benchmarking introductory programming exams

T2 - Annual Conference on Innovation and Technology in Computer Science Education 2016

AU - Simon, null

AU - Sheard, Judy

AU - D'Souza, Daryl

AU - Klemperer, Peter

AU - Porter, Leo

AU - Sorva, Juha

AU - Stegeman, Martijn

AU - Zingaro, Daniel

N1 - Conference code: 21st

PY - 2016/7/11

Y1 - 2016/7/11

N2 - Ten selected questions have been included in 13 introductory programming exams at seven institutions in five countries. The students' results on these questions, and on the exams as a whole, lead to the development of a benchmark against which the exams in other introductory programming courses can be assessed. We illustrate some potential benefits of comparing exam performance against this benchmark, and show other uses to which it can be put, for example to assess the size and the overall difficulty of an exam. We invite others to apply the benchmark to their own courses and to share the results with us.

AB - Ten selected questions have been included in 13 introductory programming exams at seven institutions in five countries. The students' results on these questions, and on the exams as a whole, lead to the development of a benchmark against which the exams in other introductory programming courses can be assessed. We illustrate some potential benefits of comparing exam performance against this benchmark, and show other uses to which it can be put, for example to assess the size and the overall difficulty of an exam. We invite others to apply the benchmark to their own courses and to share the results with us.

KW - Benchmarking

KW - Examination

KW - Introductory programming

UR - http://www.scopus.com/inward/record.url?scp=84979766119&partnerID=8YFLogxK

U2 - 10.1145/2899415.2899473

DO - 10.1145/2899415.2899473

M3 - Conference Paper

AN - SCOPUS:84979766119

SP - 154

EP - 159

BT - Proceedings of the 21st Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2016)

A2 - Carter, Janet

A2 - Tupac, Yvan

PB - Association for Computing Machinery (ACM)

CY - New York, New York

Y2 - 11 July 2016 through 13 July 2016

ER -

Simon , Sheard J, D'Souza D, Klemperer P, Porter L, Sorva J et al. Benchmarking introductory programming exams: How and why. In Carter J, Tupac Y, editors, Proceedings of the 21st Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2016): 11th - 13th July 2016, Universidad Catolica San Pablo, Arequipa, Peru. New York, New York: Association for Computing Machinery (ACM). 2016. p. 154-159 https://doi.org/10.1145/2899415.2899473