Benchmarking introductory programming exams: How and why

Simon, Judy Sheard, Daryl D'Souza, Peter Klemperer, Leo Porter, Juha Sorva, Martijn Stegeman, Daniel Zingaro

    Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

    8 Citations (Scopus)

    Abstract

    Ten selected questions have been included in 13 introductory programming exams at seven institutions in five countries. The students' results on these questions, and on the exams as a whole, lead to the development of a benchmark against which the exams in other introductory programming courses can be assessed. We illustrate some potential benefits of comparing exam performance against this benchmark, and show other uses to which it can be put, for example to assess the size and the overall difficulty of an exam. We invite others to apply the benchmark to their own courses and to share the results with us.

    Original languageEnglish
    Title of host publicationProceedings of the 21st Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2016)
    Subtitle of host publication11th - 13th July 2016, Universidad Catolica San Pablo, Arequipa, Peru
    EditorsJanet Carter, Yvan Tupac
    Place of PublicationNew York, New York
    PublisherAssociation for Computing Machinery (ACM)
    Pages154-159
    Number of pages6
    ISBN (Electronic)9781450342315
    DOIs
    Publication statusPublished - 11 Jul 2016
    EventAnnual Conference on Innovation and Technology in Computer Science Education 2016 - Arequipa, Peru
    Duration: 11 Jul 201613 Jul 2016
    Conference number: 21st
    http://ucsp.edu.pe/iticse2016/
    https://dl.acm.org/doi/proceedings/10.1145/2899415 (Proceedings)

    Conference

    ConferenceAnnual Conference on Innovation and Technology in Computer Science Education 2016
    Abbreviated titleITiCSE 2016
    CountryPeru
    CityArequipa
    Period11/07/1613/07/16
    Other ITiCSE 2016, the 21th Annual Conference on Innovation and Technology in Computer Science Education, will take place in Arequipa, Peru, hosted by Universidad Católica San Pablo. The ACM Special Interest Group on Computer Science Education (SIGCSE) is sponsoring the event.
    Internet address

    Keywords

    • Benchmarking
    • Examination
    • Introductory programming

    Cite this