Studying MOOC completion at scale using the MOOC replication framework

Juan Miguel L. Andres, Ryan S. Baker, Dragan Gašević, George Siemens, Scott A. Crossley, Srećko Joksimović

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

23 Citations (Scopus)


Research on learner behaviors and course completion within Massive Open Online Courses (MOOCs) has been mostly confined to single courses, making the findings difficult to generalize across different data sets and to assess which contexts and types of courses these findings apply to. This paper reports on the development of the MOOC Replication Framework (MORF), a framework that facilitates the replication of previously published findings across multiple data sets and the seamless integration of new findings as new research is conducted or new hypotheses are generated. In the proof of concept presented here, we use MORF to attempt to replicate 15 previously published findings across 29 iterations of 17 MOOCs. The findings indicate that 12 of the 15 findings replicated significantly across the data sets, and that two findings replicated significantly in the opposite direction. MORF enables larger-scale analysis of MOOC research questions than previously feasible, and enables researchers around the world to conduct analyses on huge multi-MOOC data sets without having to negotiate access to data.

Original languageEnglish
Title of host publicationProceedings of the 8th International Conference on Learning Analytics & Knowledge (LAK'18)
Subtitle of host publicationTowards User-Centred Learning Analytics
EditorsSimon Buckingham Shum, Rebecca Ferguson, Agathe Merceron, Xavier Ochoa
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages8
ISBN (Print)9781450364003
Publication statusPublished - 2018
Externally publishedYes
EventInternational Learning Analytics & Knowledge Conference 2018 - SMC Conference & Function Centre, Sydney, Australia
Duration: 5 Mar 20189 Mar 2018
Conference number: 8th (Conference website) (Proceedings)


ConferenceInternational Learning Analytics & Knowledge Conference 2018
Abbreviated titleLAK 2018
Internet address


  • Completion
  • Meta-analysis
  • MOOC replication framework
  • MOOCs
  • MORF
  • Multi-MOOC analysis
  • Replication

Cite this