A systematic review of empirical studies on learning analytics dashboards

a self-regulated learning perspective

Wannisa Matcha, Nora'ayu Ahmad Uzir, Dragan Gašević, Abelardo Pardo

Research output: Contribution to journalArticleResearchpeer-review

Abstract

This paper presents a systematic literature review of learning analytics dashboards (LADs) research that reports empirical findings to assess the impact on learning and teaching. Several previous literature reviews identified self-regulated learning as a primary focus of LADs. However, there has been much less understanding how learning analytics are grounded in the literature on self-regulated learning and how self-regulated learning is supported. To address this limitation, this review analyzed the existing empirical studies on LADs based on the well-known model of self-regulated learning proposed by Winne and Hadwin. The results show that existing LADs i) are rarely grounded in learning theory; ii) cannot be suggested to support metacognition; iii) do not offer any information about effective learning tactics and strategies; and iv) have significant limitations in how their evaluation is conducted and reported. Based on the findings of the study and through the synthesis of the literature, the paper proposes that future research and development should not make any a priori design decisions about representation of data and analytic results in learning analytics systems such as LADs. To formalize this proposal, the paper defines the model for user-centered learning analytics systems (MULAS). MULAS consists of the four dimensions that are cyclically and recursively inter-connected including: theory, design, feedback, and evaluation.
Original languageEnglish
Number of pages20
JournalIEEE Transactions on Learning Technologies
DOIs
Publication statusAccepted/In press - 14 May 2019

Keywords

  • learning analytics
  • Information visualisation
  • data science
  • dashboards

Cite this

@article{3f6b4eaf91704dd5a49416b76b731c47,
title = "A systematic review of empirical studies on learning analytics dashboards: a self-regulated learning perspective",
abstract = "This paper presents a systematic literature review of learning analytics dashboards (LADs) research that reports empirical findings to assess the impact on learning and teaching. Several previous literature reviews identified self-regulated learning as a primary focus of LADs. However, there has been much less understanding how learning analytics are grounded in the literature on self-regulated learning and how self-regulated learning is supported. To address this limitation, this review analyzed the existing empirical studies on LADs based on the well-known model of self-regulated learning proposed by Winne and Hadwin. The results show that existing LADs i) are rarely grounded in learning theory; ii) cannot be suggested to support metacognition; iii) do not offer any information about effective learning tactics and strategies; and iv) have significant limitations in how their evaluation is conducted and reported. Based on the findings of the study and through the synthesis of the literature, the paper proposes that future research and development should not make any a priori design decisions about representation of data and analytic results in learning analytics systems such as LADs. To formalize this proposal, the paper defines the model for user-centered learning analytics systems (MULAS). MULAS consists of the four dimensions that are cyclically and recursively inter-connected including: theory, design, feedback, and evaluation.",
keywords = "learning analytics, Information visualisation, data science, dashboards",
author = "Wannisa Matcha and Uzir, {Nora'ayu Ahmad} and Dragan Gašević and Abelardo Pardo",
year = "2019",
month = "5",
day = "14",
doi = "10.1109/TLT.2019.2916802",
language = "English",
journal = "IEEE Transactions on Learning Technologies",
issn = "1939-1382",
publisher = "IEEE, Institute of Electrical and Electronics Engineers",

}

A systematic review of empirical studies on learning analytics dashboards : a self-regulated learning perspective. / Matcha, Wannisa; Uzir, Nora'ayu Ahmad; Gašević, Dragan; Pardo, Abelardo.

In: IEEE Transactions on Learning Technologies, 14.05.2019.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - A systematic review of empirical studies on learning analytics dashboards

T2 - a self-regulated learning perspective

AU - Matcha, Wannisa

AU - Uzir, Nora'ayu Ahmad

AU - Gašević, Dragan

AU - Pardo, Abelardo

PY - 2019/5/14

Y1 - 2019/5/14

N2 - This paper presents a systematic literature review of learning analytics dashboards (LADs) research that reports empirical findings to assess the impact on learning and teaching. Several previous literature reviews identified self-regulated learning as a primary focus of LADs. However, there has been much less understanding how learning analytics are grounded in the literature on self-regulated learning and how self-regulated learning is supported. To address this limitation, this review analyzed the existing empirical studies on LADs based on the well-known model of self-regulated learning proposed by Winne and Hadwin. The results show that existing LADs i) are rarely grounded in learning theory; ii) cannot be suggested to support metacognition; iii) do not offer any information about effective learning tactics and strategies; and iv) have significant limitations in how their evaluation is conducted and reported. Based on the findings of the study and through the synthesis of the literature, the paper proposes that future research and development should not make any a priori design decisions about representation of data and analytic results in learning analytics systems such as LADs. To formalize this proposal, the paper defines the model for user-centered learning analytics systems (MULAS). MULAS consists of the four dimensions that are cyclically and recursively inter-connected including: theory, design, feedback, and evaluation.

AB - This paper presents a systematic literature review of learning analytics dashboards (LADs) research that reports empirical findings to assess the impact on learning and teaching. Several previous literature reviews identified self-regulated learning as a primary focus of LADs. However, there has been much less understanding how learning analytics are grounded in the literature on self-regulated learning and how self-regulated learning is supported. To address this limitation, this review analyzed the existing empirical studies on LADs based on the well-known model of self-regulated learning proposed by Winne and Hadwin. The results show that existing LADs i) are rarely grounded in learning theory; ii) cannot be suggested to support metacognition; iii) do not offer any information about effective learning tactics and strategies; and iv) have significant limitations in how their evaluation is conducted and reported. Based on the findings of the study and through the synthesis of the literature, the paper proposes that future research and development should not make any a priori design decisions about representation of data and analytic results in learning analytics systems such as LADs. To formalize this proposal, the paper defines the model for user-centered learning analytics systems (MULAS). MULAS consists of the four dimensions that are cyclically and recursively inter-connected including: theory, design, feedback, and evaluation.

KW - learning analytics

KW - Information visualisation

KW - data science

KW - dashboards

U2 - 10.1109/TLT.2019.2916802

DO - 10.1109/TLT.2019.2916802

M3 - Article

JO - IEEE Transactions on Learning Technologies

JF - IEEE Transactions on Learning Technologies

SN - 1939-1382

ER -