Evaluating an open learner model visualisation prototype tool with user experience metrics

Check-Yee Law, John Grundy, Andrew Cain, Karola Von Baggo, Rajesh Vasa

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review


Learning management systems (LMS) are widely used in many educational environments. Although usability is widely acknowledged as a desired quality attribute, it has not been deeply investigated in the context of LMS systems where it has to align with pedagogy. In this research we evaluate extensions to an LMS designed to support the implementation of constructive alignment for technical units using a Task-Oriented Portfolio approach. The LMS application was extended with a range of open learner model-based visualisations to help staff and students monitor progress towards achieving unit intended learning outcomes throughout unit delivery. This paper reports on a case study of a formative usability testing of the prototype tool by using User eXperience (UX) metrics. The results unveil the potential usability issues and ways to improve the design of the prototype tool to better cater the actual target user needs.

Original languageEnglish
Title of host publicationProceedings - 25th Australasian Software Engineering Conference, ASWEC 2018
Subtitle of host publication28–29 November 2018 Adelaide, Australia
EditorsHoa Dam, Stuart Marshall
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages10
ISBN (Electronic)9781728112411
ISBN (Print)9781728112428
Publication statusPublished - 2018
EventAustralasian Software Engineering Conference 2018 - University of Adelaide, Adelaide, Australia
Duration: 26 Nov 201830 Nov 2018
Conference number: 25th
https://ieeexplore.ieee.org/xpl/conhome/8575098/proceeding (Proceedings)


ConferenceAustralasian Software Engineering Conference 2018
Abbreviated titleASWEC 2018
Internet address


  • Constructive alignment
  • Educational software
  • Formative usability testing
  • Open learner model
  • Outcome based learning
  • Pearson correlation
  • Prototype tool
  • Software development
  • User experience metrics
  • Visualisation

Cite this