VizChat: Enhancing Learning Analytics Dashboards with Contextualised Explanations Using Multimodal Generative AI Chatbots

Lixiang Yan, Linxuan Zhao, Vanessa Echeverria, Yueqiao Jin, Riordan Alfredo, Xinyu Li, Dragan Gaševi’c, Roberto Martinez-Maldonado

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

17 Citations (Scopus)

Abstract

Learning analytics dashboards (LADs) serve as pivotal tools in transforming complex learner data into actionable insights for educational stakeholders. Despite their potential, the effectiveness of LADs, particularly the visualisations they utilise, has been under scrutiny. Concerns have been raised about their potential to cause cognitive overload, especially for users with limited data visualisation literacy, thus questioning their practical utility in supporting decision-making and reflective practices. This tool paper tackles these concerns by introducing VizChat, an open-sourced, prototype chatbot designed to augment LADs by providing contextualised, AI-generated explanations for visualisations. Developed on multimodal generative AI (GPT-4V) and retrieval-augmented generation (Langchain), VizChat offers on-demand, contextually relevant explanations that aim to improve user comprehension without overwhelming them with excessive information. Through a case study, we demonstrated VizChat’s diverse capabilities, including actively seeking clarifications on ambiguous queries, personalising responses based on previous user interactions, providing contextually relevant explanations of specific visualisations, integrating information from multiple visualisations for a comprehensive response, and offering detailed insights into the data collection and analysis processes behind each visualisation. Such efforts support the paradigm shift from exploratory to explanatory approaches in LADs, highlighting the potential of integrating generative AI and chatbots to enhance the educational value of learning analytics.

Original languageEnglish
Title of host publicationArtificial Intelligence in Education - 25th International Conference, AIED 2024 Recife, Brazil, July 8–12, 2024 Proceedings, Part II
EditorsAndrew M. Olney, Irene-Angelica Chounta, Zitao Liu, Olga C. Santos, Ig Ibert Bittencourt
Place of PublicationCham Switzerland
PublisherSpringer
Pages180-193
Number of pages14
ISBN (Electronic)9783031642999
ISBN (Print)9783031642982
DOIs
Publication statusPublished - 2024
EventInternational Conference on Artificial Intelligence in Education 2024 - Recife, Brazil
Duration: 8 Jul 202412 Jul 2024
Conference number: 25th
https://link.springer.com/book/10.1007/978-3-031-64299-9 (Proceedings)
https://aied2024.cesar.school/ (Website)

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
Volume14830
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceInternational Conference on Artificial Intelligence in Education 2024
Abbreviated titleAIED 2024
Country/TerritoryBrazil
CityRecife
Period8/07/2412/07/24
Internet address

Keywords

  • Chatbots
  • Generative Artificial Intelligence
  • GPT
  • Learning Analytics
  • LLM
  • Multimodal
  • Visualisation

Cite this