UserFlow: a tool for visualizing fine-grained contextual analytics in teaching documents

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

The adoption of innovative online teaching tools in Computer Science (CS) courses provides opportunities for data-informed instruction as a regular teaching practice in CS classrooms. In this paper, we present a design study for an interactive visual analytics dashboard, called UserFlow, that supports feedback collection from teaching documents and assists instructors in interpreting feedback and acting on it in a timely manner. The design study is conducted with eight domain experts comprising of four teaching instructors, two learning analytics (LA) experts and two instructional designers. UserFlow offers a set of novel visualization designs for presenting the four interleaving aspects of document engagement (i.e., annotations, document traversal path, reading/focus time and student information). We evaluated UserFlow in an undergraduate computer science course with over 700 students. Our results demonstrate the usefulness and need for such a tool for CS educators to inform teaching approaches and courseware improvement.

Original languageEnglish
Title of host publicationProceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education
EditorsAndrew Luxton-Reilly, Monica Divitini
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Pages384-390
Number of pages7
ISBN (Electronic)9781450368742
DOIs
Publication statusPublished - Jun 2020
EventAnnual Conference on Innovation and Technology in Computer Science Education 2020 - Trondheim, Norway
Duration: 17 Jun 202018 Jun 2020
Conference number: 25th
https://iticse.acm.org (Website)
https://dl.acm.org/doi/proceedings/10.1145/3341525 (Proceedings)

Conference

ConferenceAnnual Conference on Innovation and Technology in Computer Science Education 2020
Abbreviated titleITiCSE 2020
CountryNorway
CityTrondheim
Period17/06/2018/06/20
Internet address

Keywords

  • analytics
  • annotations
  • dashboards
  • digital education
  • engagement

Cite this

Singh, S., Meyer, B., & Wybrow, M. (2020). UserFlow: a tool for visualizing fine-grained contextual analytics in teaching documents. In A. Luxton-Reilly, & M. Divitini (Eds.), Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education (pp. 384-390). Association for Computing Machinery (ACM). https://doi.org/10.1145/3341525.3387410