ICMI 2013 Grand Challenge Workshop on Multimodal Learning Analytics

Louis Philippe Morency, Sharon Oviatt, Stefan Scherer, Nadir Weibel, Marcelo Worsley

Research output: Chapter in Book/Report/Conference proceedingConference PaperOtherpeer-review

16 Citations (Scopus)


Advances in learning analytics are contributing new empirical findings, theories, methods, and metrics for understanding how students learn. It also contributes to improving pedagogical support for students' learning through assessment of new digital tools, teaching strategies, and curricula. Multimodal learning analytics (MMLA) [1] is an extension of learning analytics and emphasizes the analysis of natural rich modalities of communication across a variety of learning contexts. This MMLA Grand Challenge combines expertise from the learning sciences and machine learning in order to highlight the rich opportunities that exist at the intersection of these disciplines. As part of the Grand Challenge, researchers were asked to predict: (1) which student in a group was the dominant domain expert, and (2) which problems that the group worked on would be solved correctly or not. Analyses were based on a combination of speech, digital pen and video data. This paper describes the motivation for the grand challenge, the publicly available data resources and results reported by the challenge participants. The results demonstrate that multimodal prediction of the challenge goals: (1) is surprisingly reliable using rich multimodal data sources, (2) can be accomplished using any of the three modalities explored, and (3) need not be based on content analysis.

Original languageEnglish
Title of host publicationICMI'13 - Proceedings of the 15th ACM on International conference on multimodal interaction
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages5
ISBN (Print)9781450321297
Publication statusPublished - 2013
Externally publishedYes
EventInternational Conference on Multimodal Interfaces 2013 - Coogee Bay Hotel, Sydney, Australia
Duration: 9 Dec 201313 Dec 2013
Conference number: 15th
https://icmi.acm.org/2013/ (Conference website)
https://dl.acm.org/citation.cfm?id=2522848&picked=prox (ACM proceedings)


ConferenceInternational Conference on Multimodal Interfaces 2013
Abbreviated titleICMI 2013
Internet address


  • collaboration
  • domain expertise
  • empirical and machine learning techniques
  • multimodal learning analytics
  • predictive data and models

Cite this