Perspectives on learning with multimodal technology

Karin H. James, Daniel Schwartz, Katherine M. Cheng, James Lester, Sharon Oviatt

Research output: Chapter in Book/Report/Conference proceedingChapter (Book)Otherpeer-review


To set the stage for this multidisciplinary discussion among experts on the challenging topic of learning with multimodal technology, weasksomebasic questions:

• What have neuroscience, cognitive and learning sciences, and humancomputer interaction findings taught us about how humans learn?

• What are the implications for designing more effective educational technologies, in particular ones that leverage emerging multimodal-multisensor capabilities?

Computer technologies are becoming an increasingly influential set of tools in a student's classroom experience. However, large-scale assessments conducted on laptop initiatives and other technology programs have not always yielded significantly improved student performance on standardized achievement tests or cognitive measures. The purpose of this chapter is to discuss what role multimodalmultisensor technologies potentially could play in improving support for learning and education. The expert neuroscience, cognitive and learning sciences, and computer science discussants involved in this exchange consider what we know about how multisensory-multimodal learning occurs, and the implications for how we could develop multimodal-multisensor interfaces that more effectively stimulate thinking and learning than past computer interfaces.
Original languageEnglish
Title of host publicationThe Handbook of Multimodal-Multisensor Interfaces, Volume 1
Subtitle of host publicationFoundations, User Modeling, and Common Modality Combinations
EditorsSharon Oviatt, Bjorn Schuller, Philip R. Cohen, Daniel Sonntag, Gerasimos Potamianos, Antonio Kruger
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages24
ISBN (Electronic)9781970001655, 9781970001662
ISBN (Print)9781970001679, 9781970001648
Publication statusPublished - 2017
Externally publishedYes

Cite this