Automated cognitive presence detection in online discussion transcripts

Vitomir Kovanovic, Srecko Joksimovic, Marek Hatala, Dragan Gasevic

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

6 Citations (Scopus)

Abstract

In this paper we present the results of an exploratory study that examined the use of text mining and text classification for the automation of the content analysis of discussion transcripts within the context of distance education. We used Community of Inquiry (CoI) framework and focused on the content analysis of the cognitive presence construct given its central position within the CoI model. Our results demonstrate the potentials of proposed approach; The developed classifier achieved 58.4% accuracy and Cohen's Kappa of 0.41 for the 5-category classification task. In this paper we analyze different classification features and describe the main problems and lessons learned from the development of such a system. Furthermore, we analyzed the use of several novel classification features that are based on the specifics of cognitive presence construct and our results indicate that some of them significantly improve classification accuracy.

Original languageEnglish
Title of host publicationWorkshop Proceedings of LAK 2014
Subtitle of host publicationProceedings of the Workshops at the LAK 2014 Conference co-located with 4th International Conference on Learning Analytics and Knowledge (LAK 2014)
EditorsKalina Yacef, Hendrik Drachsler
Place of PublicationGermany
PublisherRheinisch-Westfaelische Technische Hochschule Aachen
Number of pages4
Publication statusPublished - 2014
Externally publishedYes
EventInternational Learning Analytics & Knowledge Conference 2014 - Indianapolis, United States of America
Duration: 24 Mar 201428 Mar 2014
Conference number: 4th
https://lak14indy.wordpress.com/

Publication series

NameCEUR Workshop Proceedings
PublisherRheinisch-Westfaelische Technische Hochschule Aachen
Volume1137
ISSN (Print)1613-0073

Conference

ConferenceInternational Learning Analytics & Knowledge Conference 2014
Abbreviated titleLAK 2014
CountryUnited States of America
CityIndianapolis
Period24/03/1428/03/14
Internet address

Cite this

Kovanovic, V., Joksimovic, S., Hatala, M., & Gasevic, D. (2014). Automated cognitive presence detection in online discussion transcripts. In K. Yacef, & H. Drachsler (Eds.), Workshop Proceedings of LAK 2014: Proceedings of the Workshops at the LAK 2014 Conference co-located with 4th International Conference on Learning Analytics and Knowledge (LAK 2014) (CEUR Workshop Proceedings; Vol. 1137). Rheinisch-Westfaelische Technische Hochschule Aachen. http://ceur-ws.org/Vol-1137/LA_machinelearning_submission_1.pdf