Abstract
This paper presents a study that examined automated cross-language classification of online discussion messages for the levels of cognitive presence, a key construct from the widely used Community of Inquiry (CoI) model of online learning. Specifically, we examined the classification of 1,500 Portuguese language discussion messages using a classifier trained on a corpus of the 1,747 English language discussion messages. In the study, a random forest classifier was developed using a small set of 108 validated indicators of psychological processes, linguistic coherence, and online discussion structure. The classifier obtained 67% accuracy and Cohen's κ of 0.32, showing a moderate level of inter-rater agreement above chance and the general viability of the proposed approach. Most importantly, the findings suggest that certain aspects of cognitive presence construct are highly generalizable and transfer across different languages. Finally, the paper also presents a novel method for addressing class imbalance problem using a generic algorithm heuristic technique, which provided substantial improvements over the use of imbalanced dataset. Results and practical implications are further discussed.
Original language | English |
---|---|
Title of host publication | LAK 2020 Conference Proceedings |
Editors | Vitomir Kovanović, Maren Scheffel, Niels Pinkwart, Verbert Verbert |
Place of Publication | New York NY USA |
Publisher | Association for Computing Machinery (ACM) |
Pages | 605-614 |
Number of pages | 10 |
ISBN (Electronic) | 9781450377126 |
DOIs | |
Publication status | Published - 2020 |
Event | International Learning Analytics & Knowledge Conference 2020 - Frankfurt, Germany Duration: 23 Mar 2020 → 27 Mar 2020 Conference number: 10th https://lak20.solaresearch.org (Website) https://dl-acm-org.ezproxy.lib.monash.edu.au/doi/proceedings/10.1145/3375462 (Website) |
Conference
Conference | International Learning Analytics & Knowledge Conference 2020 |
---|---|
Abbreviated title | LAK 2020 |
Country/Territory | Germany |
City | Frankfurt |
Period | 23/03/20 → 27/03/20 |
Internet address |
Keywords
- Community of Inquiry Model
- Content Analytics
- Cross-Language Classification
- Online Discussion
- Optimization