Paper "A Machine Learning Approach for Suggesting Feedback in Textual Exercises in Large Courses"
The third and last paper I want to toot about is titled "A Machine Learning Approach for Suggesting Feedback in Textual Exercises in Large Courses" and was presented at the 8th ACM Conference on Learning @ Scale (L@S) in 2021. DOI: https://doi.org/10.1145/3430895.3460135 Preprint: https://brn.is/las21
This paper presents two things: (1) CoFee (approach) and (2) Athene (reference implementation). 🧵
This paper presents CoFee, a machine learning approach designed to suggest computer-aided feedback in open-ended textual exercises. The approach uses topic modeling to split student answers into text segments and language embeddings to transform these segments. It then applies clustering to group the text segments by similarity so that the same feedback can be applied to all segments within the same cluster.
We implemented this approach in a reference implementation called Athene and integrated it into Artemis. We used Athene to review 17 textual exercises in two large courses at the Technical University of Munich with 2,300 registered students and 53 teachers. On average, Athene suggested feedback for 26% of the submissions. Accordingly, 85% of these suggestions were accepted by the teachers, 5% were extended with a comment and then accepted, and 10% were changed.
Scholar Social is a microblogging platform for researchers, grad students, librarians, archivists, undergrads, academically inclined high schoolers, educators of all levels, journal editors, research assistants, professors, administrators—anyone involved in academia who is willing to engage with others respectfully.