Automatic learner summary assessment for reading comprehension

Menglin Xia, Ekaterina Kochmar, Ted Briscoe


Abstract
Automating the assessment of learner summary provides a useful tool for assessing learner reading comprehension. We present a summarization task for evaluating non-native reading comprehension and propose three novel approaches to automatically assess the learner summaries. We evaluate our models on two datasets we created and show that our models outperform traditional approaches that rely on exact word match on this task. Our best model produces quality assessments close to professional examiners.
Anthology ID:
N19-1261
Volume:
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)
Month:
June
Year:
2019
Address:
Minneapolis, Minnesota
Editors:
Jill Burstein, Christy Doran, Thamar Solorio
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2532–2542
Language:
URL:
https://aclanthology.org/N19-1261
DOI:
10.18653/v1/N19-1261
Bibkey:
Cite (ACL):
Menglin Xia, Ekaterina Kochmar, and Ted Briscoe. 2019. Automatic learner summary assessment for reading comprehension. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 2532–2542, Minneapolis, Minnesota. Association for Computational Linguistics.
Cite (Informal):
Automatic learner summary assessment for reading comprehension (Xia et al., NAACL 2019)
Copy Citation:
PDF:
https://aclanthology.org/N19-1261.pdf