Complex Word Identification Based on Frequency in a Learner Corpus

Tomoyuki Kajiwara, Mamoru Komachi


Abstract
We introduce the TMU systems for the Complex Word Identification (CWI) Shared Task 2018. TMU systems use random forest classifiers and regressors whose features are the number of characters, the number of words, and the frequency of target words in various corpora. Our simple systems performed best on 5 tracks out of 12 tracks. Our ablation analysis revealed the usefulness of a learner corpus for CWI task.
Anthology ID:
W18-0521
Volume:
Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Editors:
Joel Tetreault, Jill Burstein, Ekaterina Kochmar, Claudia Leacock, Helen Yannakoudakis
Venue:
BEA
SIG:
SIGEDU
Publisher:
Association for Computational Linguistics
Note:
Pages:
195–199
Language:
URL:
https://aclanthology.org/W18-0521
DOI:
10.18653/v1/W18-0521
Bibkey:
Cite (ACL):
Tomoyuki Kajiwara and Mamoru Komachi. 2018. Complex Word Identification Based on Frequency in a Learner Corpus. In Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications, pages 195–199, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
Complex Word Identification Based on Frequency in a Learner Corpus (Kajiwara & Komachi, BEA 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-0521.pdf