A Multi-aspect Analysis of Automatic Essay Scoring for Brazilian Portuguese

Evelin Amorim, Adriano Veloso


Abstract
Several methods for automatic essay scoring (AES) for English language have been proposed. However, multi-aspect AES systems for other languages are unusual. Therefore, we propose a multi-aspect AES system to apply on a dataset of Brazilian Portuguese essays, which human experts evaluated according to five aspects defined by Brazilian Government to the National Exam to High School Student (ENEM). These aspects are skills that student must master and every skill is assessed apart from each other. Besides the prediction of each aspect, the feature analysis also was performed for each aspect. The AES system proposed employs several features already employed by AES systems for English language. Our results show that predictions for some aspects performed well with the features we employed, while predictions for other aspects performed poorly. Also, it is possible to note the difference between the five aspects in the detailed feature analysis we performed. Besides these contributions, the eight millions of enrollments every year for ENEM raise some challenge issues for future directions in our research.
Anthology ID:
E17-4010
Volume:
Proceedings of the Student Research Workshop at the 15th Conference of the European Chapter of the Association for Computational Linguistics
Month:
April
Year:
2017
Address:
Valencia, Spain
Editors:
Florian Kunneman, Uxoa Iñurrieta, John J. Camilleri, Mariona Coll Ardanuy
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
94–102
Language:
URL:
https://aclanthology.org/E17-4010
DOI:
Bibkey:
Cite (ACL):
Evelin Amorim and Adriano Veloso. 2017. A Multi-aspect Analysis of Automatic Essay Scoring for Brazilian Portuguese. In Proceedings of the Student Research Workshop at the 15th Conference of the European Chapter of the Association for Computational Linguistics, pages 94–102, Valencia, Spain. Association for Computational Linguistics.
Cite (Informal):
A Multi-aspect Analysis of Automatic Essay Scoring for Brazilian Portuguese (Amorim & Veloso, EACL 2017)
Copy Citation:
PDF:
https://aclanthology.org/E17-4010.pdf