AMALGUM – A Free, Balanced, Multilayer English Web Corpus

Luke Gessler, Siyao Peng, Yang Liu, Yilun Zhu, Shabnam Behzad, Amir Zeldes


Abstract
We present a freely available, genre-balanced English web corpus totaling 4M tokens and featuring a large number of high-quality automatic annotation layers, including dependency trees, non-named entity annotations, coreference resolution, and discourse trees in Rhetorical Structure Theory. By tapping open online data sources the corpus is meant to offer a more sizable alternative to smaller manually created annotated data sets, while avoiding pitfalls such as imbalanced or unknown composition, licensing problems, and low-quality natural language processing. We harness knowledge from multiple annotation layers in order to achieve a “better than NLP” benchmark and evaluate the accuracy of the resulting resource.
Anthology ID:
2020.lrec-1.648
Volume:
Proceedings of the Twelfth Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
5267–5275
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.648
DOI:
Bibkey:
Cite (ACL):
Luke Gessler, Siyao Peng, Yang Liu, Yilun Zhu, Shabnam Behzad, and Amir Zeldes. 2020. AMALGUM – A Free, Balanced, Multilayer English Web Corpus. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 5267–5275, Marseille, France. European Language Resources Association.
Cite (Informal):
AMALGUM – A Free, Balanced, Multilayer English Web Corpus (Gessler et al., LREC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lrec-1.648.pdf
Code
 gucorpling/amalgum
Data
AMALGUMGUM