Word Sense Inventories by Non-Experts.

Anna Rumshisky, Nick Botchan, Sophie Kushkuley, James Pustejovsky


Abstract
In this paper, we explore different strategies for implementing a crowdsourcing methodology for a single-step construction of an empirically-derived sense inventory and the corresponding sense-annotated corpus. We report on the crowdsourcing experiments using implementation strategies with different HIT costs, worker qualification testing, and other restrictions. We describe multiple adjustments required to ensure successful HIT design, given significant changes within the crowdsourcing community over the last three years.
Anthology ID:
L12-1603
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
4055–4059
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/1014_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Anna Rumshisky, Nick Botchan, Sophie Kushkuley, and James Pustejovsky. 2012. Word Sense Inventories by Non-Experts.. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 4055–4059, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
Word Sense Inventories by Non-Experts. (Rumshisky et al., LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/1014_Paper.pdf