Annotated Corpora for Word Alignment between Japanese and English and its Evaluation with MAP-based Word Aligner

Tsuyoshi Okita


Abstract
This paper presents two annotated corpora for word alignment between Japanese and English. We annotated on top of the IWSLT-2006 and the NTCIR-8 corpora. The IWSLT-2006 corpus is in the domain of travel conversation while the NTCIR-8 corpus is in the domain of patent. We annotated the first 500 sentence pairs from the IWSLT-2006 corpus and the first 100 sentence pairs from the NTCIR-8 corpus. After mentioned the annotation guideline, we present two evaluation algorithms how to use such hand-annotated corpora: although one is a well-known algorithm for word alignment researchers, one is novel which intends to evaluate a MAP-based word aligner of Okita et al. (2010b).
Anthology ID:
L12-1655
Volume:
Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
Month:
May
Year:
2012
Address:
Istanbul, Turkey
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
3241–3248
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/1109_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Tsuyoshi Okita. 2012. Annotated Corpora for Word Alignment between Japanese and English and its Evaluation with MAP-based Word Aligner. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 3241–3248, Istanbul, Turkey. European Language Resources Association (ELRA).
Cite (Informal):
Annotated Corpora for Word Alignment between Japanese and English and its Evaluation with MAP-based Word Aligner (Okita, LREC 2012)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2012/pdf/1109_Paper.pdf