Designing a Frame-Semantic Machine Translation Evaluation Metric

Oliver Czulo, Tiago Timponi Torrent, Ely Edison da Silva Matos, Alexandre Diniz da Costa, Debanjana Kar


Abstract
We propose a metric for machine translation evaluation based on frame semantics which does not require the use of reference translations or human corrections, but is aimed at comparing original and translated output directly. The metrics is described on the basis of an existing manual frame-semantic annotation of a parallel corpus with an English original and a Brazilian Portuguese and a German translation. We discuss implications of our metrics design, including the potential of scaling it for multiple languages.
Anthology ID:
W19-8704
Volume:
Proceedings of the Human-Informed Translation and Interpreting Technology Workshop (HiT-IT 2019)
Month:
September
Year:
2019
Address:
Varna, Bulgaria
Venue:
RANLP
SIG:
Publisher:
Incoma Ltd., Shoumen, Bulgaria
Note:
Pages:
28–35
Language:
URL:
https://aclanthology.org/W19-8704
DOI:
10.26615/issn.2683-0078.2019_004
Bibkey:
Cite (ACL):
Oliver Czulo, Tiago Timponi Torrent, Ely Edison da Silva Matos, Alexandre Diniz da Costa, and Debanjana Kar. 2019. Designing a Frame-Semantic Machine Translation Evaluation Metric. In Proceedings of the Human-Informed Translation and Interpreting Technology Workshop (HiT-IT 2019), pages 28–35, Varna, Bulgaria. Incoma Ltd., Shoumen, Bulgaria.
Cite (Informal):
Designing a Frame-Semantic Machine Translation Evaluation Metric (Czulo et al., RANLP 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-8704.pdf