[apologies for cross-posting]
Automatic Post-editing task at the 10th Workshop on Statistical Machine Translation (http://www.statmt.org/wmt15/ape-task.html)
This year WMT will include a pilot task on Automatic Post-editing (APE). This new shared task will examine automatic methods for correcting errors produced by an unknown machine translation (MT) system, by exploiting knowledge acquired from previous human post-editions and provided as training material.
GOALS:
- The aim of this task is to improve MT output in black-box scenarios, in which the MT system is used "as is" and cannot be modified. From the application point of view APE components would make it possible to:
- Cope with systematic errors of an MT system whose decoding process is not accessible
- Provide professional translators with improved MT output quality to reduce (human) post-editing effort
- Adapt the output of a general-purpose system to the lexicon/style requested in a specific application domain
DATA & EVALUATION
Training, development and test materials respectively consist of English-Spanish triples (source, target and post-edition) from the news domain kindly provided by Unbabel (http://unbabel.com).
Systems' performance will be evaluated with respect to their capability to reduce the distance that separates an automatic translation from its human-revised version. Such distance will be measured in terms of human-targeted TER (HTER).
IMPORTANT DATES
Release of training data: January 31, 2015
Test set distributed: April 27, 2015
Submission deadline: May 15, 2015
Paper submission deadline: June TBD, 2015
Notification of acceptance: July TBD, 2015
Camera-ready deadline: August TBD, 2015
For any information or question on the task, please send an email to: wmt-ape [at] fbk.eu
To be always updated about the APE pilot task, you can also join the wmt-ape group: http://groups.google.com/a/fbk.eu/forum/#!forum/wmt-ape
We hope to see you in Lisbon!
The Ape task Organizers
Rajen Chatterjee
Matteo Negri
Marco Turchi