WAT 2015
(The 2nd Workshop on Asian Translation)
http://lotus.kuee.kyoto-u.ac.jp/WAT/
October 16, 2015, Kyoto, Japan
Following the success of the previous Workshop on Asian Translation
(WAT2014), WAT2015 brings together machine translation researchers and
users to try, evaluate, share and discuss brand-new ideas of machine
translation. We are working toward the practical use of machine
translation among all Asian countries.
For the 2nd WAT, we adopt new translation subtasks
"Chinese-to-Japanese and Korean-to-Japanese patent translation" in
addition to the subtasks that were conducted in WAT2014.
IMPORTANT DATES
---------------
Submission due for crowdsourcing evaluation: August 16, 2015
System description draft paper due: September 20, 2015
Review feedback: September 27, 2015
System description camera-ready paper due: October 4, 2015
WAT 2015: October 16, 2015
TASK
----
The task is to improve the text translation quality for scientific
papers and patent documents. Participants choose any of the subtasks
in which they would like to participate and translate the test data
using their machine translation systems. The WAT organizers will
evaluate the results submitted using automatic evaluation and human
evaluation. We will also provide a baseline machine translation.
Subtasks:
Scientific Paper Subtask:
Japanese --> English
English --> Japanese
Japanese --> Chinese
Chinese --> Japanese
Patent Subtask: <= NEW!
Chinese --> Japanese
Korean --> Japanese
Dataset:
For the scientific paper subtask, WAT uses ASPEC (Asian Scientific
Paper Excerpt Corpus) for the dataset including training, development,
development test and test data. Participants must get a copy of ASPEC
by themselves from http://lotus.kuee.kyoto-u.ac.jp/ASPEC/
For the patent subtask, WAT uses the JPO Patent Corpus, which was
constructed by the Japan Patent Office (JPO). This corpus consists of
1 million Chinese-Japanese and Korean-Japanese parallel sentences from
patent descriptions with four categories. Participants of the patent
subtask are required to obtain the data from the WAT2015 site for the
JPO Patent Corpus.
http://lotus.kuee.kyoto-u.ac.jp/WAT/patent/
Automatic evaluation:
We are providing an automatic evaluation server. It is for free for
everyone, but you need to create an account for evaluation. Just
showing the list of evaluation results does not require an account.
Registration: http://lotus.kuee.kyoto-u.ac.jp/WAT/registration/
Eval. result: http://lotus.kuee.kyoto-u.ac.jp/WAT/evaluation/
Human evaluation:
Human evaluation will be carried out using crowdsourcing. Participants
can submit translation results a maximum of
twice. Sentence-by-sentence pair-wise evaluation compared to the
baseline system will be carried out. The crowdsourcing workers will be
asked to judge which translation is better than the other in view of
adequacy and fluency. All systems will be ranked by the percentage of
translations judged to improve upon the baseline system.
INVITED TALK
------------
We are planning to have an invited talk as follows:
Speaker: Dr. Haizhou Li
Research Director of the Institute for Infocomm Research in Singapore
Principal Scientist and Department Head of Human Language Technology
Title: Adequacy-Fluency Metrics: Evaluating MT in the Continuous Space Model Framework
Please visit the homepage of WAT for the biography of the speaker.
http://lotus.kuee.kyoto-u.ac.jp/WAT/#invited-talk.html
REGISTRATION
------------
The registration for task participants:
The registration fee is FREE for all participants.
http://lotus.kuee.kyoto-u.ac.jp/WAT/registration/
The registration for WAT2015 audiences:
There is no need to register in advance. The registration fee is FREE
for all audiences include participants.
PAPER
-----
Participants who submit results for human evaluation should submit
description papers of their translation systems and evaluation
results.
We strongly prefer that papers include a section entitled "Issues for
Context-aware Machine Translation" which discusses the importance and
usefulness of context.
ORGANIZERS
----------
Toshiaki Nakazawa (Japan Science and Technology Agency (JST))
Hideya Mino (National Institute of Information and Communications Technology (NICT))
Isao Goto (Japan Broadcasting Corporation (NHK))
Graham Neubig (Nara Institute of Science and Technology (NAIST))
Eiichiro Sumita (National Institute of Information and Communications Technology (NICT))
Sadao Kurohashi (Kyoto University)
CONTACT
-------
wat [at] nlp.ist.i.kyoto-u.ac.jp