Faster Decoding for Subword Level Phrase-based SMT between Related Languages

Anoop Kunchukuttan, Pushpak Bhattacharyya


Abstract
A common and effective way to train translation systems between related languages is to consider sub-word level basic units. However, this increases the length of the sentences resulting in increased decoding time. The increase in length is also impacted by the specific choice of data format for representing the sentences as subwords. In a phrase-based SMT framework, we investigate different choices of decoder parameters as well as data format and their impact on decoding time and translation accuracy. We suggest best options for these settings that significantly improve decoding time with little impact on the translation accuracy.
Anthology ID:
W16-4811
Volume:
Proceedings of the Third Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial3)
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Preslav Nakov, Marcos Zampieri, Liling Tan, Nikola Ljubešić, Jörg Tiedemann, Shervin Malmasi
Venue:
VarDial
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
82–88
Language:
URL:
https://aclanthology.org/W16-4811
DOI:
Bibkey:
Cite (ACL):
Anoop Kunchukuttan and Pushpak Bhattacharyya. 2016. Faster Decoding for Subword Level Phrase-based SMT between Related Languages. In Proceedings of the Third Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial3), pages 82–88, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Faster Decoding for Subword Level Phrase-based SMT between Related Languages (Kunchukuttan & Bhattacharyya, VarDial 2016)
Copy Citation:
PDF:
https://aclanthology.org/W16-4811.pdf