A Universal Framework for Inductive Transfer Parsing across Multi-typed Treebanks

Jiang Guo, Wanxiang Che, Haifeng Wang, Ting Liu


Abstract
Various treebanks have been released for dependency parsing. Despite that treebanks may belong to different languages or have different annotation schemes, they contain common syntactic knowledge that is potential to benefit each other. This paper presents a universal framework for transfer parsing across multi-typed treebanks with deep multi-task learning. We consider two kinds of treebanks as source: the multilingual universal treebanks and the monolingual heterogeneous treebanks. Knowledge across the source and target treebanks are effectively transferred through multi-level parameter sharing. Experiments on several benchmark datasets in various languages demonstrate that our approach can make effective use of arbitrary source treebanks to improve target parsing models.
Anthology ID:
C16-1002
Volume:
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Yuji Matsumoto, Rashmi Prasad
Venue:
COLING
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
12–22
Language:
URL:
https://aclanthology.org/C16-1002
DOI:
Bibkey:
Cite (ACL):
Jiang Guo, Wanxiang Che, Haifeng Wang, and Ting Liu. 2016. A Universal Framework for Inductive Transfer Parsing across Multi-typed Treebanks. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 12–22, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
A Universal Framework for Inductive Transfer Parsing across Multi-typed Treebanks (Guo et al., COLING 2016)
Copy Citation:
PDF:
https://aclanthology.org/C16-1002.pdf
Data
Penn Treebank