Distant Learning for Entity Linking with Automatic Noise Detection

Phong Le, Ivan Titov


Abstract
Accurate entity linkers have been produced for domains and languages where annotated data (i.e., texts linked to a knowledge base) is available. However, little progress has been made for the settings where no or very limited amounts of labeled data are present (e.g., legal or most scientific domains). In this work, we show how we can learn to link mentions without having any labeled examples, only a knowledge base and a collection of unannotated texts from the corresponding domain. In order to achieve this, we frame the task as a multi-instance learning problem and rely on surface matching to create initial noisy labels. As the learning signal is weak and our surrogate labels are noisy, we introduce a noise detection component in our model: it lets the model detect and disregard examples which are likely to be noisy. Our method, jointly learning to detect noise and link entities, greatly outperforms the surface matching baseline. For a subset of entity categories, it even approaches the performance of supervised learning.
Anthology ID:
P19-1400
Volume:
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
Month:
July
Year:
2019
Address:
Florence, Italy
Editors:
Anna Korhonen, David Traum, Lluís Màrquez
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4081–4090
Language:
URL:
https://aclanthology.org/P19-1400
DOI:
10.18653/v1/P19-1400
Bibkey:
Cite (ACL):
Phong Le and Ivan Titov. 2019. Distant Learning for Entity Linking with Automatic Noise Detection. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4081–4090, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
Distant Learning for Entity Linking with Automatic Noise Detection (Le & Titov, ACL 2019)
Copy Citation:
PDF:
https://aclanthology.org/P19-1400.pdf
Code
 lephong/dl4el
Data
AIDA CoNLL-YAGO