A Two-Stage Masked LM Method for Term Set Expansion

Guy Kushilevitz, Shaul Markovitch, Yoav Goldberg


Abstract
We tackle the task of Term Set Expansion (TSE): given a small seed set of example terms from a semantic class, finding more members of that class. The task is of great practical utility, and also of theoretical utility as it requires generalization from few examples. Previous approaches to the TSE task can be characterized as either distributional or pattern-based. We harness the power of neural masked language models (MLM) and propose a novel TSE algorithm, which combines the pattern-based and distributional approaches. Due to the small size of the seed set, fine-tuning methods are not effective, calling for more creative use of the MLM. The gist of the idea is to use the MLM to first mine for informative patterns with respect to the seed set, and then to obtain more members of the seed class by generalizing these patterns. Our method outperforms state-of-the-art TSE algorithms. Implementation is available at: https://github.com/guykush/TermSetExpansion-MPB/
Anthology ID:
2020.acl-main.610
Volume:
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
Month:
July
Year:
2020
Address:
Online
Editors:
Dan Jurafsky, Joyce Chai, Natalie Schluter, Joel Tetreault
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6829–6835
Language:
URL:
https://aclanthology.org/2020.acl-main.610
DOI:
10.18653/v1/2020.acl-main.610
Bibkey:
Cite (ACL):
Guy Kushilevitz, Shaul Markovitch, and Yoav Goldberg. 2020. A Two-Stage Masked LM Method for Term Set Expansion. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6829–6835, Online. Association for Computational Linguistics.
Cite (Informal):
A Two-Stage Masked LM Method for Term Set Expansion (Kushilevitz et al., ACL 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.acl-main.610.pdf
Video:
 http://slideslive.com/38929105
Code
 guykush/TermSetExpansion-MPB